From llvm-testresults at cs.uiuc.edu Sun Jul 1 00:25:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 1 Jul 2012 02:25:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120701072507.5200B2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1678?compare_to=1675&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1678, Order: 159503, Start Time: 2012-07-01 05:06:05, End Time: 2012-07-01 07:25:01 To: 1675, Order: 159499, Start Time: 2012-07-01 02:23:31, End Time: 2012-07-01 04:38:52 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (28 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 892 (865 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 11.03% (0.4036 => 0.4481, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2192 => 0.2318, std. dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 18.17% (0.3792 => 0.4481, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.48% (0.3488 => 0.3749, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 7.46% (0.3460 => 0.3718, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.44% (0.3442 => 0.3698, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.43% (0.3446 => 0.3702, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 7.42% (0.3465 => 0.3722, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.32% (0.3496 => 0.3752, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.30% (0.3643 => 0.3909, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.21% (0.3469 => 0.3719, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 6.93% (0.3650 => 0.3903, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.87% (0.3724 => 0.3980, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 3.76% (0.5826 => 0.6045, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.50% (0.5889 => 0.6095, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.76% (1.6211 => 1.6658, std. dev.: 0.0112) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.75% (0.5900 => 0.6062, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.71% (0.5026 => 0.5162, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.63% (3.5627 => 3.6563, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 2.40% (0.7171 => 0.7343, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.38% (0.4361 => 0.4465, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.30% (1.3152 => 1.3455, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.26% (0.5000 => 0.5113, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.19% (2.0673 => 2.1126, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.04% (0.4994 => 0.5096, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.75% (2.7292 => 2.7769, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.62% (1.9694 => 2.0013, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.30% (1.9966 => 2.0225, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.16% (4.4195 => 4.4707, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 9.24% (0.2122 => 0.2318, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.03% (2.4764 => 2.3766, std. dev.: 0.0175) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 1 00:47:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 1 Jul 2012 02:47:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120701074702.7322F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/1679?compare_to=1676&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1679, Order: 159504, Start Time: 2012-07-01 06:47:32, End Time: 2012-07-01 07:46:56 To: 1676, Order: 159503, Start Time: 2012-07-01 04:05:31, End Time: 2012-07-01 05:02:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (97 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (760 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.69% (2.0176 => 2.2736, std. dev.: 0.0528) SingleSource/UnitTests/ObjC++/property-reference: 7.05% (0.7061 => 0.7559, std. dev.: 0.0068) SingleSource/UnitTests/ObjC++/property-reference-object: 6.88% (0.5818 => 0.6218, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.73% (0.5748 => 0.6135, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.10% (0.3130 => 0.3321, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.27% (1.3693 => 1.4414, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 5.22% (0.4328 => 0.4554, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.13% (0.7038 => 0.7399, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.86% (0.2945 => 0.3088, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 4.85% (0.4062 => 0.4259, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hello: 4.79% (0.2607 => 0.2732, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 4.78% (0.2760 => 0.2892, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.75% (0.5265 => 0.5515, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.71% (0.2782 => 0.2913, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.70% (0.2765 => 0.2895, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.70% (0.2596 => 0.2718, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.60% (0.2628 => 0.2749, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: 4.57% (0.2690 => 0.2813, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.56% (0.2655 => 0.2776, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 4.39% (0.2937 => 0.3066, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.30% (3.9660 => 4.1365, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 4.23% (0.3453 => 0.3599, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.19% (0.2696 => 0.2809, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.15% (0.3107 => 0.3236, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 4.13% (0.2761 => 0.2875, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 4.11% (0.3578 => 0.3725, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.05% (0.2988 => 0.3109, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.05% (0.3485 => 0.3626, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.03% (0.4016 => 0.4178, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 3.93% (0.3914 => 0.4068, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 3.92% (0.3646 => 0.3789, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 3.92% (0.3601 => 0.3742, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 3.91% (0.3149 => 0.3272, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.89% (0.6959 => 0.7230, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 3.88% (0.3789 => 0.3936, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/synchronized: 3.88% (0.3663 => 0.3805, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 3.84% (0.3623 => 0.3762, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/property: 3.83% (0.3940 => 0.4091, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 3.82% (0.4003 => 0.4156, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.81% (0.3650 => 0.3789, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 3.51% (0.3192 => 0.3304, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 3.47% (13.8202 => 14.3002, std. dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/lists: 3.46% (0.3293 => 0.3407, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.43% (0.3756 => 0.3885, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.33% (0.4390 => 0.4536, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.32% (0.9199 => 0.9504, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.25% (1.2292 => 1.2691, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.16% (1.2193 => 1.2578, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.13% (0.3868 => 0.3989, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.90% (0.5577 => 0.5739, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5637 => 0.5795, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.80% (3.8646 => 3.9729, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.69% (1.3245 => 1.3601, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.61% (4.9865 => 5.1166, std. dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 2.60% (16.6129 => 17.0454, std. dev.: 0.0181) MultiSource/Applications/spiff/spiff: 2.57% (0.7506 => 0.7699, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.46% (1.1061 => 1.1333, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.43% (1.9270 => 1.9739, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.25% (7.2180 => 7.3804, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.21% (0.7460 => 0.7625, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 1.95% (0.8310 => 0.8472, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.93% (2.1791 => 2.2212, std. dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.62% (0.8698 => 0.8839, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 1.54% (14.8535 => 15.0824, std. dev.: 0.0071) MultiSource/Applications/JM/ldecod/ldecod: 1.50% (6.5754 => 6.6738, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 1.27% (3.1889 => 3.2293, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.17% (1.1333 => 1.1466, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.06% (1.2749 => 1.2884, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.28% (1.8175 => 2.2769, std. dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.29% (2.0200 => 2.1875, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6988, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.35% (1.2998 => 1.3954, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.94% (7.4271 => 7.7195, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9228, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6786, std. dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4801, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1893, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.46% (3.6469 => 3.7000, std. dev.: 0.0067) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0401) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.04% (1.9290 => 1.9491, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.25% (22.5627 => 20.9262, std. dev.: 0.4485) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.27% (0.3511 => 0.3361, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.47% (0.8818 => 0.8512, std. dev.: 0.0089) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.05% (0.9108 => 0.8921, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.69% (1.2308 => 1.0992, std. dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.82% (20.3410 => 18.5460, std. dev.: 0.0461) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3068, std. dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.63% (0.4366 => 0.4164, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0030) SingleSource/UnitTests/Vector/multiplies: -3.60% (2.6470 => 2.5518, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5130, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2538, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -1.48% (3.0263 => 2.9815, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.37% (2.5254 => 2.4907, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8456, std. dev.: 0.0793) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2182, std. dev.: 0.0103) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2533, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8718, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8494, std. dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 1 00:51:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 1 Jul 2012 02:51:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120701075131.5DED72A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/1680?compare_to=1677&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1680, Order: 159504, Start Time: 2012-07-01 06:47:41, End Time: 2012-07-01 07:51:25 To: 1677, Order: 159503, Start Time: 2012-07-01 04:19:53, End Time: 2012-07-01 05:20:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (30 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (825 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.32% (10.3673 => 12.8889, std. dev.: 0.1373) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.86% (1.1194 => 1.2633, std. dev.: 0.0253) SingleSource/UnitTests/ObjC/trivial-interface: 7.26% (0.3473 => 0.3725, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.18% (1.7609 => 1.8874, std. dev.: 0.0347) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.97% (0.3543 => 0.3790, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 6.95% (0.3497 => 0.3740, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.85% (0.3516 => 0.3757, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (0.1622 => 0.1733, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.80% (0.3543 => 0.3784, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.80% (0.3561 => 0.3803, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.58% (0.3694 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.50% (0.3828 => 0.4077, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.38% (2.2022 => 2.3428, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 6.34% (0.3927 => 0.4176, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.30% (0.3886 => 0.4131, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.75% (0.5925 => 0.6147, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.48% (0.6030 => 0.6240, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.41% (10.4361 => 10.7919, std. dev.: 0.0193) MultiSource/Applications/lambda-0_1_3/lambda: 2.92% (0.7433 => 0.7650, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 2.87% (0.7326 => 0.7536, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: 1.94% (0.7835 => 0.7987, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 1.29% (9.4845 => 9.6067, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.15% (4.2646 => 4.3136, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 1.03% (2.0273 => 2.0482, std. dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7508, std. dev.: 0.0038) MultiSource/Applications/lua/lua: 2.74% (26.0924 => 26.8084, std. dev.: 0.0267) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4463, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6892, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.24% (9.1159 => 9.2288, std. dev.: 0.0150) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1247, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.10% (5.2763 => 3.1607, std. dev.: 0.0709) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.40% (5.3855 => 3.6943, std. dev.: 0.0507) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.09% (5.3526 => 3.6886, std. dev.: 0.0567) MultiSource/Applications/ClamAV/clamscan: -12.90% (22.1758 => 19.3161, std. dev.: 0.0431) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.84% (2.9384 => 2.5610, std. dev.: 0.0693) SingleSource/UnitTests/Vector/constpool: -4.96% (54.1659 => 51.4772, std. dev.: 0.0568) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.27% (3.8922 => 3.7651, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.86% (0.8101 => 0.7950, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: -1.14% (21.9371 => 21.6876, std. dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: -9.89% (1.2373 => 1.1149, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.38% (19.9488 => 18.4760, std. dev.: 0.0710) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9202, std. dev.: 0.0085) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6784, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0845, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 1 03:08:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 1 Jul 2012 05:08:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120701100807.B1D7B2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1681?compare_to=1678&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1681, Order: 159504, Start Time: 2012-07-01 07:52:21, End Time: 2012-07-01 10:08:02 To: 1678, Order: 159503, Start Time: 2012-07-01 05:06:05, End Time: 2012-07-01 07:25:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (27 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (865 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 6.70% (0.3446 => 0.3677, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.68% (0.3442 => 0.3672, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.67% (0.3465 => 0.3696, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.62% (0.3488 => 0.3719, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 6.59% (0.3460 => 0.3688, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.56% (0.3643 => 0.3882, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.55% (0.3496 => 0.3725, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.40% (0.3469 => 0.3691, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.19% (0.3650 => 0.3876, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.18% (0.3724 => 0.3954, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.12% (0.5900 => 0.6084, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 2.81% (0.5826 => 0.5990, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 2.58% (0.5889 => 0.6041, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.48% (0.4361 => 0.4469, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.44% (1.6211 => 1.6607, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.34% (0.4994 => 0.5111, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.25% (3.5627 => 3.6427, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.02% (0.5000 => 0.5101, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.89% (1.3152 => 1.3400, std. dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: 1.77% (4.2109 => 4.2853, std. dev.: 0.0076) SingleSource/UnitTests/ObjC++/property-reference: 1.49% (0.7171 => 0.7278, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 1.48% (0.9909 => 1.0056, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.35% (2.0673 => 2.0952, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.33% (1.9694 => 1.9955, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.14% (2.7292 => 2.7602, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 1.08% (1.0781 => 1.0897, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.08% (0.2122 => 0.2251, std. dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.49% (2.4764 => 2.3652, std. dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: -3.01% (11.9555 => 11.5954, std. dev.: 0.0049) Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 1 10:26:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 1 Jul 2012 12:26:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120701172655.D0B552A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1682?compare_to=1679&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1682, Order: 159508, Start Time: 2012-07-01 16:30:08, End Time: 2012-07-01 17:26:50 To: 1679, Order: 159504, Start Time: 2012-07-01 06:47:32, End Time: 2012-07-01 07:46:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (121 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (735 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.13% (2.0176 => 2.2825, std. dev.: 0.0066) SingleSource/UnitTests/ObjC++/property-reference-object: 7.44% (0.5818 => 0.6251, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.27% (0.5748 => 0.6166, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.66% (0.7061 => 0.7531, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.26% (0.3130 => 0.3326, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 6.01% (1.3693 => 1.4516, std. dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 5.94% (0.4328 => 0.4585, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.89% (0.3022 => 0.3200, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 5.83% (0.2760 => 0.2921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.77% (0.2945 => 0.3115, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.72% (0.2607 => 0.2756, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.4062 => 0.4288, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.53% (0.2765 => 0.2918, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.44% (0.2628 => 0.2771, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.43% (0.2690 => 0.2836, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.36% (0.7038 => 0.7415, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 5.31% (0.2937 => 0.3093, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2966 => 0.3123, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.29% (0.1986 => 0.2091, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 5.21% (0.2726 => 0.2868, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.16% (0.2696 => 0.2835, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.3107 => 0.3265, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.9828 => 2.0835, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/methcall: 5.07% (0.2761 => 0.2901, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.06% (0.7710 => 0.8100, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 4.89% (0.2988 => 0.3134, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.83% (0.3149 => 0.3301, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.82% (0.5265 => 0.5519, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.73% (0.3485 => 0.3650, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.73% (0.3489 => 0.3654, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.72% (0.3580 => 0.3749, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.72% (0.3899 => 0.4083, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.4016 => 0.4205, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2721 => 0.2849, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.70% (0.2596 => 0.2718, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.51% (3.9660 => 4.1450, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 4.46% (0.3293 => 0.3440, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 4.42% (0.3192 => 0.3333, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 4.28% (0.3578 => 0.3731, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 4.24% (0.3868 => 0.4032, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.19% (0.4390 => 0.4574, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists1: 4.10% (0.3534 => 0.3679, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.06% (0.3914 => 0.4073, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.05% (0.3756 => 0.3908, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 4.03% (0.3623 => 0.3769, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 4.00% (0.4003 => 0.4163, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 3.97% (0.3601 => 0.3744, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.96% (0.3789 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.95% (0.3646 => 0.3790, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 3.93% (0.3663 => 0.3807, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/property: 3.88% (0.3940 => 0.4093, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.86% (0.3650 => 0.3791, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.6959 => 0.7227, std. dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 3.78% (13.8202 => 14.3428, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.9199 => 0.9517, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.21% (1.2193 => 1.2585, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.16% (0.5577 => 0.5753, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.2292 => 1.2678, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.12% (0.3755 => 0.3872, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.03% (4.9865 => 5.1378, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.97% (16.6129 => 17.1069, std. dev.: 0.0209) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (3.8646 => 3.9777, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (1.1364 => 1.1693, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.89% (1.3245 => 1.3628, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.89% (1.4563 => 1.4984, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.78% (1.1061 => 1.1369, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.78% (1.3813 => 1.4197, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.77% (0.7506 => 0.7714, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.72% (1.9270 => 1.9794, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.71% (1.3819 => 1.4193, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.67% (0.4379 => 0.4496, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 2.62% (1.0594 => 1.0872, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.32% (0.7460 => 0.7633, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.31% (7.2180 => 7.3845, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (13.2842 => 13.5764, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.15% (0.8698 => 0.8885, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.13% (0.8310 => 0.8487, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 2.00% (2.1791 => 2.2226, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.77% (3.6692 => 3.7342, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.75% (4.4433 => 4.5212, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 1.72% (6.5754 => 6.6886, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.70% (4.3801 => 4.4547, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 1.62% (14.8535 => 15.0939, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.38% (1.1333 => 1.1489, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 1.34% (3.1889 => 3.2315, std. dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 1.12% (1.2749 => 1.2892, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 1.01% (14.5298 => 14.6766, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2575, std. dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1921, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: 7.73% (1.2998 => 1.4003, std. dev.: 0.0097) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7232, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9236, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6775, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8291, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4800, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1893, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.92% (3.6469 => 3.7168, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4563, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (1.5089 => 1.5344, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.09% (22.5627 => 20.9630, std. dev.: 0.0208) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.44% (0.3511 => 0.3355, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.02% (0.8818 => 0.8552, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.63% (0.6576 => 0.6469, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (6.2785 => 6.2041, std. dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.44% (1.2308 => 1.1023, std. dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.80% (20.3410 => 18.5508, std. dev.: 0.0763) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.57% (1.3780 => 1.3150, std. dev.: 0.0072) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5868, std. dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5117, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.57% (3.0263 => 2.9789, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2588, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.39% (9.3358 => 9.2062, std. dev.: 0.0109) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8437, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8696, std. dev.: 0.0127) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2521, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 1 10:31:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 1 Jul 2012 12:31:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120701173129.8B6342A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1683?compare_to=1680&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1683, Order: 159508, Start Time: 2012-07-01 16:30:15, End Time: 2012-07-01 17:31:22 To: 1680, Order: 159504, Start Time: 2012-07-01 06:47:41, End Time: 2012-07-01 07:51:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (41 on baseline) Performance Improvements: 0 (19 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (813 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.09% (10.3673 => 12.9680, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.58% (1.1194 => 1.2602, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 7.54% (0.3473 => 0.3735, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.42% (0.3543 => 0.3806, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 7.29% (0.3497 => 0.3752, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.28% (0.3516 => 0.3772, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.27% (1.7609 => 1.8889, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 7.20% (0.3543 => 0.3798, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.19% (0.3561 => 0.3817, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.96% (0.3694 => 0.3951, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.82% (0.3828 => 0.4089, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.66% (0.3886 => 0.4145, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.62% (0.3927 => 0.4187, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.57% (2.2022 => 2.3469, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 4.35% (0.5925 => 0.6183, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.33% (0.6030 => 0.6291, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.82% (7.0540 => 7.3234, std. dev.: 0.0108) SingleSource/UnitTests/ObjC++/property-reference: 3.64% (0.7326 => 0.7593, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.59% (0.4879 => 0.5054, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.43% (10.4361 => 10.7938, std. dev.: 0.0119) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.34% (0.3177 => 0.3283, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 2.92% (0.7433 => 0.7650, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.25% (0.8172 => 0.8356, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.92% (0.5569 => 0.5676, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.69% (2.0665 => 2.1014, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.62% (0.7835 => 0.7962, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.52% (4.9449 => 5.0203, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.50% (5.0018 => 5.0768, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.38% (8.1363 => 8.2484, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 1.19% (1.1642 => 1.1780, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.15% (4.2646 => 4.3137, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (9.4845 => 9.5816, std. dev.: 0.0137) MultiSource/Applications/treecc/treecc: 1.02% (2.0273 => 2.0480, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7510, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 2.90% (26.0924 => 26.8500, std. dev.: 0.0122) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (1.5086 => 1.5372, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2458, std. dev.: 0.0326) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6891, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1245, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.12% (5.2763 => 3.1592, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.46% (5.3855 => 3.6911, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.16% (5.3526 => 3.6845, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.42% (2.9384 => 2.5442, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -12.93% (22.1758 => 19.3075, std. dev.: 0.0195) SingleSource/UnitTests/Vector/constpool: -5.05% (54.1659 => 51.4289, std. dev.: 0.0355) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.38% (3.8922 => 3.7607, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.77% (0.8101 => 0.7958, std. dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: -1.28% (21.9371 => 21.6563, std. dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.22% (7.9617 => 7.8645, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1073, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.82% (19.9488 => 18.5878, std. dev.: 0.0182) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9128, std. dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6785, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0817, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 1 11:45:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 1 Jul 2012 13:45:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120701184525.C421D2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1684?compare_to=1681&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1684, Order: 159508, Start Time: 2012-07-01 16:29:50, End Time: 2012-07-01 18:45:21 To: 1681, Order: 159504, Start Time: 2012-07-01 07:52:21, End Time: 2012-07-01 10:08:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (35 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 891 (857 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 2.05% (0.7278 => 0.7427, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 1.87% (0.5990 => 0.6102, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.03% (2.0952 => 2.1168, std. dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 23.13% (0.3792 => 0.4669, std. dev.: 0.0243) SingleSource/UnitTests/ObjC/exceptions-4: 8.14% (0.3465 => 0.3747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.13% (0.3446 => 0.3726, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.08% (0.3488 => 0.3770, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 8.01% (0.3496 => 0.3776, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.96% (0.3442 => 0.3716, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.93% (0.3469 => 0.3744, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.92% (0.3460 => 0.3734, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.80% (0.3643 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.53% (0.3650 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.33% (0.3724 => 0.3997, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.74% (0.5826 => 0.6102, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 4.47% (0.5889 => 0.6152, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference: 3.57% (0.7171 => 0.7427, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (0.5900 => 0.6065, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.71% (0.5026 => 0.5162, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.65% (1.6211 => 1.6641, std. dev.: 0.0080) MultiSource/Applications/spiff/spiff: 2.58% (0.4029 => 0.4133, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.53% (3.5627 => 3.6529, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 2.48% (0.9909 => 1.0155, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.46% (0.4994 => 0.5117, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.41% (0.4361 => 0.4466, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.39% (2.0673 => 2.1168, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.26% (0.5000 => 0.5113, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 1.97% (4.2109 => 4.2940, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.84% (1.3152 => 1.3394, std. dev.: 0.0060) MultiSource/Applications/hbd/hbd: 1.63% (0.9697 => 0.9855, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.35% (1.9694 => 1.9959, std. dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 1.25% (23.5202 => 23.8136, std. dev.: 0.0198) MultiSource/Applications/d/make_dparser: 1.18% (1.0781 => 1.0908, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (2.7292 => 2.7596, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.09% (1.9966 => 2.0184, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.07% (4.4195 => 4.4670, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 1.04% (1.8794 => 1.8990, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.51% (0.2122 => 0.2239, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.31% (2.4764 => 2.3697, std. dev.: 0.0254) MultiSource/Applications/kimwitu++/kc: -2.69% (11.9555 => 11.6344, std. dev.: 0.0051) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 1 11:50:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 1 Jul 2012 13:50:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120701185047.66C862A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1685?compare_to=1682&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1685, Order: 159509, Start Time: 2012-07-01 17:54:04, End Time: 2012-07-01 18:50:42 To: 1682, Order: 159508, Start Time: 2012-07-01 16:30:08, End Time: 2012-07-01 17:26:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (120 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (733 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.03% (2.0176 => 2.2805, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 7.51% (0.5818 => 0.6255, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.45% (0.5748 => 0.6176, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.85% (0.7061 => 0.7545, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.13% (0.3130 => 0.3322, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.85% (0.4328 => 0.4581, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.65% (0.2781 => 0.2938, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2945 => 0.3110, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.51% (0.2760 => 0.2912, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.46% (0.2782 => 0.2934, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.41% (0.2607 => 0.2748, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.39% (0.4062 => 0.4281, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.39% (0.2765 => 0.2914, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2690 => 0.2834, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.29% (0.1986 => 0.2091, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 5.26% (1.3693 => 1.4413, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.20% (0.2655 => 0.2793, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.16% (0.7038 => 0.7401, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.2937 => 0.3088, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.14% (0.2628 => 0.2763, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.06% (0.2726 => 0.2864, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.93% (0.2696 => 0.2829, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.85% (0.2761 => 0.2895, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (1.9828 => 2.0790, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/sieve: 4.81% (0.3453 => 0.3619, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.77% (0.5265 => 0.5516, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3107 => 0.3255, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.67% (0.7710 => 0.8070, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.65% (0.3485 => 0.3647, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.64% (0.3149 => 0.3295, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.61% (0.4016 => 0.4201, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.2721 => 0.2846, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.59% (0.3489 => 0.3649, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.58% (0.2596 => 0.2715, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.58% (0.3580 => 0.3744, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.3899 => 0.4073, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.45% (3.9660 => 4.1426, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/trivial-interface: 4.44% (0.3578 => 0.3737, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.26% (0.3192 => 0.3328, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 4.25% (0.3601 => 0.3754, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 4.22% (0.3646 => 0.3800, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.17% (0.3789 => 0.3947, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.16% (0.3914 => 0.4077, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.16% (0.3650 => 0.3802, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.15% (0.4003 => 0.4169, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 4.12% (0.3663 => 0.3814, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 4.09% (0.3940 => 0.4101, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (0.3756 => 0.3909, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 4.06% (0.3623 => 0.3770, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.04% (0.3293 => 0.3426, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.96% (0.3534 => 0.3674, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.94% (0.4390 => 0.4563, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.94% (0.6959 => 0.7233, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 3.77% (0.3868 => 0.4014, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.59% (13.8202 => 14.3169, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.52% (0.9199 => 0.9523, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.25% (1.2193 => 1.2589, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.08% (0.5577 => 0.5749, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.07% (1.4563 => 1.5010, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.04% (0.3755 => 0.3869, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.98% (1.2292 => 1.2658, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.94% (16.6129 => 17.1014, std. dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5637 => 0.5802, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.92% (1.3245 => 1.3632, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.84% (1.1364 => 1.1687, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.78% (3.8646 => 3.9722, std. dev.: 0.0079) MultiSource/Applications/spiff/spiff: 2.77% (0.7506 => 0.7714, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.77% (4.9865 => 5.1244, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.72% (0.4379 => 0.4498, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.65% (1.0594 => 1.0875, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.64% (1.3813 => 1.4177, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 2.62% (1.1061 => 1.1351, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.57% (1.3819 => 1.4174, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 2.50% (1.9270 => 1.9751, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.35% (7.2180 => 7.3879, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.32% (0.7460 => 0.7633, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.25% (13.2842 => 13.5829, std. dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.06% (0.8698 => 0.8877, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.01% (0.8310 => 0.8477, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.95% (2.1791 => 2.2216, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.92% (3.6692 => 3.7396, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.68% (0.6135 => 0.6238, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.66% (4.3801 => 4.4526, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.59% (14.8535 => 15.0898, std. dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 1.56% (6.5754 => 6.6782, std. dev.: 0.0124) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.53% (4.4433 => 4.5113, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.32% (3.1889 => 3.2309, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.25% (1.1333 => 1.1475, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.10% (1.2749 => 1.2889, std. dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.81% (1.8175 => 2.2685, std. dev.: 0.0297) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.54% (2.0200 => 2.1925, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: 7.19% (1.2998 => 1.3932, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7305, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6788, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4806, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5334, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.52% (3.6469 => 3.7025, std. dev.: 0.0071) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.54% (0.4657 => 0.3980, std. dev.: 0.0257) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.19% (22.5627 => 20.9412, std. dev.: 0.0186) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.81% (0.3511 => 0.3342, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.27% (0.8818 => 0.8530, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.04% (0.6576 => 0.6442, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.10% (6.2785 => 6.2093, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.53% (1.2308 => 1.1012, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.07% (20.3410 => 18.4954, std. dev.: 0.1047) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.46% (1.3780 => 1.3166, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.51% (1.9762 => 1.9068, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5992, std. dev.: 0.0123) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4464, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5101, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2575, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: -1.48% (3.0263 => 2.9815, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8436, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8679, std. dev.: 0.0156) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2520, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2227, std. dev.: 0.0140) MultiSource/Applications/lua/lua: -1.05% (26.5159 => 26.2378, std. dev.: 0.0384) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 1 11:59:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 1 Jul 2012 13:59:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120701185949.EA2062A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1686?compare_to=1683&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1686, Order: 159509, Start Time: 2012-07-01 17:58:36, End Time: 2012-07-01 18:59:43 To: 1683, Order: 159508, Start Time: 2012-07-01 16:30:15, End Time: 2012-07-01 17:31:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (43 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (812 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.24% (10.3673 => 13.0874, std. dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.30% (1.1194 => 1.2571, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 7.80% (0.3473 => 0.3744, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.61% (0.3497 => 0.3763, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 7.59% (0.3543 => 0.3812, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.59% (0.3543 => 0.3812, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.51% (0.3516 => 0.3780, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.50% (0.3561 => 0.3828, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.34% (0.1622 => 0.1741, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3694 => 0.3963, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.17% (1.7609 => 1.8871, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 6.97% (0.3828 => 0.4095, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.93% (0.3927 => 0.4199, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 6.87% (0.3886 => 0.4153, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.82% (2.2022 => 2.3523, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 4.30% (0.6030 => 0.6289, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.27% (0.5925 => 0.6178, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.04% (7.0540 => 7.3387, std. dev.: 0.0119) MultiSource/Applications/JM/ldecod/ldecod: 3.70% (10.4361 => 10.8220, std. dev.: 0.0063) SingleSource/UnitTests/ObjC++/property-reference: 3.60% (0.7326 => 0.7590, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.53% (0.4879 => 0.5051, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.27% (0.3177 => 0.3281, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 3.11% (0.3282 => 0.3384, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.87% (0.7433 => 0.7646, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.78% (0.8172 => 0.8399, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.07% (0.5569 => 0.5684, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.73% (1.5603 => 1.5873, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.73% (4.9449 => 5.0304, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.71% (5.0018 => 5.0874, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.68% (0.7835 => 0.7967, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.59% (2.0665 => 2.0993, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.47% (8.1363 => 8.2559, std. dev.: 0.0170) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.23% (4.2646 => 4.3170, std. dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (9.4845 => 9.5986, std. dev.: 0.0130) MultiSource/Applications/treecc/treecc: 1.17% (2.0273 => 2.0510, std. dev.: 0.0080) MultiSource/Applications/Burg/burg: 1.04% (1.1642 => 1.1763, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7555, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 2.81% (26.0924 => 26.8266, std. dev.: 0.0352) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (1.5086 => 1.5368, std. dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2368, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.21% (2.6546 => 2.6868, std. dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1246, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.40% (5.2763 => 3.1446, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.20% (5.3855 => 3.7054, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.87% (5.3526 => 3.7002, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.71% (2.9384 => 2.5354, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: -12.80% (22.1758 => 19.3363, std. dev.: 0.0087) SingleSource/UnitTests/Vector/constpool: -4.97% (54.1659 => 51.4743, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.19% (3.8922 => 3.7681, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.47% (0.8101 => 0.7982, std. dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.07% (7.9617 => 7.8763, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.74% (1.2373 => 1.1168, std. dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.32% (19.9488 => 18.4877, std. dev.: 0.0647) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.75% (8.1563 => 7.9320, std. dev.: 0.0079) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6817, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0861, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 1 14:28:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 1 Jul 2012 16:28:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120701212813.8454B2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1687?compare_to=1684&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1687, Order: 159509, Start Time: 2012-07-01 19:12:29, End Time: 2012-07-01 21:28:08 To: 1684, Order: 159508, Start Time: 2012-07-01 16:29:50, End Time: 2012-07-01 18:45:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (24 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (868 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.73% (2.0807 => 2.1166, std. dev.: 0.0077) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 7.13% (0.3465 => 0.3712, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.11% (0.3446 => 0.3691, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.05% (0.3460 => 0.3704, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.04% (0.3496 => 0.3742, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.00% (0.3442 => 0.3683, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: 6.98% (0.3469 => 0.3711, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.91% (0.3488 => 0.3729, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 6.75% (0.3643 => 0.3889, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.63% (0.3650 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.44% (0.3724 => 0.3964, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 4.29% (0.5826 => 0.6076, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.09% (0.5889 => 0.6130, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.39% (0.7171 => 0.7414, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.49% (0.5026 => 0.5151, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.41% (0.5900 => 0.6042, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.37% (1.6211 => 1.6596, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.10% (2.0673 => 2.1107, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 2.09% (0.9909 => 1.0116, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.01% (3.5627 => 3.6342, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.84% (1.3152 => 1.3394, std. dev.: 0.0061) MultiSource/Applications/hbd/hbd: 1.81% (0.9697 => 0.9873, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 1.61% (4.2109 => 4.2789, std. dev.: 0.0097) MultiSource/Benchmarks/Bullet/bullet: 1.01% (23.5202 => 23.7576, std. dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.66% (2.0820 => 2.1166, std. dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.46% (2.4764 => 2.3660, std. dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: -2.78% (11.9555 => 11.6226, std. dev.: 0.0190) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 00:27:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 02:27:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120702072710.285762A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1688?compare_to=1685&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1688, Order: 159512, Start Time: 2012-07-02 06:27:36, End Time: 2012-07-02 07:27:02 To: 1685, Order: 159509, Start Time: 2012-07-01 17:54:04, End Time: 2012-07-01 18:50:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (101 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (753 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.03% (1.1012 => 1.1125, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.98% (2.0176 => 2.2795, std. dev.: 0.0544) SingleSource/UnitTests/ObjC++/property-reference-object: 7.53% (0.5818 => 0.6256, std. dev.: 0.0091) SingleSource/UnitTests/ObjC++/Hello: 7.48% (0.5748 => 0.6178, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 5.78% (0.4328 => 0.4578, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.67% (0.2945 => 0.3112, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.61% (0.2781 => 0.2937, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 5.44% (0.4062 => 0.4283, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.39% (0.2782 => 0.2932, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.39% (0.2765 => 0.2914, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hello: 5.37% (0.2607 => 0.2747, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.36% (0.2760 => 0.2908, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2690 => 0.2834, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.27% (1.3693 => 1.4415, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 5.21% (0.2937 => 0.3090, std. dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 5.13% (0.7038 => 0.7399, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (0.2628 => 0.2762, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2726 => 0.2861, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.90% (0.2696 => 0.2828, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.89% (0.2761 => 0.2896, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.78% (0.2596 => 0.2720, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3107 => 0.3255, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 4.70% (0.3149 => 0.3297, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.69% (0.5265 => 0.5512, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.59% (0.3485 => 0.3645, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.59% (0.2988 => 0.3125, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.51% (3.9660 => 4.1447, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 4.42% (0.3578 => 0.3736, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 4.35% (0.3192 => 0.3331, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 4.27% (0.3914 => 0.4081, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/parameter-passing: 4.20% (0.4003 => 0.4171, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/for-in: 4.17% (0.3789 => 0.3947, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-4: 4.17% (0.3646 => 0.3798, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/synchronized: 4.15% (0.3663 => 0.3815, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/property: 4.14% (0.3940 => 0.4103, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 4.07% (0.3293 => 0.3427, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3756 => 0.3905, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.93% (0.3534 => 0.3673, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.92% (0.4390 => 0.4562, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.84% (0.6959 => 0.7226, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.3868 => 0.4015, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.66% (13.8202 => 14.3261, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.49% (0.9199 => 0.9520, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.42% (1.2193 => 1.2610, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.01% (0.3755 => 0.3868, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.98% (0.5577 => 0.5743, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.94% (1.3245 => 1.3634, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.92% (1.2292 => 1.2651, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.91% (16.6129 => 17.0964, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.89% (0.5637 => 0.5800, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 2.87% (3.8646 => 3.9757, std. dev.: 0.0156) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.82% (1.1364 => 1.1685, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 2.81% (0.7506 => 0.7717, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.79% (4.9865 => 5.1256, std. dev.: 0.0056) MultiSource/Applications/Burg/burg: 2.66% (1.1061 => 1.1355, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 2.64% (1.0594 => 1.0874, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.62% (1.3813 => 1.4175, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 2.55% (1.9270 => 1.9761, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.36% (7.2180 => 7.3886, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.24% (0.7460 => 0.7627, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 2.02% (0.8310 => 0.8478, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (0.8698 => 0.8873, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 2.01% (2.1791 => 2.2228, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 1.75% (6.5754 => 6.6902, std. dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.70% (0.6135 => 0.6239, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1.66% (14.8535 => 15.1007, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.59% (4.4433 => 4.5139, std. dev.: 0.0088) MultiSource/Applications/d/make_dparser: 1.38% (3.1889 => 3.2329, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.35% (1.1333 => 1.1486, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.09% (1.2749 => 1.2888, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 95.34% (0.1824 => 0.3563, std. dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.85% (1.8175 => 2.2692, std. dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1921, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.75% (0.9996 => 1.0771, std. dev.: 0.0059) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.96% (1.2998 => 1.3903, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7193, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6794, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.50% (1.7688 => 1.8307, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1892, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4562, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.67% (3.6469 => 3.7079, std. dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0267) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1941, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.16% (22.5627 => 20.9483, std. dev.: 0.4731) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.76% (0.3511 => 0.3344, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.84% (0.9108 => 0.8940, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.12% (6.2785 => 6.2081, std. dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -9.61% (1.2308 => 1.1125, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.79% (20.3410 => 18.5524, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4002, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.53% (1.3780 => 1.3156, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.31% (0.4366 => 0.4178, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9066, std. dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/dry: -3.15% (2.5089 => 2.4298, std. dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6055, std. dev.: 0.0620) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5019, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2576, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -1.49% (3.0263 => 2.9813, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.37% (2.5254 => 2.4907, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8447, std. dev.: 0.1081) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (0.9692 => 0.9564, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std. dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2539, std. dev.: 0.0035) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2265, std. dev.: 0.0395) MultiSource/Applications/lua/lua: -1.11% (26.5159 => 26.2209, std. dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 00:31:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 02:31:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120702073153.B72DA2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/1689?compare_to=1686&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1689, Order: 159512, Start Time: 2012-07-02 06:27:43, End Time: 2012-07-02 07:31:48 To: 1686, Order: 159509, Start Time: 2012-07-01 17:58:36, End Time: 2012-07-01 18:59:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (33 on baseline) Performance Improvements: 0 (16 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (824 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 1.13% (1.1763 => 1.1896, std. dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.51% (10.3673 => 13.1155, std. dev.: 0.1485) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.41% (1.1194 => 1.2583, std. dev.: 0.0332) SingleSource/UnitTests/ObjC/trivial-interface: 7.80% (0.3473 => 0.3744, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.64% (0.3561 => 0.3833, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.62% (0.3543 => 0.3813, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 7.61% (0.3497 => 0.3763, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.57% (0.3516 => 0.3782, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.54% (0.3543 => 0.3810, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.47% (0.3694 => 0.3970, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 7.40% (0.1622 => 0.1742, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.22% (1.7609 => 1.8880, std. dev.: 0.0182) SingleSource/UnitTests/ObjC/property: 7.00% (0.3886 => 0.4158, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.92% (0.3828 => 0.4093, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.90% (0.3927 => 0.4198, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.83% (2.2022 => 2.3527, std. dev.: 0.0417) SingleSource/UnitTests/ObjC++/property-reference-object: 4.39% (0.6030 => 0.6295, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.35% (0.5925 => 0.6183, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.69% (10.4361 => 10.8211, std. dev.: 0.0166) SingleSource/UnitTests/ObjC++/property-reference: 3.58% (0.7326 => 0.7588, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 3.11% (0.3282 => 0.3384, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.99% (0.7433 => 0.7655, std. dev.: 0.0083) MultiSource/Applications/Burg/burg: 2.18% (1.1642 => 1.1896, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 1.57% (1.5603 => 1.5848, std. dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 1.22% (9.4845 => 9.6003, std. dev.: 0.0143) MultiSource/Applications/treecc/treecc: 1.15% (2.0273 => 2.0507, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 1.05% (3.8723 => 3.9128, std. dev.: 0.0089) MultiSource/Applications/d/make_dparser: 1.01% (3.3354 => 3.3691, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7532, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 2.84% (26.0924 => 26.8323, std. dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2420, std. dev.: 0.0382) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.36% (2.6546 => 2.6907, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.07% (0.8651 => 0.1724, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.32% (5.2763 => 3.1489, std. dev.: 0.0618) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.10% (5.3855 => 3.7106, std. dev.: 0.0528) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.80% (5.3526 => 3.7042, std. dev.: 0.0516) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.69% (2.9384 => 2.5361, std. dev.: 0.0738) MultiSource/Applications/ClamAV/clamscan: -12.68% (22.1758 => 19.3632, std. dev.: 0.0377) SingleSource/UnitTests/Vector/constpool: -5.02% (54.1659 => 51.4490, std. dev.: 0.0265) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.37% (3.8922 => 3.7612, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -10.53% (1.2373 => 1.1070, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.02% (19.9488 => 18.5486, std. dev.: 0.0209) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.06% (8.1563 => 7.9071, std. dev.: 0.0122) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6848, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: -1.97% (10.2830 => 10.0808, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 01:45:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 03:45:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120702084532.3A3A42A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1690?compare_to=1687&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1690, Order: 159512, Start Time: 2012-07-02 06:27:42, End Time: 2012-07-02 08:45:27 To: 1687, Order: 159509, Start Time: 2012-07-01 19:12:29, End Time: 2012-07-01 21:28:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (18 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (874 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 7.14% (0.3446 => 0.3692, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.13% (0.3465 => 0.3712, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.11% (0.3488 => 0.3736, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 7.00% (0.3442 => 0.3683, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.99% (0.3460 => 0.3702, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.98% (0.3496 => 0.3740, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.86% (0.3469 => 0.3707, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 6.84% (0.3643 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.63% (0.3650 => 0.3892, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 6.44% (0.3724 => 0.3964, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.17% (0.5826 => 0.6069, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 4.09% (0.5889 => 0.6130, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.46% (0.7171 => 0.7419, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.31% (1.6211 => 1.6585, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 1.99% (0.9909 => 1.0106, std. dev.: 0.0044) MultiSource/Applications/hbd/hbd: 1.79% (0.9697 => 0.9871, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.71% (4.2109 => 4.2828, std. dev.: 0.0055) MultiSource/Applications/d/make_dparser: 1.05% (1.0781 => 1.0894, std. dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.16% (2.4764 => 2.3734, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -2.77% (11.9555 => 11.6246, std. dev.: 0.0103) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 01:51:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 03:51:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120702085137.588AB2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1691?compare_to=1688&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1691, Order: 159517, Start Time: 2012-07-02 07:54:41, End Time: 2012-07-02 08:51:31 To: 1688, Order: 159512, Start Time: 2012-07-02 06:27:36, End Time: 2012-07-02 07:27:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (121 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (734 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.98% (2.0176 => 2.2794, std. dev.: 0.0097) SingleSource/UnitTests/ObjC++/property-reference-object: 7.77% (0.5818 => 0.6270, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.50% (0.5748 => 0.6179, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 7.11% (0.7061 => 0.7563, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.26% (0.3130 => 0.3326, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.86% (0.2781 => 0.2944, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.82% (0.4328 => 0.4580, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3022 => 0.3197, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2607 => 0.2754, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.59% (0.4062 => 0.4289, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.54% (0.2782 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.53% (0.2765 => 0.2918, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.52% (0.2628 => 0.2773, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.47% (0.2760 => 0.2911, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2690 => 0.2837, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.44% (0.1986 => 0.2094, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.42% (0.2655 => 0.2799, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.41% (0.2937 => 0.3096, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.31% (1.3693 => 1.4420, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 5.16% (0.7038 => 0.7401, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.10% (0.2726 => 0.2865, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.09% (0.2966 => 0.3117, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 5.07% (0.2761 => 0.2901, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.06% (1.9828 => 2.0831, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 5.05% (0.3149 => 0.3308, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.04% (0.2696 => 0.2832, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.98% (0.3453 => 0.3625, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.92% (0.3107 => 0.3260, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.79% (0.3485 => 0.3652, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.72% (0.7710 => 0.8074, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.71% (0.5265 => 0.5513, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.70% (0.2596 => 0.2718, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 4.69% (0.2988 => 0.3128, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.61% (0.3489 => 0.3650, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.2721 => 0.2846, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.59% (0.3899 => 0.4078, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.56% (3.9660 => 4.1467, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/trivial-interface: 4.56% (0.3578 => 0.3741, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 4.42% (0.3646 => 0.3807, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.42% (0.3601 => 0.3760, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 4.40% (0.3663 => 0.3824, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.39% (0.3192 => 0.3332, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.35% (0.4003 => 0.4177, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/for-in: 4.33% (0.3789 => 0.3953, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 4.32% (0.3914 => 0.4083, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.28% (0.3293 => 0.3434, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.25% (0.3650 => 0.3805, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 4.19% (0.3940 => 0.4105, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.15% (0.3756 => 0.3912, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 4.14% (0.3623 => 0.3773, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.07% (0.3534 => 0.3678, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.05% (0.4390 => 0.4568, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 3.88% (0.3868 => 0.4018, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.84% (0.6959 => 0.7226, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.63% (13.8202 => 14.3223, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.61% (0.9199 => 0.9531, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.42% (0.2925 => 0.3025, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.31% (1.2193 => 1.2597, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.28% (0.5577 => 0.5760, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 3.14% (3.8646 => 3.9860, std. dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 3.11% (1.2292 => 1.2674, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.03% (0.5637 => 0.5808, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.95% (16.6129 => 17.1033, std. dev.: 0.0173) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.91% (1.4563 => 1.4987, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (1.1364 => 1.1694, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.88% (1.3245 => 1.3627, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 2.85% (0.7506 => 0.7720, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.80% (1.3813 => 1.4200, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.78% (4.9865 => 5.1250, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.74% (0.4379 => 0.4499, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.0594 => 1.0881, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.65% (1.1061 => 1.1354, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 2.61% (1.9270 => 1.9773, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.60% (1.3819 => 1.4178, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.46% (7.2180 => 7.3959, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.44% (0.7460 => 0.7642, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (13.2842 => 13.5842, std. dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.20% (0.8698 => 0.8889, std. dev.: 0.0045) MultiSource/Applications/siod/siod: 2.02% (2.1791 => 2.2231, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 1.96% (0.8310 => 0.8473, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.86% (3.6692 => 3.7375, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.70% (4.3801 => 4.4545, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.67% (4.4433 => 4.5175, std. dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: 1.64% (6.5754 => 6.6833, std. dev.: 0.0185) MultiSource/Applications/JM/lencod/lencod: 1.64% (14.8535 => 15.0970, std. dev.: 0.0087) MultiSource/Applications/d/make_dparser: 1.45% (3.1889 => 3.2352, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.34% (1.1333 => 1.1485, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.08% (1.2749 => 1.2887, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 1.07% (14.5298 => 14.6851, std. dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2649, std. dev.: 0.0461) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1908, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: 8.35% (1.2998 => 1.4083, std. dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.4271 => 7.7212, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6781, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0184) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.95% (4.1080 => 4.1882, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5342, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.46% (3.6469 => 3.7000, std. dev.: 0.0088) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 1.07% (10.7476 => 10.8621, std. dev.: 0.0440) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.14% (22.5627 => 20.9514, std. dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.78% (0.3511 => 0.3343, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.27% (0.8818 => 0.8530, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.95% (0.6576 => 0.6448, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.83% (0.9108 => 0.8941, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.16% (6.2785 => 6.2054, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2308 => 1.1097, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.84% (20.3410 => 18.5423, std. dev.: 0.0377) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0073) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5905, std. dev.: 0.0108) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5066, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2561, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -1.54% (3.0263 => 2.9796, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4884, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8644, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.33% (28.2225 => 27.8468, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2537, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 02:00:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 04:00:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120702090049.E45652A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1692?compare_to=1689&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1692, Order: 159517, Start Time: 2012-07-02 07:59:21, End Time: 2012-07-02 09:00:44 To: 1689, Order: 159512, Start Time: 2012-07-02 06:27:43, End Time: 2012-07-02 07:31:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (40 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (815 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.36% (10.3673 => 13.0999, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.41% (1.1194 => 1.2583, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 7.86% (0.3473 => 0.3746, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.67% (0.3561 => 0.3834, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.66% (0.3497 => 0.3765, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.65% (0.3543 => 0.3814, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.62% (0.3543 => 0.3813, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3516 => 0.3781, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 7.40% (0.1622 => 0.1742, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.34% (0.3694 => 0.3965, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.19% (1.7609 => 1.8875, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: 7.03% (0.3828 => 0.4097, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 6.90% (0.3927 => 0.4198, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 6.90% (0.3886 => 0.4154, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.80% (2.2022 => 2.3519, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 4.34% (0.5925 => 0.6182, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 4.28% (0.6030 => 0.6288, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.01% (7.0540 => 7.3367, std. dev.: 0.0174) MultiSource/Applications/JM/ldecod/ldecod: 3.67% (10.4361 => 10.8189, std. dev.: 0.0123) SingleSource/UnitTests/ObjC++/property-reference: 3.55% (0.7326 => 0.7586, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.53% (0.4879 => 0.5051, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.18% (0.3177 => 0.3278, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 3.11% (0.3282 => 0.3384, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.93% (0.7433 => 0.7651, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.26% (0.5569 => 0.5695, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.82% (4.9449 => 5.0349, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.81% (5.0018 => 5.0925, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.48% (8.1363 => 8.2571, std. dev.: 0.0182) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (9.4845 => 9.6189, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.40% (2.0665 => 2.0955, std. dev.: 0.0040) MultiSource/Applications/hbd/hbd: 1.28% (1.5603 => 1.5802, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.27% (4.2646 => 4.3187, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 1.09% (2.0273 => 2.0494, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9740, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7520, std. dev.: 0.0035) MultiSource/Applications/lua/lua: 2.70% (26.0924 => 26.7975, std. dev.: 0.0349) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (1.5086 => 1.5364, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 1.41% (2.4116 => 2.4456, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2420, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.37% (2.6546 => 2.6909, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1246, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.34% (5.2763 => 3.1476, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.16% (5.3855 => 3.7072, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.95% (5.3526 => 3.6960, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.63% (2.9384 => 2.5380, std. dev.: 0.0148) MultiSource/Applications/ClamAV/clamscan: -12.78% (22.1758 => 19.3410, std. dev.: 0.0270) SingleSource/UnitTests/Vector/constpool: -4.93% (54.1659 => 51.4943, std. dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.29% (3.8922 => 3.7641, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.54% (0.8101 => 0.7976, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.01% (7.9617 => 7.8814, std. dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1072, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.12% (19.9488 => 18.5289, std. dev.: 0.0582) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (8.1563 => 7.9109, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6889, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0858, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 04:28:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 06:28:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120702112814.F2D152A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1693?compare_to=1690&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1693, Order: 159517, Start Time: 2012-07-02 09:12:45, End Time: 2012-07-02 11:28:11 To: 1690, Order: 159512, Start Time: 2012-07-02 06:27:42, End Time: 2012-07-02 08:45:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (25 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (867 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.2268 => 0.2403, std. dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 7.22% (0.3465 => 0.3715, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.17% (0.3446 => 0.3693, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.08% (0.3460 => 0.3705, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 7.07% (0.3496 => 0.3743, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.03% (0.3442 => 0.3684, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.00% (0.3488 => 0.3732, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 6.95% (0.3469 => 0.3710, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.84% (0.3643 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.82% (0.3650 => 0.3899, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.50% (0.3724 => 0.3966, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.15% (0.5826 => 0.6068, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 3.89% (0.5889 => 0.6118, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.52% (0.7171 => 0.7352, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.47% (0.5900 => 0.6046, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.41% (1.6211 => 1.6601, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.38% (0.4361 => 0.4465, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.31% (0.5026 => 0.5142, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.27% (3.5627 => 3.6435, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.12% (0.4994 => 0.5100, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.79% (4.2109 => 4.2861, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.75% (0.9909 => 1.0082, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.74% (1.3152 => 1.3381, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.71% (2.0673 => 2.1026, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.07% (2.7292 => 2.7583, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.01% (1.9694 => 1.9892, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.01% (2.4764 => 2.3772, std. dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: -2.93% (11.9555 => 11.6054, std. dev.: 0.0053) Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 04:48:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 06:48:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120702114832.A74372A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1694?compare_to=1691&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1694, Order: 159520, Start Time: 2012-07-02 10:51:43, End Time: 2012-07-02 11:48:28 To: 1691, Order: 159517, Start Time: 2012-07-02 07:54:41, End Time: 2012-07-02 08:51:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (121 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (731 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.02% (2.0176 => 2.2802, std. dev.: 0.0146) SingleSource/UnitTests/ObjC++/property-reference-object: 7.70% (0.5818 => 0.6266, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.43% (0.5748 => 0.6175, std. dev.: 0.0064) SingleSource/UnitTests/ObjC++/property-reference: 6.93% (0.7061 => 0.7550, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.87% (0.4328 => 0.4582, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.86% (0.3022 => 0.3199, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.69% (0.2760 => 0.2917, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.68% (0.2781 => 0.2939, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.67% (0.2945 => 0.3112, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.64% (0.4062 => 0.4291, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2765 => 0.2920, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2607 => 0.2750, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.45% (0.2937 => 0.3097, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.45% (0.7710 => 0.8130, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 5.40% (0.2628 => 0.2770, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2690 => 0.2834, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.34% (0.1986 => 0.2092, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.27% (1.3693 => 1.4415, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 5.14% (0.7038 => 0.7400, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.12% (1.9828 => 2.0844, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.09% (0.2966 => 0.3117, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.06% (0.2726 => 0.2864, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.04% (0.2696 => 0.2832, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 5.04% (0.3453 => 0.3627, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.96% (0.2761 => 0.2898, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.89% (0.3107 => 0.3259, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 4.80% (0.3149 => 0.3300, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.79% (0.3485 => 0.3652, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.79% (0.3489 => 0.3656, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.78% (0.4016 => 0.4208, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.69% (0.2988 => 0.3128, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.65% (0.5265 => 0.5510, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.59% (0.3899 => 0.4078, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.55% (0.2596 => 0.2714, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.53% (0.3580 => 0.3742, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.52% (3.9660 => 4.1451, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/trivial-interface: 4.50% (0.3578 => 0.3739, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 4.35% (0.3192 => 0.3331, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 4.28% (0.3646 => 0.3802, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 4.25% (0.3601 => 0.3754, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 4.22% (0.3914 => 0.4079, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/synchronized: 4.18% (0.3663 => 0.3816, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 4.17% (0.4003 => 0.4170, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 4.17% (0.3789 => 0.3947, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.14% (0.3650 => 0.3801, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.13% (0.3534 => 0.3680, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 4.11% (0.3623 => 0.3772, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.10% (0.3293 => 0.3428, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (0.3756 => 0.3909, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 4.04% (0.3940 => 0.4099, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.01% (0.3868 => 0.4023, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.99% (0.4390 => 0.4565, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.84% (0.6959 => 0.7226, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.62% (13.8202 => 14.3211, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.52% (0.9199 => 0.9523, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3755 => 0.3878, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.27% (1.2193 => 1.2592, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 3.15% (1.2292 => 1.2679, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.99% (0.5577 => 0.5744, std. dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 2.93% (16.6129 => 17.0996, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.90% (1.3245 => 1.3629, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.89% (1.1364 => 1.1692, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.88% (1.4563 => 1.4983, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 2.86% (3.8646 => 3.9750, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.84% (4.9865 => 5.1283, std. dev.: 0.0073) MultiSource/Applications/spiff/spiff: 2.74% (0.7506 => 0.7712, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.74% (0.4379 => 0.4499, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.73% (1.3819 => 1.4196, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.68% (1.1061 => 1.1357, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.64% (1.3813 => 1.4178, std. dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 2.55% (1.0594 => 1.0864, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.54% (1.9270 => 1.9760, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.39% (0.7460 => 0.7638, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.31% (7.2180 => 7.3850, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.25% (13.2842 => 13.5827, std. dev.: 0.0249) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.12% (0.8698 => 0.8882, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.06% (0.8310 => 0.8481, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.89% (2.1791 => 2.2203, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.79% (3.6692 => 3.7350, std. dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.79% (0.6135 => 0.6245, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.63% (4.3801 => 4.4517, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 1.61% (14.8535 => 15.0932, std. dev.: 0.0117) MultiSource/Applications/JM/ldecod/ldecod: 1.57% (6.5754 => 6.6787, std. dev.: 0.0129) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.56% (4.4433 => 4.5124, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 1.42% (3.1889 => 3.2343, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.27% (1.1333 => 1.1477, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2749 => 1.2891, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 26.61% (1.8175 => 2.3012, std. dev.: 0.0185) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1922, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.19% (1.2998 => 1.3932, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.4271 => 7.7247, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9198, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6785, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8295, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1909, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.91% (3.6469 => 3.7167, std. dev.: 0.0028) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4562, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (1.5089 => 1.5344, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.38% (1.9433 => 1.9702, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1939, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.89% (0.4657 => 0.4010, std. dev.: 0.0234) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.17% (22.5627 => 20.9460, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.76% (0.3511 => 0.3344, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.31% (0.8818 => 0.8526, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.99% (0.6576 => 0.6445, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.91% (0.9108 => 0.8934, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.14% (6.2785 => 6.2069, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.14% (1.2308 => 1.1060, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.95% (20.3410 => 18.5214, std. dev.: 0.0553) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2637, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3103, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5870, std. dev.: 0.0213) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4463, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5079, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -1.55% (3.0263 => 2.9794, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.52% (6.3560 => 6.2593, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -1.33% (28.2225 => 27.8479, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2499, std. dev.: 0.0042) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2187, std. dev.: 0.0387) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.23% (0.9692 => 0.9573, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.09% (26.5159 => 26.2269, std. dev.: 0.0255) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 04:53:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 06:53:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120702115336.F3CC72A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1695?compare_to=1692&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1695, Order: 159520, Start Time: 2012-07-02 10:52:14, End Time: 2012-07-02 11:53:32 To: 1692, Order: 159517, Start Time: 2012-07-02 07:59:21, End Time: 2012-07-02 09:00:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (43 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (812 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.58% (3.7679 => 3.8273, std. dev.: 0.0152) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.23% (10.3673 => 13.0865, std. dev.: 0.0265) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.48% (1.1194 => 1.2591, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 7.83% (0.3473 => 0.3745, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.66% (0.3497 => 0.3765, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.57% (0.3516 => 0.3782, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.56% (0.3543 => 0.3811, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.54% (0.3543 => 0.3810, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.47% (0.3561 => 0.3827, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.40% (0.1622 => 0.1742, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.22% (1.7609 => 1.8881, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: 7.18% (0.3828 => 0.4103, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.17% (0.3694 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.03% (0.3927 => 0.4203, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.95% (0.3886 => 0.4156, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.82% (2.2022 => 2.3524, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.35% (0.5925 => 0.6183, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 4.33% (0.6030 => 0.6291, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (7.0540 => 7.3395, std. dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 3.76% (10.4361 => 10.8285, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 3.56% (0.7326 => 0.7587, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.44% (0.4879 => 0.5047, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 3.23% (0.3282 => 0.3388, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.21% (0.3177 => 0.3279, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.90% (0.8172 => 0.8409, std. dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 2.88% (0.7433 => 0.7647, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.10% (0.5569 => 0.5686, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.95% (4.9449 => 5.0414, std. dev.: 0.0054) MultiSource/Applications/spiff/spiff: 1.75% (0.7835 => 0.7972, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.75% (5.0018 => 5.0892, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.68% (2.0665 => 2.1012, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.49% (8.1363 => 8.2578, std. dev.: 0.0045) MultiSource/Applications/hbd/hbd: 1.41% (1.5603 => 1.5823, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 1.26% (9.4845 => 9.6041, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.25% (4.2646 => 4.3180, std. dev.: 0.0090) MultiSource/Applications/Burg/burg: 1.11% (1.1642 => 1.1771, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (3.6395 => 3.7476, std. dev.: 0.0046) MultiSource/Applications/lua/lua: 2.79% (26.0924 => 26.8212, std. dev.: 0.0201) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5086 => 1.5353, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.40% (2.6546 => 2.6917, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2387, std. dev.: 0.0026) MultiSource/Benchmarks/llubenchmark/llu: 1.30% (3.7781 => 3.8273, std. dev.: 0.0152) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1246, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.39% (5.2763 => 3.1452, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.19% (5.3855 => 3.7060, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.85% (5.3526 => 3.7012, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.78% (2.9384 => 2.5335, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: -12.75% (22.1758 => 19.3493, std. dev.: 0.0126) SingleSource/UnitTests/Vector/constpool: -4.94% (54.1659 => 51.4902, std. dev.: 0.0324) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.27% (3.8922 => 3.7650, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.62% (0.8101 => 0.7970, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.02% (7.9617 => 7.8804, std. dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -9.88% (1.2373 => 1.1150, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.97% (19.9488 => 18.5589, std. dev.: 0.0659) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (8.1563 => 7.9163, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6884, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0856, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 06:14:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 08:14:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120702131415.BA8CC2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1696?compare_to=1694&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1696, Order: 159522, Start Time: 2012-07-02 12:17:29, End Time: 2012-07-02 13:14:11 To: 1694, Order: 159520, Start Time: 2012-07-02 10:51:43, End Time: 2012-07-02 11:48:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (125 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (728 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.96% (3.7730 => 3.8471, std. dev.: 0.0212) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.45% (2.0176 => 2.2889, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference-object: 7.68% (0.5818 => 0.6265, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.57% (0.5748 => 0.6183, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.04% (0.7061 => 0.7558, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.85% (0.4328 => 0.4581, std. dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 5.75% (0.2781 => 0.2941, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.61% (1.3693 => 1.4461, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.49% (0.4062 => 0.4285, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.47% (0.2760 => 0.2911, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.44% (0.1986 => 0.2094, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.43% (0.2782 => 0.2933, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.36% (0.7038 => 0.7415, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.35% (0.2765 => 0.2913, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.33% (0.2607 => 0.2746, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.31% (0.2655 => 0.2796, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.20% (0.2690 => 0.2830, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.18% (0.2937 => 0.3089, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.18% (0.2628 => 0.2764, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.14% (0.7710 => 0.8106, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.01% (0.5265 => 0.5529, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.93% (0.2696 => 0.2829, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.93% (1.9828 => 2.0805, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.89% (0.2596 => 0.2723, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.89% (0.2761 => 0.2896, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.87% (0.3453 => 0.3621, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.81% (0.2721 => 0.2852, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.81% (3.9660 => 4.1567, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3107 => 0.3255, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.76% (0.3149 => 0.3299, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.4016 => 0.4205, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 4.69% (0.2988 => 0.3128, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.68% (0.3485 => 0.3648, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.64% (0.3489 => 0.3651, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3899 => 0.4080, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.64% (0.3580 => 0.3746, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 4.50% (0.3578 => 0.3739, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.33% (0.3789 => 0.3953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.32% (0.3192 => 0.3330, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 4.31% (0.3646 => 0.3803, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.25% (0.3601 => 0.3754, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.24% (0.3914 => 0.4080, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 4.23% (0.3663 => 0.3818, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 4.22% (0.3293 => 0.3432, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.22% (0.3650 => 0.3804, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.21% (0.3940 => 0.4106, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 4.20% (0.4003 => 0.4171, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 4.20% (0.3623 => 0.3775, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.12% (0.6959 => 0.7246, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.07% (0.3534 => 0.3678, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.05% (0.3756 => 0.3908, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.96% (0.3868 => 0.4021, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.92% (0.4390 => 0.4562, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.88% (13.8202 => 14.3571, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.76% (0.9199 => 0.9545, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.63% (1.2193 => 1.2636, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/09-vor/vor: 3.45% (0.2925 => 0.3026, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.38% (1.1364 => 1.1748, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (1.4563 => 1.5052, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.28% (0.5577 => 0.5760, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.25% (0.3755 => 0.3877, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.19% (1.3245 => 1.3668, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (3.8646 => 3.9871, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 3.13% (1.2292 => 1.2677, std. dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 3.13% (16.6129 => 17.1331, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.12% (0.5637 => 0.5813, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.12% (1.3813 => 1.4244, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.09% (1.3819 => 1.4246, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3246 => 0.3346, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.04% (0.4379 => 0.4512, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.01% (4.9865 => 5.1365, std. dev.: 0.0167) MultiSource/Applications/spiff/spiff: 2.97% (0.7506 => 0.7729, std. dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 2.90% (1.0594 => 1.0901, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 2.87% (1.1061 => 1.1378, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 2.81% (1.9270 => 1.9811, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.79% (13.2842 => 13.6547, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.67% (7.2180 => 7.4110, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.51% (0.7460 => 0.7647, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.27% (3.6692 => 3.7524, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.8310 => 0.8498, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.22% (0.8698 => 0.8891, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.22% (2.1791 => 2.2274, std. dev.: 0.0124) MultiSource/Applications/JM/lencod/lencod: 2.15% (14.8535 => 15.1731, std. dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 1.97% (6.5754 => 6.7049, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.95% (4.3801 => 4.4656, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.91% (4.4433 => 4.5280, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.87% (0.6135 => 0.6250, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.67% (3.1889 => 3.2422, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.61% (1.1333 => 1.1516, std. dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 1.34% (1.2749 => 1.2920, std. dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: 1.21% (14.5298 => 14.7055, std. dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2600, std. dev.: 0.0509) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1892, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.88% (1.2998 => 1.3892, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7267, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9217, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6785, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8290, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4788, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0007) MultiSource/Benchmarks/llubenchmark/llu: 1.96% (3.7731 => 3.8471, std. dev.: 0.0212) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.85% (3.6469 => 3.7144, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (1.5089 => 1.5359, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.44% (0.4657 => 0.4171, std. dev.: 0.0172) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.98% (22.5627 => 20.9871, std. dev.: 0.0201) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.44% (0.3511 => 0.3355, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.08% (0.8818 => 0.8546, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.63% (0.6576 => 0.6469, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.60% (0.9108 => 0.8962, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2308 => 1.0999, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (20.3410 => 18.6316, std. dev.: 0.0254) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3112, std. dev.: 0.0073) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6009, std. dev.: 0.0200) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4465, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5102, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2553, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: -1.54% (3.0263 => 2.9796, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.5254 => 2.4885, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8440, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std. dev.: 0.0055) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2171, std. dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2528, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.16% (26.5159 => 26.2081, std. dev.: 0.0233) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 06:23:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 08:23:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120702132324.2C17E2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1697?compare_to=1695&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1697, Order: 159522, Start Time: 2012-07-02 12:22:09, End Time: 2012-07-02 13:23:20 To: 1695, Order: 159520, Start Time: 2012-07-02 10:52:14, End Time: 2012-07-02 11:53:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (40 on baseline) Performance Improvements: 0 (19 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (814 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.13% (10.3673 => 13.1799, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.43% (1.1194 => 1.2585, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 7.46% (0.3473 => 0.3732, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.31% (0.3543 => 0.3802, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: 7.29% (0.3497 => 0.3752, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.23% (0.3543 => 0.3799, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.17% (1.7609 => 1.8871, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.16% (0.3561 => 0.3816, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.14% (0.3516 => 0.3767, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.88% (0.3694 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.69% (0.3828 => 0.4084, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.62% (0.3927 => 0.4187, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.59% (0.3886 => 0.4142, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.23% (2.2022 => 2.3394, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 4.20% (0.5925 => 0.6174, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 4.15% (0.6030 => 0.6280, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.79% (0.7326 => 0.7604, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.65% (0.4879 => 0.5057, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.59% (7.0540 => 7.3074, std. dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 3.33% (10.4361 => 10.7838, std. dev.: 0.0128) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.24% (0.3177 => 0.3280, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 2.89% (0.7433 => 0.7648, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.84% (0.8172 => 0.8404, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.05% (0.5569 => 0.5683, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.75% (4.9449 => 5.0316, std. dev.: 0.0086) MultiSource/Applications/spiff/spiff: 1.65% (0.7835 => 0.7964, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (5.0018 => 5.0841, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.51% (2.0665 => 2.0978, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.28% (8.1363 => 8.2408, std. dev.: 0.0107) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.25% (4.2646 => 4.3180, std. dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 1.17% (9.4845 => 9.5956, std. dev.: 0.0111) MultiSource/Applications/treecc/treecc: 1.16% (2.0273 => 2.0508, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9749, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7569, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 2.63% (26.0924 => 26.7798, std. dev.: 0.0361) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.98% (1.5086 => 1.5384, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: 1.39% (2.4116 => 2.4452, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2406, std. dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6890, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1245, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.31% (5.2763 => 3.1492, std. dev.: 0.0075) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.53% (5.3855 => 3.6877, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.14% (5.3526 => 3.6859, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.66% (2.9384 => 2.5371, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -12.80% (22.1758 => 19.3363, std. dev.: 0.0264) SingleSource/UnitTests/Vector/constpool: -4.99% (54.1659 => 51.4623, std. dev.: 0.0582) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.24% (3.8922 => 3.7660, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.57% (0.8101 => 0.7974, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.32% (7.9617 => 7.8565, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: -1.20% (21.9371 => 21.6749, std. dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.70% (1.2373 => 1.1049, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.96% (19.9488 => 18.5601, std. dev.: 0.0615) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9148, std. dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6856, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0848, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 07:10:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 09:10:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120702141034.BB23D2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1698?compare_to=1693&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1698, Order: 159521, Start Time: 2012-07-02 11:55:13, End Time: 2012-07-02 14:10:29 To: 1693, Order: 159517, Start Time: 2012-07-02 09:12:45, End Time: 2012-07-02 11:28:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (25 on baseline) Performance Improvements: 0 (1 on baseline) Unchanged Tests: 894 (868 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 7.25% (0.3446 => 0.3696, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.19% (0.3465 => 0.3714, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/for-in: 7.09% (0.3496 => 0.3744, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.09% (0.3442 => 0.3686, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.05% (0.3460 => 0.3704, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.02% (0.3488 => 0.3733, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 6.95% (0.3469 => 0.3710, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.86% (0.3643 => 0.3893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.66% (0.3650 => 0.3893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.55% (0.3724 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.02% (0.5826 => 0.6060, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.85% (0.5889 => 0.6116, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.66% (0.5900 => 0.6057, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 2.54% (0.7171 => 0.7353, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.53% (0.5026 => 0.5153, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.36% (1.6211 => 1.6593, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.34% (0.4361 => 0.4463, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.18% (0.4994 => 0.5103, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.18% (3.5627 => 3.6404, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.78% (2.0673 => 2.1042, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.75% (1.3152 => 1.3382, std. dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 1.71% (4.2109 => 4.2829, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 1.68% (0.9909 => 1.0075, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.00% (1.9694 => 1.9891, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.96% (11.9555 => 11.6020, std. dev.: 0.0061) Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 07:38:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 09:38:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120702143810.F0F822A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1699?compare_to=1696&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1699, Order: 159527, Start Time: 2012-07-02 13:41:30, End Time: 2012-07-02 14:38:07 To: 1696, Order: 159522, Start Time: 2012-07-02 12:17:29, End Time: 2012-07-02 13:14:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (120 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (733 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.31% (25.8901 => 26.2287, std. dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 4.70% (2.2600 => 2.3662, std. dev.: 0.0066) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.07% (2.0176 => 2.2812, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.72% (0.5818 => 0.6267, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.50% (0.5748 => 0.6179, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.95% (0.7061 => 0.7552, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.01% (0.3130 => 0.3318, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.89% (0.4328 => 0.4583, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.83% (0.2781 => 0.2943, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.77% (0.2945 => 0.3115, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.76% (0.3022 => 0.3196, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.59% (0.4062 => 0.4289, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.2607 => 0.2749, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.43% (0.2690 => 0.2836, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.34% (0.1986 => 0.2092, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.31% (0.2937 => 0.3093, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.29% (0.2628 => 0.2767, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.28% (0.2726 => 0.2870, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.27% (1.3693 => 1.4415, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.16% (0.2966 => 0.3119, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.13% (1.9828 => 2.0845, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.3107 => 0.3265, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2696 => 0.2833, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.08% (0.3149 => 0.3309, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 5.04% (0.7038 => 0.7393, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.04% (0.3453 => 0.3627, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.99% (0.2988 => 0.3137, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.93% (0.2761 => 0.2897, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.2721 => 0.2855, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 4.86% (0.3192 => 0.3347, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.86% (0.4016 => 0.4211, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.77% (0.3293 => 0.3450, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.73% (0.7710 => 0.8075, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.73% (0.3489 => 0.3654, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.72% (0.3580 => 0.3749, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.72% (0.3899 => 0.4083, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.65% (0.5265 => 0.5510, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.59% (3.9660 => 4.1479, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.53% (0.3485 => 0.3643, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 4.53% (0.3578 => 0.3740, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.51% (0.2596 => 0.2713, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-2: 4.28% (0.3601 => 0.3755, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.27% (0.3868 => 0.4033, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 4.26% (0.3663 => 0.3819, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.24% (0.3534 => 0.3684, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 4.22% (0.3646 => 0.3800, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 4.22% (0.3914 => 0.4079, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 4.20% (0.3789 => 0.3948, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.17% (0.4003 => 0.4170, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.15% (0.3756 => 0.3912, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 4.14% (0.3623 => 0.3773, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.14% (0.3650 => 0.3801, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 3.98% (0.3940 => 0.4097, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.87% (0.6959 => 0.7228, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.80% (0.4390 => 0.4557, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 3.46% (13.8202 => 14.2989, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.37% (0.9199 => 0.9509, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.30% (1.2193 => 1.2595, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.2292 => 1.2685, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3755 => 0.3870, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.03% (0.5577 => 0.5746, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.96% (16.6129 => 17.1046, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.93% (1.1364 => 1.1697, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.91% (1.4563 => 1.4987, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.81% (1.3245 => 1.3617, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.80% (3.8646 => 3.9730, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.79% (4.9865 => 5.1257, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.76% (0.4379 => 0.4500, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.75% (0.5637 => 0.5792, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.71% (1.3819 => 1.4194, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.67% (1.3813 => 1.4182, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.67% (1.9270 => 1.9784, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 2.66% (0.7506 => 0.7706, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 2.59% (1.1061 => 1.1348, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.53% (1.0594 => 1.0862, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.37% (13.2842 => 13.5985, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.34% (7.2180 => 7.3872, std. dev.: 0.0107) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.25% (0.7460 => 0.7628, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.06% (0.8698 => 0.8877, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 1.99% (0.8310 => 0.8475, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.87% (14.8535 => 15.1309, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.86% (3.6692 => 3.7376, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 1.84% (2.1791 => 2.2192, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 1.77% (6.5754 => 6.6917, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.75% (4.3801 => 4.4567, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.63% (0.6135 => 0.6235, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.62% (4.4433 => 4.5152, std. dev.: 0.0088) MultiSource/Applications/d/make_dparser: 1.34% (3.1889 => 3.2315, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.28% (1.1333 => 1.1478, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 30.19% (1.8175 => 2.3662, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1912, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: 7.72% (1.2998 => 1.4002, std. dev.: 0.0078) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.91% (7.4271 => 7.7176, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6790, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8306, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.22% (12.0921 => 12.4809, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.96% (4.1080 => 4.1887, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (3.6469 => 3.7086, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.27% (9.0760 => 9.1915, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.13% (22.5627 => 20.9529, std. dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.22% (0.3511 => 0.3363, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.94% (0.8818 => 0.8559, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.88% (0.9108 => 0.8937, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.60% (0.6576 => 0.6471, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.09% (6.2785 => 6.2101, std. dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.56% (1.2308 => 1.1008, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.51% (20.3410 => 18.6093, std. dev.: 0.0499) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.46% (1.3780 => 1.3166, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5901, std. dev.: 0.0197) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.78% (6.6320 => 6.5138, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2561, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: -1.56% (3.0263 => 2.9792, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.48% (0.9692 => 0.9549, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4889, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.35% (9.3358 => 9.2101, std. dev.: 0.0190) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8441, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2543, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.00% (26.5159 => 26.2501, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 07:51:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 09:51:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120702145156.0FE472A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1700?compare_to=1697&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1700, Order: 159528, Start Time: 2012-07-02 13:50:49, End Time: 2012-07-02 14:51:52 To: 1697, Order: 159522, Start Time: 2012-07-02 12:22:09, End Time: 2012-07-02 13:23:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (40 on baseline) Performance Improvements: 0 (19 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 872 (814 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 2.75% (10.7838 => 11.0807, std. dev.: 0.0271) MultiSource/Benchmarks/PAQ8p/paq8p: 1.42% (13.1799 => 13.3667, std. dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.93% (10.3673 => 13.3667, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.49% (1.1194 => 1.2592, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.73% (0.3543 => 0.3817, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.43% (0.3473 => 0.3731, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.21% (1.7609 => 1.8879, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 7.21% (0.3497 => 0.3749, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.14% (0.3543 => 0.3796, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 7.05% (0.3561 => 0.3812, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.03% (0.3516 => 0.3763, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 6.77% (0.3694 => 0.3944, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.56% (0.3828 => 0.4079, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.43% (0.3886 => 0.4136, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.43% (2.2022 => 2.3438, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 6.42% (0.3927 => 0.4179, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.18% (10.4361 => 11.0807, std. dev.: 0.0271) SingleSource/UnitTests/ObjC++/property-reference-object: 4.26% (0.6030 => 0.6287, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/Hello: 4.12% (0.5925 => 0.6169, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.98% (7.0540 => 7.3345, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.57% (0.4879 => 0.5053, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.43% (0.3177 => 0.3286, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 3.41% (0.3282 => 0.3394, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.30% (0.7326 => 0.7568, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 2.57% (0.7433 => 0.7624, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (0.8172 => 0.8348, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.90% (0.5569 => 0.5675, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (5.0018 => 5.0845, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.63% (4.9449 => 5.0255, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.25% (8.1363 => 8.2377, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.13% (2.0665 => 2.0899, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.11% (4.2646 => 4.3120, std. dev.: 0.0136) MultiSource/Applications/hbd/hbd: 1.06% (1.5603 => 1.5769, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.06% (9.4845 => 9.5849, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9742, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7558, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 2.76% (26.0924 => 26.8133, std. dev.: 0.0237) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (1.5086 => 1.5364, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4472, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2315, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.21% (2.6546 => 2.6866, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1243, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.04% (5.2763 => 3.1636, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.47% (5.3855 => 3.6908, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.99% (5.3526 => 3.6939, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.47% (2.9384 => 2.5425, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -12.91% (22.1758 => 19.3119, std. dev.: 0.0184) SingleSource/UnitTests/Vector/constpool: -5.26% (54.1659 => 51.3141, std. dev.: 0.0237) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.40% (3.8922 => 3.7599, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.86% (0.8101 => 0.7950, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.44% (7.9617 => 7.8474, std. dev.: 0.0089) MultiSource/Applications/JM/lencod/lencod: -1.21% (21.9371 => 21.6723, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.56% (1.2373 => 1.1066, std. dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.30% (19.9488 => 18.4924, std. dev.: 0.0569) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (8.1563 => 7.9244, std. dev.: 0.0083) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6843, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0829, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 09:02:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 11:02:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120702160204.273842A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1701?compare_to=1699&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1701, Order: 159532, Start Time: 2012-07-02 15:05:18, End Time: 2012-07-02 16:02:00 To: 1699, Order: 159527, Start Time: 2012-07-02 13:41:30, End Time: 2012-07-02 14:38:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (116 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (736 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.83% (2.0176 => 2.2765, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.67% (0.5818 => 0.6264, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.39% (0.5748 => 0.6173, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.85% (0.7061 => 0.7545, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.15% (0.4328 => 0.4594, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.09% (0.3022 => 0.3206, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.06% (0.2607 => 0.2765, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.05% (0.2760 => 0.2927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.05% (0.2628 => 0.2787, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.04% (0.2945 => 0.3123, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2655 => 0.2813, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.95% (0.2690 => 0.2850, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.79% (0.2937 => 0.3107, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.79% (0.4062 => 0.4297, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.63% (1.3693 => 1.4464, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.60% (0.2696 => 0.2847, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.59% (0.1986 => 0.2097, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.50% (0.2726 => 0.2876, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.45% (1.9828 => 2.0909, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.3107 => 0.3274, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.36% (0.2761 => 0.2909, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.24% (0.3453 => 0.3634, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.21% (0.3149 => 0.3313, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.15% (0.2988 => 0.3142, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 5.14% (0.7038 => 0.7400, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.10% (0.3899 => 0.4098, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.08% (0.3485 => 0.3662, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.01% (0.7710 => 0.8096, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.96% (0.3489 => 0.3662, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 4.92% (0.3578 => 0.3754, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.91% (0.4016 => 0.4213, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.89% (0.3580 => 0.3755, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.89% (0.3192 => 0.3348, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.74% (0.3646 => 0.3819, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.73% (0.5265 => 0.5514, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-2: 4.67% (0.3601 => 0.3769, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.2596 => 0.2717, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.63% (0.3650 => 0.3819, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.62% (0.3789 => 0.3964, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 4.60% (0.4003 => 0.4187, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.59% (0.3663 => 0.3831, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.57% (0.3914 => 0.4093, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 4.53% (0.3623 => 0.3787, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.52% (0.3293 => 0.3442, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.44% (0.3940 => 0.4115, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.43% (3.9660 => 4.1418, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.33% (0.3534 => 0.3687, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.29% (0.3756 => 0.3917, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.21% (0.3868 => 0.4031, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.03% (0.4390 => 0.4567, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.92% (0.6959 => 0.7232, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.63% (13.8202 => 14.3213, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.51% (0.9199 => 0.9522, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3755 => 0.3881, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.27% (1.2292 => 1.2694, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.18% (1.2193 => 1.2581, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.17% (0.5577 => 0.5754, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 3.04% (16.6129 => 17.1177, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.90% (0.7506 => 0.7724, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.85% (1.3245 => 1.3623, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.81% (1.4563 => 1.4972, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 2.79% (3.8646 => 3.9724, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.76% (4.9865 => 5.1242, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.72% (1.1061 => 1.1362, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.62% (1.3819 => 1.4181, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1660, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.60% (1.9270 => 1.9771, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.48% (1.3813 => 1.4155, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 2.41% (1.0594 => 1.0849, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.7460 => 0.7635, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.29% (7.2180 => 7.3832, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.09% (0.8698 => 0.8880, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.02% (13.2842 => 13.5529, std. dev.: 0.0071) MultiSource/Applications/siod/siod: 1.94% (2.1791 => 2.2214, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 1.84% (0.8310 => 0.8463, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.70% (3.6692 => 3.7316, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 1.60% (6.5754 => 6.6804, std. dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 1.59% (14.8535 => 15.0895, std. dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.59% (4.3801 => 4.4496, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.53% (4.4433 => 4.5114, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.15% (3.1889 => 3.2255, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.15% (1.1333 => 1.1463, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.30% (0.1824 => 0.3544, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.03% (1.8175 => 2.2724, std. dev.: 0.0460) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1887, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: 8.19% (1.2998 => 1.4062, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.95% (0.9996 => 1.0791, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.02% (7.4271 => 7.7260, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9192, std. dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6779, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4800, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1895, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.93% (3.6469 => 3.7172, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4563, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5072, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1965, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.14% (0.4657 => 0.4045, std. dev.: 0.0112) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.23% (22.5627 => 20.9318, std. dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.27% (0.3511 => 0.3361, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.25% (0.8818 => 0.8531, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.01% (0.9108 => 0.8925, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.55% (0.6576 => 0.6474, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.20% (6.2785 => 6.2033, std. dev.: 0.0142) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.10% (1.2308 => 1.1065, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.86% (20.3410 => 18.5395, std. dev.: 0.0169) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.8259 => 8.5691, std. dev.: 0.0152) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2553, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: -1.54% (3.0263 => 2.9797, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8606, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.35% (28.2225 => 27.8411, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (0.9692 => 0.9564, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2347, std. dev.: 0.0083) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2598, std. dev.: 0.0020) MultiSource/Applications/lua/lua: -1.05% (26.5159 => 26.2377, std. dev.: 0.0281) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 09:20:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 11:20:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120702162024.A7ECC2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1702?compare_to=1700&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1702, Order: 159532, Start Time: 2012-07-02 15:19:15, End Time: 2012-07-02 16:20:20 To: 1700, Order: 159528, Start Time: 2012-07-02 13:50:49, End Time: 2012-07-02 14:51:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (39 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (816 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.87% (10.3673 => 13.3608, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.34% (1.1194 => 1.2575, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 7.52% (0.3473 => 0.3734, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.26% (1.7609 => 1.8887, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 7.22% (0.3561 => 0.3818, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.18% (0.3497 => 0.3748, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.11% (0.3543 => 0.3795, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.11% (0.3516 => 0.3766, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.06% (0.3543 => 0.3793, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 6.90% (0.3694 => 0.3949, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: 6.53% (0.3828 => 0.4078, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.51% (0.3886 => 0.4139, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 6.44% (0.3927 => 0.4180, std. dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.42% (2.2022 => 2.3436, std. dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 6.25% (10.4361 => 11.0880, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 4.26% (0.6030 => 0.6287, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.19% (0.5925 => 0.6173, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.91% (7.0540 => 7.3299, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.53% (0.4879 => 0.5051, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.43% (0.7326 => 0.7577, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 3.41% (0.3282 => 0.3394, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.31% (0.3177 => 0.3282, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.77% (0.7433 => 0.7639, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.97% (0.8172 => 0.8333, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.92% (0.5569 => 0.5676, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.71% (5.0018 => 5.0874, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.62% (4.9449 => 5.0251, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.49% (0.7835 => 0.7952, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.33% (8.1363 => 8.2447, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (9.4845 => 9.5889, std. dev.: 0.0152) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.09% (4.2646 => 4.3111, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9741, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7524, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 2.81% (26.0924 => 26.8244, std. dev.: 0.0350) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (1.5086 => 1.5374, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2393, std. dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6881, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1243, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.13% (5.2763 => 3.1590, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.43% (5.3855 => 3.6927, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.01% (5.3526 => 3.6927, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.58% (2.9384 => 2.5395, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -12.90% (22.1758 => 19.3161, std. dev.: 0.0078) SingleSource/UnitTests/Vector/constpool: -5.18% (54.1659 => 51.3619, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.46% (3.8922 => 3.7576, std. dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.40% (7.9617 => 7.8503, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: -1.21% (21.9371 => 21.6714, std. dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.05% (1.2373 => 1.1129, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.84% (19.9488 => 18.5844, std. dev.: 0.0350) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.87% (8.1563 => 7.9224, std. dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6799, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: -2.03% (10.2830 => 10.0742, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 09:53:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 11:53:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120702165306.8D50C2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1703?compare_to=1698&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1703, Order: 159530, Start Time: 2012-07-02 14:37:44, End Time: 2012-07-02 16:53:02 To: 1698, Order: 159521, Start Time: 2012-07-02 11:55:13, End Time: 2012-07-02 14:10:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (27 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (865 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 7.05% (0.3446 => 0.3689, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.99% (0.3460 => 0.3702, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.98% (0.3465 => 0.3707, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: 6.89% (0.3496 => 0.3737, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.80% (0.3442 => 0.3676, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 6.75% (0.3469 => 0.3703, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.74% (0.3488 => 0.3723, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 6.64% (0.3643 => 0.3885, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.63% (0.3650 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.34% (0.3724 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.91% (0.5826 => 0.6054, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.62% (0.5889 => 0.6102, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.66% (0.5900 => 0.6057, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.60% (1.6211 => 1.6632, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.51% (0.5026 => 0.5152, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.45% (0.4361 => 0.4468, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.35% (3.5627 => 3.6466, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 2.34% (0.7171 => 0.7339, std. dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.98% (4.2109 => 4.2941, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.84% (2.0673 => 2.1053, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.76% (1.3152 => 1.3383, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.17% (4.4195 => 4.4713, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.14% (2.7292 => 2.7602, std. dev.: 0.0046) MultiSource/Applications/d/make_dparser: 1.13% (1.0781 => 1.0903, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.12% (1.9694 => 1.9915, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.09% (1.9966 => 2.0184, std. dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.24% (2.4764 => 2.3715, std. dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: -2.92% (11.9555 => 11.6062, std. dev.: 0.0052) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 10:44:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 12:44:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120702174418.54B4A2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1704?compare_to=1701&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1704, Order: 159534, Start Time: 2012-07-02 16:47:32, End Time: 2012-07-02 17:44:13 To: 1701, Order: 159532, Start Time: 2012-07-02 15:05:18, End Time: 2012-07-02 16:02:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (120 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (734 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.68% (2.0176 => 2.2734, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.70% (0.5818 => 0.6266, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.43% (0.5748 => 0.6175, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.77% (0.7061 => 0.7539, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3022 => 0.3215, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.18% (0.2945 => 0.3127, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.01% (0.2760 => 0.2926, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.93% (0.2781 => 0.2946, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.90% (0.2782 => 0.2946, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.86% (0.2765 => 0.2927, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.80% (0.2655 => 0.2809, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.79% (0.2607 => 0.2758, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.79% (0.4062 => 0.4297, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.75% (0.2628 => 0.2779, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.59% (0.1986 => 0.2097, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.56% (1.3693 => 1.4455, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 5.54% (0.2726 => 0.2877, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.47% (0.3453 => 0.3642, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2761 => 0.2912, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.46% (1.9828 => 2.0911, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.43% (0.2966 => 0.3127, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.23% (0.7038 => 0.7406, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.21% (0.3149 => 0.3313, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.16% (0.3485 => 0.3665, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 5.09% (0.2988 => 0.3140, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.07% (0.3489 => 0.3666, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.03% (0.7710 => 0.8098, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.3899 => 0.4094, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.93% (0.2596 => 0.2724, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 4.92% (0.3578 => 0.3754, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.89% (0.3580 => 0.3755, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.88% (0.4016 => 0.4212, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.5265 => 0.5521, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 4.76% (0.3192 => 0.3344, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.73% (0.3914 => 0.4099, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.72% (0.4003 => 0.4192, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.71% (0.3650 => 0.3822, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 4.69% (0.3623 => 0.3793, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 4.67% (0.3601 => 0.3769, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.66% (0.3646 => 0.3816, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 4.64% (0.3663 => 0.3833, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.2721 => 0.2847, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.62% (0.3293 => 0.3445, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 4.57% (0.3940 => 0.4120, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 4.54% (0.3789 => 0.3961, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.50% (0.3534 => 0.3693, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.43% (3.9660 => 4.1416, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/moments: 4.34% (0.3868 => 0.4036, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.34% (0.3756 => 0.3919, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.21% (0.4390 => 0.4575, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.98% (0.6959 => 0.7236, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.2925 => 0.3031, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.62% (0.9199 => 0.9532, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.53% (13.8202 => 14.3077, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3755 => 0.3884, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.29% (1.2292 => 1.2697, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.2193 => 1.2580, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.14% (0.5577 => 0.5752, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.13% (1.3245 => 1.3659, std. dev.: 0.0043) MultiSource/Applications/Burg/burg: 3.12% (1.1061 => 1.1406, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.12% (4.9865 => 5.1420, std. dev.: 0.0231) MultiSource/Applications/kimwitu++/kc: 3.03% (16.6129 => 17.1170, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.00% (0.5637 => 0.5806, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.89% (0.7506 => 0.7723, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.84% (1.4563 => 1.4977, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 2.83% (3.8646 => 3.9738, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.80% (1.1364 => 1.1682, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.76% (1.3813 => 1.4194, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.76% (1.3819 => 1.4200, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.69% (0.4379 => 0.4497, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 2.67% (1.9270 => 1.9785, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.61% (0.7460 => 0.7655, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.50% (1.0594 => 1.0859, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.42% (7.2180 => 7.3927, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.35% (0.8698 => 0.8902, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (13.2842 => 13.5731, std. dev.: 0.0188) MultiSource/Applications/siod/siod: 2.05% (2.1791 => 2.2237, std. dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/football/football: 1.96% (0.8310 => 0.8473, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.78% (3.6692 => 3.7344, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.71% (4.4433 => 4.5191, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.67% (4.3801 => 4.4531, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 1.63% (14.8535 => 15.0952, std. dev.: 0.0125) MultiSource/Applications/JM/ldecod/ldecod: 1.57% (6.5754 => 6.6784, std. dev.: 0.0229) MultiSource/Applications/d/make_dparser: 1.24% (3.1889 => 3.2283, std. dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.18% (1.1333 => 1.1467, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.05% (1.8175 => 2.2727, std. dev.: 0.0477) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.30% (2.0200 => 2.1877, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 7.87% (1.2998 => 1.4021, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7322, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6790, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4803, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1913, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4560, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.67% (3.6469 => 3.7077, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5340, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5078, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.38% (1.9433 => 1.9701, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.09% (22.5627 => 20.9624, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.44% (0.3511 => 0.3355, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.47% (0.8818 => 0.8512, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.04% (0.9108 => 0.8922, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.78% (0.6576 => 0.6459, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.12% (6.2785 => 6.2081, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.62% (1.2308 => 1.1124, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.16% (20.3410 => 18.4772, std. dev.: 0.0901) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3152, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0105) SingleSource/UnitTests/Vector/multiplies: -3.61% (2.6470 => 2.5514, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.5997, std. dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4475, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5066, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2566, std. dev.: 0.0052) MultiSource/Applications/spiff/spiff: -1.49% (3.0263 => 2.9813, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8597, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.35% (28.2225 => 27.8426, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2523, std. dev.: 0.0036) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2258, std. dev.: 0.0149) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 10:48:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 12:48:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120702174851.BBB2E2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1705?compare_to=1702&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1705, Order: 159534, Start Time: 2012-07-02 16:47:43, End Time: 2012-07-02 17:48:47 To: 1702, Order: 159532, Start Time: 2012-07-02 15:19:15, End Time: 2012-07-02 16:20:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (41 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (814 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.61% (10.3673 => 13.2294, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.41% (1.1194 => 1.2583, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 7.49% (0.3473 => 0.3733, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.24% (1.7609 => 1.8884, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.23% (0.3497 => 0.3750, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.22% (0.3516 => 0.3770, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.17% (0.3543 => 0.3797, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.17% (0.3543 => 0.3797, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.16% (0.3561 => 0.3816, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.88% (0.3694 => 0.3948, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.78% (0.1622 => 0.1732, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.66% (0.3828 => 0.4083, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.59% (0.3886 => 0.4142, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.57% (0.3927 => 0.4185, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.50% (2.2022 => 2.3454, std. dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 6.04% (10.4361 => 11.0663, std. dev.: 0.0110) SingleSource/UnitTests/ObjC++/Hello: 4.39% (0.5925 => 0.6185, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 4.25% (0.6030 => 0.6286, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.00% (7.0540 => 7.3364, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/oourafft: 3.47% (0.3282 => 0.3396, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 3.47% (0.7326 => 0.7580, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.44% (0.4879 => 0.5047, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.31% (0.3177 => 0.3282, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 2.83% (0.7433 => 0.7643, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.09% (0.8172 => 0.8343, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.90% (0.5569 => 0.5675, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.67% (5.0018 => 5.0851, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.65% (4.9449 => 5.0263, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 1.60% (0.7835 => 0.7960, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.32% (8.1363 => 8.2440, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.14% (2.0665 => 2.0900, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.13% (4.2646 => 4.3130, std. dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 1.13% (9.4845 => 9.5919, std. dev.: 0.0135) MultiSource/Applications/treecc/treecc: 1.10% (2.0273 => 2.0496, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7481, std. dev.: 0.0090) MultiSource/Applications/lua/lua: 2.77% (26.0924 => 26.8139, std. dev.: 0.0117) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (1.5086 => 1.5373, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 1.42% (2.4116 => 2.4458, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2408, std. dev.: 0.0270) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.19% (2.6546 => 2.6862, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1244, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.06% (5.2763 => 3.1627, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.40% (5.3855 => 3.6942, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.02% (5.3526 => 3.6924, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.50% (2.9384 => 2.5417, std. dev.: 0.0169) MultiSource/Applications/ClamAV/clamscan: -12.85% (22.1758 => 19.3272, std. dev.: 0.0096) SingleSource/UnitTests/Vector/constpool: -5.23% (54.1659 => 51.3357, std. dev.: 0.0303) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.41% (3.8922 => 3.7595, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.68% (0.8101 => 0.7965, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.27% (7.9617 => 7.8606, std. dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -10.62% (1.2373 => 1.1059, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.96% (19.9488 => 18.5595, std. dev.: 0.0519) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (8.1563 => 7.9194, std. dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0845, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 12:08:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 14:08:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120702190815.309F72A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1706?compare_to=1704&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1706, Order: 159539, Start Time: 2012-07-02 18:11:29, End Time: 2012-07-02 19:08:10 To: 1704, Order: 159534, Start Time: 2012-07-02 16:47:32, End Time: 2012-07-02 17:44:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (120 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (733 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.18% (2.0176 => 2.2835, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.36% (0.5818 => 0.6188, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.23% (0.5748 => 0.6106, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.62% (0.7061 => 0.7458, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.55% (0.4328 => 0.4568, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.48% (0.7038 => 0.7424, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.2945 => 0.3105, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.39% (0.2782 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.22% (0.2607 => 0.2743, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.12% (0.2655 => 0.2791, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 5.11% (0.2781 => 0.2923, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (0.2628 => 0.2762, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.09% (0.2690 => 0.2827, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.06% (1.3693 => 1.4386, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.06% (0.7710 => 0.8100, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 5.05% (0.4062 => 0.4267, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.97% (0.2937 => 0.3083, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.2721 => 0.2855, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 4.77% (0.2726 => 0.2856, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.75% (0.2696 => 0.2824, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 4.74% (0.2761 => 0.2892, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.73% (0.5265 => 0.5514, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.62% (0.3899 => 0.4079, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary: 4.60% (0.3107 => 0.3250, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.60% (0.2760 => 0.2887, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.60% (0.3022 => 0.3161, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.55% (3.9660 => 4.1464, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 4.54% (0.3149 => 0.3292, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.52% (0.2966 => 0.3100, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.51% (0.2596 => 0.2713, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.45% (1.9828 => 2.0711, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.3489 => 0.3643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.41% (0.2765 => 0.2887, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.33% (0.3485 => 0.3636, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.27% (0.3580 => 0.3733, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.14% (0.3192 => 0.3324, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.08% (0.3453 => 0.3594, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.01% (0.3293 => 0.3425, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 3.97% (0.3578 => 0.3720, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.93% (0.4016 => 0.4174, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.6959 => 0.7231, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2988 => 0.3104, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions: 3.81% (0.3914 => 0.4063, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.76% (1.2193 => 1.2651, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 3.75% (0.4003 => 0.4153, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 3.73% (0.3646 => 0.3782, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.72% (0.3789 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.72% (0.3601 => 0.3735, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 3.71% (0.3663 => 0.3799, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.71% (0.3534 => 0.3665, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.70% (0.3650 => 0.3785, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.65% (13.8202 => 14.3243, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4390 => 0.4550, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 3.64% (0.3623 => 0.3755, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.62% (4.9865 => 5.1670, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.60% (0.9199 => 0.9530, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.57% (0.3756 => 0.3890, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 3.55% (0.3940 => 0.4080, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.52% (0.3868 => 0.4004, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (1.4563 => 1.5057, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.17% (0.5577 => 0.5754, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.03% (16.6129 => 17.1166, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.3245 => 1.3642, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.94% (0.5637 => 0.5803, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3755 => 0.3864, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.89% (3.8646 => 3.9763, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.86% (1.1364 => 1.1689, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.81% (1.3819 => 1.4208, std. dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.79% (0.4379 => 0.4501, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.78% (1.1061 => 1.1368, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.77% (1.9270 => 1.9804, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.76% (1.3813 => 1.4194, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 2.68% (0.7506 => 0.7707, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 2.60% (1.2292 => 1.2612, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.47% (0.7460 => 0.7644, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (13.2842 => 13.6099, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.34% (7.2180 => 7.3870, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.8310 => 0.8498, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.13% (2.1791 => 2.2256, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (0.8698 => 0.8873, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.96% (3.6692 => 3.7411, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.89% (14.8535 => 15.1335, std. dev.: 0.0136) MultiSource/Applications/JM/ldecod/ldecod: 1.85% (6.5754 => 6.6969, std. dev.: 0.0151) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.83% (4.3801 => 4.4604, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.76% (0.6135 => 0.6243, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.69% (4.4433 => 4.5186, std. dev.: 0.0099) MultiSource/Applications/d/make_dparser: 1.39% (3.1889 => 3.2333, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.29% (1.1333 => 1.1479, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.15% (1.2749 => 1.2895, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.85% (0.4846 => 0.6971, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.93% (1.8175 => 2.2706, std. dev.: 0.0305) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.57% (2.0200 => 2.1931, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4046, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7351, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4787, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4560, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.54% (3.6469 => 3.7030, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: 1.50% (1.9290 => 1.9580, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5079, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.13% (0.4657 => 0.3906, std. dev.: 0.0228) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.86% (22.5627 => 21.0138, std. dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.16% (0.3511 => 0.3365, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.07% (0.8818 => 0.8547, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.59% (0.9108 => 0.8963, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.15% (6.2785 => 6.2062, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1021, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.55% (20.3410 => 18.6014, std. dev.: 0.0400) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.38% (1.3780 => 1.3039, std. dev.: 0.0042) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.5998, std. dev.: 0.0138) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.76% (6.6320 => 6.5153, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2523, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.54% (3.0263 => 2.9798, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.51% (2.5254 => 2.4873, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8443, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2242, std. dev.: 0.0141) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8485, std. dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 12:18:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 14:18:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120702191851.692852A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1707?compare_to=1705&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1707, Order: 159540, Start Time: 2012-07-02 18:17:37, End Time: 2012-07-02 19:18:46 To: 1705, Order: 159534, Start Time: 2012-07-02 16:47:43, End Time: 2012-07-02 17:48:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (38 on baseline) Performance Improvements: 2 (19 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 869 (816 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.15% (13.2294 => 13.5133, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/power/power: 5.98% (1.1251 => 1.1924, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 1.04% (1.1059 => 1.1174, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -3.57% (11.0663 => 10.6713, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: -1.32% (0.7580 => 0.7480, std. dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.35% (10.3673 => 13.5133, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.38% (1.1194 => 1.2580, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 7.34% (0.3473 => 0.3728, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.31% (0.3516 => 0.3773, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-2: 7.18% (0.3497 => 0.3748, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.14% (0.3543 => 0.3796, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.05% (0.3561 => 0.3812, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.03% (0.3543 => 0.3792, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.85% (0.3694 => 0.3947, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.72% (0.3927 => 0.4191, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.66% (0.3828 => 0.4083, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.66% (1.7609 => 1.8781, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.56% (0.3886 => 0.4141, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.77% (2.2022 => 2.3293, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.49% (0.3177 => 0.3288, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.38% (7.0540 => 7.2926, std. dev.: 0.0271) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.26% (0.4879 => 0.5038, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.03% (0.7433 => 0.7658, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.89% (0.5925 => 0.6096, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 2.75% (0.6030 => 0.6196, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.35% (0.8172 => 0.8364, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.28% (0.5569 => 0.5696, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.25% (10.4361 => 10.6713, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 2.10% (0.7326 => 0.7480, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 1.66% (0.7835 => 0.7965, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.64% (4.9449 => 5.0260, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.54% (5.0018 => 5.0788, std. dev.: 0.0069) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.24% (4.2646 => 4.3176, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.18% (8.1363 => 8.2325, std. dev.: 0.0060) MultiSource/Applications/treecc/treecc: 1.17% (2.0273 => 2.0510, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 1.11% (9.4845 => 9.5899, std. dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7552, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 2.84% (26.0924 => 26.8333, std. dev.: 0.0248) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.81% (1.5086 => 1.5359, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4473, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6876, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1244, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.22% (5.2763 => 3.1543, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.78% (5.3855 => 3.6738, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.57% (5.3526 => 3.6626, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.38% (2.9384 => 2.5452, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -13.01% (22.1758 => 19.2901, std. dev.: 0.0290) SingleSource/UnitTests/Vector/constpool: -5.23% (54.1659 => 51.3346, std. dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.00% (3.8922 => 3.7755, std. dev.: 0.0157) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.76% (7.9617 => 7.8214, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.68% (0.8101 => 0.7965, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -1.27% (21.9371 => 21.6593, std. dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -9.69% (1.2373 => 1.1174, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.91% (19.9488 => 18.5707, std. dev.: 0.0828) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9203, std. dev.: 0.0094) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.51% (32.5116 => 31.6957, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0841, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 12:35:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 14:35:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120702193523.E96542A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1708?compare_to=1703&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1708, Order: 159534, Start Time: 2012-07-02 17:20:05, End Time: 2012-07-02 19:35:20 To: 1703, Order: 159530, Start Time: 2012-07-02 14:37:44, End Time: 2012-07-02 16:53:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (30 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (862 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.47% (2.0447 => 2.0953, std. dev.: 0.0138) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 7.20% (0.3488 => 0.3739, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 7.16% (0.3465 => 0.3713, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.11% (0.3460 => 0.3706, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.11% (0.3446 => 0.3691, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.07% (0.3496 => 0.3743, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.00% (0.3442 => 0.3683, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.92% (0.3469 => 0.3709, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 6.86% (0.3643 => 0.3893, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.66% (0.3650 => 0.3893, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 6.53% (0.3724 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.86% (0.5826 => 0.6051, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.58% (0.5889 => 0.6100, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.85% (0.5900 => 0.6068, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.55% (0.5026 => 0.5154, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.45% (1.6211 => 1.6608, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.38% (0.4361 => 0.4465, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.38% (0.7171 => 0.7342, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.36% (3.5627 => 3.6468, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.08% (0.4994 => 0.5098, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.89% (2.0673 => 2.1064, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 1.89% (0.9909 => 1.0096, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.86% (1.3152 => 1.3396, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 1.81% (4.2109 => 4.2871, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.28% (1.9694 => 1.9947, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.26% (2.7292 => 2.7637, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.18% (4.4195 => 4.4717, std. dev.: 0.0058) MultiSource/Applications/d/make_dparser: 1.17% (1.0781 => 1.0907, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.14% (1.9966 => 2.0194, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 1.05% (0.9697 => 0.9799, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.2122 => 0.2279, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.16% (2.4764 => 2.3734, std. dev.: 0.0204) MultiSource/Applications/kimwitu++/kc: -2.87% (11.9555 => 11.6128, std. dev.: 0.0048) Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 13:32:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 15:32:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120702203211.88BB02A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1709?compare_to=1706&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1709, Order: 159546, Start Time: 2012-07-02 19:35:27, End Time: 2012-07-02 20:32:06 To: 1706, Order: 159539, Start Time: 2012-07-02 18:11:29, End Time: 2012-07-02 19:08:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (734 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.08% (5.1670 => 5.1111, std. dev.: 0.0117) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.68% (2.0176 => 2.2735, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 6.92% (0.5748 => 0.6146, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.82% (0.5818 => 0.6215, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.12% (0.7061 => 0.7493, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.54% (0.1986 => 0.2096, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.46% (0.7710 => 0.8131, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 5.46% (0.7038 => 0.7422, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.31% (0.4328 => 0.4558, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.2945 => 0.3101, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.29% (0.2781 => 0.2928, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.19% (1.3693 => 1.4404, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.14% (0.2782 => 0.2925, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.01% (0.5265 => 0.5529, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.2721 => 0.2857, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 4.99% (0.2607 => 0.2737, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.97% (0.2655 => 0.2787, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.93% (0.2596 => 0.2724, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.93% (0.2760 => 0.2896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.87% (0.2690 => 0.2821, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.87% (0.2937 => 0.3080, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.85% (0.2765 => 0.2899, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.83% (0.2628 => 0.2755, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.74% (0.2761 => 0.2892, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.66% (0.2726 => 0.2853, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.65% (0.2966 => 0.3104, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.56% (0.2696 => 0.2819, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.54% (1.9828 => 2.0728, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3899 => 0.4074, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.47% (0.3107 => 0.3246, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.45% (3.9660 => 4.1423, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.3489 => 0.3643, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.41% (0.3580 => 0.3738, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3149 => 0.3287, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.34% (0.3453 => 0.3603, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.25% (0.3485 => 0.3633, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 4.19% (0.3578 => 0.3728, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.13% (0.4016 => 0.4182, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.12% (0.2988 => 0.3111, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.10% (0.3192 => 0.3323, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.04% (0.3914 => 0.4072, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.98% (16.6129 => 17.2748, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists: 3.95% (0.3293 => 0.3423, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.94% (0.3601 => 0.3743, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.92% (0.3646 => 0.3789, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.92% (0.3650 => 0.3793, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 3.89% (0.3623 => 0.3764, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.85% (0.3789 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 3.85% (0.3663 => 0.3804, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 3.85% (0.4003 => 0.4157, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.81% (0.3756 => 0.3899, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.76% (0.3534 => 0.3667, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 3.73% (0.3940 => 0.4087, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.70% (0.9199 => 0.9539, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.58% (0.5637 => 0.5839, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.56% (13.8202 => 14.3120, std. dev.: 0.1790) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.4390 => 0.4543, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.48% (0.5577 => 0.5771, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.39% (1.2193 => 1.2606, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 3.39% (0.3868 => 0.3999, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.29% (13.2842 => 13.7217, std. dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3246 => 0.3346, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.02% (1.3245 => 1.3645, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (1.4563 => 1.5002, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 2.99% (3.8646 => 3.9800, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.92% (1.3819 => 1.4223, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.92% (1.3813 => 1.4216, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.78% (1.2292 => 1.2634, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.68% (1.1364 => 1.1669, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.65% (0.4379 => 0.4495, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.58% (1.1061 => 1.1346, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.50% (4.9865 => 5.1111, std. dev.: 0.0117) MultiSource/Benchmarks/nbench/nbench: 2.48% (1.0594 => 1.0857, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.48% (0.7460 => 0.7645, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.44% (7.2180 => 7.3939, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8310 => 0.8488, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.86% (3.6692 => 3.7376, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 1.85% (2.1791 => 2.2194, std. dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: 1.79% (14.8535 => 15.1198, std. dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.70% (0.8698 => 0.8846, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 1.67% (6.5754 => 6.6850, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.66% (0.6135 => 0.6237, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.59% (4.3801 => 4.4499, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.59% (16.2614 => 16.5200, std. dev.: 0.0266) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.57% (4.4433 => 4.5130, std. dev.: 0.0055) MultiSource/Applications/ClamAV/clamscan: 1.26% (14.5298 => 14.7136, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.25% (1.1333 => 1.1475, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 25.72% (1.8175 => 2.2849, std. dev.: 0.0411) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1906, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 7.96% (1.2998 => 1.4033, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.93% (0.9996 => 1.0789, std. dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.84% (7.4271 => 7.7122, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6781, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4786, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (3.6469 => 3.7034, std. dev.: 0.0060) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.18% (1.9290 => 1.9517, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.13% (10.7476 => 10.8690, std. dev.: 0.0132) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.82% (0.4657 => 0.3967, std. dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.35% (22.5627 => 20.9050, std. dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.36% (0.3511 => 0.3358, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.06% (0.8818 => 0.8548, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.78% (0.9108 => 0.8946, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.57% (0.6576 => 0.6473, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.30% (6.2785 => 6.1966, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.63% (1.2308 => 1.1000, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.68% (20.3410 => 18.5756, std. dev.: 0.0535) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3162, std. dev.: 0.0068) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5871, std. dev.: 0.0143) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5046, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2579, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9828, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8446, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8660, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2160, std. dev.: 0.0205) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2530, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 13:49:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 15:49:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120702204900.7C2332A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/1710?compare_to=1707&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1710, Order: 159549, Start Time: 2012-07-02 19:47:52, End Time: 2012-07-02 20:48:56 To: 1707, Order: 159540, Start Time: 2012-07-02 18:17:37, End Time: 2012-07-02 19:18:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (37 on baseline) Performance Improvements: 0 (19 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (817 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.09% (10.3673 => 13.4868, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.54% (1.1194 => 1.2598, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.39% (0.3543 => 0.3805, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 7.00% (0.3473 => 0.3716, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.91% (0.3516 => 0.3759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.83% (0.3497 => 0.3736, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 6.75% (0.3543 => 0.3782, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.69% (1.7609 => 1.8787, std. dev.: 0.0097) SingleSource/UnitTests/ObjC/synchronized: 6.68% (0.3561 => 0.3799, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.52% (0.3694 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.40% (0.3828 => 0.4073, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 6.37% (0.3927 => 0.4177, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.28% (0.3886 => 0.4130, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.98% (2.2022 => 2.3339, std. dev.: 0.0094) SingleSource/UnitTests/ObjC++/Hello: 3.48% (0.5925 => 0.6131, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.39% (7.0540 => 7.2930, std. dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference-object: 3.33% (0.6030 => 0.6231, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.30% (0.4879 => 0.5040, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.03% (0.7433 => 0.7658, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 2.72% (0.7326 => 0.7525, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (0.8172 => 0.8332, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.94% (0.5569 => 0.5677, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 1.77% (10.4361 => 10.6213, std. dev.: 0.0225) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.63% (14.3668 => 14.6013, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.41% (4.9449 => 5.0147, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 1.40% (0.7835 => 0.7945, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.34% (5.0018 => 5.0687, std. dev.: 0.0044) MultiSource/Applications/treecc/treecc: 1.28% (2.0273 => 2.0533, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.11% (4.2646 => 4.3118, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7480, std. dev.: 0.0054) MultiSource/Applications/lua/lua: 2.64% (26.0924 => 26.7806, std. dev.: 0.0284) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (1.5086 => 1.5364, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2394, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6876, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1242, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.20% (5.2763 => 3.1551, std. dev.: 0.0097) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.73% (5.3855 => 3.6766, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.53% (5.3526 => 3.6648, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.27% (2.9384 => 2.5485, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -12.86% (22.1758 => 19.3243, std. dev.: 0.0258) SingleSource/UnitTests/Vector/constpool: -4.92% (54.1659 => 51.5009, std. dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.09% (3.8922 => 3.7721, std. dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.14% (7.9617 => 7.7915, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.88% (0.8101 => 0.7949, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -1.30% (21.9371 => 21.6523, std. dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.88% (1.2373 => 1.1150, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.95% (19.9488 => 18.5625, std. dev.: 0.0784) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.00% (8.1563 => 7.9118, std. dev.: 0.0110) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6859, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 14:56:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 16:56:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120702215607.CC23C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/1711?compare_to=1709&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1711, Order: 159578, Start Time: 2012-07-02 20:59:27, End Time: 2012-07-02 21:56:03 To: 1709, Order: 159546, Start Time: 2012-07-02 19:35:27, End Time: 2012-07-02 20:32:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (117 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (736 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.11% (1.1000 => 1.1122, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.17% (2.0176 => 2.2632, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 7.68% (0.5818 => 0.6265, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.53% (0.5748 => 0.6181, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.76% (0.7061 => 0.7538, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.04% (0.3130 => 0.3319, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 5.71% (0.4328 => 0.4575, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2945 => 0.3113, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.68% (0.2782 => 0.2940, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.54% (0.2781 => 0.2935, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2690 => 0.2835, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.35% (0.2655 => 0.2797, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.29% (0.4062 => 0.4277, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.26% (0.3022 => 0.3181, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2628 => 0.2766, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.14% (0.1986 => 0.2088, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.10% (0.2726 => 0.2865, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.08% (1.3693 => 1.4388, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.07% (0.2760 => 0.2900, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.04% (0.2696 => 0.2832, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.00% (0.2761 => 0.2899, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.97% (0.7038 => 0.7388, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.96% (0.2966 => 0.3113, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.92% (0.3453 => 0.3623, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.86% (1.9828 => 2.0792, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 4.83% (0.3107 => 0.3257, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.70% (0.3149 => 0.3297, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.69% (0.3899 => 0.4082, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.67% (0.3192 => 0.3341, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.58% (0.7710 => 0.8063, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.53% (0.4016 => 0.4198, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.5265 => 0.5502, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.49% (0.3293 => 0.3441, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.44% (0.3489 => 0.3644, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.43% (0.2596 => 0.2711, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 4.42% (0.3578 => 0.3736, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.39% (0.3914 => 0.4086, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.39% (0.3485 => 0.3638, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.34% (0.3756 => 0.3919, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2988 => 0.3116, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 4.28% (0.3623 => 0.3778, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.27% (0.3580 => 0.3733, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 4.20% (0.4003 => 0.4171, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.19% (0.3601 => 0.3752, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.18% (3.9660 => 4.1318, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/for-in: 4.14% (0.3789 => 0.3946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.14% (0.3646 => 0.3797, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.14% (0.3650 => 0.3801, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.12% (0.3663 => 0.3814, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 3.93% (0.3534 => 0.3673, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 3.91% (0.3940 => 0.4094, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.3868 => 0.4016, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.76% (0.4390 => 0.4555, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.65% (0.6959 => 0.7213, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 3.64% (16.6129 => 17.2182, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.9199 => 0.9517, std. dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 3.35% (13.8202 => 14.2830, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.19% (13.2842 => 13.7082, std. dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.03% (1.2193 => 1.2563, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.96% (0.3755 => 0.3866, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.89% (1.2292 => 1.2647, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.80% (0.5577 => 0.5733, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.69% (4.9865 => 5.1208, std. dev.: 0.0206) MultiSource/Applications/spiff/spiff: 2.64% (0.7506 => 0.7704, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (1.4563 => 1.4947, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.63% (1.3245 => 1.3593, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/gs/gs: 2.62% (3.8646 => 3.9659, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.59% (0.5637 => 0.5783, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 2.54% (1.9270 => 1.9759, std. dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.53% (0.4379 => 0.4490, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (1.1364 => 1.1638, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 2.34% (1.1061 => 1.1320, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.34% (1.3819 => 1.4142, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.33% (1.3813 => 1.4135, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 2.26% (1.0594 => 1.0833, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.15% (7.2180 => 7.3730, std. dev.: 0.0080) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.10% (0.7460 => 0.7617, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 1.89% (0.8310 => 0.8467, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.78% (0.8698 => 0.8853, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.61% (3.6692 => 3.7283, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 1.60% (14.8535 => 15.0908, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.45% (4.3801 => 4.4436, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 1.45% (6.5754 => 6.6705, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 1.36% (16.2614 => 16.4825, std. dev.: 0.0194) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.35% (4.4433 => 4.5032, std. dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.12% (1.1333 => 1.1460, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.05% (14.5298 => 14.6826, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2635, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1892, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 7.71% (1.2998 => 1.4000, std. dev.: 0.0133) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7191, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9194, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6782, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4783, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.87% (1.4298 => 1.4565, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.59% (3.6469 => 3.7049, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5089 => 1.5328, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.15% (1.9290 => 1.9512, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.40% (0.4657 => 0.3940, std. dev.: 0.0179) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.29% (22.5627 => 20.9179, std. dev.: 0.0218) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.24% (0.3511 => 0.3362, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.12% (0.8818 => 0.8543, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.87% (0.9108 => 0.8938, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.33% (6.2785 => 6.1949, std. dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.64% (1.2308 => 1.1122, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.52% (20.3410 => 18.6070, std. dev.: 0.0132) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.14% (1.3780 => 1.3209, std. dev.: 0.0099) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6043, std. dev.: 0.0208) SingleSource/Benchmarks/Dhrystone/dry: -2.51% (2.5089 => 2.4460, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5057, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2551, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: -1.55% (3.0263 => 2.9795, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8435, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2486, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.20% (0.9692 => 0.9576, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2334, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8468, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 15:18:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 17:18:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120702221809.4F6D72A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/1712?compare_to=1708&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1712, Order: 159563, Start Time: 2012-07-02 20:02:39, End Time: 2012-07-02 22:18:05 To: 1708, Order: 159534, Start Time: 2012-07-02 17:20:05, End Time: 2012-07-02 19:35:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (34 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 894 (858 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 8.23% (0.3465 => 0.3750, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.20% (0.3488 => 0.3774, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.18% (0.3446 => 0.3728, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: 8.15% (0.3496 => 0.3781, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.12% (0.3460 => 0.3741, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.07% (0.3469 => 0.3749, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.05% (0.3442 => 0.3719, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.85% (0.3643 => 0.3929, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 7.67% (0.3650 => 0.3930, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.55% (0.3724 => 0.4005, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.46% (0.5826 => 0.6086, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 4.11% (0.5889 => 0.6131, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.36% (0.7171 => 0.7412, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.18% (1.6211 => 1.6726, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (0.5026 => 0.5182, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.00% (3.5627 => 3.6696, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.77% (0.4361 => 0.4482, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.66% (0.5900 => 0.6057, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 2.65% (4.2109 => 4.3224, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: 2.58% (0.4029 => 0.4133, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.42% (1.3152 => 1.3470, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.34% (0.5000 => 0.5117, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.32% (0.4994 => 0.5110, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.08% (2.0673 => 2.1102, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 1.98% (0.9909 => 1.0105, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.84% (4.4195 => 4.5007, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.77% (1.9694 => 2.0042, std. dev.: 0.0071) MultiSource/Applications/d/make_dparser: 1.74% (1.0781 => 1.0969, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.69% (2.7292 => 2.7754, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (1.9966 => 2.0296, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.42% (2.1653 => 2.1960, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.35% (1.8794 => 1.9047, std. dev.: 0.0085) MultiSource/Applications/SPASS/SPASS: 1.28% (5.5417 => 5.6128, std. dev.: 0.0095) MultiSource/Applications/JM/lencod/lencod: 1.25% (4.6177 => 4.6755, std. dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.48% (2.4764 => 2.3655, std. dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: -2.63% (11.9555 => 11.6408, std. dev.: 0.0039) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 15:19:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 17:19:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120702221909.3D8432A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/1713?compare_to=1710&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1713, Order: 159581, Start Time: 2012-07-02 21:17:50, End Time: 2012-07-02 22:19:05 To: 1710, Order: 159549, Start Time: 2012-07-02 19:47:52, End Time: 2012-07-02 20:48:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (53 on baseline) Performance Improvements: 1 (17 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 870 (803 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (0.8332 => 0.8473, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (10.6213 => 10.7310, std. dev.: 0.0080) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.03% (7.7915 => 7.8718, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.07% (13.4868 => 13.3431, std. dev.: 0.0115) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.70% (10.3673 => 13.3431, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.60% (1.1194 => 1.2604, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.72% (0.3473 => 0.3741, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.69% (1.7609 => 1.8964, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.59% (0.3543 => 0.3812, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 7.52% (0.3497 => 0.3760, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.48% (0.3516 => 0.3779, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.42% (0.3543 => 0.3806, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.30% (0.3561 => 0.3821, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.15% (0.3694 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.97% (0.3828 => 0.4095, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.82% (0.3927 => 0.4195, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.82% (0.3886 => 0.4151, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.35% (2.2022 => 2.3420, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.13% (0.2065 => 0.2171, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 4.25% (0.5925 => 0.6177, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.17% (7.0540 => 7.3483, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.06% (0.4879 => 0.5077, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.87% (0.3177 => 0.3300, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.68% (0.8172 => 0.8473, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 3.45% (0.6030 => 0.6238, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 3.20% (0.3282 => 0.3387, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.18% (0.7433 => 0.7669, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 2.91% (0.7326 => 0.7539, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (10.4361 => 10.7310, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.68% (0.5569 => 0.5718, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.51% (0.5860 => 0.6007, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.28% (0.4615 => 0.4720, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.13% (14.3668 => 14.6732, std. dev.: 0.0092) MultiSource/Applications/spiff/spiff: 2.12% (0.7835 => 0.8001, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.96% (4.9449 => 5.0417, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.94% (5.0018 => 5.0990, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.66% (8.1363 => 8.2714, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.58% (4.2646 => 4.3319, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 1.54% (2.0273 => 2.0586, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 1.45% (9.4845 => 9.6219, std. dev.: 0.0205) MultiSource/Applications/d/make_dparser: 1.34% (3.3354 => 3.3802, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.32% (17.1811 => 17.4080, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.29% (0.9765 => 0.9891, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.28% (1.5415 => 1.5612, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.15% (1.3050 => 1.3200, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 1.11% (3.8723 => 3.9152, std. dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7591 => 5.8227, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.08% (2.0665 => 2.0889, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.07% (1.5603 => 1.5770, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7510, std. dev.: 0.0035) MultiSource/Applications/lua/lua: 2.85% (26.0924 => 26.8365, std. dev.: 0.0298) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (1.5086 => 1.5370, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2358, std. dev.: 0.0301) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.29% (2.6546 => 2.6889, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1255, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.05% (0.8651 => 0.1726, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.86% (5.2763 => 3.1733, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.40% (5.3855 => 3.6946, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.07% (5.3526 => 3.6898, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.60% (2.9384 => 2.5388, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -12.47% (22.1758 => 19.4113, std. dev.: 0.0251) SingleSource/UnitTests/Vector/constpool: -5.32% (54.1659 => 51.2869, std. dev.: 0.0638) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.04% (3.8922 => 3.7737, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.13% (7.9617 => 7.8718, std. dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.94% (1.2373 => 1.1143, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.68% (19.9488 => 18.6156, std. dev.: 0.0300) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9149, std. dev.: 0.0079) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6782, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0850, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 16:19:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 18:19:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120702231955.88E5F2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1714?compare_to=1711&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1714, Order: 159598, Start Time: 2012-07-02 22:23:15, End Time: 2012-07-02 23:19:51 To: 1711, Order: 159578, Start Time: 2012-07-02 20:59:27, End Time: 2012-07-02 21:56:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (115 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (738 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/Hello: -1.63% (0.6181 => 0.6080, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.86% (2.0176 => 2.2771, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.10% (0.5818 => 0.6173, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.78% (0.5748 => 0.6080, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.44% (0.7061 => 0.7445, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 5.43% (0.7038 => 0.7420, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 5.29% (0.4328 => 0.4557, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (0.2945 => 0.3098, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.18% (0.2781 => 0.2925, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 5.08% (1.3693 => 1.4389, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.96% (0.3022 => 0.3172, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 4.85% (0.4062 => 0.4259, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.82% (0.2782 => 0.2916, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.81% (0.2721 => 0.2852, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 4.77% (0.2726 => 0.2856, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 4.64% (0.2760 => 0.2888, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.59% (0.2966 => 0.3102, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.57% (0.3107 => 0.3249, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.54% (0.3149 => 0.3292, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.54% (0.2690 => 0.2812, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.52% (0.2765 => 0.2890, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 4.49% (0.2761 => 0.2885, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.49% (0.2607 => 0.2724, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.48% (0.2655 => 0.2774, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.46% (0.5265 => 0.5500, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wc: 4.46% (0.2937 => 0.3068, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.44% (0.7710 => 0.8052, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.42% (1.9828 => 2.0705, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.39% (0.2596 => 0.2710, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 4.34% (0.2628 => 0.2742, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.33% (0.3899 => 0.4068, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.30% (3.9660 => 4.1366, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.30% (0.3489 => 0.3639, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.17% (0.3453 => 0.3597, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.15% (0.2696 => 0.2808, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.11% (0.3580 => 0.3727, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 3.99% (16.6129 => 17.2765, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.99% (0.3485 => 0.3624, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.88% (0.3192 => 0.3316, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 3.82% (0.2988 => 0.3102, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.81% (0.6959 => 0.7224, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.4016 => 0.4166, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.73% (0.3756 => 0.3896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.65% (0.3534 => 0.3663, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.61% (0.3293 => 0.3412, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.54% (0.3868 => 0.4005, std. dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 3.51% (13.8202 => 14.3049, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9199 => 0.9508, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.25% (13.2842 => 13.7158, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.23% (0.4390 => 0.4532, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (1.2193 => 1.2571, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.94% (0.5577 => 0.5741, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 2.88% (0.3578 => 0.3681, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.86% (1.4563 => 1.4979, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions: 2.84% (0.3914 => 0.4025, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 2.82% (0.4003 => 0.4116, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 2.77% (0.3646 => 0.3747, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (3.8646 => 3.9714, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 2.72% (0.3789 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 2.69% (0.3940 => 0.4046, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.69% (1.3245 => 1.3601, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.62% (4.9865 => 5.1169, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1660, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.58% (1.9270 => 1.9768, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.54% (1.2292 => 1.2604, std. dev.: 0.0096) MultiSource/Applications/spiff/spiff: 2.48% (0.7506 => 0.7692, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 2.41% (1.1061 => 1.1328, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.39% (1.0594 => 1.0847, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.35% (0.4379 => 0.4482, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.27% (1.3819 => 1.4133, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.19% (1.3813 => 1.4116, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.17% (0.7460 => 0.7622, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.08% (7.2180 => 7.3684, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 1.94% (0.8310 => 0.8471, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.76% (0.8698 => 0.8851, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.72% (2.1791 => 2.2166, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 1.65% (6.5754 => 6.6840, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.60% (3.6692 => 3.7280, std. dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 1.58% (14.8535 => 15.0888, std. dev.: 0.0155) MultiSource/Applications/sqlite3/sqlite3: 1.58% (16.2614 => 16.5184, std. dev.: 0.0079) MultiSource/Applications/d/make_dparser: 1.29% (3.1889 => 3.2301, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.29% (4.3801 => 4.4366, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.27% (4.4433 => 4.4998, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.16% (1.1333 => 1.1464, std. dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: 1.03% (14.5298 => 14.6800, std. dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.49% (1.8175 => 2.2626, std. dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1893, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: 8.26% (1.2998 => 1.4071, std. dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.00% (7.4271 => 7.7239, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9199, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4787, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.67% (3.6469 => 3.7077, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.59% (1.5089 => 1.5329, std. dev.: 0.0031) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.06% (0.4657 => 0.3909, std. dev.: 0.0196) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.02% (22.5627 => 20.9778, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.36% (0.3511 => 0.3358, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.86% (0.9108 => 0.8939, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.64% (0.6576 => 0.6468, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.56% (6.2785 => 6.1805, std. dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.66% (1.2308 => 1.1119, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.56% (20.3410 => 18.6005, std. dev.: 0.0480) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5933, std. dev.: 0.0123) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: -2.25% (0.4533 => 0.4431, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5065, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2555, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8599, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9828, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4902, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8432, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2177, std. dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std. dev.: 0.0032) MultiSource/Applications/lua/lua: -1.02% (26.5159 => 26.2452, std. dev.: 0.0195) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 16:47:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 18:47:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120702234739.926D22A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1715?compare_to=1713&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1715, Order: 159606, Start Time: 2012-07-02 22:46:26, End Time: 2012-07-02 23:47:34 To: 1713, Order: 159581, Start Time: 2012-07-02 21:17:50, End Time: 2012-07-02 22:19:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (37 on baseline) Performance Improvements: 2 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 872 (818 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.14% (13.3431 => 13.0573, std. dev.: 0.0112) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.61% (0.8473 => 0.8337, std. dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.95% (10.3673 => 13.0573, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.23% (1.1194 => 1.2563, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.38% (1.7609 => 1.8909, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.31% (0.3543 => 0.3802, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.97% (0.3473 => 0.3715, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.75% (0.3497 => 0.3733, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.75% (0.3543 => 0.3782, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.74% (0.3516 => 0.3753, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.60% (0.3561 => 0.3796, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.47% (0.3694 => 0.3933, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 6.30% (0.3828 => 0.4069, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.26% (0.3927 => 0.4173, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 6.12% (0.3886 => 0.4124, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.79% (2.2022 => 2.3298, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 3.67% (0.6030 => 0.6251, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.65% (0.5925 => 0.6141, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.53% (7.0540 => 7.3029, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.26% (0.4879 => 0.5038, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.21% (0.3177 => 0.3279, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 2.85% (0.7326 => 0.7535, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.74% (0.7433 => 0.7637, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 2.35% (10.4361 => 10.6811, std. dev.: 0.0123) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.02% (0.8172 => 0.8337, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.83% (0.5569 => 0.5671, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.76% (14.3668 => 14.6193, std. dev.: 0.0135) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.38% (4.9449 => 5.0131, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.34% (5.0018 => 5.0686, std. dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 1.18% (17.1811 => 17.3832, std. dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.03% (8.1363 => 8.2205, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.02% (4.2646 => 4.3083, std. dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 5.75% (1.1277 => 1.1925, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.00% (3.6395 => 3.7487, std. dev.: 0.0054) MultiSource/Applications/lua/lua: 2.73% (26.0924 => 26.8047, std. dev.: 0.0185) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4463, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2403, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.29% (2.6546 => 2.6889, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.15% (6.6874 => 0.1238, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.17% (5.2763 => 3.1567, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.66% (5.3855 => 3.6804, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.49% (5.3526 => 3.6671, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.66% (2.9384 => 2.5371, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -12.70% (22.1758 => 19.3588, std. dev.: 0.0163) SingleSource/UnitTests/Vector/constpool: -5.13% (54.1659 => 51.3863, std. dev.: 0.0951) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.20% (3.8922 => 3.7677, std. dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.07% (7.9617 => 7.7969, std. dev.: 0.0096) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.95% (0.8101 => 0.7943, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2373 => 1.1159, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.51% (19.9488 => 18.6497, std. dev.: 0.0226) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9202, std. dev.: 0.0093) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6803, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0848, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 17:43:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 19:43:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120703004355.421F02A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1716?compare_to=1714&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1716, Order: 159615, Start Time: 2012-07-02 23:47:03, End Time: 2012-07-03 00:43:50 To: 1714, Order: 159598, Start Time: 2012-07-02 22:23:15, End Time: 2012-07-02 23:19:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (124 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (729 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.39% (2.0176 => 2.2878, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: 7.24% (0.5818 => 0.6239, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 7.05% (0.5748 => 0.6153, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.63% (0.7061 => 0.7529, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.94% (0.4328 => 0.4585, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.83% (0.2781 => 0.2943, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2945 => 0.3113, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 5.57% (0.7038 => 0.7430, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.52% (1.3693 => 1.4449, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2966 => 0.3123, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 5.27% (0.4062 => 0.4276, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.23% (0.3022 => 0.3180, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.18% (0.2721 => 0.2862, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.10% (0.2782 => 0.2924, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.07% (0.2760 => 0.2900, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.1986 => 0.2086, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 5.02% (0.2607 => 0.2738, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.00% (0.2761 => 0.2899, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.99% (0.3107 => 0.3262, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.97% (0.2655 => 0.2787, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.88% (0.5265 => 0.5522, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 4.87% (0.2690 => 0.2821, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.86% (0.3149 => 0.3302, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 4.77% (0.2937 => 0.3077, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.76% (0.2628 => 0.2753, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.76% (1.9828 => 2.0771, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.75% (0.3580 => 0.3750, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.73% (0.3489 => 0.3654, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.67% (3.9660 => 4.1513, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 4.66% (0.3453 => 0.3614, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.2596 => 0.2717, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.62% (0.3899 => 0.4079, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.60% (0.7710 => 0.8065, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.53% (0.2696 => 0.2818, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (0.3485 => 0.3642, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.50% (0.3534 => 0.3693, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.43% (0.4016 => 0.4194, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.32% (16.6129 => 17.3308, std. dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/matrix: 4.32% (0.2988 => 0.3117, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary2: 4.26% (0.3192 => 0.3328, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (0.3756 => 0.3915, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.15% (0.6959 => 0.7248, std. dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 4.13% (13.8202 => 14.3905, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/lists: 4.10% (0.3293 => 0.3428, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 4.02% (0.3578 => 0.3722, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 3.97% (0.4003 => 0.4162, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.96% (0.3914 => 0.4069, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.87% (0.4390 => 0.4560, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 3.86% (0.3623 => 0.3763, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.85% (0.3868 => 0.4017, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 3.81% (0.3646 => 0.3785, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: 3.78% (0.3601 => 0.3737, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 3.74% (0.3663 => 0.3800, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 3.73% (0.3940 => 0.4087, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.73% (0.3650 => 0.3786, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 3.72% (0.3789 => 0.3930, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.72% (13.2842 => 13.7778, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.67% (0.9199 => 0.9537, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.64% (0.5577 => 0.5780, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.43% (1.2193 => 1.2611, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (4.9865 => 5.1505, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.11% (0.3246 => 0.3347, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (1.4563 => 1.5009, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.3245 => 1.3643, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 3.00% (3.8646 => 3.9804, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5637 => 0.5804, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.91% (1.9270 => 1.9831, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (1.1364 => 1.1694, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.88% (1.2292 => 1.2646, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 2.86% (1.1061 => 1.1377, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3755 => 0.3861, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.80% (1.0594 => 1.0891, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.79% (0.4379 => 0.4501, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.77% (0.7506 => 0.7714, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.75% (1.3813 => 1.4193, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.72% (1.3819 => 1.4195, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.55% (0.7460 => 0.7650, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.39% (7.2180 => 7.3902, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 2.32% (0.8310 => 0.8503, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 2.20% (2.1791 => 2.2271, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.13% (0.8698 => 0.8883, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.08% (3.6692 => 3.7457, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 1.91% (6.5754 => 6.7010, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 1.87% (14.8535 => 15.1317, std. dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 1.84% (16.2614 => 16.5604, std. dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.73% (0.6135 => 0.6241, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 1.69% (3.1889 => 3.2427, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.68% (4.3801 => 4.4536, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.52% (4.4433 => 4.5107, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.45% (1.1333 => 1.1497, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 1.31% (14.5298 => 14.7206, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.1007 => 2.1232, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2603, std. dev.: 0.0421) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1922, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.90% (0.9996 => 1.0786, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: 7.45% (1.2998 => 1.3966, std. dev.: 0.0082) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.78% (7.4271 => 7.7081, std. dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9222, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6794, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4804, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1897, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5345, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.57% (3.6469 => 3.7042, std. dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.54% (22.5627 => 21.0876, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.62% (0.3511 => 0.3384, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.99% (0.8818 => 0.8554, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.66% (0.9108 => 0.8957, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.14% (6.2785 => 6.2068, std. dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2308 => 1.1047, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.17% (20.3410 => 18.4761, std. dev.: 0.0631) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0219) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9830, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5838, std. dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5059, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2555, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: -1.57% (3.0263 => 2.9788, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.48% (2.5254 => 2.4879, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8433, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2176, std. dev.: 0.0178) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8682, std. dev.: 0.0167) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2511, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8480, std. dev.: 0.0048) MultiSource/Applications/lua/lua: -1.02% (26.5159 => 26.2450, std. dev.: 0.0498) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 18:00:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 20:00:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120703010041.BA7EC2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1717?compare_to=1712&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1717, Order: 159605, Start Time: 2012-07-02 22:45:18, End Time: 2012-07-03 01:00:37 To: 1712, Order: 159563, Start Time: 2012-07-02 20:02:39, End Time: 2012-07-02 22:18:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (26 on baseline) Performance Improvements: 0 (3 on baseline) Unchanged Tests: 894 (865 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 6.39% (0.3460 => 0.3681, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.38% (0.3465 => 0.3686, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.36% (0.3446 => 0.3665, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.35% (0.3496 => 0.3718, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.30% (0.3442 => 0.3659, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.22% (0.3488 => 0.3705, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 6.20% (0.3469 => 0.3684, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.15% (0.3643 => 0.3867, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 6.08% (0.3650 => 0.3872, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.99% (0.3724 => 0.3947, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 2.85% (0.5826 => 0.5992, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.79% (1.6211 => 1.6663, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.75% (0.5900 => 0.6062, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.61% (0.5026 => 0.5157, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.57% (3.5627 => 3.6543, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.50% (0.4361 => 0.4470, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 2.45% (0.5889 => 0.6033, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.18% (4.2109 => 4.3025, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference: 1.94% (0.7171 => 0.7310, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.89% (1.3152 => 1.3401, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.41% (0.9909 => 1.0049, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.34% (2.0673 => 2.0951, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.15% (1.0781 => 1.0905, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.06% (4.4195 => 4.4665, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.05% (1.9694 => 1.9900, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.45% (0.2122 => 0.2280, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.61% (2.4764 => 2.3623, std. dev.: 0.0082) MultiSource/Applications/kimwitu++/kc: -3.01% (11.9555 => 11.5952, std. dev.: 0.0212) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.08% (4.6926 => 4.6418, std. dev.: 0.0179) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 18:16:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 20:16:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120703011621.0E3102A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1718?compare_to=1715&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1718, Order: 159626, Start Time: 2012-07-03 00:15:00, End Time: 2012-07-03 01:16:15 To: 1715, Order: 159606, Start Time: 2012-07-02 22:46:26, End Time: 2012-07-02 23:47:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (36 on baseline) Performance Improvements: 0 (19 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (818 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.40% (13.0573 => 13.3713, std. dev.: 0.0131) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.98% (10.3673 => 13.3713, std. dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.39% (1.1194 => 1.2581, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.23% (1.7609 => 1.8883, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: 6.36% (0.3473 => 0.3694, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.23% (0.3497 => 0.3715, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.15% (0.3543 => 0.3761, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.09% (0.3516 => 0.3730, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.07% (0.3561 => 0.3777, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.01% (0.3543 => 0.3756, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 5.90% (0.3694 => 0.3912, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.65% (0.3927 => 0.4149, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.63% (2.2022 => 2.3261, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 5.62% (0.3828 => 0.4043, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.61% (0.3886 => 0.4104, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.44% (7.0540 => 7.2970, std. dev.: 0.0131) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.23% (0.8172 => 0.8436, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.09% (0.4879 => 0.5030, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 2.92% (0.7433 => 0.7650, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 2.85% (0.5925 => 0.6094, std. dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference-object: 2.72% (0.6030 => 0.6194, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.51% (0.4615 => 0.4731, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.31% (10.4361 => 10.6770, std. dev.: 0.0082) SingleSource/UnitTests/ObjC++/property-reference: 2.21% (0.7326 => 0.7488, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.85% (0.5569 => 0.5672, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.74% (14.3668 => 14.6171, std. dev.: 0.0308) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.45% (4.9449 => 5.0164, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.43% (5.0018 => 5.0733, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.11% (8.1363 => 8.2266, std. dev.: 0.0124) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.07% (4.2646 => 4.3101, std. dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7541, std. dev.: 0.0079) MultiSource/Applications/lua/lua: 2.70% (26.0924 => 26.7966, std. dev.: 0.0309) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2413, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6874, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1244, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.99% (5.2763 => 3.1662, std. dev.: 0.0114) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.90% (5.3855 => 3.6673, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.65% (5.3526 => 3.6587, std. dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.58% (2.9384 => 2.5394, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -12.94% (22.1758 => 19.3064, std. dev.: 0.0091) SingleSource/UnitTests/Vector/constpool: -5.25% (54.1659 => 51.3200, std. dev.: 0.0821) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.08% (3.8922 => 3.7725, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.01% (0.8101 => 0.7938, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.69% (7.9617 => 7.8275, std. dev.: 0.0130) MultiSource/Applications/JM/lencod/lencod: -1.40% (21.9371 => 21.6307, std. dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.16% (1.2373 => 1.1116, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.41% (19.9488 => 18.4715, std. dev.: 0.0912) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.83% (8.1563 => 7.9255, std. dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6885, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 19:07:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 21:07:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120703020739.823CB2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1719?compare_to=1716&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1719, Order: 159631, Start Time: 2012-07-03 01:11:01, End Time: 2012-07-03 02:07:35 To: 1716, Order: 159615, Start Time: 2012-07-02 23:47:03, End Time: 2012-07-03 00:43:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (121 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (732 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.91% (2.0176 => 2.2781, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.00% (0.5818 => 0.6167, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.79% (0.5748 => 0.6081, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.45% (0.7061 => 0.7446, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.10% (0.7038 => 0.7397, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (0.4328 => 0.4541, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.82% (0.5265 => 0.5519, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.82% (0.2781 => 0.2915, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.76% (1.3693 => 1.4345, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2721 => 0.2850, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.72% (0.2945 => 0.3084, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.60% (0.2782 => 0.2910, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.53% (0.4062 => 0.4246, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.51% (0.2596 => 0.2713, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.48% (0.2655 => 0.2774, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hello: 4.45% (0.2607 => 0.2723, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.42% (0.2690 => 0.2809, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.40% (3.9660 => 4.1405, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.38% (0.7710 => 0.8048, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/fibo: 4.38% (0.2628 => 0.2743, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.32% (0.2937 => 0.3064, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.24% (0.3022 => 0.3150, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.23% (0.2765 => 0.2882, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.22% (0.2726 => 0.2841, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2760 => 0.2876, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.12% (0.2696 => 0.2807, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.06% (0.3107 => 0.3233, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.03% (0.3899 => 0.4056, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.01% (0.2966 => 0.3085, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.98% (0.2761 => 0.2871, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.95% (1.9828 => 2.0611, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.90% (0.3485 => 0.3621, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.87% (0.3149 => 0.3271, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.85% (0.3453 => 0.3586, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.78% (0.3489 => 0.3621, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.77% (0.3580 => 0.3715, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.76% (0.6959 => 0.7221, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.60% (0.3192 => 0.3307, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.58% (16.6129 => 17.2077, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.56% (0.4016 => 0.4159, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.48% (0.2988 => 0.3092, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 3.48% (0.3534 => 0.3657, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 3.47% (0.3578 => 0.3702, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.44% (13.8202 => 14.2954, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/lists: 3.43% (0.3293 => 0.3406, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.42% (0.9199 => 0.9514, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.35% (0.3756 => 0.3882, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.35% (0.3914 => 0.4045, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.34% (13.2842 => 13.7278, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/for-in: 3.30% (0.3789 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 3.30% (0.4003 => 0.4135, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 3.25% (0.3601 => 0.3718, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.21% (1.2193 => 1.2585, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.21% (0.4390 => 0.4531, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 3.21% (0.3646 => 0.3763, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 3.20% (0.3940 => 0.4066, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 3.14% (0.3663 => 0.3778, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.12% (0.3650 => 0.3764, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 3.12% (0.3623 => 0.3736, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.00% (0.3868 => 0.3984, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.98% (0.5577 => 0.5743, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.90% (1.4563 => 1.4985, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.79% (0.5637 => 0.5794, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.76% (1.3245 => 1.3610, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.72% (1.1364 => 1.1673, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.69% (4.9865 => 5.1204, std. dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 2.68% (1.0594 => 1.0878, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.62% (0.7506 => 0.7703, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 2.62% (3.8646 => 3.9658, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (0.4379 => 0.4492, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 2.57% (1.1061 => 1.1345, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.47% (1.9270 => 1.9746, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.28% (1.3819 => 1.4134, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 2.26% (1.2292 => 1.2570, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.24% (0.7460 => 0.7627, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.20% (1.3813 => 1.4117, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.20% (7.2180 => 7.3768, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 2.05% (0.8310 => 0.8480, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.89% (2.1791 => 2.2203, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.77% (3.6692 => 3.7341, std. dev.: 0.0136) MultiSource/Applications/JM/ldecod/ldecod: 1.68% (6.5754 => 6.6857, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.64% (14.8535 => 15.0967, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 1.57% (16.2614 => 16.5170, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.43% (4.3801 => 4.4429, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.27% (4.4433 => 4.4999, std. dev.: 0.0033) MultiSource/Applications/d/make_dparser: 1.26% (3.1889 => 3.2291, std. dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 1.25% (14.5298 => 14.7114, std. dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.16% (1.1333 => 1.1465, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.02% (1.2749 => 1.2879, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.68% (1.8175 => 2.2660, std. dev.: 0.0370) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.54% (2.0200 => 2.1925, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel-2: 7.46% (1.2998 => 1.3968, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7302, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6787, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4800, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4559, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9583, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.42% (3.6469 => 3.6988, std. dev.: 0.0083) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.23% (10.7476 => 10.8802, std. dev.: 0.0381) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.59% (0.4657 => 0.3931, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.22% (22.5627 => 20.9339, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.70% (0.3511 => 0.3346, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.87% (0.8818 => 0.8565, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.75% (0.9108 => 0.8949, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.47% (6.2785 => 6.1864, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.59% (1.2308 => 1.1005, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.93% (20.3410 => 18.5251, std. dev.: 0.0448) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.49% (1.3780 => 1.3161, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5902, std. dev.: 0.0159) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4475, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5098, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.46% (3.0263 => 2.9821, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.46% (6.3560 => 6.2633, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: -1.33% (28.2225 => 27.8462, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2538, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2262, std. dev.: 0.0039) MultiSource/Applications/lua/lua: -1.09% (26.5159 => 26.2263, std. dev.: 0.0272) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 19:44:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 21:44:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120703024449.52B222A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1720?compare_to=1718&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1720, Order: 159631, Start Time: 2012-07-03 01:43:35, End Time: 2012-07-03 02:44:45 To: 1718, Order: 159626, Start Time: 2012-07-03 00:15:00, End Time: 2012-07-03 01:16:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (36 on baseline) Performance Improvements: 1 (19 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 873 (818 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.40% (0.8436 => 0.8318, std. dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.73% (10.3673 => 13.2425, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.26% (1.1194 => 1.2566, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.05% (1.7609 => 1.8851, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: 6.31% (0.3473 => 0.3692, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.10% (0.3543 => 0.3759, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: 6.09% (0.3497 => 0.3710, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 5.97% (0.3516 => 0.3726, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.96% (0.3543 => 0.3754, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 5.93% (0.3561 => 0.3772, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.87% (2.2022 => 2.3314, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.79% (0.3694 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.62% (0.3828 => 0.4043, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/parameter-passing: 5.47% (0.3927 => 0.4142, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 5.46% (0.3886 => 0.4098, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.43% (7.0540 => 7.2959, std. dev.: 0.0161) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.26% (0.4879 => 0.5038, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 2.73% (0.7433 => 0.7636, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 2.61% (10.4361 => 10.7087, std. dev.: 0.0085) SingleSource/UnitTests/ObjC++/property-reference-object: 2.27% (0.6030 => 0.6167, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.24% (0.5925 => 0.6058, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.19% (0.5569 => 0.5691, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (0.8172 => 0.8318, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.76% (14.3668 => 14.6200, std. dev.: 0.0196) SingleSource/UnitTests/ObjC++/property-reference: 1.75% (0.7326 => 0.7454, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.47% (5.0018 => 5.0752, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.43% (4.9449 => 5.0154, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 1.22% (9.4845 => 9.5999, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.14% (8.1363 => 8.2288, std. dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.27% (3.6395 => 3.7586, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.93% (26.0924 => 26.8561, std. dev.: 0.0275) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.03% (1.5086 => 1.5392, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2465, std. dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/dry: 1.42% (2.4116 => 2.4458, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6885, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1243, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.07% (5.2763 => 3.1623, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.86% (5.3855 => 3.6697, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.65% (5.3526 => 3.6584, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.60% (2.9384 => 2.5387, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -12.98% (22.1758 => 19.2979, std. dev.: 0.0249) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3265, std. dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.81% (3.8922 => 3.7830, std. dev.: 0.0109) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.02% (0.8101 => 0.7937, std. dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.43% (7.9617 => 7.8477, std. dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: -1.23% (21.9371 => 21.6679, std. dev.: 0.0216) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.85% (1.2373 => 1.1154, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.00% (19.9488 => 18.5523, std. dev.: 0.0191) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.81% (8.1563 => 7.9270, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.51% (32.5116 => 31.6966, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0839, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 20:32:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 22:32:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120703033241.6853A2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1721?compare_to=1719&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1721, Order: 159633, Start Time: 2012-07-03 02:35:48, End Time: 2012-07-03 03:32:37 To: 1719, Order: 159631, Start Time: 2012-07-03 01:11:01, End Time: 2012-07-03 02:07:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (120 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (734 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.90% (2.0176 => 2.2779, std. dev.: 0.0166) SingleSource/UnitTests/ObjC++/property-reference-object: 6.14% (0.5818 => 0.6175, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.10% (0.3130 => 0.3321, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 5.78% (0.5748 => 0.6080, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.37% (0.7061 => 0.7440, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.03% (0.7038 => 0.7392, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (0.4328 => 0.4541, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2945 => 0.3089, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.88% (1.3693 => 1.4361, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.71% (0.2782 => 0.2913, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.68% (0.2690 => 0.2816, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.67% (0.2781 => 0.2911, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.63% (0.4062 => 0.4250, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2607 => 0.2725, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.52% (0.2655 => 0.2775, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.51% (0.2596 => 0.2713, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.5265 => 0.5502, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.35% (3.9660 => 4.1386, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/wc: 4.32% (0.2937 => 0.3064, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.32% (0.7710 => 0.8043, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/fibo: 4.30% (0.2628 => 0.2741, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.27% (0.3022 => 0.3151, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2760 => 0.2876, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.19% (0.2696 => 0.2809, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.17% (0.3453 => 0.3597, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 4.15% (0.2726 => 0.2839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.09% (0.2761 => 0.2874, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.09% (0.3107 => 0.3234, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.09% (0.2765 => 0.2878, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.04% (1.9828 => 2.0630, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.95% (0.3899 => 0.4053, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.94% (0.3149 => 0.3273, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.84% (0.3489 => 0.3623, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.77% (0.3580 => 0.3715, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3485 => 0.3616, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.70% (0.3192 => 0.3310, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.65% (0.6959 => 0.7213, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.61% (0.4016 => 0.4161, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.55% (0.3293 => 0.3410, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.51% (0.2988 => 0.3093, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 3.47% (16.6129 => 17.1898, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.46% (13.2842 => 13.7437, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/trivial-interface: 3.44% (0.3578 => 0.3701, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 3.42% (0.3914 => 0.4048, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 3.41% (13.8202 => 14.2915, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.35% (0.9199 => 0.9507, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.34% (0.3534 => 0.3652, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.27% (0.3756 => 0.3879, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.25% (1.2193 => 1.2589, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 3.22% (0.4003 => 0.4132, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 3.22% (0.3601 => 0.3717, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 3.19% (0.3789 => 0.3910, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 3.18% (0.3646 => 0.3762, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 3.17% (0.3663 => 0.3779, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.12% (0.3650 => 0.3764, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 3.12% (0.3940 => 0.4063, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.10% (0.4390 => 0.4526, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 3.08% (0.3868 => 0.3987, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 3.06% (0.3623 => 0.3734, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.92% (0.5577 => 0.5740, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.82% (1.3245 => 1.3619, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5637 => 0.5795, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.79% (1.4563 => 1.4969, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.78% (1.1364 => 1.1680, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.67% (4.9865 => 5.1194, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 2.63% (3.8646 => 3.9663, std. dev.: 0.0108) MultiSource/Benchmarks/nbench/nbench: 2.60% (1.0594 => 1.0869, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.56% (0.4379 => 0.4491, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.52% (0.7506 => 0.7695, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.40% (1.9270 => 1.9732, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.39% (1.1061 => 1.1325, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.30% (1.3819 => 1.4137, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 2.26% (1.2292 => 1.2570, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.22% (1.3813 => 1.4120, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.17% (7.2180 => 7.3749, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.8310 => 0.8485, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.09% (0.7460 => 0.7616, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.84% (2.1791 => 2.2191, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.67% (3.6692 => 3.7305, std. dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: 1.64% (16.2614 => 16.5282, std. dev.: 0.0127) MultiSource/Applications/JM/ldecod/ldecod: 1.62% (6.5754 => 6.6818, std. dev.: 0.0131) MultiSource/Applications/JM/lencod/lencod: 1.62% (14.8535 => 15.0936, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.60% (0.8698 => 0.8837, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.38% (4.3801 => 4.4405, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.25% (4.4433 => 4.4988, std. dev.: 0.0076) MultiSource/Applications/d/make_dparser: 1.19% (3.1889 => 3.2269, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.18% (1.1333 => 1.1467, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 1.13% (14.5298 => 14.6940, std. dev.: 0.0185) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2882, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.52% (1.8175 => 2.2631, std. dev.: 0.0283) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.40% (2.0200 => 2.1896, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.91% (0.9996 => 1.0787, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: 7.81% (1.2998 => 1.4013, std. dev.: 0.0182) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7295, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9218, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8310, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4787, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.65% (3.6469 => 3.7071, std. dev.: 0.0079) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.5089 => 1.5318, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9577, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.62% (0.4657 => 0.3883, std. dev.: 0.0193) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.26% (22.5627 => 20.9254, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.78% (0.3511 => 0.3343, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.73% (0.9108 => 0.8950, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.50% (6.2785 => 6.1845, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.28% (1.2308 => 1.1043, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.69% (20.3410 => 18.5740, std. dev.: 0.0436) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3082, std. dev.: 0.0084) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.67% (2.6470 => 2.5498, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.8259 => 8.5786, std. dev.: 0.0227) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4464, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5036, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2549, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.50% (0.9692 => 0.9547, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9827, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: -1.33% (28.2225 => 27.8478, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2192, std. dev.: 0.0334) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2559, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 20:43:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 22:43:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120703034321.576B92A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1722?compare_to=1717&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1722, Order: 159631, Start Time: 2012-07-03 01:27:51, End Time: 2012-07-03 03:43:17 To: 1717, Order: 159605, Start Time: 2012-07-02 22:45:18, End Time: 2012-07-03 01:00:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (38 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (854 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.93% (0.2261 => 0.2395, std. dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 16.51% (0.3792 => 0.4418, std. dev.: 0.0137) SingleSource/UnitTests/ObjC/exceptions-4: 7.53% (0.3465 => 0.3726, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: 7.37% (0.3446 => 0.3700, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.34% (0.3460 => 0.3714, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.32% (0.3469 => 0.3723, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 7.23% (0.3442 => 0.3691, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.15% (0.3496 => 0.3746, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.14% (0.3488 => 0.3737, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 6.85% (0.3650 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.75% (0.3643 => 0.3889, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/parameter-passing: 6.74% (0.3724 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.31% (0.5826 => 0.6019, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.02% (0.5026 => 0.5178, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 3.02% (0.5889 => 0.6067, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.90% (1.6211 => 1.6681, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.89% (0.4361 => 0.4487, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.68% (3.5627 => 3.6581, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.39% (0.5900 => 0.6041, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 2.34% (0.7171 => 0.7339, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.34% (4.2109 => 4.3093, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.26% (0.4994 => 0.5107, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (1.3152 => 1.3431, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.02% (0.5000 => 0.5101, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.73% (2.0673 => 2.1030, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.69% (0.9909 => 1.0076, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.65% (4.4195 => 4.4925, std. dev.: 0.0056) MultiSource/Applications/d/make_dparser: 1.50% (1.0781 => 1.0943, std. dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 1.36% (23.5202 => 23.8393, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.28% (1.9694 => 1.9947, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.21% (1.9966 => 2.0207, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.19% (2.7292 => 2.7618, std. dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: 1.15% (2.1653 => 2.1903, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 1.14% (1.8794 => 1.9009, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 1.13% (2.1013 => 2.1251, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 1.08% (5.5417 => 5.6016, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 1.02% (4.6177 => 4.6646, std. dev.: 0.0122) MultiSource/Applications/oggenc/oggenc: 1.00% (1.5932 => 1.6092, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.23% (2.4764 => 2.3716, std. dev.: 0.0340) MultiSource/Applications/kimwitu++/kc: -2.80% (11.9555 => 11.6205, std. dev.: 0.0021) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 21:13:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 23:13:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120703041320.5DEE12A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1723?compare_to=1720&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1723, Order: 159634, Start Time: 2012-07-03 03:12:03, End Time: 2012-07-03 04:13:15 To: 1720, Order: 159631, Start Time: 2012-07-03 01:43:35, End Time: 2012-07-03 02:44:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (44 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (811 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.57% (10.3673 => 13.3296, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.35% (1.1194 => 1.2576, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.41% (1.7609 => 1.8914, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: 6.42% (0.3473 => 0.3696, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.21% (0.3543 => 0.3763, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-4: 6.18% (0.3543 => 0.3762, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.18% (0.3497 => 0.3713, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.14% (0.3516 => 0.3732, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.10% (2.2022 => 2.3366, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 6.07% (0.3561 => 0.3777, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.96% (0.3694 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.77% (0.3828 => 0.4049, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.76% (0.3927 => 0.4153, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.69% (0.3886 => 0.4107, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.76% (7.0540 => 7.3195, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.69% (0.4879 => 0.5059, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.65% (0.3177 => 0.3293, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 3.29% (0.5925 => 0.6120, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.28% (0.7433 => 0.7677, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 3.26% (0.3282 => 0.3389, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 2.90% (0.6030 => 0.6205, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.84% (10.4361 => 10.7322, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.30% (0.5569 => 0.5697, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.25% (0.8172 => 0.8356, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference: 2.14% (0.7326 => 0.7483, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (14.3668 => 14.6516, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.98% (4.9449 => 5.0426, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 1.68% (0.7835 => 0.7967, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.68% (5.0018 => 5.0859, std. dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 1.45% (9.4845 => 9.6222, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.41% (8.1363 => 8.2512, std. dev.: 0.0059) MultiSource/Applications/treecc/treecc: 1.40% (2.0273 => 2.0556, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.34% (4.2646 => 4.3217, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 1.19% (1.1642 => 1.1780, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.12% (1.5415 => 1.5587, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.1861 => 1.1982, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.26% (3.6395 => 3.7581, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.74% (26.0924 => 26.8072, std. dev.: 0.0190) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5086 => 1.5352, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.44% (9.1159 => 9.2475, std. dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6876, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1287, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.89% (5.2763 => 3.1716, std. dev.: 0.0139) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.75% (5.3855 => 3.6754, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.42% (5.3526 => 3.6708, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.68% (2.9384 => 2.5364, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -12.79% (22.1758 => 19.3393, std. dev.: 0.0322) SingleSource/UnitTests/Vector/constpool: -5.28% (54.1659 => 51.3059, std. dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.88% (3.8922 => 3.7800, std. dev.: 0.0195) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.43% (0.8101 => 0.7985, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: -1.01% (21.9371 => 21.7148, std. dev.: 0.0173) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2373 => 1.1077, std. dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.82% (19.9488 => 18.5884, std. dev.: 0.0511) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (8.1563 => 7.9244, std. dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6913, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0865, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 21:56:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 2 Jul 2012 23:56:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120703045630.EC4A42A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1724?compare_to=1721&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1724, Order: 159634, Start Time: 2012-07-03 03:59:51, End Time: 2012-07-03 04:56:27 To: 1721, Order: 159633, Start Time: 2012-07-03 02:35:48, End Time: 2012-07-03 03:32:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (734 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.97% (2.0176 => 2.2793, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.10% (0.3130 => 0.3321, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.88% (0.5818 => 0.6160, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.74% (0.5748 => 0.6078, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.30% (0.7061 => 0.7435, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 5.21% (0.7038 => 0.7405, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (0.4328 => 0.4542, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.83% (1.3693 => 1.4354, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2721 => 0.2850, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.2945 => 0.3083, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.65% (0.5265 => 0.5510, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.55% (0.2596 => 0.2714, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.53% (0.2781 => 0.2907, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.53% (0.4062 => 0.4246, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.52% (3.9660 => 4.1454, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2782 => 0.2907, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.47% (0.3022 => 0.3157, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.46% (0.2760 => 0.2883, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.41% (0.2607 => 0.2722, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.29% (0.7710 => 0.8041, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.26% (0.2655 => 0.2768, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 4.24% (0.2690 => 0.2804, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.22% (0.2628 => 0.2739, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.16% (0.2765 => 0.2880, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.10% (0.3899 => 0.4059, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.05% (0.2937 => 0.3056, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.02% (0.2761 => 0.2872, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.97% (0.2696 => 0.2803, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.94% (0.2966 => 0.3083, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.93% (0.2726 => 0.2833, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.89% (0.6959 => 0.7230, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.87% (0.3485 => 0.3620, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.84% (1.9828 => 2.0589, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 3.83% (0.3107 => 0.3226, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.83% (0.3580 => 0.3717, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.76% (0.3453 => 0.3583, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.71% (0.2988 => 0.3099, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.71% (0.4016 => 0.4165, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.70% (0.3489 => 0.3618, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.65% (13.8202 => 14.3246, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 3.62% (0.3149 => 0.3263, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.61% (16.6129 => 17.2124, std. dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.58% (0.9199 => 0.9528, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 3.51% (0.3192 => 0.3304, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.46% (0.3293 => 0.3407, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.34% (13.2842 => 13.7275, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (1.2193 => 1.2599, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 3.25% (0.3534 => 0.3649, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.22% (0.3756 => 0.3877, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.10% (0.4390 => 0.4526, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.05% (0.5577 => 0.5747, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.04% (1.3245 => 1.3647, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 2.95% (0.3868 => 0.3982, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.90% (1.4563 => 1.4986, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 2.89% (0.3914 => 0.4027, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 2.88% (0.3578 => 0.3681, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.82% (0.5637 => 0.5796, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 2.77% (0.3646 => 0.3747, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.76% (4.9865 => 5.1241, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: 2.75% (0.4003 => 0.4113, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 2.74% (0.3789 => 0.3893, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.74% (0.7506 => 0.7712, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.74% (1.1364 => 1.1675, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (3.8646 => 3.9680, std. dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.67% (0.4379 => 0.4496, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 2.67% (1.0594 => 1.0877, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 2.61% (0.3940 => 0.4043, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.59% (1.9270 => 1.9770, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 2.59% (1.1061 => 1.1347, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.37% (1.3813 => 1.4140, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.34% (7.2180 => 7.3869, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.34% (1.3819 => 1.4142, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.25% (1.2292 => 1.2569, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.21% (0.7460 => 0.7625, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8310 => 0.8483, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.93% (2.1791 => 2.2211, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.86% (3.6692 => 3.7376, std. dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: 1.81% (6.5754 => 6.6944, std. dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: 1.71% (14.8535 => 15.1069, std. dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: 1.69% (16.2614 => 16.5358, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.66% (0.6135 => 0.6237, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.56% (4.3801 => 4.4484, std. dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.45% (0.8698 => 0.8824, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.37% (4.4433 => 4.5040, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.33% (14.5298 => 14.7224, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 1.28% (3.1889 => 3.2298, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 1.22% (1.2749 => 1.2905, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.22% (1.1333 => 1.1471, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.44% (1.8175 => 2.2798, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/mandel-2: 8.93% (1.2998 => 1.4159, std. dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.07% (2.0200 => 2.1830, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.89% (0.9996 => 1.0785, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.95% (7.4271 => 7.7208, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4556, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (3.6469 => 3.7086, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5340, std. dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5075, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.13% (10.7476 => 10.8690, std. dev.: 0.0336) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.43% (0.4657 => 0.3892, std. dev.: 0.0130) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.16% (22.5627 => 20.9473, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.73% (0.3511 => 0.3345, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.79% (0.8818 => 0.8572, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.90% (0.6576 => 0.6451, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.62% (0.9108 => 0.8960, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.17% (6.2785 => 6.2052, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.18% (1.2308 => 1.1055, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.26% (20.3410 => 18.4579, std. dev.: 0.1229) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.69% (1.3780 => 1.3134, std. dev.: 0.0083) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5893, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5076, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2559, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: -1.50% (3.0263 => 2.9808, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.33% (28.2225 => 27.8483, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8655, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2149, std. dev.: 0.0352) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2527, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 22:41:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 00:41:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120703054159.9D85C2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1725?compare_to=1723&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1725, Order: 159641, Start Time: 2012-07-03 04:40:41, End Time: 2012-07-03 05:41:56 To: 1723, Order: 159634, Start Time: 2012-07-03 03:12:03, End Time: 2012-07-03 04:13:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (42 on baseline) Performance Improvements: 0 (19 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (812 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.52% (10.3673 => 13.3236, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.24% (1.1194 => 1.2564, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.48% (1.7609 => 1.8926, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: 6.39% (0.3473 => 0.3695, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.21% (0.3497 => 0.3714, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.15% (0.3561 => 0.3780, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.14% (0.3516 => 0.3732, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.12% (0.3543 => 0.3760, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.10% (2.2022 => 2.3365, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.07% (0.3543 => 0.3758, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: 6.06% (0.3694 => 0.3918, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.74% (0.3886 => 0.4109, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.69% (0.3828 => 0.4046, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.65% (0.3927 => 0.4149, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.69% (0.4879 => 0.5059, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.68% (0.3177 => 0.3294, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.59% (7.0540 => 7.3074, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/oourafft: 3.23% (0.3282 => 0.3388, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.21% (0.5925 => 0.6115, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 3.11% (0.7433 => 0.7664, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 2.90% (0.6030 => 0.6205, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (10.4361 => 10.7317, std. dev.: 0.0181) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.34% (0.8172 => 0.8363, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 2.24% (0.7326 => 0.7490, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.91% (0.5860 => 0.5972, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (14.3668 => 14.6393, std. dev.: 0.0100) MultiSource/Applications/spiff/spiff: 1.67% (0.7835 => 0.7966, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.63% (4.9449 => 5.0255, std. dev.: 0.0161) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.61% (5.0018 => 5.0823, std. dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (9.4845 => 9.6210, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.39% (8.1363 => 8.2495, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.34% (4.2646 => 4.3217, std. dev.: 0.0041) MultiSource/Applications/treecc/treecc: 1.26% (2.0273 => 2.0528, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.1861 => 1.1983, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7561, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 2.87% (26.0924 => 26.8405, std. dev.: 0.0305) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5366, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.50% (9.1159 => 9.2529, std. dev.: 0.0216) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6899, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -80.07% (0.8651 => 0.1724, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.92% (5.2763 => 3.1699, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.75% (5.3855 => 3.6757, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.53% (5.3526 => 3.6651, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.65% (2.9384 => 2.5373, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -12.77% (22.1758 => 19.3440, std. dev.: 0.0268) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3265, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.92% (3.8922 => 3.7784, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.63% (0.8101 => 0.7969, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -1.04% (21.9371 => 21.7099, std. dev.: 0.0121) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.00% (7.9617 => 7.8819, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.36% (1.2373 => 1.1091, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.53% (19.9488 => 18.6460, std. dev.: 0.0582) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.00% (8.1563 => 7.9114, std. dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6855, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0843, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 23:20:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 01:20:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120703062016.AF9B82A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1726?compare_to=1724&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1726, Order: 159643, Start Time: 2012-07-03 05:23:34, End Time: 2012-07-03 06:20:11 To: 1724, Order: 159634, Start Time: 2012-07-03 03:59:51, End Time: 2012-07-03 04:56:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (112 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (740 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.00% (2.0176 => 2.2798, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.07% (0.3130 => 0.3320, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.86% (0.5818 => 0.6159, std. dev.: 0.0105) SingleSource/UnitTests/ObjC++/Hello: 5.71% (0.5748 => 0.6076, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 5.33% (0.7061 => 0.7437, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 5.26% (0.7038 => 0.7408, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.97% (0.4328 => 0.4543, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.86% (0.7710 => 0.8085, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 4.81% (1.3693 => 1.4352, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.62% (0.5265 => 0.5508, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.57% (0.2760 => 0.2886, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.53% (0.3022 => 0.3159, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2782 => 0.2907, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.48% (3.9660 => 4.1438, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash: 4.43% (0.4062 => 0.4242, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.42% (0.2781 => 0.2904, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.41% (0.2655 => 0.2772, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.39% (0.2596 => 0.2710, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.24% (0.2690 => 0.2804, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.20% (0.2765 => 0.2881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.18% (0.2607 => 0.2716, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.15% (0.2937 => 0.3059, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.11% (0.2628 => 0.2736, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.08% (0.3899 => 0.4058, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.04% (0.2726 => 0.2836, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.90% (1.9828 => 2.0601, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 3.88% (0.2761 => 0.2868, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.86% (0.2696 => 0.2800, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.84% (0.2966 => 0.3080, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.84% (0.6959 => 0.7226, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.82% (0.3453 => 0.3585, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.79% (0.3485 => 0.3617, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.69% (0.3580 => 0.3712, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.65% (16.6129 => 17.2187, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.3489 => 0.3616, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.62% (0.3149 => 0.3263, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 3.60% (0.3107 => 0.3219, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.60% (13.8202 => 14.3172, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/matrix: 3.58% (0.2988 => 0.3095, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.49% (0.3293 => 0.3408, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.48% (0.9199 => 0.9519, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.38% (13.2842 => 13.7333, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.37% (1.2193 => 1.2604, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.23% (0.3534 => 0.3648, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.3756 => 0.3873, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.05% (0.5577 => 0.5747, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.02% (0.3868 => 0.3985, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.98% (0.4390 => 0.4521, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.95% (1.4563 => 1.4992, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.91% (1.3245 => 1.3631, std. dev.: 0.0107) SingleSource/UnitTests/ObjC/trivial-interface: 2.91% (0.3578 => 0.3682, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.82% (4.9865 => 5.1269, std. dev.: 0.0091) SingleSource/UnitTests/ObjC/exceptions: 2.81% (0.3914 => 0.4024, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.77% (1.1364 => 1.1679, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (3.8646 => 3.9712, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.76% (1.0594 => 1.0886, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 2.75% (0.4003 => 0.4113, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 2.72% (0.3789 => 0.3892, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.69% (0.4379 => 0.4497, std. dev.: 0.0043) MultiSource/Applications/spiff/spiff: 2.64% (0.7506 => 0.7704, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 2.57% (1.9270 => 1.9766, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 2.54% (0.3940 => 0.4040, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.51% (1.1061 => 1.1339, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.41% (1.3819 => 1.4152, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.34% (7.2180 => 7.3868, std. dev.: 0.0085) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.33% (1.3813 => 1.4135, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 2.25% (1.2292 => 1.2569, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.17% (0.8310 => 0.8490, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.14% (0.7460 => 0.7620, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.97% (2.1791 => 2.2220, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.83% (3.6692 => 3.7365, std. dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 1.75% (14.8535 => 15.1137, std. dev.: 0.0122) MultiSource/Applications/JM/ldecod/ldecod: 1.72% (6.5754 => 6.6885, std. dev.: 0.0119) MultiSource/Applications/sqlite3/sqlite3: 1.71% (16.2614 => 16.5395, std. dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.63% (0.8698 => 0.8840, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.53% (4.3801 => 4.4469, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.45% (4.4433 => 4.5078, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 1.26% (3.1889 => 3.2291, std. dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.1333 => 1.1474, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.19% (14.5298 => 14.7022, std. dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: 1.14% (1.2749 => 1.2894, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.75% (1.8175 => 2.2674, std. dev.: 0.0503) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.54% (2.0200 => 2.1925, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: 7.75% (1.2998 => 1.4005, std. dev.: 0.0095) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7303, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9221, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6782, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.50% (1.7688 => 1.8307, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9772, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.96% (4.1080 => 4.1887, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.83% (3.6469 => 3.7137, std. dev.: 0.0046) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4553, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5089 => 1.5335, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.11% (0.4657 => 0.3860, std. dev.: 0.0076) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.09% (22.5627 => 20.9628, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.73% (0.3511 => 0.3345, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.80% (0.8818 => 0.8571, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.93% (0.6576 => 0.6449, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.62% (0.9108 => 0.8960, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.22% (6.2785 => 6.2022, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.66% (1.2308 => 1.1119, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.35% (20.3410 => 18.4387, std. dev.: 0.0560) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3078, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.5997, std. dev.: 0.0101) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5028, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2512, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.49% (3.0263 => 2.9811, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8436, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2239, std. dev.: 0.0321) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8719, std. dev.: 0.0045) MultiSource/Applications/lua/lua: -1.15% (26.5159 => 26.2112, std. dev.: 0.0276) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2563, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 2 23:25:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 01:25:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120703062552.D5AF52A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1727?compare_to=1722&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1727, Order: 159634, Start Time: 2012-07-03 04:10:23, End Time: 2012-07-03 06:25:47 To: 1722, Order: 159631, Start Time: 2012-07-03 01:27:51, End Time: 2012-07-03 03:43:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (30 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (862 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.28% (0.9794 => 0.9919, std. dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 18.70% (0.3792 => 0.4501, std. dev.: 0.0265) SingleSource/UnitTests/ObjC/exceptions-2: 7.78% (0.3446 => 0.3714, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.68% (0.3465 => 0.3731, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.58% (0.3469 => 0.3732, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.57% (0.3460 => 0.3722, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.54% (0.3488 => 0.3751, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 7.47% (0.3442 => 0.3699, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.47% (0.3496 => 0.3757, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.16% (0.3643 => 0.3904, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 7.12% (0.3650 => 0.3910, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.93% (0.3724 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.45% (0.5826 => 0.6085, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.11% (0.5889 => 0.6131, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.40% (0.7171 => 0.7415, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.65% (1.6211 => 1.6640, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.61% (0.5026 => 0.5157, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.57% (2.0673 => 2.1204, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 2.50% (0.9909 => 1.0157, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.50% (0.4361 => 0.4470, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.44% (3.5627 => 3.6496, std. dev.: 0.0053) MultiSource/Applications/hbd/hbd: 2.29% (0.9697 => 0.9919, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.25% (0.5900 => 0.6033, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.18% (1.3152 => 1.3439, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 2.07% (4.2109 => 4.2981, std. dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: 1.49% (23.5202 => 23.8701, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 1.48% (1.0781 => 1.0941, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.33% (4.4195 => 4.4781, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.20% (1.9694 => 1.9930, std. dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.19% (2.7292 => 2.7616, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.12% (1.9966 => 2.0189, std. dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.56% (2.4764 => 2.3635, std. dev.: 0.0223) MultiSource/Applications/kimwitu++/kc: -2.72% (11.9555 => 11.6305, std. dev.: 0.0155) Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 00:13:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 02:13:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120703071338.CC28C2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1728?compare_to=1725&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1728, Order: 159643, Start Time: 2012-07-03 06:09:23, End Time: 2012-07-03 07:13:33 To: 1725, Order: 159641, Start Time: 2012-07-03 04:40:41, End Time: 2012-07-03 05:41:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (30 on baseline) Performance Improvements: 0 (17 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (826 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.54% (10.3673 => 13.3259, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.32% (1.1194 => 1.2573, std. dev.: 0.0233) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.50% (1.7609 => 1.8930, std. dev.: 0.0296) SingleSource/UnitTests/ObjC/trivial-interface: 6.39% (0.3473 => 0.3695, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.18% (0.3497 => 0.3713, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.12% (0.3543 => 0.3760, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.12% (2.2022 => 2.3370, std. dev.: 0.0311) SingleSource/UnitTests/ObjC/exceptions-3: 6.11% (0.3516 => 0.3731, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.07% (0.3543 => 0.3758, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 6.04% (0.3561 => 0.3776, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.93% (0.3694 => 0.3913, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.69% (0.3828 => 0.4046, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.63% (0.3927 => 0.4148, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.61% (0.3886 => 0.4104, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.38% (0.4615 => 0.4771, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.16% (0.7433 => 0.7668, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 3.16% (0.5925 => 0.6112, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 3.14% (0.3282 => 0.3385, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.88% (10.4361 => 10.7368, std. dev.: 0.0138) SingleSource/UnitTests/ObjC++/property-reference-object: 2.85% (0.6030 => 0.6202, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.18% (0.7326 => 0.7486, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.63% (0.7835 => 0.7963, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 1.50% (9.4845 => 9.6265, std. dev.: 0.0125) MultiSource/Applications/treecc/treecc: 1.23% (2.0273 => 2.0523, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 1.11% (1.1642 => 1.1771, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9740, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7478, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.35% (2.6546 => 2.6904, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -80.08% (0.8651 => 0.1723, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.95% (5.2763 => 3.1683, std. dev.: 0.0435) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.75% (5.3855 => 3.6758, std. dev.: 0.0585) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.47% (5.3526 => 3.6681, std. dev.: 0.0559) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.60% (2.9384 => 2.5387, std. dev.: 0.0443) MultiSource/Applications/ClamAV/clamscan: -12.75% (22.1758 => 19.3489, std. dev.: 0.0135) SingleSource/UnitTests/Vector/constpool: -5.31% (54.1659 => 51.2872, std. dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.91% (3.8922 => 3.7790, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: -1.05% (21.9371 => 21.7075, std. dev.: 0.0178) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.17% (1.2373 => 1.1115, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.98% (19.9488 => 18.5564, std. dev.: 0.0321) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9148, std. dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6925, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0849, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 00:46:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 02:46:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120703074650.3DC052A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1729?compare_to=1726&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1729, Order: 159646, Start Time: 2012-07-03 06:47:40, End Time: 2012-07-03 07:46:45 To: 1726, Order: 159643, Start Time: 2012-07-03 05:23:34, End Time: 2012-07-03 06:20:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (102 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (755 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 13.65% (0.3860 => 0.4387, std. dev.: 0.0143) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.26% (2.0176 => 2.2851, std. dev.: 0.0616) SingleSource/UnitTests/ObjC++/property-reference: 6.42% (0.7061 => 0.7514, std. dev.: 0.0098) SingleSource/UnitTests/ObjC++/property-reference-object: 6.31% (0.5818 => 0.6185, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5748 => 0.6099, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.01% (0.3130 => 0.3318, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.50% (0.2945 => 0.3107, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.43% (0.4328 => 0.4563, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.19% (1.3693 => 1.4404, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.12% (0.3107 => 0.3266, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/except: 5.04% (0.2760 => 0.2899, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.03% (0.2782 => 0.2922, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.03% (0.2726 => 0.2863, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.02% (0.2607 => 0.2738, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.97% (0.4062 => 0.4264, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 4.94% (0.7038 => 0.7386, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 4.94% (0.2690 => 0.2823, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.93% (0.2761 => 0.2897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.88% (0.2765 => 0.2900, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.86% (0.2655 => 0.2784, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.76% (0.2628 => 0.2753, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.73% (0.2937 => 0.3076, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.64% (0.3149 => 0.3295, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.52% (0.5265 => 0.5503, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.51% (0.2596 => 0.2713, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.49% (0.2696 => 0.2817, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.43% (3.9660 => 4.1417, std. dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.4390 => 0.4583, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 4.31% (0.3293 => 0.3435, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.30% (0.3485 => 0.3635, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2988 => 0.3116, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.20% (0.3453 => 0.3598, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.10% (0.3192 => 0.3323, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.03% (0.4016 => 0.4178, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.94% (0.3756 => 0.3904, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3534 => 0.3670, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.68% (0.6959 => 0.7215, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.67% (0.3868 => 0.4010, std. dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 3.55% (16.6129 => 17.2019, std. dev.: 0.0177) MultiSource/Applications/SPASS/SPASS: 3.50% (13.8202 => 14.3037, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.9199 => 0.9513, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.26% (1.2193 => 1.2590, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 3.24% (0.3578 => 0.3694, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions: 3.14% (0.3914 => 0.4037, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: 3.00% (0.4003 => 0.4123, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 2.96% (0.3646 => 0.3754, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.96% (0.3650 => 0.3758, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-2: 2.94% (0.3601 => 0.3707, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 2.90% (0.3789 => 0.3899, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/synchronized: 2.89% (0.3663 => 0.3769, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.89% (0.5637 => 0.5800, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.89% (0.5577 => 0.5738, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 2.79% (0.3623 => 0.3724, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.73% (1.3245 => 1.3606, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 2.69% (0.3940 => 0.4046, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 2.65% (0.7506 => 0.7705, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.63% (1.2292 => 1.2615, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.57% (3.8646 => 3.9638, std. dev.: 0.0104) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.56% (4.9865 => 5.1141, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.50% (1.9270 => 1.9752, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.48% (1.1061 => 1.1335, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.24% (7.2180 => 7.3795, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.18% (0.7460 => 0.7623, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.02% (0.8310 => 0.8478, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 1.80% (6.5754 => 6.6937, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.73% (14.8535 => 15.1106, std. dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.63% (0.8698 => 0.8840, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.61% (16.2614 => 16.5233, std. dev.: 0.0098) MultiSource/Applications/siod/siod: 1.55% (2.1791 => 2.2129, std. dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: 1.36% (14.5298 => 14.7279, std. dev.: 0.0076) MultiSource/Applications/d/make_dparser: 1.30% (3.1889 => 3.2302, std. dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 1.22% (1.2749 => 1.2904, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.18% (1.1333 => 1.1467, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.64% (1.8175 => 2.3017, std. dev.: 0.0408) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.31% (2.0200 => 2.1879, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.93% (0.9996 => 1.0789, std. dev.: 0.0066) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 5.91% (1.2998 => 1.3766, std. dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.83% (7.4271 => 7.7112, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6785, std. dev.: 0.0214) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (3.6469 => 3.7093, std. dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 1.53% (10.7476 => 10.9124, std. dev.: 0.0295) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5124, std. dev.: 0.0387) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.12% (1.9290 => 1.9506, std. dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.23% (22.5627 => 20.9325, std. dev.: 0.4375) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.50% (0.3511 => 0.3353, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.75% (0.9108 => 0.8949, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1106, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.68% (20.3410 => 18.5750, std. dev.: 0.0441) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4002, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3162, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5111, std. dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2564, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: -1.49% (3.0263 => 2.9812, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.38% (2.5254 => 2.4905, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.33% (28.2225 => 27.8468, std. dev.: 0.0411) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.29% (0.9692 => 0.9567, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8680, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2523, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2251, std. dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8498, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 01:42:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 03:42:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120703084244.22DC72A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1730?compare_to=1728&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1730, Order: 159647, Start Time: 2012-07-03 07:41:12, End Time: 2012-07-03 08:42:40 To: 1728, Order: 159643, Start Time: 2012-07-03 06:09:23, End Time: 2012-07-03 07:13:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (37 on baseline) Performance Improvements: 0 (19 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (817 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.24% (10.3673 => 13.2946, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.34% (1.1194 => 1.2575, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.44% (1.7609 => 1.8919, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 6.08% (0.3473 => 0.3684, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.75% (0.3516 => 0.3718, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.70% (0.3543 => 0.3745, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.70% (0.3543 => 0.3745, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 5.69% (0.3497 => 0.3696, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 5.67% (0.3561 => 0.3763, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.61% (2.2022 => 2.3258, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 5.52% (0.3694 => 0.3898, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.30% (0.3828 => 0.4031, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.27% (0.3927 => 0.4134, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 5.22% (0.3886 => 0.4089, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.46% (0.4879 => 0.5048, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.38% (7.0540 => 7.2927, std. dev.: 0.0112) SingleSource/UnitTests/ObjC++/Hello: 3.14% (0.5925 => 0.6111, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 3.00% (0.6030 => 0.6211, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.99% (0.7433 => 0.7655, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.41% (0.8172 => 0.8369, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference: 2.31% (0.7326 => 0.7495, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (14.3668 => 14.6757, std. dev.: 0.0118) MultiSource/Applications/JM/ldecod/ldecod: 2.06% (10.4361 => 10.6515, std. dev.: 0.0241) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.69% (4.9449 => 5.0284, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.54% (5.0018 => 5.0789, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.37% (8.1363 => 8.2474, std. dev.: 0.0152) MultiSource/Benchmarks/mafft/pairlocalalign: 1.33% (9.4845 => 9.6107, std. dev.: 0.0129) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.29% (4.2646 => 4.3195, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.21% (17.1811 => 17.3892, std. dev.: 0.0347) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.1861 => 1.1983, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7520, std. dev.: 0.0043) MultiSource/Applications/lua/lua: 2.75% (26.0924 => 26.8089, std. dev.: 0.0141) SingleSource/Benchmarks/Dhrystone/dry: 1.42% (2.4116 => 2.4459, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2397, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.20% (2.6546 => 2.6865, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1243, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.15% (5.2763 => 3.1579, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.82% (5.3855 => 3.6718, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.52% (5.3526 => 3.6654, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.64% (2.9384 => 2.5377, std. dev.: 0.0169) MultiSource/Applications/ClamAV/clamscan: -12.68% (22.1758 => 19.3648, std. dev.: 0.0470) SingleSource/UnitTests/Vector/constpool: -5.32% (54.1659 => 51.2826, std. dev.: 0.0204) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.95% (3.8922 => 3.7775, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.78% (0.8101 => 0.7957, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.26% (7.9617 => 7.8613, std. dev.: 0.0154) MultiSource/Applications/JM/lencod/lencod: -1.16% (21.9371 => 21.6817, std. dev.: 0.0406) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2373 => 1.1079, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.92% (19.9488 => 18.5692, std. dev.: 0.0385) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9129, std. dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6839, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0840, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3526, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 02:11:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 04:11:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120703091103.B8B062A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1731?compare_to=1727&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1731, Order: 159646, Start Time: 2012-07-03 06:53:03, End Time: 2012-07-03 09:10:58 To: 1727, Order: 159634, Start Time: 2012-07-03 04:10:23, End Time: 2012-07-03 06:25:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (40 on baseline) Performance Improvements: 0 (2 on baseline) Unchanged Tests: 893 (852 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 14.51% (0.4501 => 0.5154, std. dev.: 0.0168) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 35.92% (0.3792 => 0.5154, std. dev.: 0.0168) SingleSource/UnitTests/ObjC/exceptions-4: 7.88% (0.3465 => 0.3738, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.86% (0.3446 => 0.3717, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.86% (0.3460 => 0.3732, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.75% (0.3469 => 0.3738, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.67% (0.3496 => 0.3764, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.61% (0.3442 => 0.3704, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.57% (0.3488 => 0.3752, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 7.33% (0.3643 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.26% (0.3650 => 0.3915, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 7.17% (0.3724 => 0.3991, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.45% (0.5826 => 0.6085, std. dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: 4.08% (0.5889 => 0.6129, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.50% (0.5026 => 0.5202, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.29% (0.5900 => 0.6094, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 3.21% (0.7171 => 0.7401, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.16% (1.6211 => 1.6723, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: 3.00% (0.4029 => 0.4150, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.96% (0.4361 => 0.4490, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.88% (2.0673 => 2.1269, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.83% (3.5627 => 3.6636, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.80% (0.9909 => 1.0186, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.78% (0.4994 => 0.5133, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.49% (1.3152 => 1.3480, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 2.46% (4.2109 => 4.3146, std. dev.: 0.0065) MultiSource/Applications/hbd/hbd: 2.30% (0.9697 => 0.9920, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.22% (0.5000 => 0.5111, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 2.07% (1.0781 => 1.1004, std. dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (2.7292 => 2.7756, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.70% (1.9694 => 2.0028, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.68% (4.4195 => 4.4938, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 1.60% (23.5202 => 23.8969, std. dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 1.51% (1.8794 => 1.9078, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.49% (1.9966 => 2.0264, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 1.44% (2.1653 => 2.1964, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 1.37% (2.1013 => 2.1301, std. dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 1.25% (4.6177 => 4.6753, std. dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 1.22% (5.5417 => 5.6093, std. dev.: 0.0071) MultiSource/Applications/oggenc/oggenc: 1.04% (1.5932 => 1.6098, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.06% (2.4764 => 2.3758, std. dev.: 0.0178) MultiSource/Applications/kimwitu++/kc: -2.48% (11.9555 => 11.6594, std. dev.: 0.0058) Report Time: 2.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 02:11:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 04:11:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120703091120.6B6232A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1732?compare_to=1729&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1732, Order: 159648, Start Time: 2012-07-03 08:14:31, End Time: 2012-07-03 09:11:16 To: 1729, Order: 159646, Start Time: 2012-07-03 06:47:40, End Time: 2012-07-03 07:46:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (126 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (729 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.09% (1.3766 => 1.4054, std. dev.: 0.0102) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.53% (2.0176 => 2.2906, std. dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference-object: 7.73% (0.5818 => 0.6268, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.46% (0.5748 => 0.6177, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.93% (0.7061 => 0.7550, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.74% (0.1986 => 0.2100, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 5.73% (0.4328 => 0.4576, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 5.54% (0.2781 => 0.2935, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 5.43% (1.3693 => 1.4436, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 5.39% (0.4062 => 0.4281, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 5.37% (0.3578 => 0.3770, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 5.33% (0.7038 => 0.7413, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.28% (0.2782 => 0.2929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 5.17% (0.3601 => 0.3787, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.16% (0.3646 => 0.3834, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.13% (0.2690 => 0.2828, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.12% (0.2596 => 0.2729, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 5.11% (0.3914 => 0.4114, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2761 => 0.2902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.11% (0.3663 => 0.3850, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 5.10% (0.2726 => 0.2865, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.10% (0.3022 => 0.3176, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.10% (0.3650 => 0.3836, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.09% (0.3789 => 0.3982, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.07% (0.5265 => 0.5532, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.06% (0.7710 => 0.8100, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.05% (0.2655 => 0.2789, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.04% (0.2760 => 0.2899, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.00% (0.3623 => 0.3804, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.99% (0.2607 => 0.2737, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.97% (0.4003 => 0.4202, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.92% (0.2765 => 0.2901, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.89% (0.2966 => 0.3111, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.88% (1.9828 => 2.0795, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.87% (0.3489 => 0.3659, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.87% (0.2937 => 0.3080, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.83% (0.2628 => 0.2755, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.79% (3.9660 => 4.1561, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/property: 4.77% (0.3940 => 0.4128, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3107 => 0.3255, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2721 => 0.2850, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.71% (0.2696 => 0.2823, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.60% (0.3149 => 0.3294, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.53% (0.3485 => 0.3643, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.42% (0.3192 => 0.3333, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.40% (0.3453 => 0.3605, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.39% (0.3899 => 0.4070, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.39% (0.3580 => 0.3737, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4016 => 0.4187, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.25% (0.2988 => 0.3115, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.22% (0.3534 => 0.3683, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.19% (0.3293 => 0.3431, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 4.07% (13.8202 => 14.3833, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.05% (0.3756 => 0.3908, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.01% (0.6959 => 0.7238, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 3.98% (0.3868 => 0.4022, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.90% (13.2842 => 13.8028, std. dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.90% (0.4390 => 0.4561, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.89% (0.9199 => 0.9557, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 3.69% (16.6129 => 17.2258, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.59% (1.2193 => 1.2631, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.48% (0.5577 => 0.5771, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.37% (1.4563 => 1.5054, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.26% (0.5637 => 0.5821, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (1.3245 => 1.3672, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.13% (1.1364 => 1.1720, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.09% (0.7506 => 0.7738, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.06% (0.4379 => 0.4513, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.99% (1.2292 => 1.2660, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.93% (4.9865 => 5.1327, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.91% (7.2180 => 7.4277, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.85% (1.9270 => 1.9819, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 2.83% (3.8646 => 3.9739, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3755 => 0.3861, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 2.78% (1.1061 => 1.1369, std. dev.: 0.0082) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.60% (0.7460 => 0.7654, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.60% (1.3819 => 1.4178, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.50% (1.3813 => 1.4159, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.48% (0.8310 => 0.8516, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (3.6692 => 3.7532, std. dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 2.23% (6.5754 => 6.7221, std. dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 2.20% (16.2614 => 16.6195, std. dev.: 0.0256) MultiSource/Applications/JM/lencod/lencod: 2.16% (14.8535 => 15.1736, std. dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.03% (4.3801 => 4.4688, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.01% (4.4433 => 4.5328, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (0.8698 => 0.8872, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.96% (0.6135 => 0.6255, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.89% (2.1791 => 2.2203, std. dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: 1.58% (14.5298 => 14.7599, std. dev.: 0.0139) MultiSource/Applications/d/make_dparser: 1.58% (3.1889 => 3.2392, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.52% (1.1333 => 1.1505, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2937, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.13% (2.1007 => 2.1244, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2623, std. dev.: 0.0446) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.29% (2.0200 => 2.1874, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: 8.12% (1.2998 => 1.4054, std. dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (4.5947 => 4.8136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.87% (7.4271 => 7.7146, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6797, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9772, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1912, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.94% (1.5089 => 1.5382, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.79% (1.4298 => 1.4554, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.66% (3.6469 => 3.7076, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5107, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1943, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.05% (22.5627 => 20.9728, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.41% (0.3511 => 0.3356, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.94% (0.8818 => 0.8559, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.75% (0.6576 => 0.6461, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.56% (0.9108 => 0.8966, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.64% (1.2308 => 1.1121, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.92% (20.3410 => 18.5257, std. dev.: 0.0321) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3104, std. dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5950, std. dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4477, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5109, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2543, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: -1.47% (3.0263 => 2.9819, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8444, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.30% (0.9692 => 0.9566, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2253, std. dev.: 0.0317) SingleSource/Benchmarks/Shootout/heapsort: -1.14% (3.9173 => 3.8728, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2578, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 03:11:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 05:11:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120703101110.7B1B92A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1733?compare_to=1730&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1733, Order: 159648, Start Time: 2012-07-03 09:09:59, End Time: 2012-07-03 10:11:06 To: 1730, Order: 159647, Start Time: 2012-07-03 07:41:12, End Time: 2012-07-03 08:42:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (53 on baseline) Performance Improvements: 0 (18 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 872 (802 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (13.2946 => 13.5742, std. dev.: 0.0053) MultiSource/Applications/JM/ldecod/ldecod: 1.04% (10.6515 => 10.7628, std. dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.93% (10.3673 => 13.5742, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.40% (1.1194 => 1.2470, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.99% (1.7609 => 1.9016, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.69% (0.3473 => 0.3740, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.48% (0.3516 => 0.3779, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-2: 7.41% (0.3497 => 0.3756, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.39% (0.3543 => 0.3805, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.34% (0.3543 => 0.3803, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 7.27% (0.3561 => 0.3820, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.12% (0.3694 => 0.3957, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.87% (0.3828 => 0.4091, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.79% (0.3886 => 0.4150, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.77% (0.3927 => 0.4193, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.48% (2.2022 => 2.3450, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.25% (7.0540 => 7.3539, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.16% (0.4879 => 0.5082, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.90% (0.3177 => 0.3301, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 3.46% (0.5925 => 0.6130, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.35% (0.6030 => 0.6232, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 3.17% (0.3282 => 0.3386, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.13% (10.4361 => 10.7628, std. dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 2.99% (0.7433 => 0.7655, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 2.68% (0.7326 => 0.7522, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.53% (0.8172 => 0.8379, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.34% (0.4615 => 0.4723, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.17% (4.9449 => 5.0523, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.13% (14.3668 => 14.6724, std. dev.: 0.0164) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.11% (5.0018 => 5.1073, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.10% (0.5569 => 0.5686, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 1.93% (0.7835 => 0.7986, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.74% (0.5860 => 0.5962, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.69% (9.4845 => 9.6450, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.66% (8.1363 => 8.2714, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.63% (4.2646 => 4.3340, std. dev.: 0.0095) MultiSource/Applications/d/make_dparser: 1.45% (3.3354 => 3.3837, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.41% (0.8067 => 0.8181, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.32% (2.0273 => 2.0540, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.29% (1.1861 => 1.2014, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.25% (1.5415 => 1.5607, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.21% (1.3050 => 1.3208, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 1.20% (5.7591 => 5.8282, std. dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 1.19% (17.1811 => 17.3853, std. dev.: 0.0228) MultiSource/Applications/Burg/burg: 1.16% (1.1642 => 1.1777, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.11% (1.5603 => 1.5776, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7507, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 2.78% (26.0924 => 26.8186, std. dev.: 0.0208) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.03% (1.5086 => 1.5393, std. dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2317, std. dev.: 0.0443) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6880, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.28% (5.2763 => 3.1512, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.44% (5.3855 => 3.6925, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.11% (5.3526 => 3.6873, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.57% (2.9384 => 2.5397, std. dev.: 0.0169) MultiSource/Applications/ClamAV/clamscan: -12.83% (22.1758 => 19.3300, std. dev.: 0.0132) SingleSource/UnitTests/Vector/constpool: -4.95% (54.1659 => 51.4842, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.45% (3.8922 => 3.7968, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.46% (0.8101 => 0.7983, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.10% (7.9617 => 7.8742, std. dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.72% (1.2373 => 1.1047, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.66% (19.9488 => 18.6208, std. dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9202, std. dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6920, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0838, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 04:54:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 06:54:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120703115401.993792A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1734?compare_to=1731&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1734, Order: 159648, Start Time: 2012-07-03 09:38:29, End Time: 2012-07-03 11:53:59 To: 1731, Order: 159646, Start Time: 2012-07-03 06:53:03, End Time: 2012-07-03 09:10:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (42 on baseline) Performance Improvements: 1 (3 on baseline) Unchanged Tests: 891 (849 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.79% (2.0575 => 2.0944, std. dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/fldry: 1.27% (17.1124 => 17.3291, std. dev.: 0.0124) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.15% (0.4283 => 0.4148, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 20.41% (0.3792 => 0.4566, std. dev.: 0.0274) SingleSource/UnitTests/ObjC/exceptions-2: 8.71% (0.3446 => 0.3746, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.69% (0.3465 => 0.3766, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.59% (0.3469 => 0.3767, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.53% (0.3460 => 0.3755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.51% (0.3488 => 0.3785, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 8.47% (0.3496 => 0.3792, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.43% (0.3442 => 0.3732, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.03% (0.3650 => 0.3943, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.96% (0.3643 => 0.3933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.3724 => 0.4017, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.84% (0.5826 => 0.6108, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 4.57% (0.5889 => 0.6158, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.00% (0.7171 => 0.7458, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.96% (0.5026 => 0.5225, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (1.6211 => 1.6772, std. dev.: 0.0088) MultiSource/Applications/spiff/spiff: 3.38% (0.4029 => 0.4165, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.32% (0.4361 => 0.4506, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.27% (0.5900 => 0.6093, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.23% (3.5627 => 3.6779, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 3.15% (0.9909 => 1.0221, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.01% (1.3152 => 1.3548, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.92% (2.0673 => 2.1276, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 2.71% (0.3726 => 0.3827, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.3845 => 0.3949, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.70% (4.2109 => 4.3245, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.60% (0.3930 => 0.4032, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.58% (0.5000 => 0.5129, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.47% (0.4658 => 0.4773, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.40% (0.4994 => 0.5114, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.37% (0.9697 => 0.9927, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 2.02% (23.5202 => 23.9964, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.93% (1.9966 => 2.0352, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.92% (1.9694 => 2.0073, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.87% (2.7292 => 2.7802, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.66% (4.4195 => 4.4930, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 1.61% (2.1013 => 2.1352, std. dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 1.45% (5.5417 => 5.6218, std. dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 1.43% (2.1653 => 2.1962, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 1.41% (4.6177 => 4.6826, std. dev.: 0.0100) MultiSource/Benchmarks/MallocBench/gs/gs: 1.31% (1.8794 => 1.9041, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 1.04% (1.4269 => 1.4417, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.37% (2.4764 => 2.3681, std. dev.: 0.0202) MultiSource/Applications/kimwitu++/kc: -2.48% (11.9555 => 11.6595, std. dev.: 0.0198) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.47% (0.4253 => 0.4148, std. dev.: 0.0009) Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 07:16:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 09:16:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120703141605.7D6392A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1735?compare_to=1732&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1735, Order: 159657, Start Time: 2012-07-03 13:01:52, End Time: 2012-07-03 14:16:00 To: 1732, Order: 159648, Start Time: 2012-07-03 08:14:31, End Time: 2012-07-03 09:11:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (129 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 58 (62 on baseline) Unchanged Tests: 894 (727 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.49% (2.0176 => 2.2897, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 7.63% (0.5818 => 0.6262, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.48% (0.5748 => 0.6178, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.90% (0.7061 => 0.7548, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.74% (0.3130 => 0.3341, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.99% (0.7710 => 0.8172, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.88% (0.4062 => 0.4301, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/objinst: 5.84% (0.2945 => 0.3117, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.75% (0.4328 => 0.4577, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.74% (0.1986 => 0.2100, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 5.59% (0.3578 => 0.3778, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.53% (0.7038 => 0.7427, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.51% (1.3693 => 1.4447, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 5.50% (0.2781 => 0.2934, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.24% (0.5265 => 0.5541, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.23% (0.3650 => 0.3841, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.23% (0.3022 => 0.3180, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 5.22% (0.3601 => 0.3789, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.21% (0.2782 => 0.2927, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.21% (0.3646 => 0.3836, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.19% (0.3663 => 0.3853, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.18% (0.2607 => 0.2742, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.15% (0.3789 => 0.3984, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.14% (0.3914 => 0.4115, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.12% (0.2596 => 0.2729, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.11% (0.3623 => 0.3808, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.10% (0.2726 => 0.2865, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (0.2628 => 0.2762, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.09% (0.2690 => 0.2827, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.07% (0.2760 => 0.2900, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.07% (0.2761 => 0.2901, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.05% (0.2655 => 0.2789, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.01% (0.2937 => 0.3084, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 5.00% (0.4003 => 0.4203, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.99% (0.2966 => 0.3114, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.98% (1.9828 => 2.0816, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.96% (0.3489 => 0.3662, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.87% (3.9660 => 4.1591, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 4.85% (0.3940 => 0.4131, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3107 => 0.3255, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.71% (0.2696 => 0.2823, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2721 => 0.2849, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.67% (0.3899 => 0.4081, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.64% (0.3149 => 0.3295, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3580 => 0.3743, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.53% (0.3485 => 0.3643, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.40% (0.3453 => 0.3605, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.39% (0.3192 => 0.3332, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.36% (0.4016 => 0.4191, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2988 => 0.3116, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.25% (0.6959 => 0.7255, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 4.16% (0.3293 => 0.3430, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.13% (0.3534 => 0.3680, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.12% (0.4390 => 0.4571, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.10% (13.8202 => 14.3874, std. dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.10% (0.3756 => 0.3910, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.03% (0.3868 => 0.4024, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.95% (13.2842 => 13.8084, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.92% (0.9199 => 0.9560, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 3.72% (16.6129 => 17.2306, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.67% (1.2193 => 1.2641, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.65% (1.4563 => 1.5095, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.53% (0.5577 => 0.5774, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.2925 => 0.3027, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.39% (0.3246 => 0.3356, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.33% (1.3245 => 1.3686, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 3.30% (1.1061 => 1.1426, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.28% (0.5637 => 0.5822, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.23% (1.1364 => 1.1731, std. dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.17% (0.4379 => 0.4518, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.10% (0.7506 => 0.7739, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.05% (1.0594 => 1.0917, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.04% (0.3755 => 0.3869, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.01% (1.2292 => 1.2662, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.95% (4.9865 => 5.1337, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.94% (7.2180 => 7.4299, std. dev.: 0.0061) MultiSource/Applications/treecc/treecc: 2.92% (1.9270 => 1.9832, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 2.92% (3.8646 => 3.9773, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.89% (1.3813 => 1.4212, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.78% (1.3819 => 1.4203, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.67% (0.7460 => 0.7659, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.50% (3.6692 => 3.7610, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (6.5754 => 6.7260, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 2.22% (14.8535 => 15.1837, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 2.13% (2.1791 => 2.2256, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.12% (16.2614 => 16.6054, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.09% (4.3801 => 4.4717, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.06% (0.8698 => 0.8877, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6135 => 0.6261, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.97% (4.4433 => 4.5309, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6283 => 0.6393, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 1.66% (3.1889 => 3.2419, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.66% (1.1333 => 1.1521, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.63% (14.5298 => 14.7660, std. dev.: 0.0107) MultiSource/Applications/SIBsim4/SIBsim4: 1.54% (1.2749 => 1.2945, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.26% (2.1007 => 2.1272, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.81% (1.8175 => 2.2685, std. dev.: 0.0209) SingleSource/Benchmarks/Misc/mandel-2: 8.76% (1.2998 => 1.4137, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1911, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.25% (0.9996 => 1.0821, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.81% (7.4271 => 7.7104, std. dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6789, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0105) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1917, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.92% (3.6469 => 3.7168, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5339, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (1.9290 => 1.9561, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 1.07% (10.7476 => 10.8629, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.00% (22.5627 => 20.9837, std. dev.: 0.0179) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.39% (0.3511 => 0.3357, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.81% (0.8818 => 0.8570, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.67% (0.6576 => 0.6466, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.49% (0.9108 => 0.8972, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.16% (1.2308 => 1.1058, std. dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.81% (20.3410 => 18.5496, std. dev.: 0.0901) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.24% (1.3780 => 1.3058, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6032, std. dev.: 0.0174) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5117, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.58% (3.0263 => 2.9785, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.49% (6.3560 => 6.2616, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.35% (28.2225 => 27.8419, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2201, std. dev.: 0.0274) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2566, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 07:20:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 09:20:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120703142057.517392A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1736?compare_to=1733&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1736, Order: 159657, Start Time: 2012-07-03 13:02:01, End Time: 2012-07-03 14:20:53 To: 1733, Order: 159648, Start Time: 2012-07-03 09:09:59, End Time: 2012-07-03 10:11:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (50 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 58 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 874 (805 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.97% (10.3673 => 13.5785, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.36% (1.1194 => 1.2466, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.02% (1.7609 => 1.9021, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 7.69% (0.3473 => 0.3740, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.43% (0.3497 => 0.3757, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-4: 7.42% (0.3543 => 0.3806, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 7.39% (0.3516 => 0.3776, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 7.33% (0.3561 => 0.3822, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.28% (0.3543 => 0.3801, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.04% (0.3694 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.84% (0.3828 => 0.4090, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.82% (0.3886 => 0.4151, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.77% (0.3927 => 0.4193, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (0.1622 => 0.1731, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.48% (2.2022 => 2.3449, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.28% (7.0540 => 7.3562, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.4879 => 0.5080, std. dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.97% (0.3177 => 0.3303, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 3.44% (0.5925 => 0.6129, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference-object: 3.33% (0.6030 => 0.6231, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 3.23% (0.3282 => 0.3388, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.18% (0.7433 => 0.7669, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 3.07% (10.4361 => 10.7565, std. dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.64% (0.4615 => 0.4737, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 2.62% (0.7326 => 0.7518, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.59% (0.8172 => 0.8384, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.35% (0.5569 => 0.5700, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.21% (4.9449 => 5.0540, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.16% (14.3668 => 14.6769, std. dev.: 0.0203) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.12% (5.0018 => 5.1080, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: 1.90% (0.7835 => 0.7984, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.77% (4.2646 => 4.3400, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.74% (0.5860 => 0.5962, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (9.4845 => 9.6489, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.71% (8.1363 => 8.2751, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 1.43% (3.3354 => 3.3832, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.43% (2.0273 => 2.0562, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.41% (1.5415 => 1.5633, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.30% (1.1861 => 1.2015, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.27% (17.1811 => 17.3992, std. dev.: 0.0161) MultiSource/Applications/oggenc/oggenc: 1.27% (5.7591 => 5.8320, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 1.00% (3.8723 => 3.9112, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7472, std. dev.: 0.0066) MultiSource/Applications/lua/lua: 2.63% (26.0924 => 26.7775, std. dev.: 0.0125) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (1.5086 => 1.5374, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4472, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.41% (9.1159 => 9.2441, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.22% (2.6546 => 2.6871, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.30% (5.2763 => 3.1497, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.45% (5.3855 => 3.6916, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.13% (5.3526 => 3.6866, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.49% (2.9384 => 2.5419, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -12.83% (22.1758 => 19.3303, std. dev.: 0.0201) SingleSource/UnitTests/Vector/constpool: -5.01% (54.1659 => 51.4533, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.50% (3.8922 => 3.7950, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.30% (0.8101 => 0.7996, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.08% (7.9617 => 7.8757, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.50% (1.2373 => 1.1074, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.20% (19.9488 => 18.5132, std. dev.: 0.0721) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9127, std. dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6866, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0846, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 08:45:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 10:45:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120703154510.886D22A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1737?compare_to=1734&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1737, Order: 159657, Start Time: 2012-07-03 13:01:41, End Time: 2012-07-03 15:45:07 To: 1734, Order: 159648, Start Time: 2012-07-03 09:38:29, End Time: 2012-07-03 11:53:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (44 on baseline) Performance Improvements: 1 (3 on baseline) Added Tests: 58 (58 on baseline) Unchanged Tests: 893 (847 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.56% (2.0944 => 2.0618, std. dev.: 0.0085) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 8.94% (0.3446 => 0.3754, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.83% (0.3465 => 0.3771, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.64% (0.3460 => 0.3759, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.62% (0.3469 => 0.3768, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.50% (0.3496 => 0.3793, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.49% (0.3488 => 0.3784, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 8.48% (0.3442 => 0.3734, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.11% (0.3650 => 0.3946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3643 => 0.3937, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.3724 => 0.4016, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 4.86% (0.5826 => 0.6109, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 4.57% (0.5889 => 0.6158, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.65% (0.2738 => 0.2838, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (1.6211 => 1.6784, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 3.43% (0.7171 => 0.7417, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.32% (0.4361 => 0.4506, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.31% (3.5627 => 3.6805, std. dev.: 0.0053) MultiSource/Applications/spiff/spiff: 3.20% (0.4029 => 0.4158, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.09% (1.3152 => 1.3558, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (2.0673 => 2.1294, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.00% (0.5900 => 0.6077, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.97% (0.9909 => 1.0203, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (0.5026 => 0.5169, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (0.3625 => 0.3726, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 2.71% (4.2109 => 4.3250, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.67% (0.3930 => 0.4035, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.50% (0.4994 => 0.5119, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.50% (0.9697 => 0.9939, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.32% (0.4658 => 0.4766, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.14% (0.5000 => 0.5107, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.00% (1.9694 => 2.0087, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.99% (23.5202 => 23.9886, std. dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.95% (2.7292 => 2.7823, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.90% (1.0781 => 1.0986, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.88% (1.9966 => 2.0341, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 1.70% (1.8794 => 1.9114, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.65% (4.4195 => 4.4924, std. dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (2.1013 => 2.1345, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 1.57% (5.5417 => 5.6286, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 1.57% (2.1653 => 2.1992, std. dev.: 0.0076) MultiSource/Applications/treecc/treecc: 1.50% (0.7875 => 0.7993, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.47% (4.6177 => 4.6857, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 1.09% (1.4269 => 1.4425, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.23% (0.2122 => 0.2233, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.58% (2.4764 => 2.3629, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: -2.46% (11.9555 => 11.6611, std. dev.: 0.0156) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.45% (0.4253 => 0.4149, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 08:57:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 10:57:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120703155729.CBD1E2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1738?compare_to=1735&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1738, Order: 159659, Start Time: 2012-07-03 14:43:17, End Time: 2012-07-03 15:57:26 To: 1735, Order: 159657, Start Time: 2012-07-03 13:01:52, End Time: 2012-07-03 14:16:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (124 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (729 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.07% (2.0176 => 2.2814, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.61% (0.5818 => 0.6261, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.53% (0.7061 => 0.7593, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 7.46% (0.5748 => 0.6177, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.79% (0.4062 => 0.4297, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.64% (0.2945 => 0.3111, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.55% (0.4328 => 0.4568, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.54% (0.1986 => 0.2096, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.46% (0.3022 => 0.3187, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.43% (0.2781 => 0.2932, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 5.35% (1.3693 => 1.4425, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.25% (0.2760 => 0.2905, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2782 => 0.2928, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.24% (0.7038 => 0.7407, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 5.23% (0.3578 => 0.3765, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.22% (0.5265 => 0.5540, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 5.22% (0.2607 => 0.2743, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.7710 => 0.8111, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 5.18% (0.2937 => 0.3089, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.12% (0.2655 => 0.2791, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2628 => 0.2761, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.06% (0.2690 => 0.2826, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.02% (0.2966 => 0.3115, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2726 => 0.2861, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.92% (0.2765 => 0.2901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.91% (0.3646 => 0.3825, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.90% (0.4003 => 0.4199, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.89% (0.2596 => 0.2723, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 4.89% (0.2761 => 0.2896, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 4.89% (0.3601 => 0.3777, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 4.86% (0.3623 => 0.3799, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (1.9828 => 2.0789, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.82% (0.3650 => 0.3826, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 4.80% (0.3663 => 0.3839, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.80% (0.3789 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.80% (0.3914 => 0.4102, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.70% (0.3149 => 0.3297, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.64% (3.9660 => 4.1502, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary: 4.63% (0.3107 => 0.3251, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 4.57% (0.3940 => 0.4120, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.57% (0.3899 => 0.4077, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.50% (0.3489 => 0.3646, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.50% (0.3580 => 0.3741, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.45% (0.2988 => 0.3121, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4390 => 0.4584, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 4.37% (0.3453 => 0.3604, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.35% (0.3192 => 0.3331, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.33% (0.3485 => 0.3636, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4016 => 0.4187, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.25% (0.3293 => 0.3433, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.10% (0.3756 => 0.3910, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.02% (0.3534 => 0.3676, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.6959 => 0.7231, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 3.76% (13.8202 => 14.3392, std. dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3868 => 0.4013, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.70% (0.9199 => 0.9539, std. dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 3.62% (16.6129 => 17.2144, std. dev.: 0.0165) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.58% (13.2842 => 13.7592, std. dev.: 0.0126) MultiSource/Benchmarks/McCat/09-vor/vor: 3.56% (0.2925 => 0.3029, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.31% (1.2193 => 1.2596, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.23% (0.5577 => 0.5757, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.08% (1.4563 => 1.5011, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 3.01% (0.7506 => 0.7732, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.98% (1.2292 => 1.2658, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.96% (0.3755 => 0.3866, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 2.94% (1.1061 => 1.1386, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.90% (0.4379 => 0.4506, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.89% (1.3245 => 1.3628, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.85% (4.9865 => 5.1286, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.81% (1.1364 => 1.1683, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.80% (1.9270 => 1.9810, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 2.78% (3.8646 => 3.9722, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 2.69% (1.0594 => 1.0879, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.64% (7.2180 => 7.4086, std. dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.36% (0.7460 => 0.7636, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.26% (1.3819 => 1.4132, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.25% (1.3813 => 1.4124, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.14% (3.6692 => 3.7479, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 2.12% (0.8310 => 0.8486, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.98% (4.3801 => 4.4668, std. dev.: 0.0056) MultiSource/Applications/siod/siod: 1.95% (2.1791 => 2.2215, std. dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 1.89% (14.8535 => 15.1340, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.89% (0.8698 => 0.8862, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 1.87% (6.5754 => 6.6981, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.84% (16.2614 => 16.5600, std. dev.: 0.0250) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.75% (4.4433 => 4.5211, std. dev.: 0.0080) MultiSource/Applications/d/make_dparser: 1.60% (3.1889 => 3.2399, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 1.45% (14.5298 => 14.7398, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.42% (1.1333 => 1.1494, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (1.2749 => 1.2906, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.70% (1.8175 => 2.2664, std. dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1903, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 7.60% (1.2998 => 1.3986, std. dev.: 0.0092) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.95% (7.4271 => 7.7202, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9225, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6797, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8320, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4803, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1909, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.86% (1.4298 => 1.4564, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.66% (3.6469 => 3.7075, std. dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5089 => 1.5332, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1965, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (22.5627 => 20.9353, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.04% (0.3511 => 0.3334, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.31% (0.8818 => 0.8526, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.93% (0.6576 => 0.6449, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.82% (0.9108 => 0.8942, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (6.2785 => 6.2139, std. dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -9.53% (1.2308 => 1.1135, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.53% (20.3410 => 18.6052, std. dev.: 0.0197) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3063, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5959, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5026, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2519, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.52% (3.0263 => 2.9804, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8434, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2550, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8719, std. dev.: 0.0113) MultiSource/Applications/lua/lua: -1.14% (26.5159 => 26.2134, std. dev.: 0.0374) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8482, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 09:07:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 11:07:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120703160702.A31A42A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1739?compare_to=1736&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1739, Order: 159659, Start Time: 2012-07-03 14:48:10, End Time: 2012-07-03 16:06:58 To: 1736, Order: 159657, Start Time: 2012-07-03 13:02:01, End Time: 2012-07-03 14:20:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (48 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (807 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.01% (13.5785 => 13.8508, std. dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.60% (10.3673 => 13.8508, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.57% (1.1194 => 1.2489, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.26% (1.7609 => 1.8888, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 7.11% (0.3473 => 0.3720, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.03% (0.3497 => 0.3743, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.94% (0.3543 => 0.3789, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 6.89% (0.3543 => 0.3787, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.77% (0.3561 => 0.3802, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (0.1622 => 0.1731, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.71% (0.3516 => 0.3752, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 6.61% (0.3694 => 0.3938, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 6.30% (0.3828 => 0.4069, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.21% (0.3927 => 0.4171, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.20% (0.3886 => 0.4127, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.19% (2.2022 => 2.3385, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.99% (0.2065 => 0.2168, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.4879 => 0.5078, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.99% (7.0540 => 7.3358, std. dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: 3.98% (10.4361 => 10.8515, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.90% (0.3177 => 0.3301, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 3.05% (0.5925 => 0.6106, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.03% (0.6030 => 0.6213, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.85% (0.7433 => 0.7645, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 2.44% (0.7326 => 0.7505, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.41% (0.5569 => 0.5703, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (14.3668 => 14.6816, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.10% (4.9449 => 5.0489, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (0.8172 => 0.8336, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.84% (5.0018 => 5.0937, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 1.67% (0.7835 => 0.7966, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.53% (8.1363 => 8.2606, std. dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (9.4845 => 9.6190, std. dev.: 0.0181) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.42% (4.2646 => 4.3250, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.38% (1.5415 => 1.5627, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 1.25% (3.3354 => 3.3770, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.22% (17.1811 => 17.3905, std. dev.: 0.0142) MultiSource/Applications/oggenc/oggenc: 1.12% (5.7591 => 5.8237, std. dev.: 0.0069) MultiSource/Applications/treecc/treecc: 1.07% (2.0273 => 2.0490, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7527, std. dev.: 0.0077) MultiSource/Applications/lua/lua: 2.65% (26.0924 => 26.7840, std. dev.: 0.0374) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (1.5086 => 1.5365, std. dev.: 0.0013) MultiSource/Benchmarks/llubenchmark/llu: 1.65% (3.7781 => 3.8406, std. dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.45% (9.1159 => 9.2480, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6900, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.28% (5.2763 => 3.1508, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.44% (5.3855 => 3.6921, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.04% (5.3526 => 3.6913, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.36% (2.9384 => 2.5457, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -13.05% (22.1758 => 19.2828, std. dev.: 0.0155) SingleSource/UnitTests/Vector/constpool: -4.92% (54.1659 => 51.5027, std. dev.: 0.0224) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.91% (3.8922 => 3.7791, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.83% (0.8101 => 0.7953, std. dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.02% (7.9617 => 7.8806, std. dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1166, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.89% (19.9488 => 18.5739, std. dev.: 0.0709) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9183, std. dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6906, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0845, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 10:39:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 12:39:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120703173926.007672A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1740?compare_to=1738&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1740, Order: 159662, Start Time: 2012-07-03 16:24:55, End Time: 2012-07-03 17:39:21 To: 1738, Order: 159659, Start Time: 2012-07-03 14:43:17, End Time: 2012-07-03 15:57:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (124 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (728 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.61% (3.8789 => 3.7777, std. dev.: 0.0169) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.07% (2.0176 => 2.2812, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.66% (0.7061 => 0.7602, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.34% (0.5818 => 0.6245, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.03% (0.5748 => 0.6152, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.3130 => 0.3333, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4328 => 0.4596, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.08% (0.4062 => 0.4309, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.04% (0.1986 => 0.2106, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.01% (0.2945 => 0.3122, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 5.87% (1.3693 => 1.4497, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.82% (0.2782 => 0.2944, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.79% (0.2781 => 0.2942, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2607 => 0.2753, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.43% (0.2966 => 0.3127, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.42% (0.2655 => 0.2799, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2690 => 0.2835, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.37% (0.7038 => 0.7416, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/except: 5.36% (0.2760 => 0.2908, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.34% (0.7710 => 0.8122, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 5.34% (0.3107 => 0.3273, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.33% (0.3022 => 0.3183, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.32% (0.2761 => 0.2908, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.29% (0.2628 => 0.2767, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.28% (0.2726 => 0.2870, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.24% (0.2937 => 0.3091, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3149 => 0.3314, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.13% (1.9828 => 2.0846, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (0.2765 => 0.2906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.09% (0.3578 => 0.3760, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2696 => 0.2833, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.03% (0.5265 => 0.5530, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 4.94% (0.3789 => 0.3976, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.90% (0.3489 => 0.3660, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.89% (0.3580 => 0.3755, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 4.88% (0.3646 => 0.3824, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.83% (0.3663 => 0.3840, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.83% (0.3601 => 0.3775, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.82% (0.3899 => 0.4087, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2988 => 0.3132, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.82% (0.2596 => 0.2721, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 4.80% (0.3914 => 0.4102, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.77% (0.4003 => 0.4194, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 4.75% (0.3623 => 0.3795, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.64% (3.9660 => 4.1502, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary2: 4.64% (0.3192 => 0.3340, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.62% (0.3940 => 0.4122, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.56% (0.3485 => 0.3644, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.56% (0.4016 => 0.4199, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 4.53% (0.3534 => 0.3694, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.3756 => 0.3923, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.40% (0.3293 => 0.3438, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 4.03% (0.3868 => 0.4024, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.95% (0.6959 => 0.7234, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.92% (0.4390 => 0.4562, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 3.77% (13.8202 => 14.3410, std. dev.: 0.0113) MultiSource/Applications/kimwitu++/kc: 3.76% (16.6129 => 17.2380, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.67% (0.9199 => 0.9537, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.50% (13.2842 => 13.7486, std. dev.: 0.0134) MultiSource/Benchmarks/McCat/09-vor/vor: 3.45% (0.2925 => 0.3026, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.40% (1.2193 => 1.2608, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.29% (0.7506 => 0.7753, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.28% (1.4563 => 1.5040, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.18% (1.2292 => 1.2683, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.16% (0.5577 => 0.5753, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3755 => 0.3870, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.00% (0.5637 => 0.5806, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (3.8646 => 3.9779, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.92% (1.3245 => 1.3632, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.90% (0.4379 => 0.4506, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 2.87% (1.1061 => 1.1379, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.85% (1.1364 => 1.1688, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.83% (4.9865 => 5.1276, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 2.73% (1.9270 => 1.9796, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.54% (7.2180 => 7.4010, std. dev.: 0.0075) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.53% (1.3813 => 1.4163, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.45% (1.3819 => 1.4158, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.39% (0.7460 => 0.7638, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.32% (2.1791 => 2.2297, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.13% (0.8310 => 0.8487, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (3.6692 => 3.7442, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.02% (0.8698 => 0.8874, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.94% (4.3801 => 4.4649, std. dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 1.91% (14.8535 => 15.1378, std. dev.: 0.0135) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (6.5754 => 6.6988, std. dev.: 0.0101) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.76% (4.4433 => 4.5217, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.75% (16.2614 => 16.5465, std. dev.: 0.0350) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.73% (0.6135 => 0.6241, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (1.1333 => 1.1511, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.56% (3.1889 => 3.2385, std. dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2928, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 1.35% (14.5298 => 14.7257, std. dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 24.95% (1.8175 => 2.2710, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.53% (2.0200 => 2.1924, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.06% (0.9996 => 1.0802, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 7.85% (1.2998 => 1.4018, std. dev.: 0.0079) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.02% (7.4271 => 7.7257, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6786, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 2.00% (1.4298 => 1.4584, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6469 => 3.7088, std. dev.: 0.0041) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0117) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (1.9290 => 1.9552, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.14% (22.5627 => 20.9511, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.84% (0.3511 => 0.3341, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.07% (0.6576 => 0.6440, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.77% (0.9108 => 0.8947, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.09% (6.2785 => 6.2102, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.09% (1.2308 => 1.1066, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.72% (20.3410 => 18.5680, std. dev.: 0.0150) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3154, std. dev.: 0.0092) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5871, std. dev.: 0.0137) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2467, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.48% (2.5254 => 2.4880, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: -1.48% (3.0263 => 2.9816, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.43% (9.3358 => 9.2025, std. dev.: 0.0506) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.35% (28.2225 => 27.8427, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8663, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2529, std. dev.: 0.0056) MultiSource/Applications/lua/lua: -1.04% (26.5159 => 26.2394, std. dev.: 0.0327) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8494, std. dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 10:52:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 12:52:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120703175258.88A852A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1741?compare_to=1739&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1741, Order: 159662, Start Time: 2012-07-03 16:34:18, End Time: 2012-07-03 17:52:55 To: 1739, Order: 159659, Start Time: 2012-07-03 14:48:10, End Time: 2012-07-03 16:06:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (46 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (809 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.63% (10.3673 => 13.8538, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.64% (1.1194 => 1.2497, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.29% (1.7609 => 1.8892, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.05% (0.3473 => 0.3718, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (0.1622 => 0.1733, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 6.81% (0.3497 => 0.3735, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 6.77% (0.3543 => 0.3783, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.77% (0.3543 => 0.3783, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.74% (0.3516 => 0.3753, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.74% (0.3561 => 0.3801, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/for-in: 6.52% (0.3694 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.26% (0.3927 => 0.4173, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.25% (2.2022 => 2.3399, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.22% (0.3828 => 0.4066, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.20% (0.3886 => 0.4127, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.05% (10.4361 => 10.8591, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.00% (0.4879 => 0.5074, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.93% (0.3177 => 0.3302, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.93% (7.0540 => 7.3311, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 3.07% (0.5925 => 0.6107, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.00% (0.6030 => 0.6211, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.92% (0.7433 => 0.7650, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 2.87% (0.7326 => 0.7536, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (14.3668 => 14.6860, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.08% (0.5569 => 0.5685, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.02% (4.9449 => 5.0448, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (0.8172 => 0.8327, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.84% (5.0018 => 5.0936, std. dev.: 0.0107) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.69% (4.2646 => 4.3365, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: 1.61% (0.7835 => 0.7961, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.51% (8.1363 => 8.2593, std. dev.: 0.0077) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (9.4845 => 9.6192, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 1.41% (3.3354 => 3.3825, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.30% (17.1811 => 17.4043, std. dev.: 0.0451) MultiSource/Applications/Burg/burg: 1.21% (1.1642 => 1.1783, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 1.15% (5.7591 => 5.8251, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.13% (1.5415 => 1.5589, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7513, std. dev.: 0.0047) MultiSource/Applications/lua/lua: 2.76% (26.0924 => 26.8135, std. dev.: 0.0349) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5358, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4472, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2400, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6886, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1247, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.31% (5.2763 => 3.1494, std. dev.: 0.0172) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.51% (5.3855 => 3.6885, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.17% (5.3526 => 3.6843, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.40% (2.9384 => 2.5447, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -12.98% (22.1758 => 19.2979, std. dev.: 0.0124) SingleSource/UnitTests/Vector/constpool: -4.93% (54.1659 => 51.4977, std. dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.83% (3.8922 => 3.7819, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.75% (0.8101 => 0.7959, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.34% (7.9617 => 7.8549, std. dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.39% (1.2373 => 1.1087, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.20% (19.9488 => 18.5133, std. dev.: 0.0768) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (8.1563 => 7.9197, std. dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6844, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0866, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 11:55:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 13:55:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120703185531.2C8162A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1742?compare_to=1737&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1742, Order: 159662, Start Time: 2012-07-03 16:12:26, End Time: 2012-07-03 18:55:28 To: 1737, Order: 159657, Start Time: 2012-07-03 13:01:41, End Time: 2012-07-03 15:45:07 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (41 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (851 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.57% (1.6012 => 1.6263, std. dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 8.39% (0.3446 => 0.3735, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.25% (0.3465 => 0.3751, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.24% (0.3460 => 0.3745, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.19% (0.3469 => 0.3753, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.15% (0.3496 => 0.3781, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.08% (0.3442 => 0.3720, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.00% (0.3488 => 0.3767, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.70% (0.3650 => 0.3931, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.69% (0.3643 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.3724 => 0.4003, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.67% (0.5826 => 0.6098, std. dev.: 0.0072) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.67% (0.3792 => 0.3969, std. dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference-object: 4.08% (0.5889 => 0.6129, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.46% (0.5900 => 0.6104, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.39% (1.6211 => 1.6761, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.35% (0.4361 => 0.4507, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.29% (3.5627 => 3.6800, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.22% (0.5026 => 0.5188, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.08% (1.3152 => 1.3557, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.03% (0.4029 => 0.4151, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 2.94% (0.7171 => 0.7382, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.86% (0.4994 => 0.5137, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.78% (4.2109 => 4.3278, std. dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.60% (0.5000 => 0.5130, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.43% (2.0673 => 2.1175, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.31% (0.9909 => 1.0138, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.12% (1.9694 => 2.0112, std. dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 2.08% (1.5932 => 1.6263, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.98% (0.9697 => 0.9889, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.89% (1.0781 => 1.0985, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (4.4195 => 4.5020, std. dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.84% (1.9966 => 2.0334, std. dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (2.7292 => 2.7756, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 1.58% (23.5202 => 23.8921, std. dev.: 0.0140) MultiSource/Applications/JM/ldecod/ldecod: 1.55% (2.1653 => 2.1989, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.47% (4.6177 => 4.6858, std. dev.: 0.0127) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (2.1013 => 2.1311, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 1.34% (1.8794 => 1.9045, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 1.31% (5.5417 => 5.6141, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 1.39% (2.8036 => 2.8427, std. dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.64% (2.4764 => 2.3614, std. dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: -2.58% (11.9555 => 11.6466, std. dev.: 0.0147) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 12:22:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 14:22:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120703192220.1024C2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1743?compare_to=1740&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1743, Order: 159668, Start Time: 2012-07-03 18:07:47, End Time: 2012-07-03 19:22:14 To: 1740, Order: 159662, Start Time: 2012-07-03 16:24:55, End Time: 2012-07-03 17:39:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (125 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (731 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.63% (54.5293 => 56.5111, std. dev.: 0.0270) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.32% (2.0176 => 2.2863, std. dev.: 0.0137) SingleSource/UnitTests/ObjC++/property-reference: 7.95% (0.7061 => 0.7622, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 7.84% (0.5818 => 0.6274, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.45% (0.5748 => 0.6176, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.79% (0.4062 => 0.4338, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 6.76% (0.2945 => 0.3144, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (0.4328 => 0.4618, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0047) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2781 => 0.2962, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.49% (0.3022 => 0.3218, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.40% (0.2655 => 0.2825, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.40% (0.2782 => 0.2960, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2690 => 0.2860, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.25% (0.2607 => 0.2770, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2760 => 0.2932, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.21% (1.3693 => 1.4543, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2761 => 0.2932, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.16% (0.2628 => 0.2790, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.2937 => 0.3117, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.11% (0.2765 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.09% (0.2726 => 0.2892, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.97% (0.2966 => 0.3143, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 5.97% (0.7038 => 0.7458, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.93% (0.2696 => 0.2856, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.87% (1.9828 => 2.0991, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.85% (0.3899 => 0.4127, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.83% (0.3107 => 0.3288, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.79% (0.1986 => 0.2101, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.75% (0.3149 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.73% (0.7710 => 0.8152, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.65% (0.3489 => 0.3686, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 5.59% (0.3453 => 0.3646, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (0.3485 => 0.3675, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.42% (0.3192 => 0.3365, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.35% (0.2988 => 0.3148, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.34% (0.3580 => 0.3771, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.28% (0.4016 => 0.4228, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (0.3756 => 0.3954, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.20% (0.2596 => 0.2731, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.19% (0.3293 => 0.3464, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.19% (0.5265 => 0.5538, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: 5.07% (0.3534 => 0.3713, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.03% (0.3578 => 0.3758, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.01% (3.9660 => 4.1648, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 4.94% (0.3789 => 0.3976, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 4.91% (0.3663 => 0.3843, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 4.80% (0.3646 => 0.3821, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.75% (0.3914 => 0.4100, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.75% (0.4003 => 0.4193, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.74% (0.3650 => 0.3823, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 4.68% (0.3868 => 0.4049, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.67% (0.4390 => 0.4595, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 4.64% (0.3623 => 0.3791, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 4.62% (0.3940 => 0.4122, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.38% (0.6959 => 0.7264, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 4.38% (16.6129 => 17.3404, std. dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 4.13% (13.8202 => 14.3908, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.89% (0.9199 => 0.9557, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.78% (0.3755 => 0.3897, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.77% (1.2292 => 1.2756, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.70% (13.2842 => 13.7763, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.66% (1.2193 => 1.2639, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (1.4563 => 1.5092, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.2925 => 0.3031, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.57% (1.3245 => 1.3718, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.44% (0.5577 => 0.5769, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.42% (4.9865 => 5.1570, std. dev.: 0.0150) MultiSource/Benchmarks/MallocBench/gs/gs: 3.36% (3.8646 => 3.9943, std. dev.: 0.0090) MultiSource/Applications/spiff/spiff: 3.33% (0.7506 => 0.7756, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.33% (1.1061 => 1.1429, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.31% (0.4379 => 0.4524, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.14% (0.5637 => 0.5814, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.12% (1.1364 => 1.1718, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.0594 => 1.0914, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 3.02% (1.9270 => 1.9852, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.82% (7.2180 => 7.4219, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.77% (0.7460 => 0.7667, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.74% (1.3819 => 1.4198, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.71% (1.3813 => 1.4188, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.59% (0.8698 => 0.8923, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.56% (2.1791 => 2.2348, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (0.8310 => 0.8522, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.34% (3.6692 => 3.7552, std. dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 2.18% (14.8535 => 15.1766, std. dev.: 0.0105) MultiSource/Applications/JM/ldecod/ldecod: 2.17% (6.5754 => 6.7184, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.10% (4.3801 => 4.4723, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.00% (4.4433 => 4.5322, std. dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 1.97% (16.2614 => 16.5824, std. dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.94% (0.6283 => 0.6405, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.72% (3.1889 => 3.2436, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.62% (1.1333 => 1.1517, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 1.55% (14.5298 => 14.7557, std. dev.: 0.0161) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (1.2749 => 1.2942, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1921, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 8.42% (1.2998 => 1.4092, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.97% (7.4271 => 7.7222, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (12.4560 => 12.9184, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6792, std. dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8314, std. dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.97% (1.4298 => 1.4580, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.94% (4.1080 => 4.1878, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.92% (3.6469 => 3.7169, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.48% (1.5089 => 1.5312, std. dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.69% (22.5627 => 21.0525, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.33% (0.3511 => 0.3359, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.65% (0.8818 => 0.8584, std. dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.73% (1.2308 => 1.1111, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.85% (20.3410 => 18.5415, std. dev.: 0.0653) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.65% (1.3780 => 1.3139, std. dev.: 0.0078) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.49% (1.9762 => 1.9072, std. dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5935, std. dev.: 0.0251) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4477, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5092, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2538, std. dev.: 0.0031) MultiSource/Applications/spiff/spiff: -1.55% (3.0263 => 2.9795, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.51% (0.9692 => 0.9546, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4888, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8606, std. dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8436, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: -1.34% (9.3358 => 9.2110, std. dev.: 0.0406) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2498, std. dev.: 0.0035) MultiSource/Applications/lua/lua: -1.08% (26.5159 => 26.2294, std. dev.: 0.0319) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 12:38:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 14:38:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120703193858.4770C2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1744?compare_to=1741&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1744, Order: 159668, Start Time: 2012-07-03 18:20:13, End Time: 2012-07-03 19:38:53 To: 1741, Order: 159662, Start Time: 2012-07-03 16:34:18, End Time: 2012-07-03 17:52:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (40 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (814 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.51% (55.2276 => 56.6120, std. dev.: 0.0253) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.31% (13.8538 => 13.2564, std. dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.87% (10.3673 => 13.2564, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.15% (1.1194 => 1.2442, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 7.23% (0.3473 => 0.3724, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.11% (0.3543 => 0.3795, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.08% (0.3516 => 0.3765, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.02% (1.7609 => 1.8845, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-2: 6.98% (0.3497 => 0.3741, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.94% (0.3561 => 0.3808, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.89% (0.3543 => 0.3787, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.69% (0.3694 => 0.3941, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.61% (0.3828 => 0.4081, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.44% (0.3927 => 0.4180, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.36% (0.3886 => 0.4133, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.98% (2.2022 => 2.3340, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.59% (0.3177 => 0.3291, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.57% (0.4879 => 0.5053, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.43% (7.0540 => 7.2962, std. dev.: 0.0068) SingleSource/UnitTests/ObjC++/Hello: 3.11% (0.5925 => 0.6109, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 3.04% (10.4361 => 10.7530, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference-object: 3.03% (0.6030 => 0.6213, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.84% (0.7326 => 0.7534, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.65% (0.7433 => 0.7630, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (0.8172 => 0.8332, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.87% (4.9449 => 5.0374, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (14.3668 => 14.6302, std. dev.: 0.0157) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.79% (5.0018 => 5.0911, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.63% (0.7835 => 0.7963, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 1.51% (9.4845 => 9.6273, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.34% (8.1363 => 8.2457, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.19% (4.2646 => 4.3154, std. dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 1.14% (17.1811 => 17.3771, std. dev.: 0.0215) MultiSource/Applications/d/make_dparser: 1.14% (3.3354 => 3.3733, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9742, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7465, std. dev.: 0.0049) MultiSource/Applications/lua/lua: 2.84% (26.0924 => 26.8344, std. dev.: 0.0344) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.94% (1.5086 => 1.5379, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4460, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2398, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6878, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1244, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.27% (5.2763 => 3.1514, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.06% (5.3855 => 3.6591, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.82% (5.3526 => 3.6494, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.71% (2.9384 => 2.5354, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -13.20% (22.1758 => 19.2479, std. dev.: 0.0232) SingleSource/UnitTests/Vector/constpool: -4.95% (54.1659 => 51.4824, std. dev.: 0.0749) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.03% (3.8922 => 3.7742, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.81% (0.8101 => 0.7954, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.20% (7.9617 => 7.8659, std. dev.: 0.0092) MultiSource/Applications/JM/lencod/lencod: -1.00% (21.9371 => 21.7177, std. dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.30% (1.2373 => 1.1098, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.90% (19.9488 => 18.5715, std. dev.: 0.0262) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9159, std. dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6835, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0848, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 14:04:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 16:04:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120703210418.2743F2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1745?compare_to=1743&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1745, Order: 159674, Start Time: 2012-07-03 19:49:45, End Time: 2012-07-03 21:04:13 To: 1743, Order: 159668, Start Time: 2012-07-03 18:07:47, End Time: 2012-07-03 19:22:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (126 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (728 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.24% (2.0176 => 2.2847, std. dev.: 0.0176) SingleSource/UnitTests/ObjC++/property-reference: 7.65% (0.7061 => 0.7601, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 7.59% (0.2781 => 0.2992, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 7.29% (0.5818 => 0.6242, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.03% (0.5748 => 0.6152, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.52% (0.2655 => 0.2828, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.47% (0.4062 => 0.4325, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 6.35% (0.2945 => 0.3132, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.26% (0.4328 => 0.4599, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.93% (0.2782 => 0.2947, std. dev.: 0.0054) MultiSource/Applications/hbd/hbd: 5.92% (1.3693 => 1.4504, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.86% (0.2765 => 0.2927, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 5.85% (0.7038 => 0.7450, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/random: 5.80% (0.2690 => 0.2846, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.76% (0.3022 => 0.3196, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.69% (0.1986 => 0.2099, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.67% (0.2628 => 0.2777, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.56% (1.9828 => 2.0930, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.51% (0.7710 => 0.8135, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2596 => 0.2738, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.3107 => 0.3275, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.31% (0.4390 => 0.4623, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.30% (0.3149 => 0.3316, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.23% (0.3899 => 0.4103, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.19% (0.3489 => 0.3670, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.09% (0.5265 => 0.5533, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.08% (0.3580 => 0.3762, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.08% (0.3485 => 0.3662, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.98% (0.3192 => 0.3351, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.86% (0.4016 => 0.4211, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.83% (3.9660 => 4.1576, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.74% (0.3293 => 0.3449, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 4.58% (0.3534 => 0.3696, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.56% (0.6959 => 0.7276, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 4.36% (16.6129 => 17.3366, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 4.34% (0.3868 => 0.4036, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 4.22% (0.3789 => 0.3949, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 4.22% (0.3578 => 0.3729, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 4.11% (0.3914 => 0.4075, std. dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 4.08% (13.8202 => 14.3838, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 4.05% (0.4003 => 0.4165, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.00% (0.3650 => 0.3796, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 4.00% (0.3601 => 0.3745, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.98% (0.9199 => 0.9565, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 3.96% (0.3663 => 0.3808, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 3.93% (0.3940 => 0.4095, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 3.92% (0.3623 => 0.3765, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.89% (0.3646 => 0.3788, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.82% (0.5577 => 0.5790, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.73% (1.4563 => 1.5106, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.67% (13.2842 => 13.7711, std. dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3755 => 0.3890, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.56% (1.2193 => 1.2627, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.2925 => 0.3028, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.46% (1.2292 => 1.2717, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.45% (4.9865 => 5.1587, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.39% (1.3245 => 1.3694, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 3.25% (0.7506 => 0.7750, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 3.24% (3.8646 => 3.9900, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.23% (0.5637 => 0.5819, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.19% (1.1061 => 1.1414, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.99% (1.9270 => 1.9847, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.0594 => 1.0911, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.98% (1.1364 => 1.1703, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.76% (0.7460 => 0.7666, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (1.3819 => 1.4179, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.60% (7.2180 => 7.4055, std. dev.: 0.0099) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.55% (1.3813 => 1.4165, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.48% (2.1791 => 2.2332, std. dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/football/football: 2.47% (0.8310 => 0.8515, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.46% (0.8698 => 0.8912, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.35% (0.6135 => 0.6279, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.25% (3.6692 => 3.7518, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 2.11% (6.5754 => 6.7142, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 2.09% (14.8535 => 15.1639, std. dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.02% (4.3801 => 4.4684, std. dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 1.87% (16.2614 => 16.5648, std. dev.: 0.0242) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.86% (4.4433 => 4.5259, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6283 => 0.6393, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 1.65% (3.1889 => 3.2416, std. dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: 1.49% (14.5298 => 14.7469, std. dev.: 0.0104) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2936, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.29% (2.1007 => 2.1279, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.96% (1.8175 => 2.2711, std. dev.: 0.0463) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.27% (2.0200 => 2.1870, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 7.55% (1.2998 => 1.3979, std. dev.: 0.0136) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.7000, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.11% (0.2093 => 0.2200, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7315, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6787, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.55% (1.7688 => 1.8316, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1889, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.87% (1.4298 => 1.4565, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.64% (3.6469 => 3.7066, std. dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (1.9290 => 1.9554, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.79% (22.5627 => 21.0316, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.64% (0.3511 => 0.3348, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.63% (0.8818 => 0.8586, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.46% (0.9108 => 0.8975, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.04% (1.2308 => 1.1072, std. dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.06% (20.3410 => 18.4972, std. dev.: 0.0709) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.24% (1.3780 => 1.3196, std. dev.: 0.0035) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5878, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2543, std. dev.: 0.0058) MultiSource/Applications/spiff/spiff: -1.45% (3.0263 => 2.9824, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.35% (28.2225 => 27.8428, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2509, std. dev.: 0.0041) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2340, std. dev.: 0.0214) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.3305 => 7.2541, std. dev.: 0.0045) MultiSource/Applications/lua/lua: -1.04% (26.5159 => 26.2414, std. dev.: 0.0182) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 14:24:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 16:24:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120703212459.9F2CF2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1746?compare_to=1744&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1746, Order: 159676, Start Time: 2012-07-03 20:06:13, End Time: 2012-07-03 21:24:54 To: 1744, Order: 159668, Start Time: 2012-07-03 18:20:13, End Time: 2012-07-03 19:38:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (45 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (810 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.05% (2.0695 => 2.0913, std. dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.73% (10.3673 => 13.2419, std. dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.60% (1.1194 => 1.2493, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.09% (0.3473 => 0.3754, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 7.75% (0.3497 => 0.3768, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.73% (0.3543 => 0.3817, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.71% (0.3516 => 0.3787, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.68% (0.3543 => 0.3815, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.64% (0.3561 => 0.3833, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.48% (1.7609 => 1.8927, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.47% (0.3694 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.24% (0.3828 => 0.4105, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.23% (0.3886 => 0.4167, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.03% (0.3927 => 0.4203, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.23% (2.2022 => 2.3393, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.87% (0.3177 => 0.3300, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.4879 => 0.5064, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.76% (7.0540 => 7.3191, std. dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 3.55% (0.6030 => 0.6244, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 3.54% (0.5925 => 0.6135, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 3.29% (0.7326 => 0.7567, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.07% (10.4361 => 10.7560, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 2.58% (0.7433 => 0.7625, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.34% (0.8172 => 0.8363, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.03% (0.5569 => 0.5682, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.99% (4.9449 => 5.0433, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (14.3668 => 14.6463, std. dev.: 0.0095) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.94% (5.0018 => 5.0988, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: 1.74% (0.7835 => 0.7971, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.61% (8.1363 => 8.2672, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (9.4845 => 9.6363, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.35% (4.2646 => 4.3220, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.21% (2.0273 => 2.0518, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.20% (2.0665 => 2.0913, std. dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 1.18% (17.1811 => 17.3830, std. dev.: 0.0157) MultiSource/Applications/d/make_dparser: 1.17% (3.3354 => 3.3743, std. dev.: 0.0140) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.10% (1.5415 => 1.5584, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.04% (1.5603 => 1.5766, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7551, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 2.73% (26.0924 => 26.8044, std. dev.: 0.0332) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (1.5086 => 1.5388, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6893, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2333, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.16% (5.2763 => 3.1572, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.72% (5.3855 => 3.6773, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.45% (5.3526 => 3.6693, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.40% (2.9384 => 2.5446, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -13.09% (22.1758 => 19.2719, std. dev.: 0.0116) SingleSource/UnitTests/Vector/constpool: -4.84% (54.1659 => 51.5456, std. dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.01% (3.8922 => 3.7750, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.72% (0.8101 => 0.7962, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.14% (7.9617 => 7.8708, std. dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2373 => 1.1156, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.18% (19.9488 => 18.5171, std. dev.: 0.0183) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9184, std. dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6794, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0861, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 15:05:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 17:05:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120703220555.B2E482A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1747?compare_to=1742&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1747, Order: 159674, Start Time: 2012-07-03 19:22:45, End Time: 2012-07-03 22:05:51 To: 1742, Order: 159662, Start Time: 2012-07-03 16:12:26, End Time: 2012-07-03 18:55:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (34 on baseline) Performance Improvements: 2 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 949 (858 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 25.70% (59.7016 => 75.0448, std. dev.: 0.0293) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.91% (1.6263 => 1.5953, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -1.60% (1.5286 => 1.5042, std. dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 7.75% (0.3446 => 0.3713, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-4: 7.73% (0.3465 => 0.3733, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.57% (0.3460 => 0.3722, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.52% (0.3469 => 0.3730, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.52% (0.3496 => 0.3759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.44% (0.3442 => 0.3698, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.43% (0.3488 => 0.3747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.32% (0.3650 => 0.3917, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.11% (0.3643 => 0.3902, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 6.93% (0.3724 => 0.3982, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.02% (0.5826 => 0.6060, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.62% (0.5889 => 0.6102, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.00% (0.4029 => 0.4150, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.99% (1.6211 => 1.6695, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.89% (0.4361 => 0.4487, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.81% (0.5026 => 0.5167, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.75% (0.5900 => 0.6062, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.70% (3.5627 => 3.6590, std. dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference: 2.54% (0.7171 => 0.7353, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (1.3152 => 1.3485, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.52% (2.0673 => 2.1193, std. dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: 2.22% (4.2109 => 4.3044, std. dev.: 0.0091) MultiSource/Applications/hexxagon/hexxagon: 2.22% (0.9909 => 1.0129, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.14% (0.4994 => 0.5101, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 1.56% (0.9697 => 0.9848, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.55% (1.9694 => 2.0000, std. dev.: 0.0063) MultiSource/Applications/d/make_dparser: 1.52% (1.0781 => 1.0945, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 1.49% (23.5202 => 23.8707, std. dev.: 0.0165) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.48% (2.7292 => 2.7697, std. dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 1.44% (5.5417 => 5.6216, std. dev.: 0.0096) MultiSource/Benchmarks/MallocBench/gs/gs: 1.32% (1.8794 => 1.9042, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.26% (1.9966 => 2.0217, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.20% (4.4195 => 4.4726, std. dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.2122 => 0.2242, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.43% (2.4764 => 2.3668, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: -2.52% (11.9555 => 11.6539, std. dev.: 0.0113) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 15:46:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 17:46:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120703224605.C70952A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1748?compare_to=1745&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1748, Order: 159684, Start Time: 2012-07-03 21:31:35, End Time: 2012-07-03 22:46:01 To: 1745, Order: 159674, Start Time: 2012-07-03 19:49:45, End Time: 2012-07-03 21:04:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (125 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (728 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.99% (2.0176 => 2.2796, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 6.73% (0.7061 => 0.7536, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference-object: 6.38% (0.5818 => 0.6189, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.14% (0.5748 => 0.6101, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.98% (0.4328 => 0.4587, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.80% (0.2655 => 0.2809, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.77% (0.2945 => 0.3115, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.64% (0.1986 => 0.2098, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 5.64% (1.3693 => 1.4465, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.61% (0.7038 => 0.7433, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2760 => 0.2913, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.54% (0.4062 => 0.4287, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3022 => 0.3184, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.32% (0.2782 => 0.2930, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.14% (0.2607 => 0.2741, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.11% (0.2937 => 0.3087, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.09% (0.2690 => 0.2827, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2628 => 0.2761, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.03% (0.5265 => 0.5530, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.99% (0.2966 => 0.3114, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.96% (0.2761 => 0.2898, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2726 => 0.2861, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.90% (0.7710 => 0.8088, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.87% (1.9828 => 2.0793, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.85% (0.3899 => 0.4088, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.82% (0.2596 => 0.2721, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.79% (0.3489 => 0.3656, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.73% (0.3149 => 0.3298, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.71% (0.2696 => 0.2823, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2721 => 0.2849, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.67% (3.9660 => 4.1511, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3107 => 0.3252, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 4.58% (0.3453 => 0.3611, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3580 => 0.3743, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.53% (0.4016 => 0.4198, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 4.45% (0.2988 => 0.3121, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (0.3485 => 0.3640, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.44% (0.4390 => 0.4585, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 4.32% (0.3192 => 0.3330, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.31% (0.3293 => 0.3435, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (0.3756 => 0.3914, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.15% (0.6959 => 0.7248, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 4.14% (16.6129 => 17.3002, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/lists1: 4.13% (0.3534 => 0.3680, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.00% (13.8202 => 14.3734, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/moments: 3.96% (0.3868 => 0.4021, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 3.91% (0.3578 => 0.3718, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.84% (0.9199 => 0.9552, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.84% (0.3650 => 0.3790, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 3.81% (0.3914 => 0.4063, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.76% (0.3646 => 0.3783, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 3.75% (0.4003 => 0.4153, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.69% (0.3789 => 0.3929, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-2: 3.67% (0.3601 => 0.3733, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.66% (13.2842 => 13.7701, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/property: 3.63% (0.3940 => 0.4083, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 3.62% (0.3623 => 0.3754, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 3.60% (0.3663 => 0.3795, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.45% (0.2925 => 0.3026, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.38% (1.2193 => 1.2605, std. dev.: 0.0055) MultiSource/Applications/spiff/spiff: 3.32% (0.7506 => 0.7755, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.30% (0.3246 => 0.3353, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.25% (0.5577 => 0.5758, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.17% (0.3755 => 0.3874, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 3.16% (1.1061 => 1.1410, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.15% (4.9865 => 5.1436, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.12% (0.5637 => 0.5813, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.12% (1.2292 => 1.2675, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (1.4563 => 1.5015, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 3.07% (3.8646 => 3.9833, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.02% (1.3245 => 1.3645, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.95% (1.9270 => 1.9839, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.88% (1.1364 => 1.1691, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.81% (1.0594 => 1.0892, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.75% (0.7460 => 0.7665, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.64% (1.3819 => 1.4184, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.57% (7.2180 => 7.4036, std. dev.: 0.0057) MultiSource/Applications/siod/siod: 2.47% (2.1791 => 2.2329, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.46% (1.3813 => 1.4153, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.19% (3.6692 => 3.7497, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.19% (0.8310 => 0.8492, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.14% (0.8698 => 0.8884, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 2.03% (14.8535 => 15.1545, std. dev.: 0.0133) MultiSource/Applications/JM/ldecod/ldecod: 1.94% (6.5754 => 6.7031, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.78% (0.6135 => 0.6244, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.77% (4.3801 => 4.4575, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.73% (4.4433 => 4.5202, std. dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 1.70% (16.2614 => 16.5384, std. dev.: 0.0252) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.43% (1.1333 => 1.1495, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 1.43% (3.1889 => 3.2344, std. dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 1.35% (14.5298 => 14.7258, std. dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: 1.18% (1.2749 => 1.2899, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.09% (2.1007 => 2.1236, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.10% (1.8175 => 2.2737, std. dev.: 0.0165) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1930, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 8.24% (1.2998 => 1.4069, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.83% (0.2093 => 0.2194, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7318, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6794, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.94% (1.4298 => 1.4575, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.67% (3.6469 => 3.7078, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5089 => 1.5328, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.31% (1.9290 => 1.9542, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.84% (22.5627 => 21.0198, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.24% (0.3511 => 0.3362, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.48% (0.8818 => 0.8599, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.69% (0.9108 => 0.8954, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.26% (6.2785 => 6.1997, std. dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.35% (1.2308 => 1.1034, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.08% (20.3410 => 18.4933, std. dev.: 0.0600) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.16% (1.3780 => 1.3069, std. dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5921, std. dev.: 0.0157) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5043, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.88% (0.6589 => 0.6465, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2519, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -1.51% (3.0263 => 2.9807, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.49% (2.5254 => 2.4877, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: -1.35% (28.2225 => 27.8427, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2342, std. dev.: 0.0069) MultiSource/Applications/lua/lua: -1.06% (26.5159 => 26.2340, std. dev.: 0.0166) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2609, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 16:11:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 18:11:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120703231107.996FC2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1749?compare_to=1746&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1749, Order: 159687, Start Time: 2012-07-03 21:52:18, End Time: 2012-07-03 23:11:04 To: 1746, Order: 159676, Start Time: 2012-07-03 20:06:13, End Time: 2012-07-03 21:24:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (52 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (803 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 8.10% (13.2419 => 14.3146, std. dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.07% (10.3673 => 14.3146, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.91% (1.1194 => 1.2415, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.20% (0.3473 => 0.3723, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 6.95% (0.3497 => 0.3740, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.94% (0.3516 => 0.3760, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.92% (0.3543 => 0.3788, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.90% (1.7609 => 1.8824, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.86% (0.3543 => 0.3786, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/synchronized: 6.85% (0.3561 => 0.3805, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 6.69% (0.3694 => 0.3941, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.67% (2.2022 => 2.3490, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 6.45% (0.3828 => 0.4075, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.41% (0.3886 => 0.4135, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.39% (0.3927 => 0.4178, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.97% (10.4361 => 10.8502, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.90% (7.0540 => 7.3290, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.4879 => 0.5064, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.65% (0.3177 => 0.3293, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 3.56% (0.3282 => 0.3399, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.24% (0.7433 => 0.7674, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 3.12% (0.5925 => 0.6110, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.05% (0.6030 => 0.6214, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.76% (0.7326 => 0.7528, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.28% (0.4615 => 0.4720, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.11% (4.9449 => 5.0492, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5860 => 0.5983, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (14.3668 => 14.6681, std. dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.05% (0.5569 => 0.5683, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (0.8172 => 0.8336, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.95% (5.0018 => 5.0991, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.88% (4.2646 => 4.3446, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: 1.81% (0.7835 => 0.7977, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 1.78% (1.5603 => 1.5881, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (2.0665 => 2.1030, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (9.4845 => 9.6486, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.71% (8.1363 => 8.2757, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.48% (0.8067 => 0.8186, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.45% (2.0273 => 2.0567, std. dev.: 0.0030) MultiSource/Applications/d/make_dparser: 1.36% (3.3354 => 3.3809, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.29% (1.5415 => 1.5614, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.26% (1.1861 => 1.2010, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 1.21% (5.7591 => 5.8286, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.18% (17.1811 => 17.3836, std. dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7559, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 2.82% (26.0924 => 26.8294, std. dev.: 0.0251) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5086 => 1.5361, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6899, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2362, std. dev.: 0.0371) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1247, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.25% (5.2763 => 3.1525, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.00% (5.3855 => 3.6623, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.72% (5.3526 => 3.6549, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.75% (2.9384 => 2.5345, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -13.01% (22.1758 => 19.2901, std. dev.: 0.0204) SingleSource/UnitTests/Vector/constpool: -5.02% (54.1659 => 51.4494, std. dev.: 0.0481) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.50% (3.8922 => 3.7948, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.63% (0.8101 => 0.7969, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.16% (7.9617 => 7.8690, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.19% (1.2373 => 1.1112, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.77% (19.9488 => 18.5983, std. dev.: 0.0321) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (8.1563 => 7.9194, std. dev.: 0.0079) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6792, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0848, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 17:27:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 19:27:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120704002754.65D982A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1750?compare_to=1748&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1750, Order: 159690, Start Time: 2012-07-03 23:13:28, End Time: 2012-07-04 00:27:48 To: 1748, Order: 159684, Start Time: 2012-07-03 21:31:35, End Time: 2012-07-03 22:46:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (127 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (729 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.05% (2.0176 => 2.2808, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 7.27% (0.7061 => 0.7574, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.00% (0.5818 => 0.6225, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.81% (0.3130 => 0.3343, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.66% (0.5748 => 0.6131, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.18% (1.3693 => 1.4539, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4328 => 0.4593, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.08% (0.2945 => 0.3124, std. dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 5.97% (0.7038 => 0.7458, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.74% (0.1986 => 0.2100, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 5.65% (0.2781 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.54% (0.4062 => 0.4287, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.52% (0.2607 => 0.2751, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.51% (0.2760 => 0.2912, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2690 => 0.2838, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.46% (0.2655 => 0.2800, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.44% (0.2628 => 0.2771, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.43% (0.3022 => 0.3186, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.32% (0.2726 => 0.2871, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.29% (0.2761 => 0.2907, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.26% (1.9828 => 2.0870, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/wc: 5.24% (0.2937 => 0.3091, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.3107 => 0.3268, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.14% (0.7710 => 0.8106, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.14% (0.2765 => 0.2907, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.12% (0.2596 => 0.2729, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2696 => 0.2834, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.10% (0.3899 => 0.4098, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.07% (0.5265 => 0.5532, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.99% (0.3489 => 0.3663, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.99% (0.3149 => 0.3306, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.83% (3.9660 => 4.1577, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.80% (0.3580 => 0.3752, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.76% (0.3192 => 0.3344, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.4016 => 0.4205, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.68% (0.3485 => 0.3648, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.62% (0.3293 => 0.3445, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 4.59% (0.2988 => 0.3125, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.50% (0.6959 => 0.7272, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 4.33% (0.3534 => 0.3687, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.31% (16.6129 => 17.3290, std. dev.: 0.0191) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3756 => 0.3916, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.24% (0.4390 => 0.4576, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 4.13% (13.8202 => 14.3914, std. dev.: 0.0107) SingleSource/UnitTests/ObjC/trivial-interface: 4.05% (0.3578 => 0.3723, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 3.96% (0.3868 => 0.4021, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.88% (0.9199 => 0.9556, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 3.88% (0.3663 => 0.3805, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 3.83% (0.3914 => 0.4064, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 3.83% (0.3789 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.82% (0.4003 => 0.4156, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.81% (0.3646 => 0.3785, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.77% (0.5577 => 0.5787, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.75% (0.3650 => 0.3787, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 3.75% (0.3601 => 0.3736, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 3.67% (0.3623 => 0.3756, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 3.65% (0.3940 => 0.4084, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.61% (1.2193 => 1.2633, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.59% (13.2842 => 13.7609, std. dev.: 0.0131) MultiSource/Benchmarks/McCat/09-vor/vor: 3.45% (0.2925 => 0.3026, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.39% (1.2292 => 1.2709, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.34% (1.1061 => 1.1430, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.31% (1.4563 => 1.5045, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (4.9865 => 5.1504, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.23% (0.5637 => 0.5819, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.20% (0.3755 => 0.3875, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: 3.14% (0.7506 => 0.7742, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 3.13% (3.8646 => 3.9856, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.08% (1.3245 => 1.3653, std. dev.: 0.0117) MultiSource/Applications/treecc/treecc: 3.08% (1.9270 => 1.9863, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.04% (1.1364 => 1.1709, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.00% (1.0594 => 1.0912, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.99% (0.4379 => 0.4510, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.82% (0.7460 => 0.7670, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.69% (7.2180 => 7.4120, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.60% (1.3819 => 1.4178, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.50% (0.8310 => 0.8518, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.50% (2.1791 => 2.2336, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.48% (1.3813 => 1.4155, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.36% (3.6692 => 3.7558, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.32% (0.8698 => 0.8900, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 2.18% (14.8535 => 15.1771, std. dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (0.4791 => 0.4895, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 2.15% (6.5754 => 6.7168, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.03% (4.3801 => 4.4689, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.96% (0.6135 => 0.6255, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.87% (4.4433 => 4.5266, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.83% (16.2614 => 16.5587, std. dev.: 0.0231) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.79% (1.1333 => 1.1536, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.64% (0.6283 => 0.6386, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.60% (3.1889 => 3.2398, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.53% (14.5298 => 14.7523, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.12% (2.1007 => 2.1243, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 25.09% (1.8175 => 2.2736, std. dev.: 0.0177) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.41% (2.0200 => 2.1899, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: 8.22% (1.2998 => 1.4067, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6988, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7266, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6798, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4798, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1919, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.87% (1.4298 => 1.4566, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5342, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.65% (3.6469 => 3.7071, std. dev.: 0.0068) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.26% (1.9290 => 1.9533, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.72% (22.5627 => 21.0471, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.30% (0.3511 => 0.3360, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.8818 => 0.8585, std. dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.61% (0.9108 => 0.8961, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.55% (1.2308 => 1.1132, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.91% (20.3410 => 18.5291, std. dev.: 0.0810) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.74% (1.3780 => 1.3127, std. dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.51% (1.9762 => 1.9068, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5847, std. dev.: 0.0239) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.28% (0.4867 => 0.4756, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5050, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2559, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: -1.48% (3.0263 => 2.9816, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8603, std. dev.: 0.0163) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8438, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2237, std. dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2543, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 17:57:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 19:57:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120704005715.94C432A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1751?compare_to=1749&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1751, Order: 159692, Start Time: 2012-07-03 23:38:28, End Time: 2012-07-04 00:57:11 To: 1749, Order: 159687, Start Time: 2012-07-03 21:52:18, End Time: 2012-07-03 23:11:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (53 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (802 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.86% (14.3146 => 13.9051, std. dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.12% (10.3673 => 13.9051, std. dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.00% (1.1194 => 1.2425, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.00% (0.3473 => 0.3716, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 6.98% (0.1432 => 0.1532, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.80% (0.3543 => 0.3784, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.77% (0.3516 => 0.3754, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.75% (1.7609 => 1.8797, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.69% (0.3497 => 0.3731, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.66% (0.3543 => 0.3779, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.60% (0.3561 => 0.3796, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.50% (0.3694 => 0.3934, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.43% (2.2022 => 2.3438, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 6.40% (0.3828 => 0.4073, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.32% (0.3927 => 0.4175, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 6.23% (0.3886 => 0.4128, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.03% (7.0540 => 7.3381, std. dev.: 0.0045) SingleSource/UnitTests/ObjC++/Hello: 3.97% (0.5925 => 0.6160, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 3.90% (0.6030 => 0.6265, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 3.86% (10.4361 => 10.8389, std. dev.: 0.0115) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.78% (0.3177 => 0.3297, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.75% (0.4879 => 0.5062, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 3.26% (0.3282 => 0.3389, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.11% (0.7326 => 0.7554, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 3.07% (0.7433 => 0.7661, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.34% (0.4615 => 0.4723, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.27% (14.3668 => 14.6930, std. dev.: 0.0268) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.13% (4.9449 => 5.0504, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.07% (0.8172 => 0.8341, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.07% (5.0018 => 5.1052, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 1.95% (0.7835 => 0.7988, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 1.91% (9.4845 => 9.6657, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.86% (0.5860 => 0.5969, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.81% (4.2646 => 4.3418, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.77% (8.1363 => 8.2803, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 1.43% (3.3354 => 3.3830, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.40% (17.1811 => 17.4217, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.36% (1.5415 => 1.5625, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.35% (2.0273 => 2.0547, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 1.35% (5.7591 => 5.8367, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.27% (2.0665 => 2.0927, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.26% (1.1861 => 1.2011, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.17% (1.3050 => 1.3203, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.12% (1.1642 => 1.1772, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 1.08% (3.8723 => 3.9141, std. dev.: 0.0047) MultiSource/Applications/hbd/hbd: 1.01% (1.5603 => 1.5760, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9743, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.33% (3.6395 => 3.7606, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.68% (26.0924 => 26.7926, std. dev.: 0.0295) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5086 => 1.5352, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4474, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.44% (9.1159 => 9.2475, std. dev.: 0.0296) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6895, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.45% (5.2763 => 3.1422, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.02% (5.3855 => 3.6612, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.79% (5.3526 => 3.6511, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.90% (2.9384 => 2.5301, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -12.82% (22.1758 => 19.3336, std. dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -4.88% (54.1659 => 51.5204, std. dev.: 0.0286) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.53% (3.8922 => 3.7938, std. dev.: 0.0128) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.57% (0.8101 => 0.7974, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (7.9617 => 7.8798, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.30% (1.2373 => 1.1098, std. dev.: 0.0129) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.98% (19.9488 => 18.5572, std. dev.: 0.0664) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (8.1563 => 7.9173, std. dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6894, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0828, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 18:16:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 20:16:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120704011622.B5E9C2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1752?compare_to=1747&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1752, Order: 159687, Start Time: 2012-07-03 22:33:11, End Time: 2012-07-04 01:16:19 To: 1747, Order: 159674, Start Time: 2012-07-03 19:22:45, End Time: 2012-07-03 22:05:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (35 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (857 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 15.50% (102.5421 => 118.4383, std. dev.: 0.0741) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 7.95% (0.3446 => 0.3720, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.92% (0.3460 => 0.3734, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.85% (0.3465 => 0.3737, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.73% (0.3469 => 0.3737, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.72% (0.3496 => 0.3766, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.64% (0.3442 => 0.3705, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.57% (0.3488 => 0.3752, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 7.51% (0.3650 => 0.3924, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.22% (0.3643 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.14% (0.3724 => 0.3990, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.98% (0.5826 => 0.6058, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.65% (0.5889 => 0.6104, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (1.6211 => 1.6746, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (0.5026 => 0.5180, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.04% (3.5627 => 3.6710, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.78% (0.4029 => 0.4141, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.63% (0.5900 => 0.6055, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 2.58% (0.7171 => 0.7356, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.51% (4.2109 => 4.3164, std. dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.46% (1.3152 => 1.3476, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.44% (2.0673 => 2.1177, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 2.36% (0.9909 => 1.0143, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.32% (0.5000 => 0.5116, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.22% (0.4994 => 0.5105, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.71% (1.9694 => 2.0031, std. dev.: 0.0032) MultiSource/Applications/hbd/hbd: 1.65% (0.9697 => 0.9857, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.61% (4.4195 => 4.4906, std. dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 1.60% (2.1653 => 2.1999, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.58% (1.9966 => 2.0282, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 1.57% (5.5417 => 5.6286, std. dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 1.54% (4.6177 => 4.6889, std. dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 1.44% (23.5202 => 23.8591, std. dev.: 0.0121) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.39% (2.7292 => 2.7670, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 1.29% (1.8794 => 1.9036, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.21% (2.1013 => 2.1268, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.09% (2.4764 => 2.3750, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: -2.12% (11.9555 => 11.7016, std. dev.: 0.0078) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 19:09:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 21:09:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120704020932.0FEBC2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1753?compare_to=1750&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1753, Order: 159696, Start Time: 2012-07-04 00:55:11, End Time: 2012-07-04 02:09:27 To: 1750, Order: 159690, Start Time: 2012-07-03 23:13:28, End Time: 2012-07-04 00:27:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (735 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.02% (2.0176 => 2.2802, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.83% (0.7061 => 0.7543, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.74% (0.5818 => 0.6210, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 6.42% (0.5748 => 0.6117, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.79% (0.1986 => 0.2101, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.74% (0.7038 => 0.7442, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 5.66% (0.4328 => 0.4573, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.37% (0.2945 => 0.3103, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 5.35% (1.3693 => 1.4425, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.20% (0.5265 => 0.5539, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.10% (0.7710 => 0.8103, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.10% (0.3022 => 0.3176, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 5.02% (0.4062 => 0.4266, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.00% (0.2782 => 0.2921, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.96% (0.2966 => 0.3113, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.95% (0.3899 => 0.4092, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.91% (0.2607 => 0.2735, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.77% (0.2726 => 0.2856, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.75% (0.2655 => 0.2781, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 4.68% (0.2690 => 0.2816, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.68% (0.2628 => 0.2751, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.68% (1.9828 => 2.0755, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 4.67% (0.2760 => 0.2889, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.2596 => 0.2717, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.64% (3.9660 => 4.1500, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 4.60% (0.2937 => 0.3072, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.56% (0.2761 => 0.2887, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.56% (0.2696 => 0.2819, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.56% (0.3489 => 0.3648, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.54% (0.3107 => 0.3248, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.51% (0.3149 => 0.3291, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.47% (0.3580 => 0.3740, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.28% (0.6959 => 0.7257, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.28% (0.3485 => 0.3634, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.26% (0.3453 => 0.3600, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.13% (0.4016 => 0.4182, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.10% (0.3192 => 0.3323, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.99% (0.3756 => 0.3906, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 3.99% (16.6129 => 17.2753, std. dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/lists1: 3.96% (0.3534 => 0.3674, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.93% (13.8202 => 14.3632, std. dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/lists: 3.92% (0.3293 => 0.3422, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.92% (0.2988 => 0.3105, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.88% (0.3868 => 0.4018, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.80% (0.4390 => 0.4557, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.77% (0.9199 => 0.9546, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.70% (13.2842 => 13.7759, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.35% (1.2193 => 1.2601, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.32% (0.5577 => 0.5762, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.29% (1.4563 => 1.5042, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.18% (4.9865 => 5.1450, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.15% (1.3245 => 1.3662, std. dev.: 0.0043) MultiSource/Applications/spiff/spiff: 3.13% (0.7506 => 0.7741, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 3.02% (1.1061 => 1.1395, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5637 => 0.5805, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 2.94% (1.2292 => 1.2653, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.0594 => 1.0903, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (1.1364 => 1.1694, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.88% (1.9270 => 1.9825, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (3.8646 => 3.9748, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 2.82% (0.3578 => 0.3679, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 2.77% (0.4003 => 0.4114, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.77% (1.3819 => 1.4202, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 2.73% (0.3914 => 0.4021, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3755 => 0.3857, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.71% (1.3813 => 1.4188, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/property: 2.64% (0.3940 => 0.4044, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 2.64% (0.3789 => 0.3889, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (0.4379 => 0.4492, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.41% (7.2180 => 7.3923, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (0.7460 => 0.7637, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8310 => 0.8502, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.29% (2.1791 => 2.2291, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.15% (3.6692 => 3.7480, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.8698 => 0.8878, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.01% (6.5754 => 6.7077, std. dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: 2.00% (16.2614 => 16.5864, std. dev.: 0.0158) MultiSource/Applications/JM/lencod/lencod: 1.92% (14.8535 => 15.1388, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.81% (4.3801 => 4.4593, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.70% (0.6135 => 0.6239, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 1.55% (3.1889 => 3.2383, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.54% (4.4433 => 4.5118, std. dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: 1.53% (14.5298 => 14.7523, std. dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.41% (1.1333 => 1.1493, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.35% (2.1007 => 2.1291, std. dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2913, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.95% (1.8175 => 2.3074, std. dev.: 0.0341) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.36% (2.0200 => 2.1889, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.86% (1.2998 => 1.4019, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9996 => 1.0772, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.00% (7.4271 => 7.7242, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6788, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.79% (3.6469 => 3.7121, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.75% (1.4298 => 1.4548, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (1.9290 => 1.9557, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.71% (22.5627 => 21.0478, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.87% (0.3511 => 0.3375, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.08% (0.8818 => 0.8546, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.59% (0.9108 => 0.8963, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.42% (6.2785 => 6.1896, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2308 => 1.1042, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.61% (20.3410 => 18.5902, std. dev.: 0.0309) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3141, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -3.51% (1.9762 => 1.9069, std. dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5916, std. dev.: 0.0157) SingleSource/Benchmarks/Dhrystone/dry: -2.53% (2.5089 => 2.4453, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.32% (0.4867 => 0.4754, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5052, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2564, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: -1.45% (3.0263 => 2.9823, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4890, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8449, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0174) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.28% (0.9692 => 0.9568, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2273, std. dev.: 0.0134) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2554, std. dev.: 0.0018) MultiSource/Applications/lua/lua: -1.12% (26.5159 => 26.2179, std. dev.: 0.0352) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 19:43:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 21:43:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120704024316.DEFEE2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1754?compare_to=1751&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1754, Order: 159696, Start Time: 2012-07-04 01:24:31, End Time: 2012-07-04 02:43:13 To: 1751, Order: 159692, Start Time: 2012-07-03 23:38:28, End Time: 2012-07-04 00:57:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (49 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (806 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.27% (13.9051 => 14.0821, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.5146 => 56.5435, std. dev.: 0.0429) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.18% (10.8389 => 10.7110, std. dev.: 0.0117) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.83% (10.3673 => 14.0821, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.91% (1.1194 => 1.2527, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.46% (1.7609 => 1.8922, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops: 6.98% (0.1432 => 0.1532, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.76% (2.2022 => 2.3510, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.99% (0.3473 => 0.3681, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.94% (0.3516 => 0.3725, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: 5.87% (0.3561 => 0.3770, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 5.80% (0.3497 => 0.3700, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.79% (0.3543 => 0.3748, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 5.76% (0.3543 => 0.3747, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.58% (0.3694 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.40% (0.3886 => 0.4096, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions: 5.38% (0.3828 => 0.4034, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.37% (0.3927 => 0.4138, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 4.74% (0.5925 => 0.6206, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.44% (0.6030 => 0.6298, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.14% (0.4879 => 0.5081, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.99% (7.0540 => 7.3358, std. dev.: 0.0207) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.84% (0.3177 => 0.3299, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 3.74% (0.7326 => 0.7600, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 3.19% (0.7433 => 0.7670, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 3.11% (0.3282 => 0.3384, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (10.4361 => 10.7110, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.12% (14.3668 => 14.6709, std. dev.: 0.0298) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.99% (0.8172 => 0.8335, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.96% (0.5569 => 0.5678, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.89% (4.9449 => 5.0383, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.80% (5.0018 => 5.0918, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.66% (2.0665 => 2.1009, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 1.61% (1.5603 => 1.5854, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 1.60% (0.7835 => 0.7960, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (9.4845 => 9.6297, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.50% (4.2646 => 4.3287, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.48% (8.1363 => 8.2567, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 1.28% (2.0273 => 2.0533, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 1.27% (3.3354 => 3.3777, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.15% (17.1811 => 17.3787, std. dev.: 0.0171) MultiSource/Applications/oggenc/oggenc: 1.02% (5.7591 => 5.8180, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.02% (1.5415 => 1.5572, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7474, std. dev.: 0.0058) MultiSource/Applications/lua/lua: 2.55% (26.0924 => 26.7587, std. dev.: 0.0344) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5086 => 1.5354, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: 1.53% (9.1159 => 9.2558, std. dev.: 0.0204) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4463, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.23% (2.6546 => 2.6872, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1250, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.09% (5.2763 => 3.1612, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.61% (5.3855 => 3.6834, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.31% (5.3526 => 3.6767, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.69% (2.9384 => 2.5362, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -12.85% (22.1758 => 19.3268, std. dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3272, std. dev.: 0.0338) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.80% (3.8922 => 3.7832, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.79% (0.8101 => 0.7956, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.53% (7.9617 => 7.8399, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2373 => 1.1105, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.94% (19.9488 => 18.5643, std. dev.: 0.0235) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (8.1563 => 7.9162, std. dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6857, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0856, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 20:51:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 22:51:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120704035156.D09E02A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1755?compare_to=1753&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1755, Order: 159701, Start Time: 2012-07-04 02:37:39, End Time: 2012-07-04 03:51:52 To: 1753, Order: 159696, Start Time: 2012-07-04 00:55:11, End Time: 2012-07-04 02:09:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (129 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.82% (53.8957 => 56.4956, std. dev.: 0.0768) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.80% (2.0176 => 2.2961, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 7.20% (0.5818 => 0.6237, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.99% (0.5748 => 0.6150, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 6.97% (0.7061 => 0.7553, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 5.94% (0.7038 => 0.7456, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 5.71% (0.4062 => 0.4294, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 5.56% (1.3693 => 1.4455, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 5.52% (0.4328 => 0.4567, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.37% (0.2945 => 0.3103, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.23% (0.3022 => 0.3180, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.19% (3.9660 => 4.1719, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.19% (0.1986 => 0.2089, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.18% (0.7710 => 0.8109, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.11% (0.5265 => 0.5534, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.11% (0.2781 => 0.2923, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.07% (0.2721 => 0.2859, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.92% (0.3899 => 0.4091, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.89% (0.2596 => 0.2723, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.85% (0.2782 => 0.2917, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.78% (0.2655 => 0.2782, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.74% (1.9828 => 2.0767, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.68% (0.2690 => 0.2816, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.67% (0.2765 => 0.2894, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.64% (0.2628 => 0.2750, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.62% (0.2966 => 0.3103, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.60% (0.2760 => 0.2887, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.59% (0.2726 => 0.2851, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.53% (0.2937 => 0.3070, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.53% (0.2761 => 0.2886, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.50% (0.3489 => 0.3646, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.45% (0.2696 => 0.2816, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.41% (0.3580 => 0.3738, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.41% (0.6959 => 0.7266, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 4.31% (0.3107 => 0.3241, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.23% (13.2842 => 13.8461, std. dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.22% (0.3485 => 0.3632, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.19% (0.3149 => 0.3281, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.18% (16.6129 => 17.3067, std. dev.: 0.0089) MultiSource/Applications/SPASS/SPASS: 4.17% (13.8202 => 14.3961, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.11% (0.9199 => 0.9577, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.11% (0.4016 => 0.4181, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.08% (0.3453 => 0.3594, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (0.3756 => 0.3909, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.04% (0.3192 => 0.3321, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.95% (0.3293 => 0.3423, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2988 => 0.3104, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 3.88% (0.3534 => 0.3671, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.76% (0.4390 => 0.4555, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.3868 => 0.4011, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.69% (0.2925 => 0.3033, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.67% (1.2193 => 1.2641, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.64% (0.5577 => 0.5780, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.57% (1.4563 => 1.5083, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.50% (0.7506 => 0.7769, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.48% (0.3246 => 0.3359, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.46% (0.5637 => 0.5832, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.43% (1.3245 => 1.3699, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.33% (0.3578 => 0.3697, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.31% (1.0594 => 1.0945, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.29% (1.1364 => 1.1738, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: 3.25% (0.4003 => 0.4133, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 3.24% (0.3914 => 0.4041, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.23% (3.8646 => 3.9893, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.21% (4.9865 => 5.1468, std. dev.: 0.0075) MultiSource/Applications/treecc/treecc: 3.18% (1.9270 => 1.9883, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.17% (1.3813 => 1.4251, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.17% (1.3819 => 1.4257, std. dev.: 0.0048) MultiSource/Applications/Burg/burg: 3.16% (1.1061 => 1.1410, std. dev.: 0.0088) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.15% (0.3650 => 0.3765, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.11% (0.4379 => 0.4515, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 3.07% (0.3646 => 0.3758, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.06% (0.3789 => 0.3905, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 3.03% (0.3601 => 0.3710, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 3.02% (0.3940 => 0.4059, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: 3.00% (0.3663 => 0.3773, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 2.95% (0.3623 => 0.3730, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.88% (1.2292 => 1.2646, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.80% (7.2180 => 7.4204, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.75% (3.6692 => 3.7702, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.75% (0.7460 => 0.7665, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3755 => 0.3858, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.53% (2.1791 => 2.2343, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.50% (14.8535 => 15.2248, std. dev.: 0.0115) MultiSource/Applications/JM/ldecod/ldecod: 2.35% (6.5754 => 6.7297, std. dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: 2.17% (16.2614 => 16.6150, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (0.4791 => 0.4895, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.8698 => 0.8878, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6135 => 0.6261, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.98% (4.3801 => 4.4667, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.97% (4.4433 => 4.5310, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.90% (1.1333 => 1.1548, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6283 => 0.6400, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.81% (3.1889 => 3.2467, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 1.80% (14.5298 => 14.7914, std. dev.: 0.0083) MultiSource/Applications/SIBsim4/SIBsim4: 1.74% (1.2749 => 1.2971, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.1007 => 2.1303, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 26.39% (1.8175 => 2.2972, std. dev.: 0.0329) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1906, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.52% (1.2998 => 1.3846, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (2.5629 => 2.7293, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.92% (7.4271 => 7.7183, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9218, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6779, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1913, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4556, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5337, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.57% (3.6469 => 3.7042, std. dev.: 0.0065) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.12% (10.7476 => 10.8677, std. dev.: 0.0203) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.48% (22.5627 => 21.1008, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.50% (0.3511 => 0.3388, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.49% (0.8818 => 0.8598, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.20% (0.9108 => 0.8999, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2308 => 1.0998, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.80% (20.3410 => 18.5500, std. dev.: 0.0354) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3147, std. dev.: 0.0063) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.51% (1.9762 => 1.9069, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5976, std. dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5086, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2568, std. dev.: 0.0045) MultiSource/Applications/spiff/spiff: -1.51% (3.0263 => 2.9807, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8631, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.36% (2.5254 => 2.4910, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8438, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.14% (3.8887 => 3.8444, std. dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2562, std. dev.: 0.0052) MultiSource/Applications/lua/lua: -1.05% (26.5159 => 26.2381, std. dev.: 0.0186) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 21:26:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 23:26:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120704042643.2913E2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1756?compare_to=1752&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1756, Order: 159699, Start Time: 2012-07-04 01:43:32, End Time: 2012-07-04 04:26:39 To: 1752, Order: 159687, Start Time: 2012-07-03 22:33:11, End Time: 2012-07-04 01:16:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (36 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (856 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.00% (2.3750 => 2.4225, std. dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.03% (1.6734 => 1.6906, std. dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 7.10% (0.3465 => 0.3711, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.08% (0.3446 => 0.3690, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.03% (0.3469 => 0.3713, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.02% (0.3460 => 0.3703, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.86% (0.3442 => 0.3678, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.81% (0.3496 => 0.3734, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.74% (0.3488 => 0.3723, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 6.64% (0.3643 => 0.3885, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/property: 6.55% (0.3650 => 0.3889, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 6.34% (0.3724 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.69% (0.5826 => 0.6099, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: 4.36% (0.5889 => 0.6146, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.19% (0.7171 => 0.7400, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.18% (0.3362 => 0.3469, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (1.6211 => 1.6693, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.96% (0.5026 => 0.5175, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.92% (0.9909 => 1.0198, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.90% (2.0673 => 2.1273, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.89% (0.4361 => 0.4487, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.84% (0.4994 => 0.5136, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 2.80% (0.4029 => 0.4142, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (0.5900 => 0.6065, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.52% (3.5627 => 3.6525, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.51% (1.3152 => 1.3482, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: 2.42% (4.2109 => 4.3130, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 2.32% (23.5202 => 24.0663, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.26% (0.5000 => 0.5113, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.93% (0.9697 => 0.9884, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 1.66% (1.0781 => 1.0960, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.59% (4.4195 => 4.4896, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.57% (1.9694 => 2.0004, std. dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 1.44% (5.5417 => 5.6213, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.34% (1.9966 => 2.0233, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 1.24% (1.5932 => 1.6129, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.23% (1.8794 => 1.9026, std. dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 1.04% (4.6177 => 4.6655, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.28% (11.9555 => 11.6826, std. dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -2.18% (2.4764 => 2.4225, std. dev.: 0.0086) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 3 21:29:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 3 Jul 2012 23:29:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120704042926.4C2E72A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1757?compare_to=1754&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1757, Order: 159701, Start Time: 2012-07-04 03:10:34, End Time: 2012-07-04 04:29:22 To: 1754, Order: 159696, Start Time: 2012-07-04 01:24:31, End Time: 2012-07-04 02:43:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (50 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (805 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.46% (78.1518 => 80.0769, std. dev.: 0.6114) SingleSource/Benchmarks/Misc/lowercase: 1.36% (7.9466 => 8.0547, std. dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.09% (14.0821 => 13.6471, std. dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.64% (10.3673 => 13.6471, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2530, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.88% (1.7609 => 1.8997, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.26% (0.1432 => 0.1536, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.07% (2.2022 => 2.3580, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 6.13% (0.3473 => 0.3686, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.81% (0.3543 => 0.3749, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.67% (0.3543 => 0.3744, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 5.66% (0.3497 => 0.3695, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 5.64% (0.3561 => 0.3762, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.63% (0.3516 => 0.3714, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/for-in: 5.47% (0.3694 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.36% (0.3828 => 0.4033, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.35% (0.3927 => 0.4137, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.17% (0.3886 => 0.4087, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.4879 => 0.5105, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.25% (0.3177 => 0.3312, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (7.0540 => 7.3435, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/Hello: 4.00% (0.5925 => 0.6162, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.95% (0.6030 => 0.6268, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 3.72% (0.3282 => 0.3404, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 3.24% (10.4361 => 10.7745, std. dev.: 0.0161) SingleSource/UnitTests/ObjC++/property-reference: 3.04% (0.7326 => 0.7549, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.00% (0.7433 => 0.7656, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (14.3668 => 14.6786, std. dev.: 0.0295) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.03% (5.0018 => 5.1032, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.01% (4.9449 => 5.0441, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.92% (0.5569 => 0.5676, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (9.4845 => 9.6562, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.60% (8.1363 => 8.2665, std. dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.58% (4.2646 => 4.3321, std. dev.: 0.0105) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.53% (0.8172 => 0.8297, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 1.49% (0.7835 => 0.7952, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 1.44% (3.3354 => 3.3835, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 1.38% (17.1811 => 17.4174, std. dev.: 0.0195) MultiSource/Applications/oggenc/oggenc: 1.27% (5.7591 => 5.8323, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.23% (1.5415 => 1.5604, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.22% (2.0273 => 2.0521, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.19% (1.1861 => 1.2002, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.07% (1.3050 => 1.3190, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.07% (1.5603 => 1.5770, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0166) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.13% (3.6395 => 3.7534, std. dev.: 0.0035) MultiSource/Applications/lua/lua: 2.70% (26.0924 => 26.7981, std. dev.: 0.0259) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5086 => 1.5360, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.38% (2.6546 => 2.6913, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2346, std. dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1245, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.91% (5.2763 => 3.1706, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.33% (5.3855 => 3.6984, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.10% (5.3526 => 3.6877, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.34% (2.9384 => 2.5465, std. dev.: 0.0081) MultiSource/Applications/ClamAV/clamscan: -12.94% (22.1758 => 19.3055, std. dev.: 0.0154) SingleSource/UnitTests/Vector/constpool: -4.92% (54.1659 => 51.5021, std. dev.: 0.0825) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.62% (3.8922 => 3.7903, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.90% (0.8101 => 0.7947, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.14% (7.9617 => 7.8707, std. dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2373 => 1.1095, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.01% (19.9488 => 18.5494, std. dev.: 0.0304) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.02% (8.1563 => 7.9097, std. dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6871, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0852, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 00:39:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 02:39:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120704073907.94E802A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1758?compare_to=1756&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1758, Order: 159701, Start Time: 2012-07-04 04:53:51, End Time: 2012-07-04 07:39:02 To: 1756, Order: 159699, Start Time: 2012-07-04 01:43:32, End Time: 2012-07-04 04:26:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (32 on baseline) Performance Improvements: 1 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (860 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.21% (1.6906 => 1.6701, std. dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 7.37% (0.3446 => 0.3700, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.33% (0.3465 => 0.3719, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.25% (0.3460 => 0.3711, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.21% (0.3469 => 0.3719, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.09% (0.3496 => 0.3744, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.02% (0.3488 => 0.3733, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.00% (0.3442 => 0.3683, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.73% (0.3643 => 0.3888, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/property: 6.71% (0.3650 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.53% (0.3724 => 0.3967, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.22% (0.5826 => 0.6130, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.01% (0.5889 => 0.6184, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.63% (0.7171 => 0.7431, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.96% (0.5026 => 0.5175, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.91% (1.6211 => 1.6683, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.87% (0.4361 => 0.4486, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.85% (2.0673 => 2.1262, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 2.84% (0.9909 => 1.0190, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.76% (0.4994 => 0.5132, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.56% (4.2109 => 4.3188, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.55% (3.5627 => 3.6535, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.46% (0.5900 => 0.6045, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (1.3152 => 1.3464, std. dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: 2.10% (23.5202 => 24.0130, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 1.87% (0.9697 => 0.9878, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.59% (4.4195 => 4.4896, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.58% (1.0781 => 1.0951, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.57% (1.9694 => 2.0003, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 1.31% (1.8794 => 1.9040, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.15% (1.9966 => 2.0196, std. dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 1.03% (4.6177 => 4.6652, std. dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.43% (11.9555 => 11.6653, std. dev.: 0.0120) SingleSource/UnitTests/Vector/constpool: -2.22% (2.4764 => 2.4214, std. dev.: 0.0197) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 00:44:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 02:44:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120704074444.C32C32A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1759?compare_to=1755&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1759, Order: 159703, Start Time: 2012-07-04 06:27:38, End Time: 2012-07-04 07:44:39 To: 1755, Order: 159701, Start Time: 2012-07-04 02:37:39, End Time: 2012-07-04 03:51:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (114 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (740 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 28.04% (0.3920 => 0.5019, std. dev.: 0.0238) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.38% (2.0176 => 2.2875, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.07% (0.7061 => 0.7560, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.82% (0.5818 => 0.6215, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.49% (0.5748 => 0.6121, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.45% (0.3130 => 0.3332, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.71% (0.4062 => 0.4294, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 5.64% (0.7038 => 0.7435, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.54% (0.7710 => 0.8137, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 5.52% (0.4328 => 0.4567, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.25% (1.3693 => 1.4412, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 5.11% (0.2781 => 0.2923, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.07% (0.5265 => 0.5532, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.89% (0.2966 => 0.3111, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.82% (0.3899 => 0.4087, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.82% (0.2782 => 0.2916, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.80% (1.9828 => 2.0780, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.80% (0.3022 => 0.3167, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.76% (0.2690 => 0.2818, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.74% (0.2596 => 0.2719, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.69% (0.3580 => 0.3748, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.65% (3.9660 => 4.1506, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hello: 4.64% (0.2607 => 0.2728, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 4.64% (0.2760 => 0.2888, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.60% (0.2655 => 0.2777, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 4.56% (0.2761 => 0.2887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.52% (0.2765 => 0.2890, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.49% (0.2628 => 0.2746, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.48% (0.2726 => 0.2848, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.46% (0.2937 => 0.3068, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.3489 => 0.3643, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.30% (0.3485 => 0.3635, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.30% (0.2696 => 0.2812, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 4.26% (0.3149 => 0.3283, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.25% (0.3107 => 0.3239, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.3192 => 0.3325, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.6959 => 0.7244, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 4.05% (16.6129 => 17.2865, std. dev.: 0.0254) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.01% (0.4016 => 0.4177, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3453 => 0.3591, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3293 => 0.3420, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.82% (0.3534 => 0.3669, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.81% (0.3756 => 0.3899, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.80% (13.2842 => 13.7886, std. dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3868 => 0.4013, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.75% (0.2988 => 0.3100, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.71% (0.4390 => 0.4553, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.66% (0.9199 => 0.9536, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.37% (0.5577 => 0.5765, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.37% (1.2193 => 1.2604, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 3.30% (0.3578 => 0.3696, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 3.17% (0.4003 => 0.4130, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.10% (1.3245 => 1.3655, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 3.07% (0.3914 => 0.4034, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.05% (3.8646 => 3.9824, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.04% (0.3650 => 0.3761, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 3.04% (0.3789 => 0.3904, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (1.4563 => 1.5005, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 3.03% (1.2292 => 1.2665, std. dev.: 0.0080) SingleSource/UnitTests/ObjC/synchronized: 3.03% (0.3663 => 0.3774, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.02% (0.3646 => 0.3756, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.99% (4.9865 => 5.1357, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 2.96% (1.0594 => 1.0908, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.95% (1.1364 => 1.1699, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 2.94% (0.3940 => 0.4056, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 2.94% (0.3601 => 0.3707, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 2.90% (0.3623 => 0.3728, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.82% (1.3813 => 1.4203, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.71% (1.3819 => 1.4193, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.69% (0.7460 => 0.7661, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.63% (0.4379 => 0.4494, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.45% (7.2180 => 7.3952, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8310 => 0.8502, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.17% (3.6692 => 3.7490, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.12% (0.6135 => 0.6265, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.93% (16.2614 => 16.5749, std. dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.8698 => 0.8863, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.85% (4.4433 => 4.5257, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.82% (4.3801 => 4.4597, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.49% (1.1333 => 1.1502, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.41% (14.5298 => 14.7351, std. dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.24% (2.1007 => 2.1267, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.57% (1.8175 => 2.2641, std. dev.: 0.0361) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.36% (2.0200 => 2.1888, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.98% (0.9996 => 1.0794, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: 7.56% (1.2998 => 1.3980, std. dev.: 0.0086) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.14% (7.4271 => 7.7345, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6785, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4806, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.06% (4.1080 => 4.1928, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.94% (1.4298 => 1.4575, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5348, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.46% (3.6469 => 3.7002, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.77% (22.5627 => 21.0346, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.73% (0.3511 => 0.3380, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.59% (0.8818 => 0.8590, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.55% (0.9108 => 0.8967, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.26% (6.2785 => 6.1995, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.35% (1.2308 => 1.1034, std. dev.: 0.0138) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.66% (20.3410 => 18.5788, std. dev.: 0.0408) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.09% (1.3780 => 1.3216, std. dev.: 0.0071) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6028, std. dev.: 0.0094) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.47% (0.4867 => 0.4747, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5119, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2554, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8612, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -1.42% (3.0263 => 2.9833, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8443, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2145, std. dev.: 0.0143) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2538, std. dev.: 0.0038) MultiSource/Applications/lua/lua: -1.14% (26.5159 => 26.2132, std. dev.: 0.0364) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8469, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 00:49:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 02:49:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120704074900.76A462A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1760?compare_to=1757&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1760, Order: 159703, Start Time: 2012-07-04 06:27:40, End Time: 2012-07-04 07:48:54 To: 1757, Order: 159701, Start Time: 2012-07-04 03:10:34, End Time: 2012-07-04 04:29:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (53 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (804 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.01% (10.3673 => 13.6856, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.35% (1.1194 => 1.2576, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.93% (1.7609 => 1.9005, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.16% (2.2022 => 2.3599, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.78% (0.1622 => 0.1732, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.36% (0.3473 => 0.3694, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: 6.23% (0.3561 => 0.3783, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-2: 6.06% (0.3497 => 0.3709, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.04% (0.3543 => 0.3757, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.96% (0.3543 => 0.3754, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 5.94% (0.3516 => 0.3725, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 5.82% (0.3694 => 0.3909, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.56% (0.3828 => 0.4041, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.53% (0.3927 => 0.4144, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.51% (0.3886 => 0.4100, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.62% (7.0540 => 7.3796, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.55% (0.4879 => 0.5101, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.06% (0.3177 => 0.3306, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/Hello: 4.00% (0.5925 => 0.6162, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 3.91% (0.6030 => 0.6266, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 3.66% (0.3282 => 0.3402, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.43% (0.3092 => 0.3198, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.34% (0.4615 => 0.4769, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 3.33% (10.4361 => 10.7833, std. dev.: 0.0182) MultiSource/Applications/lambda-0_1_3/lambda: 3.23% (0.7433 => 0.7673, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 3.22% (0.7326 => 0.7562, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.71% (0.5569 => 0.5720, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.53% (5.0018 => 5.1284, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (14.3668 => 14.7059, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.32% (0.5860 => 0.5996, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: 2.27% (0.7835 => 0.8013, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.20% (4.9449 => 5.0535, std. dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: 2.05% (9.4845 => 9.6791, std. dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.94% (8.1363 => 8.2944, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.81% (4.2646 => 4.3416, std. dev.: 0.0151) MultiSource/Applications/d/make_dparser: 1.76% (3.3354 => 3.3941, std. dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 1.45% (17.1811 => 17.4304, std. dev.: 0.0102) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7591 => 5.8383, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 1.37% (2.0273 => 2.0551, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.32% (1.1861 => 1.2018, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.32% (1.5415 => 1.5618, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.23% (1.3050 => 1.3210, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.18% (2.0665 => 2.0908, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.15% (1.4186 => 1.4349, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 1.12% (3.8723 => 3.9155, std. dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7595, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 2.71% (26.0924 => 26.8007, std. dev.: 0.0402) MultiSource/Applications/minisat/minisat: 1.71% (9.1159 => 9.2719, std. dev.: 0.0154) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6894, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.91% (5.2763 => 3.1707, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.16% (5.3855 => 3.7075, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.90% (5.3526 => 3.6989, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.15% (2.9384 => 2.5521, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -12.64% (22.1758 => 19.3727, std. dev.: 0.0668) SingleSource/UnitTests/Vector/constpool: -5.16% (54.1659 => 51.3731, std. dev.: 0.0579) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.07% (7.9617 => 7.8765, std. dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.43% (1.2373 => 1.1082, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.88% (19.9488 => 18.5760, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.87% (8.1563 => 7.9221, std. dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6839, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -2.00% (10.2830 => 10.0778, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 02:26:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 04:26:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120704092659.123112A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1761?compare_to=1759&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1761, Order: 159706, Start Time: 2012-07-04 08:12:31, End Time: 2012-07-04 09:26:52 To: 1759, Order: 159703, Start Time: 2012-07-04 06:27:38, End Time: 2012-07-04 07:44:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (122 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (732 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.44% (7.9470 => 8.0611, std. dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.32% (2.0176 => 2.2864, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 7.49% (0.5818 => 0.6254, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.24% (0.5748 => 0.6164, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.63% (0.7061 => 0.7529, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2781 => 0.2962, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 6.42% (0.2945 => 0.3134, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.13% (0.4062 => 0.4311, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2655 => 0.2817, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.03% (0.2937 => 0.3114, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.96% (0.3022 => 0.3202, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.91% (0.2690 => 0.2849, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.87% (0.2760 => 0.2922, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.83% (0.2726 => 0.2885, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.82% (0.2628 => 0.2781, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.77% (0.7038 => 0.7444, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 5.76% (0.2761 => 0.2920, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.68% (1.9828 => 2.0955, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.66% (1.3693 => 1.4468, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary: 5.63% (0.3107 => 0.3282, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.63% (0.2966 => 0.3133, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2765 => 0.2920, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.53% (0.3149 => 0.3323, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.45% (0.2696 => 0.2843, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.27% (0.3489 => 0.3673, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.21% (0.3899 => 0.4102, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.20% (0.3192 => 0.3358, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.14% (0.3485 => 0.3664, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.03% (0.3580 => 0.3760, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.01% (0.3293 => 0.3458, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 4.94% (0.3868 => 0.4059, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.90% (0.7710 => 0.8088, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.89% (0.2988 => 0.3134, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.78% (0.4016 => 0.4208, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.75% (0.5265 => 0.5515, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.62% (0.2596 => 0.2716, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.58% (0.4390 => 0.4591, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.54% (3.9660 => 4.1459, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 4.05% (16.6129 => 17.2859, std. dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.97% (0.6959 => 0.7235, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.88% (13.2842 => 13.7999, std. dev.: 0.0115) MultiSource/Applications/SPASS/SPASS: 3.85% (13.8202 => 14.3523, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.70% (0.9199 => 0.9539, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3755 => 0.3890, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.59% (1.2292 => 1.2733, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.53% (1.2193 => 1.2623, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.44% (0.5577 => 0.5769, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 3.42% (0.2925 => 0.3025, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (1.4563 => 1.5053, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (4.9865 => 5.1520, std. dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.11% (0.3246 => 0.3347, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.10% (1.3245 => 1.3656, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.08% (1.1364 => 1.1714, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.05% (0.5637 => 0.5809, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 2.96% (0.3914 => 0.4030, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.94% (1.0594 => 1.0905, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 2.91% (0.3578 => 0.3682, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.87% (3.8646 => 3.9756, std. dev.: 0.0082) MultiSource/Applications/Burg/burg: 2.87% (1.1061 => 1.1378, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 2.77% (0.3789 => 0.3894, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 2.76% (0.7506 => 0.7713, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.73% (1.9270 => 1.9796, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 2.72% (0.3940 => 0.4047, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.65% (1.3819 => 1.4185, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.61% (1.3813 => 1.4174, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (0.4379 => 0.4492, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.48% (7.2180 => 7.3973, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8310 => 0.8513, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.41% (0.7460 => 0.7640, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.34% (3.6692 => 3.7551, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.29% (0.8698 => 0.8897, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.28% (16.2614 => 16.6317, std. dev.: 0.0267) MultiSource/Applications/JM/lencod/lencod: 2.16% (14.8535 => 15.1742, std. dev.: 0.0195) MultiSource/Applications/siod/siod: 2.11% (2.1791 => 2.2251, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (6.5754 => 6.7128, std. dev.: 0.0080) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.96% (4.4433 => 4.5305, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.92% (4.3801 => 4.4640, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.74% (0.6135 => 0.6242, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.66% (0.6283 => 0.6387, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.64% (3.1889 => 3.2413, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (1.1333 => 1.1509, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 1.51% (14.5298 => 14.7492, std. dev.: 0.0146) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (1.2749 => 1.2941, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.19% (2.1007 => 2.1256, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.95% (1.8175 => 2.2710, std. dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.32% (2.0200 => 2.1881, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.00% (1.2998 => 1.3908, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.83% (0.2093 => 0.2194, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.18% (7.4271 => 7.7374, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6779, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4786, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9772, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4559, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (1.5089 => 1.5353, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (3.6469 => 3.7035, std. dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.58% (22.5627 => 21.0787, std. dev.: 0.0201) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.33% (0.3511 => 0.3394, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.38% (0.8818 => 0.8608, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.60% (0.9108 => 0.8962, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.36% (6.2785 => 6.1928, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.90% (1.2308 => 1.1089, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.17% (20.3410 => 18.4763, std. dev.: 0.0505) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.40% (1.3780 => 1.3173, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5992, std. dev.: 0.0103) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.76% (6.6320 => 6.5151, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2507, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.48% (3.0263 => 2.9815, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8604, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8437, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2123, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2568, std. dev.: 0.0012) MultiSource/Applications/lua/lua: -1.11% (26.5159 => 26.2218, std. dev.: 0.0177) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 5.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 02:35:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 04:35:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120704093545.A50612A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1762?compare_to=1760&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1762, Order: 159706, Start Time: 2012-07-04 08:16:40, End Time: 2012-07-04 09:35:39 To: 1760, Order: 159703, Start Time: 2012-07-04 06:27:40, End Time: 2012-07-04 07:48:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (59 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (796 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.32% (2.0908 => 2.1185, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.62% (78.6551 => 80.7184, std. dev.: 0.2151) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.23% (10.3673 => 13.8120, std. dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.54% (1.1194 => 1.2486, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.98% (1.7609 => 1.9014, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.25% (2.2022 => 2.3399, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.05% (0.3473 => 0.3683, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.73% (0.3543 => 0.3746, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 5.63% (0.3516 => 0.3714, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 5.60% (0.3497 => 0.3693, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.56% (0.3543 => 0.3740, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.56% (0.3561 => 0.3759, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.44% (0.3694 => 0.3895, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 5.36% (0.3828 => 0.4033, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.27% (0.3927 => 0.4134, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.22% (0.3886 => 0.4089, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.20% (0.5925 => 0.6174, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.10% (0.4879 => 0.5079, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 4.08% (0.6030 => 0.6276, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.99% (7.0540 => 7.3353, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.68% (0.3177 => 0.3294, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 3.59% (0.7433 => 0.7700, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 3.34% (0.7326 => 0.7571, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: 3.08% (0.3282 => 0.3383, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (10.4361 => 10.7101, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.57% (0.5569 => 0.5712, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.52% (2.0665 => 2.1185, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.49% (0.4615 => 0.4730, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 2.42% (0.4289 => 0.4393, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.28% (0.8172 => 0.8358, std. dev.: 0.0065) MultiSource/Applications/spiff/spiff: 2.23% (0.7835 => 0.8010, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (14.3668 => 14.6844, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5860 => 0.5985, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.10% (1.5603 => 1.5930, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.95% (5.0018 => 5.0992, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.81% (4.9449 => 5.0344, std. dev.: 0.0156) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (4.2646 => 4.3406, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 1.78% (0.6456 => 0.6571, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 1.72% (9.4845 => 9.6480, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.58% (1.5415 => 1.5659, std. dev.: 0.0044) MultiSource/Applications/treecc/treecc: 1.54% (2.0273 => 2.0585, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 1.46% (1.2842 => 1.3029, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.45% (8.1363 => 8.2542, std. dev.: 0.0067) MultiSource/Applications/d/make_dparser: 1.42% (3.3354 => 3.3827, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.32% (1.1861 => 1.2017, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.25% (17.1811 => 17.3960, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.11% (1.3050 => 1.3195, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 1.11% (3.8723 => 3.9151, std. dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 1.08% (5.7591 => 5.8212, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.07% (0.9765 => 0.9869, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.01% (2.2024 => 2.2247, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (3.6395 => 3.7601, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.71% (26.0924 => 26.8001, std. dev.: 0.0307) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.95% (1.5086 => 1.5380, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4474, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.45% (9.1159 => 9.2477, std. dev.: 0.0235) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6891, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.16% (5.2763 => 3.1571, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.67% (5.3855 => 3.6799, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.33% (5.3526 => 3.6758, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.51% (2.9384 => 2.5415, std. dev.: 0.0116) MultiSource/Applications/ClamAV/clamscan: -12.77% (22.1758 => 19.3444, std. dev.: 0.0405) SingleSource/UnitTests/Vector/constpool: -4.91% (54.1659 => 51.5081, std. dev.: 0.0372) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.44% (3.8922 => 3.7971, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.58% (0.8101 => 0.7973, std. dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.24% (7.9617 => 7.8629, std. dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.09% (1.2373 => 1.1125, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.09% (19.9488 => 18.5336, std. dev.: 0.0592) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9178, std. dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6924, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0844, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 4.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 03:49:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 05:49:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120704104958.60FBB2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1763?compare_to=1758&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1763, Order: 159706, Start Time: 2012-07-04 08:06:34, End Time: 2012-07-04 10:49:56 To: 1758, Order: 159701, Start Time: 2012-07-04 04:53:51, End Time: 2012-07-04 07:39:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (32 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (860 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.43% (124.3209 => 131.0733, std. dev.: 0.2128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.09% (54.2576 => 54.8496, std. dev.: 0.0521) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 6.62% (0.3446 => 0.3674, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.61% (0.3465 => 0.3694, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.54% (0.3488 => 0.3716, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 6.53% (0.3460 => 0.3686, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.51% (0.3469 => 0.3695, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.45% (0.3442 => 0.3664, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.44% (0.3496 => 0.3721, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.15% (0.3643 => 0.3867, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.11% (0.3650 => 0.3873, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.96% (0.3724 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.99% (0.5826 => 0.6117, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.67% (0.5889 => 0.6164, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: 3.30% (0.7171 => 0.7408, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.00% (1.6211 => 1.6697, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.82% (0.4361 => 0.4484, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.56% (3.5627 => 3.6540, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.53% (0.5900 => 0.6049, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (0.5026 => 0.5149, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 2.38% (4.2109 => 4.3112, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.32% (2.0673 => 2.1153, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.32% (0.9909 => 1.0139, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.15% (1.3152 => 1.3435, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 2.12% (23.5202 => 24.0188, std. dev.: 0.0101) MultiSource/Applications/d/make_dparser: 1.67% (1.0781 => 1.0961, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 1.65% (0.9697 => 0.9857, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.55% (4.4195 => 4.4879, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.51% (1.9694 => 1.9992, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 1.31% (1.8794 => 1.9041, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.25% (1.9966 => 2.0215, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 1.17% (2.1653 => 2.1906, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 1.04% (5.5417 => 5.5993, std. dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 1.02% (4.6177 => 4.6649, std. dev.: 0.0109) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.24% (11.9555 => 11.6877, std. dev.: 0.0180) SingleSource/UnitTests/Vector/constpool: -2.08% (2.4764 => 2.4248, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 04:32:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 06:32:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120704113227.09C2A2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1764?compare_to=1761&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1764, Order: 159707, Start Time: 2012-07-04 10:17:57, End Time: 2012-07-04 11:32:25 To: 1761, Order: 159706, Start Time: 2012-07-04 08:12:31, End Time: 2012-07-04 09:26:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (120 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (734 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.15% (54.6622 => 56.3832, std. dev.: 0.1581) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.51% (3.8341 => 3.7761, std. dev.: 0.0184) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.42% (2.0176 => 2.2883, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.36% (0.5818 => 0.6246, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.17% (0.5748 => 0.6160, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.65% (0.3130 => 0.3338, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.57% (0.7061 => 0.7525, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 6.55% (0.2945 => 0.3138, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash2: 6.33% (0.4328 => 0.4602, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.26% (0.2781 => 0.2955, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.21% (0.7038 => 0.7475, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.13% (0.4062 => 0.4311, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.02% (0.2690 => 0.2852, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.92% (1.3693 => 1.4504, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.89% (0.3022 => 0.3200, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.88% (0.2655 => 0.2811, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.87% (0.2607 => 0.2760, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.86% (0.2937 => 0.3109, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.83% (0.2726 => 0.2885, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.83% (0.2761 => 0.2922, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.78% (0.2628 => 0.2780, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.72% (0.2760 => 0.2918, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.68% (1.9828 => 2.0954, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 5.63% (0.3107 => 0.3282, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.62% (0.3149 => 0.3326, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.39% (0.3489 => 0.3677, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.22% (0.3485 => 0.3667, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.21% (0.3899 => 0.4102, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 5.18% (0.3453 => 0.3632, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.17% (0.3580 => 0.3765, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.95% (0.3293 => 0.3456, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.89% (0.2988 => 0.3134, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.88% (0.4016 => 0.4212, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.85% (0.7710 => 0.8084, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.76% (0.3868 => 0.4052, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.71% (0.3756 => 0.3933, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.69% (0.5265 => 0.5512, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.65% (0.4390 => 0.4594, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.63% (3.9660 => 4.1495, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.51% (0.2596 => 0.2713, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 4.11% (16.6129 => 17.2962, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.97% (0.6959 => 0.7235, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.92% (13.2842 => 13.8046, std. dev.: 0.0177) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.2292 => 1.2773, std. dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 3.88% (13.8202 => 14.3563, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.71% (0.9199 => 0.9540, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.47% (1.2193 => 1.2616, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3755 => 0.3883, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.41% (0.5577 => 0.5767, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.41% (1.4563 => 1.5059, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 3.31% (1.1061 => 1.1427, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (4.9865 => 5.1508, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.11% (1.3245 => 1.3657, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.05% (1.1364 => 1.1711, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.05% (0.5637 => 0.5809, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 2.98% (3.8646 => 3.9797, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 2.97% (1.0594 => 1.0909, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/parameter-passing: 2.97% (0.4003 => 0.4122, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 2.96% (0.3578 => 0.3684, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.94% (0.7506 => 0.7727, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.92% (1.9270 => 1.9833, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 2.89% (0.3914 => 0.4027, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 2.69% (0.3789 => 0.3891, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 2.66% (0.3940 => 0.4045, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.64% (1.3813 => 1.4178, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.63% (0.4379 => 0.4494, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.60% (0.7460 => 0.7654, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.50% (1.3819 => 1.4164, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.49% (7.2180 => 7.3976, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.40% (0.8698 => 0.8907, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 2.35% (16.2614 => 16.6428, std. dev.: 0.0095) MultiSource/Applications/siod/siod: 2.26% (2.1791 => 2.2284, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.22% (6.5754 => 6.7217, std. dev.: 0.0116) MultiSource/Applications/JM/lencod/lencod: 2.22% (14.8535 => 15.1836, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.19% (3.6692 => 3.7495, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.89% (4.3801 => 4.4631, std. dev.: 0.0141) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.89% (4.4433 => 4.5272, std. dev.: 0.0088) MultiSource/Applications/d/make_dparser: 1.88% (3.1889 => 3.2487, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.73% (0.6135 => 0.6241, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (0.6283 => 0.6391, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.65% (14.5298 => 14.7701, std. dev.: 0.0169) MultiSource/Applications/SIBsim4/SIBsim4: 1.59% (1.2749 => 1.2952, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (1.1333 => 1.1511, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.35% (2.1007 => 2.1291, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.50% (1.8175 => 2.2627, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.28% (2.0200 => 2.1873, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: 7.09% (1.2998 => 1.3920, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7352, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9199, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6777, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8310, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4556, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5348, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.62% (3.6469 => 3.7058, std. dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5074, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.65% (22.5627 => 21.0626, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.45% (0.3511 => 0.3390, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.59% (0.8818 => 0.8590, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.46% (0.9108 => 0.8975, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.28% (6.2785 => 6.1980, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2308 => 1.1042, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.98% (20.3410 => 18.5145, std. dev.: 0.0916) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.13% (1.3780 => 1.3073, std. dev.: 0.0095) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -3.52% (1.9762 => 1.9067, std. dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5966, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: -2.52% (2.5089 => 2.4457, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5109, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2553, std. dev.: 0.0088) MultiSource/Applications/spiff/spiff: -1.57% (3.0263 => 2.9788, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8584, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.33% (28.2225 => 27.8476, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2220, std. dev.: 0.0129) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2586, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8492, std. dev.: 0.0100) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 04:36:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 06:36:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120704113645.876CE2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1765?compare_to=1762&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1765, Order: 159707, Start Time: 2012-07-04 10:17:54, End Time: 2012-07-04 11:36:42 To: 1762, Order: 159706, Start Time: 2012-07-04 08:16:40, End Time: 2012-07-04 09:35:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (800 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.32% (10.3673 => 13.8217, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.74% (1.1194 => 1.2508, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.85% (1.7609 => 1.8992, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.32% (2.2022 => 2.3414, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.93% (0.3473 => 0.3679, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.72% (0.3516 => 0.3717, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.70% (0.3543 => 0.3745, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.67% (0.3543 => 0.3744, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.66% (0.3497 => 0.3695, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.64% (0.3561 => 0.3762, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.50% (0.3694 => 0.3897, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: 5.46% (0.3828 => 0.4037, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/parameter-passing: 5.35% (0.3927 => 0.4137, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.30% (0.3886 => 0.4092, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.30% (0.5925 => 0.6180, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.20% (0.4879 => 0.5084, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 4.15% (0.6030 => 0.6280, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.09% (7.0540 => 7.3424, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.75% (0.3177 => 0.3296, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 3.39% (0.7326 => 0.7574, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.08% (0.4615 => 0.4757, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 3.05% (0.3282 => 0.3382, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.79% (0.8172 => 0.8400, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (10.4361 => 10.7179, std. dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.59% (2.0665 => 2.1201, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 2.49% (0.4289 => 0.4396, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (14.3668 => 14.6961, std. dev.: 0.0104) MultiSource/Applications/hbd/hbd: 2.24% (1.5603 => 1.5952, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.21% (0.5569 => 0.5692, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.12% (4.9449 => 5.0496, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.85% (5.0018 => 5.0943, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 1.81% (0.7835 => 0.7977, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 1.80% (0.6456 => 0.6572, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (4.2646 => 4.3395, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.75% (1.5415 => 1.5685, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (9.4845 => 9.6422, std. dev.: 0.0184) MultiSource/Applications/treecc/treecc: 1.58% (2.0273 => 2.0594, std. dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: 1.57% (1.2842 => 1.3043, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.46% (8.1363 => 8.2550, std. dev.: 0.0048) MultiSource/Applications/d/make_dparser: 1.42% (3.3354 => 3.3829, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.38% (1.1861 => 1.2025, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 1.26% (1.1642 => 1.1789, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.26% (17.1811 => 17.3977, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 1.22% (3.8723 => 3.9195, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.19% (1.3050 => 1.3205, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7591 => 5.8264, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7589, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 2.75% (26.0924 => 26.8106, std. dev.: 0.0260) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (1.5086 => 1.5364, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.62% (9.1159 => 9.2638, std. dev.: 0.0074) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4472, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6902, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1250, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.14% (5.2763 => 3.1583, std. dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.67% (5.3855 => 3.6797, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.32% (5.3526 => 3.6761, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.52% (2.9384 => 2.5411, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -12.72% (22.1758 => 19.3543, std. dev.: 0.0203) SingleSource/UnitTests/Vector/constpool: -4.92% (54.1659 => 51.5015, std. dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.46% (3.8922 => 3.7963, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.54% (0.8101 => 0.7976, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2373 => 1.1056, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.85% (19.9488 => 18.5821, std. dev.: 0.0263) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9202, std. dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6795, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0864, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 06:13:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 08:13:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120704131352.2735A2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1766?compare_to=1764&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1766, Order: 159708, Start Time: 2012-07-04 11:59:37, End Time: 2012-07-04 13:13:50 To: 1764, Order: 159707, Start Time: 2012-07-04 10:17:57, End Time: 2012-07-04 11:32:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (126 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (728 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.28% (2.0176 => 2.2856, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference: 7.41% (0.7061 => 0.7584, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 7.15% (0.5818 => 0.6234, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.01% (0.5748 => 0.6151, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.38% (0.4062 => 0.4321, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.96% (0.4328 => 0.4586, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.91% (0.2945 => 0.3119, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.77% (0.7038 => 0.7444, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 5.72% (0.2781 => 0.2940, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.62% (1.3693 => 1.4462, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.50% (0.2782 => 0.2935, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.46% (0.3022 => 0.3187, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.42% (0.2655 => 0.2799, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 5.36% (0.2726 => 0.2872, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2690 => 0.2834, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.33% (0.2607 => 0.2746, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.33% (0.2966 => 0.3124, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wc: 5.24% (0.2937 => 0.3091, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.22% (0.2760 => 0.2904, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.21% (0.2628 => 0.2765, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.20% (1.9828 => 2.0860, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.3107 => 0.3265, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 5.08% (0.3149 => 0.3309, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.06% (0.2765 => 0.2905, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.03% (0.7710 => 0.8098, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.93% (0.3489 => 0.3661, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.92% (0.4390 => 0.4606, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.92% (0.5265 => 0.5524, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.90% (0.2696 => 0.2828, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.83% (3.9660 => 4.1574, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.76% (0.3485 => 0.3651, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.72% (0.3580 => 0.3749, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2721 => 0.2849, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.67% (0.3899 => 0.4081, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 4.63% (0.3453 => 0.3613, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.58% (0.2596 => 0.2715, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: 4.52% (0.3293 => 0.3442, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.42% (0.3756 => 0.3922, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.2988 => 0.3120, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.41% (0.4016 => 0.4193, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.36% (0.3534 => 0.3688, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 3.92% (16.6129 => 17.2643, std. dev.: 0.0162) MultiSource/Applications/SPASS/SPASS: 3.91% (13.8202 => 14.3607, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.79% (13.2842 => 13.7875, std. dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.76% (0.9199 => 0.9545, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.74% (0.6959 => 0.7219, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.47% (1.2193 => 1.2616, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.46% (1.2292 => 1.2717, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.37% (0.5577 => 0.5765, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.30% (1.4563 => 1.5043, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 3.27% (0.3578 => 0.3695, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: 3.26% (0.7506 => 0.7751, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.16% (0.5637 => 0.5815, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.14% (4.9865 => 5.1430, std. dev.: 0.0144) SingleSource/UnitTests/ObjC/parameter-passing: 3.12% (0.4003 => 0.4128, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.12% (1.3245 => 1.3658, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.09% (0.3755 => 0.3871, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 3.07% (0.3914 => 0.4034, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.04% (1.1364 => 1.1709, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0906, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 2.87% (0.3623 => 0.3727, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 2.86% (0.3601 => 0.3704, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.85% (1.9270 => 1.9820, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 2.84% (1.1061 => 1.1375, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.84% (3.8646 => 3.9742, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 2.82% (0.3789 => 0.3896, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.82% (0.3650 => 0.3753, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.81% (1.3819 => 1.4207, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 2.80% (0.3646 => 0.3748, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 2.76% (0.3663 => 0.3764, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 2.74% (0.3940 => 0.4048, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.74% (1.3813 => 1.4191, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (0.4379 => 0.4492, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.47% (0.8310 => 0.8515, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.35% (7.2180 => 7.3875, std. dev.: 0.0085) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.33% (0.7460 => 0.7634, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.22% (16.2614 => 16.6232, std. dev.: 0.0182) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (3.6692 => 3.7500, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.20% (0.8698 => 0.8889, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.17% (2.1791 => 2.2263, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 2.08% (14.8535 => 15.1623, std. dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: 2.02% (6.5754 => 6.7080, std. dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.84% (0.6135 => 0.6248, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.80% (1.2749 => 1.2979, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: 1.79% (3.1889 => 3.2460, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.71% (4.3801 => 4.4549, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.66% (4.4433 => 4.5170, std. dev.: 0.0107) MultiSource/Applications/ClamAV/clamscan: 1.64% (14.5298 => 14.7677, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.6283 => 0.6384, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.45% (1.1333 => 1.1497, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.29% (2.1007 => 2.1278, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.83% (1.8175 => 2.3052, std. dev.: 0.0341) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1934, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0066) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.87% (1.2998 => 1.3891, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.22% (7.4271 => 7.7408, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9216, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6787, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4808, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1892, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.87% (1.4298 => 1.4565, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.79% (3.6469 => 3.7123, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5346, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 1.11% (10.7476 => 10.8671, std. dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.73% (22.5627 => 21.0439, std. dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.13% (0.3511 => 0.3366, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.80% (0.8818 => 0.8571, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.60% (0.9108 => 0.8962, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.30% (6.2785 => 6.1970, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.70% (1.2308 => 1.1114, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.86% (20.3410 => 18.5391, std. dev.: 0.0510) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.36% (1.3780 => 1.3179, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0094) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5893, std. dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4464, std. dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5051, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2560, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: -1.45% (3.0263 => 2.9824, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: -1.35% (28.2225 => 27.8421, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.34% (9.3358 => 9.2111, std. dev.: 0.0075) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2538, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.15% (3.8887 => 3.8440, std. dev.: 0.0078) MultiSource/Applications/lua/lua: -1.11% (26.5159 => 26.2208, std. dev.: 0.0311) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 06:22:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 08:22:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120704132257.9A98C2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1767?compare_to=1765&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1767, Order: 159708, Start Time: 2012-07-04 12:04:03, End Time: 2012-07-04 13:22:55 To: 1765, Order: 159707, Start Time: 2012-07-04 10:17:54, End Time: 2012-07-04 11:36:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (56 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (799 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.58% (13.8217 => 13.6031, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.03% (2.1201 => 2.0983, std. dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.21% (10.3673 => 13.6031, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.74% (1.1194 => 1.2508, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.11% (1.7609 => 1.8861, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.55% (2.2022 => 2.3464, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 5.99% (0.3473 => 0.3681, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 5.89% (0.3497 => 0.3703, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 5.76% (0.3561 => 0.3766, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.73% (0.3543 => 0.3746, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.70% (0.3543 => 0.3745, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.69% (0.3516 => 0.3716, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 5.58% (0.3694 => 0.3900, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.33% (0.3886 => 0.4093, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 5.30% (0.3927 => 0.4135, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions: 5.28% (0.3828 => 0.4030, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.18% (0.4879 => 0.5083, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.14% (7.0540 => 7.3461, std. dev.: 0.0073) SingleSource/UnitTests/ObjC++/property-reference-object: 3.88% (0.6030 => 0.6264, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.85% (0.5925 => 0.6153, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.75% (0.3177 => 0.3296, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 3.63% (0.7433 => 0.7703, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 3.14% (0.3282 => 0.3385, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 3.13% (0.7326 => 0.7555, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (0.8172 => 0.8401, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (10.4361 => 10.7177, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (14.3668 => 14.7047, std. dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.32% (0.5569 => 0.5698, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.93% (0.5860 => 0.5973, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.92% (5.0018 => 5.0979, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.91% (4.9449 => 5.0393, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.85% (4.2646 => 4.3435, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.71% (0.7835 => 0.7969, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.70% (8.1363 => 8.2746, std. dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (9.4845 => 9.6433, std. dev.: 0.0091) MultiSource/Applications/d/make_dparser: 1.57% (3.3354 => 3.3876, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.55% (2.0273 => 2.0588, std. dev.: 0.0037) MultiSource/Applications/hbd/hbd: 1.55% (1.5603 => 1.5845, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.54% (2.0665 => 2.0983, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.51% (17.1811 => 17.4398, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.46% (1.5415 => 1.5640, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.43% (0.8067 => 0.8182, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.40% (1.1861 => 1.2027, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.33% (1.1642 => 1.1797, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.19% (1.3050 => 1.3205, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.14% (1.4186 => 1.4348, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (2.2024 => 2.2255, std. dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7591 => 5.8189, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7527, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 2.79% (26.0924 => 26.8201, std. dev.: 0.0113) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.5086 => 1.5376, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2451, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6881, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1245, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.05% (5.2763 => 3.1633, std. dev.: 0.0148) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.71% (5.3855 => 3.6776, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.38% (5.3526 => 3.6728, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.08% (2.9384 => 2.5542, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -12.76% (22.1758 => 19.3472, std. dev.: 0.0185) SingleSource/UnitTests/Vector/constpool: -4.89% (54.1659 => 51.5155, std. dev.: 0.0479) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.43% (3.8922 => 3.7975, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.64% (0.8101 => 0.7968, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.16% (7.9617 => 7.8694, std. dev.: 0.0230) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.86% (1.2373 => 1.1153, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.26% (19.9488 => 18.5001, std. dev.: 0.1028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9153, std. dev.: 0.0141) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6933, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0844, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 07:00:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 09:00:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120704140007.786042A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1768?compare_to=1763&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1768, Order: 159708, Start Time: 2012-07-04 11:17:10, End Time: 2012-07-04 14:00:04 To: 1763, Order: 159706, Start Time: 2012-07-04 08:06:34, End Time: 2012-07-04 10:49:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (33 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (859 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 7.60% (0.3446 => 0.3708, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.42% (0.3465 => 0.3722, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.29% (0.3469 => 0.3722, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.28% (0.3460 => 0.3712, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.28% (0.3488 => 0.3742, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 7.15% (0.3496 => 0.3746, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.09% (0.3442 => 0.3686, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 6.82% (0.3650 => 0.3899, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.73% (0.3643 => 0.3888, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.61% (0.3724 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.12% (0.5826 => 0.6124, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.84% (0.5889 => 0.6174, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.51% (0.7171 => 0.7423, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.21% (0.4361 => 0.4501, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.15% (1.6211 => 1.6721, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.74% (2.0673 => 2.1240, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.72% (3.5627 => 3.6595, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 2.64% (0.9909 => 1.0171, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.49% (0.5900 => 0.6047, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (0.5026 => 0.5149, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 2.37% (4.2109 => 4.3105, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (1.3152 => 1.3442, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.08% (0.4994 => 0.5098, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.01% (0.9697 => 0.9892, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.67% (4.4195 => 4.4933, std. dev.: 0.0131) MultiSource/Applications/d/make_dparser: 1.56% (1.0781 => 1.0949, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.42% (23.5202 => 23.8539, std. dev.: 0.0203) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.36% (1.9694 => 1.9962, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 1.32% (1.8794 => 1.9042, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.20% (1.9966 => 2.0206, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.18% (4.6177 => 4.6723, std. dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.10% (2.7292 => 2.7592, std. dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 1.09% (2.1653 => 2.1888, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.41% (11.9555 => 11.6668, std. dev.: 0.0180) SingleSource/UnitTests/Vector/constpool: -2.00% (2.4764 => 2.4269, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 07:55:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 09:55:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120704145534.559D32A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1769?compare_to=1766&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1769, Order: 159710, Start Time: 2012-07-04 13:41:06, End Time: 2012-07-04 14:55:31 To: 1766, Order: 159708, Start Time: 2012-07-04 11:59:37, End Time: 2012-07-04 13:13:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.40% (1.3891 => 1.4085, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -2.21% (2.3052 => 2.2543, std. dev.: 0.0123) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.33% (2.0176 => 2.2866, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.39% (0.7061 => 0.7583, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.30% (0.5818 => 0.6243, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.98% (0.5748 => 0.6149, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.42% (0.2945 => 0.3134, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.22% (0.2781 => 0.2954, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.19% (0.1986 => 0.2109, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.19% (1.3693 => 1.4541, std. dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: 6.07% (0.7038 => 0.7465, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.02% (0.3022 => 0.3204, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.93% (0.2782 => 0.2947, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.83% (0.4062 => 0.4299, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.80% (0.2655 => 0.2809, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.80% (0.2690 => 0.2846, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.80% (0.2966 => 0.3138, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.80% (0.2726 => 0.2884, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.76% (0.2761 => 0.2920, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.72% (1.9828 => 2.0963, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.67% (0.2628 => 0.2777, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2765 => 0.2920, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.59% (0.3149 => 0.3325, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2760 => 0.2913, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.49% (0.3899 => 0.4113, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.45% (0.2696 => 0.2843, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.39% (0.3489 => 0.3677, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.16% (0.3485 => 0.3665, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.14% (0.3192 => 0.3356, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.09% (0.5265 => 0.5533, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.08% (0.2596 => 0.2728, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.08% (0.7710 => 0.8102, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.90% (0.4390 => 0.4605, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.89% (0.2988 => 0.3134, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.81% (0.2721 => 0.2852, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (0.3756 => 0.3935, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.74% (0.3293 => 0.3449, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.73% (0.4016 => 0.4206, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.73% (0.3534 => 0.3701, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.64% (3.9660 => 4.1501, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.3868 => 0.4047, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.17% (16.6129 => 17.3051, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.04% (0.6959 => 0.7240, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.91% (13.8202 => 14.3601, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.90% (13.2842 => 13.8029, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.77% (0.9199 => 0.9546, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.62% (1.2292 => 1.2737, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.56% (1.2193 => 1.2627, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.46% (0.5577 => 0.5770, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3755 => 0.3881, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.35% (1.3245 => 1.3689, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.34% (1.4563 => 1.5050, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 3.33% (0.3578 => 0.3697, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.24% (4.9865 => 5.1481, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/parameter-passing: 3.20% (0.4003 => 0.4131, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.19% (0.3789 => 0.3910, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.17% (0.3914 => 0.4038, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.14% (0.5637 => 0.5814, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.13% (0.7506 => 0.7741, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 3.12% (3.8646 => 3.9852, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.12% (1.3819 => 1.4250, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.11% (0.3246 => 0.3347, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 3.07% (0.3646 => 0.3758, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.06% (0.3663 => 0.3775, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.06% (1.1061 => 1.1399, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: 3.05% (0.3601 => 0.3711, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.05% (1.1364 => 1.1711, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.05% (1.0594 => 1.0917, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 3.04% (0.3623 => 0.3733, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.99% (1.9270 => 1.9846, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.99% (0.3650 => 0.3759, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 2.92% (0.3940 => 0.4055, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.87% (1.3813 => 1.4209, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.83% (0.4379 => 0.4503, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.61% (0.7460 => 0.7655, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.52% (7.2180 => 7.3996, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8310 => 0.8511, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.40% (2.1791 => 2.2315, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.37% (0.8698 => 0.8904, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.34% (3.6692 => 3.7549, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.19% (16.2614 => 16.6172, std. dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 2.10% (14.8535 => 15.1650, std. dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (6.5754 => 6.7065, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.99% (4.3801 => 4.4673, std. dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.87% (0.6135 => 0.6250, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.80% (0.6283 => 0.6396, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 1.78% (3.1889 => 3.2458, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.75% (4.4433 => 4.5211, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: 1.69% (14.5298 => 14.7749, std. dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (1.1333 => 1.1510, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.53% (1.2749 => 1.2944, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.16% (2.1007 => 2.1250, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.03% (1.8175 => 2.2543, std. dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.53% (2.0200 => 2.1923, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 8.36% (1.2998 => 1.4085, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.83% (0.2093 => 0.2194, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.84% (7.4271 => 7.7123, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9224, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6782, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4803, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9773, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 2.00% (1.4298 => 1.4584, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5355, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (3.6469 => 3.7094, std. dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1943, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.5627 => 21.0501, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.56% (0.3511 => 0.3386, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.8818 => 0.8569, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.69% (0.6576 => 0.6465, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.57% (0.9108 => 0.8965, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.17% (6.2785 => 6.2051, std. dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.61% (1.2308 => 1.1125, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.91% (20.3410 => 18.5283, std. dev.: 0.1006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.25% (1.3780 => 1.3057, std. dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -3.50% (1.9762 => 1.9071, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5979, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5059, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2526, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.5254 => 2.4875, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -1.48% (3.0263 => 2.9814, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std. dev.: 0.0126) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8447, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2154, std. dev.: 0.0365) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2529, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8473, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 08:08:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 10:08:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120704150853.90D4D2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1770?compare_to=1767&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1770, Order: 159710, Start Time: 2012-07-04 13:50:12, End Time: 2012-07-04 15:08:51 To: 1767, Order: 159708, Start Time: 2012-07-04 12:04:03, End Time: 2012-07-04 13:22:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (59 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (798 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.66% (54.5639 => 56.5584, std. dev.: 0.1049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.52% (10.3673 => 13.7388, std. dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.78% (1.1194 => 1.2513, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.83% (1.7609 => 1.8988, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.23% (0.3473 => 0.3724, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.89% (0.3497 => 0.3738, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.86% (0.3543 => 0.3786, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 6.83% (0.3516 => 0.3756, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.80% (2.2022 => 2.3519, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.77% (0.3543 => 0.3783, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.77% (0.3561 => 0.3802, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.58% (0.3694 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.44% (0.3927 => 0.4180, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.43% (0.3828 => 0.4074, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.41% (0.3886 => 0.4135, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.76% (0.5925 => 0.6207, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 4.71% (0.6030 => 0.6314, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.4879 => 0.5103, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.45% (7.0540 => 7.3676, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.12% (0.3177 => 0.3308, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.09% (0.7433 => 0.7737, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 3.97% (0.7326 => 0.7617, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.73% (0.8172 => 0.8477, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 3.32% (0.3282 => 0.3391, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 3.08% (10.4361 => 10.7578, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.85% (0.5860 => 0.6027, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.71% (0.5569 => 0.5720, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.71% (0.4615 => 0.4740, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (14.3668 => 14.7552, std. dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (4.9449 => 5.0636, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.39% (5.0018 => 5.1211, std. dev.: 0.0080) MultiSource/Applications/spiff/spiff: 2.34% (0.7835 => 0.8018, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.15% (4.2646 => 4.3562, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.05% (2.0273 => 2.0688, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.04% (8.1363 => 8.3021, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.03% (2.0665 => 2.1084, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 2.00% (9.4845 => 9.6738, std. dev.: 0.0074) MultiSource/Applications/Burg/burg: 1.98% (1.1642 => 1.1872, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.95% (0.8067 => 0.8224, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.94% (1.5603 => 1.5905, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.93% (3.3354 => 3.3999, std. dev.: 0.0139) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.5415 => 1.5700, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.74% (1.1861 => 1.2067, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.67% (3.8723 => 3.9371, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.58% (0.9765 => 0.9919, std. dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 1.56% (17.1811 => 17.4489, std. dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.53% (1.3050 => 1.3250, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.50% (2.2024 => 2.2355, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.40% (1.4186 => 1.4385, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7591 => 5.8306, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 1.24% (1.2842 => 1.3001, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.00% (3.6395 => 3.7486, std. dev.: 0.0096) MultiSource/Applications/lua/lua: 2.73% (26.0924 => 26.8059, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: 1.60% (9.1159 => 9.2620, std. dev.: 0.0083) SingleSource/Benchmarks/Dhrystone/dry: 1.38% (2.4116 => 2.4449, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6885, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.12% (5.2763 => 3.1593, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.49% (5.3855 => 3.6894, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.19% (5.3526 => 3.6829, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.30% (2.9384 => 2.5475, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -12.53% (22.1758 => 19.3978, std. dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -4.90% (54.1659 => 51.5096, std. dev.: 0.0211) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.11% (3.8922 => 3.8102, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.06% (1.2373 => 1.1128, std. dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.01% (19.9488 => 18.5508, std. dev.: 0.0917) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (8.1563 => 7.9199, std. dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6834, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -1.98% (10.2830 => 10.0798, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 10:10:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 12:10:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120704171017.02DFB2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1771?compare_to=1768&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1771, Order: 159710, Start Time: 2012-07-04 14:27:16, End Time: 2012-07-04 17:10:15 To: 1768, Order: 159708, Start Time: 2012-07-04 11:17:10, End Time: 2012-07-04 14:00:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (35 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 949 (857 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 244.40% (2.8809 => 9.9219, std. dev.: 0.0318) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.33% (125.4801 => 127.1500, std. dev.: 0.5517) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.07% (54.2660 => 54.8491, std. dev.: 0.0481) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 7.63% (0.3446 => 0.3709, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.59% (0.3465 => 0.3728, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.43% (0.3460 => 0.3717, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.41% (0.3469 => 0.3726, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.35% (0.3496 => 0.3753, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.29% (0.3442 => 0.3693, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.25% (0.3488 => 0.3741, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.07% (0.3650 => 0.3908, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.92% (0.3643 => 0.3895, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.77% (0.3724 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.27% (0.5826 => 0.6075, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.02% (0.5889 => 0.6126, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.03% (0.4361 => 0.4493, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.00% (1.6211 => 1.6697, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.92% (0.5900 => 0.6072, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.84% (0.7171 => 0.7375, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.83% (0.5026 => 0.5168, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.81% (3.5627 => 3.6627, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.54% (0.4994 => 0.5121, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.50% (0.9909 => 1.0157, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.46% (2.0673 => 2.1182, std. dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 2.39% (4.2109 => 4.3117, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.30% (1.3152 => 1.3454, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 1.97% (0.9697 => 0.9888, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.60% (1.0781 => 1.0953, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.53% (4.4195 => 4.4870, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.42% (1.9694 => 1.9973, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.38% (2.7292 => 2.7668, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 1.24% (23.5202 => 23.8123, std. dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.22% (1.9966 => 2.0210, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 1.17% (2.1653 => 2.1906, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 1.17% (1.8794 => 1.9013, std. dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 1.09% (4.6177 => 4.6680, std. dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 1.00% (2.1013 => 2.1224, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.04% (2.8036 => 2.8328, std. dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.56% (2.4764 => 2.4130, std. dev.: 0.0207) MultiSource/Applications/kimwitu++/kc: -2.51% (11.9555 => 11.6552, std. dev.: 0.0119) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 10:56:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 12:56:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120704175622.80A022A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1772?compare_to=1769&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1772, Order: 159715, Start Time: 2012-07-04 16:42:02, End Time: 2012-07-04 17:56:18 To: 1769, Order: 159710, Start Time: 2012-07-04 13:41:06, End Time: 2012-07-04 14:55:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.64% (55.1311 => 56.0332, std. dev.: 0.2483) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.25% (2.0176 => 2.2850, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.55% (0.7061 => 0.7594, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.25% (0.5818 => 0.6240, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.98% (0.5748 => 0.6149, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.61% (0.3130 => 0.3337, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 6.45% (0.2945 => 0.3135, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.29% (0.2781 => 0.2956, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.14% (0.1986 => 0.2108, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 6.14% (1.3693 => 1.4534, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2761 => 0.2926, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2655 => 0.2813, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.94% (0.7038 => 0.7456, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.88% (0.4062 => 0.4301, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.87% (0.2690 => 0.2848, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.87% (0.2726 => 0.2886, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.86% (0.2782 => 0.2945, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.86% (0.3022 => 0.3199, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.84% (1.9828 => 2.0985, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.77% (0.2966 => 0.3137, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.75% (0.2628 => 0.2779, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3107 => 0.3283, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.65% (0.2760 => 0.2916, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2765 => 0.2920, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.60% (0.7710 => 0.8142, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 5.53% (0.3149 => 0.3323, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.3192 => 0.3367, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3489 => 0.3675, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.20% (0.3580 => 0.3766, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.16% (0.3485 => 0.3665, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.13% (0.3899 => 0.4099, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.04% (0.3293 => 0.3459, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.01% (0.5265 => 0.5529, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.85% (0.2721 => 0.2853, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.83% (0.3868 => 0.4055, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2988 => 0.3132, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.78% (0.2596 => 0.2720, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (0.3756 => 0.3935, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.73% (0.3534 => 0.3701, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.63% (3.9660 => 4.1496, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4390 => 0.4586, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.21% (0.6959 => 0.7252, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 4.03% (16.6129 => 17.2822, std. dev.: 0.0289) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.93% (13.2842 => 13.8058, std. dev.: 0.0083) MultiSource/Applications/SPASS/SPASS: 3.92% (13.8202 => 14.3626, std. dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.89% (0.9199 => 0.9557, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.63% (1.2292 => 1.2738, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.58% (1.2193 => 1.2629, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3755 => 0.3886, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.2925 => 0.3027, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.44% (0.5577 => 0.5769, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 3.33% (0.3578 => 0.3697, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.31% (1.4563 => 1.5045, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 3.27% (0.4003 => 0.4134, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 3.22% (0.3914 => 0.4040, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 3.21% (0.3646 => 0.3763, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.19% (4.9865 => 5.1454, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 3.17% (0.7506 => 0.7744, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 3.17% (0.3601 => 0.3715, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.14% (1.3245 => 1.3661, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 3.14% (0.3789 => 0.3908, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.12% (3.8646 => 3.9853, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.10% (0.5637 => 0.5812, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.10% (1.1061 => 1.1404, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3246 => 0.3346, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 3.06% (0.3663 => 0.3775, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.05% (1.1364 => 1.1711, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.04% (0.3650 => 0.3761, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 3.02% (0.3940 => 0.4059, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 3.01% (0.3623 => 0.3732, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.00% (1.9270 => 1.9848, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.98% (1.0594 => 1.0910, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.95% (1.3813 => 1.4220, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.79% (0.4379 => 0.4501, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.76% (1.3819 => 1.4200, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.57% (7.2180 => 7.4037, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.44% (0.7460 => 0.7642, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 2.42% (2.1791 => 2.2319, std. dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.39% (0.8698 => 0.8906, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 2.38% (0.8310 => 0.8508, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.35% (3.6692 => 3.7556, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 2.22% (16.2614 => 16.6216, std. dev.: 0.0191) MultiSource/Applications/JM/ldecod/ldecod: 2.10% (6.5754 => 6.7132, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.05% (14.8535 => 15.1586, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.93% (4.3801 => 4.4647, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.84% (4.4433 => 4.5249, std. dev.: 0.0083) MultiSource/Applications/d/make_dparser: 1.78% (3.1889 => 3.2456, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.74% (0.6135 => 0.6242, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 1.70% (14.5298 => 14.7771, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 1.61% (1.2749 => 1.2954, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.49% (1.1333 => 1.1502, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.13% (2.1007 => 2.1244, std. dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.66% (1.8175 => 2.2657, std. dev.: 0.0164) SingleSource/Benchmarks/Misc/mandel-2: 8.55% (1.2998 => 1.4109, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1917, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7193, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8314, std. dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.06% (4.1080 => 4.1927, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5349, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (3.6469 => 3.7094, std. dev.: 0.0029) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9586, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1961, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.5627 => 21.0521, std. dev.: 0.0277) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.13% (0.3511 => 0.3366, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.53% (0.8818 => 0.8595, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.98% (0.6576 => 0.6446, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.59% (0.9108 => 0.8963, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (6.2785 => 6.2042, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2308 => 1.1107, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.59% (20.3410 => 18.5937, std. dev.: 0.0331) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.11% (1.3780 => 1.3076, std. dev.: 0.0269) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.8259 => 8.5701, std. dev.: 0.0194) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5067, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2568, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: -1.53% (3.0263 => 2.9799, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8456, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2515, std. dev.: 0.0040) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2307, std. dev.: 0.0170) MultiSource/Applications/lua/lua: -1.05% (26.5159 => 26.2364, std. dev.: 0.0102) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 11:01:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 13:01:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120704180105.AEB392A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1773?compare_to=1770&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1773, Order: 159715, Start Time: 2012-07-04 16:42:11, End Time: 2012-07-04 18:01:03 To: 1770, Order: 159710, Start Time: 2012-07-04 13:50:12, End Time: 2012-07-04 15:08:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (62 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.64% (10.3673 => 13.7513, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.85% (1.1194 => 1.2520, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.84% (1.7609 => 1.8989, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.08% (0.3473 => 0.3719, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.97% (0.3543 => 0.3790, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.83% (0.3516 => 0.3756, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.81% (2.2022 => 2.3521, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 6.81% (0.3497 => 0.3735, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.80% (0.3543 => 0.3784, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 6.77% (0.3561 => 0.3802, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 6.58% (0.3694 => 0.3937, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 6.49% (0.3927 => 0.4182, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.45% (0.3828 => 0.4075, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.36% (0.3886 => 0.4133, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.69% (0.5925 => 0.6203, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.66% (0.6030 => 0.6311, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.51% (0.4879 => 0.5099, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.35% (7.0540 => 7.3610, std. dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 4.26% (0.7433 => 0.7750, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.09% (0.3177 => 0.3307, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: 3.86% (0.7326 => 0.7609, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.82% (0.8172 => 0.8484, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 3.23% (0.3282 => 0.3388, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 3.14% (10.4361 => 10.7637, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (14.3668 => 14.7550, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.66% (0.5569 => 0.5717, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.56% (4.9449 => 5.0716, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.56% (0.4615 => 0.4733, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.53% (0.5860 => 0.6008, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.43% (5.0018 => 5.1235, std. dev.: 0.0082) MultiSource/Applications/spiff/spiff: 2.28% (0.7835 => 0.8014, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.20% (4.2646 => 4.3584, std. dev.: 0.0071) MultiSource/Applications/treecc/treecc: 2.15% (2.0273 => 2.0708, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.08% (2.0665 => 2.1095, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.04% (1.5415 => 1.5730, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.02% (8.1363 => 8.3010, std. dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 1.94% (9.4845 => 9.6686, std. dev.: 0.0060) MultiSource/Applications/d/make_dparser: 1.92% (3.3354 => 3.3996, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.88% (1.5603 => 1.5896, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.83% (0.8067 => 0.8215, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 1.77% (0.6456 => 0.6570, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (1.1861 => 1.2063, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.70% (3.8723 => 3.9380, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 1.64% (17.1811 => 17.4626, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.55% (1.3050 => 1.3252, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.45% (2.2024 => 2.2343, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.44% (1.4186 => 1.4390, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.40% (0.9765 => 0.9902, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7591 => 5.8307, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 1.24% (1.2842 => 1.3001, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.01% (2.2969 => 2.3200, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7509, std. dev.: 0.0033) MultiSource/Applications/lua/lua: 2.69% (26.0924 => 26.7946, std. dev.: 0.0294) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.06% (1.5086 => 1.5397, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.51% (9.1159 => 9.2534, std. dev.: 0.0150) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6886, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.13% (5.2763 => 3.1589, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.50% (5.3855 => 3.6893, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.19% (5.3526 => 3.6830, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.27% (2.9384 => 2.5486, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -12.48% (22.1758 => 19.4075, std. dev.: 0.0113) SingleSource/UnitTests/Vector/constpool: -4.91% (54.1659 => 51.5076, std. dev.: 0.0516) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.08% (3.8922 => 3.8111, std. dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.43% (1.2373 => 1.1082, std. dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.27% (19.9488 => 18.4991, std. dev.: 0.0678) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (8.1563 => 7.9110, std. dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.57% (32.5116 => 31.6763, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0850, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 12:37:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 14:37:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120704193757.99B4C2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1774?compare_to=1772&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1774, Order: 159718, Start Time: 2012-07-04 18:23:37, End Time: 2012-07-04 19:37:54 To: 1772, Order: 159715, Start Time: 2012-07-04 16:42:02, End Time: 2012-07-04 17:56:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (122 on baseline) Performance Improvements: 2 (33 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (735 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.66% (2.0985 => 2.0636, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -1.15% (1.2738 => 1.2592, std. dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.81% (2.0176 => 2.2963, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.68% (0.7061 => 0.7533, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 6.45% (0.5818 => 0.6193, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.09% (0.5748 => 0.6098, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.70% (0.7038 => 0.7439, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.49% (0.5265 => 0.5554, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.44% (0.2721 => 0.2869, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.25% (1.3693 => 1.4412, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.24% (0.2596 => 0.2732, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.19% (0.1986 => 0.2089, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 5.12% (0.4062 => 0.4270, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.11% (0.4328 => 0.4549, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.10% (3.9660 => 4.1681, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.86% (0.7710 => 0.8085, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.77% (0.6959 => 0.7291, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 4.57% (0.2781 => 0.2908, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.37% (0.3022 => 0.3154, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2782 => 0.2901, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 4.26% (0.2607 => 0.2718, std. dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 4.11% (13.8202 => 14.3885, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.08% (0.2966 => 0.3087, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.08% (1.9828 => 2.0636, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.07% (0.2655 => 0.2763, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.06% (0.2760 => 0.2872, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.06% (0.2761 => 0.2873, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.05% (0.3899 => 0.4057, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 4.04% (0.2726 => 0.2836, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.01% (0.2765 => 0.2876, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.99% (13.2842 => 13.8143, std. dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.98% (0.3489 => 0.3628, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 3.98% (0.2690 => 0.2797, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.94% (0.5577 => 0.5797, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 3.92% (0.2628 => 0.2731, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.89% (0.9199 => 0.9557, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 3.88% (0.2937 => 0.3051, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.86% (1.2193 => 1.2664, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 3.83% (0.3107 => 0.3226, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 3.75% (0.3149 => 0.3267, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 3.74% (16.6129 => 17.2334, std. dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.73% (0.3485 => 0.3615, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 3.69% (0.3578 => 0.3710, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.65% (0.3646 => 0.3779, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 3.58% (0.3663 => 0.3794, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 3.56% (0.3789 => 0.3924, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.54% (0.4016 => 0.4158, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.53% (0.3453 => 0.3575, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.50% (0.3914 => 0.4051, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: 3.50% (0.4003 => 0.4143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.43% (0.3756 => 0.3885, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.43% (1.4563 => 1.5062, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/09-vor/vor: 3.42% (0.2925 => 0.3025, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 3.40% (0.3940 => 0.4074, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 3.39% (0.3623 => 0.3746, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 3.38% (0.3192 => 0.3300, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.34% (0.3650 => 0.3772, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.32% (1.1364 => 1.1741, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (1.3245 => 1.3684, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 3.31% (0.3534 => 0.3651, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.30% (0.3246 => 0.3353, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.29% (1.0594 => 1.0943, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.26% (0.5637 => 0.5821, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 3.22% (1.1061 => 1.1417, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (3.8646 => 3.9880, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.4390 => 0.4529, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 3.15% (0.3868 => 0.3990, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.10% (1.3819 => 1.4248, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 3.09% (0.7506 => 0.7738, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.02% (0.7460 => 0.7685, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.00% (1.9270 => 1.9849, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.99% (0.4379 => 0.4510, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.99% (1.3813 => 1.4226, std. dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.90% (4.9865 => 5.1309, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8310 => 0.8535, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.68% (7.2180 => 7.4114, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.65% (3.6692 => 3.7666, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 2.48% (16.2614 => 16.6639, std. dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 2.44% (1.2292 => 1.2592, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.42% (14.8535 => 15.2123, std. dev.: 0.0144) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (6.5754 => 6.7323, std. dev.: 0.0056) MultiSource/Applications/siod/siod: 2.36% (2.1791 => 2.2305, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.07% (0.6135 => 0.6262, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.01% (4.3801 => 4.4681, std. dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 1.93% (1.2749 => 1.2995, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.93% (4.4433 => 4.5290, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.88% (3.1889 => 3.2489, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.82% (14.5298 => 14.7939, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.74% (0.8698 => 0.8849, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (1.1333 => 1.1528, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.6283 => 0.6384, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.27% (2.1007 => 2.1273, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 26.70% (1.8175 => 2.3028, std. dev.: 0.0302) SingleSource/Benchmarks/Misc/mandel-2: 8.65% (1.2998 => 1.4122, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1916, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7187, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9216, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6777, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4801, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.96% (4.1080 => 4.1884, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4559, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5089 => 1.5335, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.60% (3.6469 => 3.7052, std. dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9592, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2143, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.83% (22.5627 => 21.0207, std. dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.32% (0.8818 => 0.8613, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.27% (0.9108 => 0.8992, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.28% (1.2308 => 1.1043, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.62% (20.3410 => 18.5866, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5843, std. dev.: 0.0151) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4463, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5107, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2513, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.54% (3.0263 => 2.9797, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8437, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2201, std. dev.: 0.0024) MultiSource/Applications/lua/lua: -1.07% (26.5159 => 26.2332, std. dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2604, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 12:47:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 14:47:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120704194704.17F542A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1775?compare_to=1773&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1775, Order: 159718, Start Time: 2012-07-04 18:28:18, End Time: 2012-07-04 19:47:01 To: 1773, Order: 159715, Start Time: 2012-07-04 16:42:11, End Time: 2012-07-04 18:01:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (56 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (800 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.78% (3.7625 => 3.8294, std. dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.46% (10.3673 => 13.7325, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.17% (1.1194 => 1.2444, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 7.46% (0.3473 => 0.3732, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.16% (0.3561 => 0.3816, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.15% (0.3497 => 0.3747, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.14% (0.3543 => 0.3796, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.14% (0.3516 => 0.3767, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.12% (1.7609 => 1.8863, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.11% (0.3543 => 0.3795, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 6.98% (0.1432 => 0.1532, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 6.90% (0.3694 => 0.3949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.70% (0.3927 => 0.4190, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.66% (0.3886 => 0.4145, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.66% (0.3828 => 0.4083, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.47% (2.2022 => 2.3446, std. dev.: 0.0059) SingleSource/UnitTests/ObjC++/Hello: 4.57% (0.5925 => 0.6196, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.54% (0.6030 => 0.6304, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.28% (0.4879 => 0.5088, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.15% (0.3177 => 0.3309, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.89% (7.0540 => 7.3281, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference: 3.79% (0.7326 => 0.7604, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.34% (0.7433 => 0.7681, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 3.05% (0.3282 => 0.3382, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (10.4361 => 10.7106, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.60% (0.5569 => 0.5714, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.49% (0.4615 => 0.4730, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.45% (0.8172 => 0.8372, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.41% (14.3668 => 14.7131, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.41% (0.5860 => 0.6001, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.25% (5.0018 => 5.1144, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.11% (4.9449 => 5.0493, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 2.08% (0.7835 => 0.7998, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.00% (4.2646 => 4.3499, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.83% (8.1363 => 8.2852, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (9.4845 => 9.6437, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.67% (3.3354 => 3.3911, std. dev.: 0.0149) MultiSource/Applications/treecc/treecc: 1.63% (2.0273 => 2.0604, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.57% (1.1642 => 1.1825, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.53% (1.1861 => 1.2042, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.44% (0.8067 => 0.8183, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.41% (1.5415 => 1.5632, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.35% (3.8723 => 3.9247, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 1.32% (1.5603 => 1.5809, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.29% (17.1811 => 17.4031, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.29% (2.0665 => 2.0931, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 1.18% (5.7591 => 5.8272, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.08% (0.9765 => 0.9870, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7462, std. dev.: 0.0063) MultiSource/Applications/lua/lua: 2.78% (26.0924 => 26.8190, std. dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0003) MultiSource/Benchmarks/llubenchmark/llu: 1.36% (3.7781 => 3.8294, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6898, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2343, std. dev.: 0.0341) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1250, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.46% (0.8651 => 0.1690, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.16% (5.2763 => 3.1571, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.89% (5.3855 => 3.6679, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.56% (5.3526 => 3.6631, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.29% (2.9384 => 2.5480, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -12.94% (22.1758 => 19.3066, std. dev.: 0.0078) SingleSource/UnitTests/Vector/constpool: -4.84% (54.1659 => 51.5434, std. dev.: 0.0520) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.56% (3.8922 => 3.7926, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.28% (0.8101 => 0.7997, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.93% (1.2373 => 1.1021, std. dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.09% (19.9488 => 18.5339, std. dev.: 0.0784) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (8.1563 => 7.9248, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6932, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 13:20:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 15:20:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120704202024.9C3262A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/1776?compare_to=1771&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1776, Order: 159718, Start Time: 2012-07-04 17:37:20, End Time: 2012-07-04 20:20:22 To: 1771, Order: 159710, Start Time: 2012-07-04 14:27:16, End Time: 2012-07-04 17:10:15 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (37 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (856 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.21% (17.3621 => 17.1516, std. dev.: 0.0684) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 7.47% (0.3465 => 0.3724, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.46% (0.3460 => 0.3718, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.43% (0.3446 => 0.3702, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.32% (0.3469 => 0.3723, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.27% (0.3496 => 0.3750, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.21% (0.3442 => 0.3690, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.20% (0.3488 => 0.3739, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.96% (0.3650 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.89% (0.3643 => 0.3894, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.71% (0.3724 => 0.3974, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.48% (0.5826 => 0.6029, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 3.28% (0.5889 => 0.6082, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.15% (0.4029 => 0.4156, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.03% (0.4361 => 0.4493, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.93% (1.6211 => 1.6686, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.88% (0.5900 => 0.6070, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.78% (3.5627 => 3.6617, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 2.37% (4.2109 => 4.3108, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.35% (0.5026 => 0.5144, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.25% (0.9909 => 1.0132, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.21% (1.3152 => 1.3443, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 2.15% (0.7171 => 0.7325, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (2.0673 => 2.1113, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.10% (0.4994 => 0.5099, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.62% (4.4195 => 4.4913, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 1.58% (0.9697 => 0.9850, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 1.58% (1.0781 => 1.0951, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.52% (1.9694 => 1.9994, std. dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.52% (2.7292 => 2.7706, std. dev.: 0.0107) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.34% (1.9966 => 2.0234, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 1.29% (1.8794 => 1.9037, std. dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 1.26% (5.5417 => 5.6113, std. dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 1.16% (23.5202 => 23.7934, std. dev.: 0.0116) MultiSource/Benchmarks/mafft/pairlocalalign: 1.13% (2.1013 => 2.1250, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1.12% (4.6177 => 4.6696, std. dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: 1.09% (2.1653 => 2.1888, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.74% (0.2122 => 0.2265, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.58% (11.9555 => 11.6472, std. dev.: 0.0099) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 14:19:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 16:19:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120704211952.10D752A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1777?compare_to=1774&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1777, Order: 159721, Start Time: 2012-07-04 20:05:11, End Time: 2012-07-04 21:19:48 To: 1774, Order: 159718, Start Time: 2012-07-04 18:23:37, End Time: 2012-07-04 19:37:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (127 on baseline) Performance Improvements: 2 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (727 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.83% (0.0998 => 0.0840, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -1.72% (2.3028 => 2.2632, std. dev.: 0.0131) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.48% (2.0176 => 2.2896, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.81% (0.3130 => 0.3343, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.57% (0.5818 => 0.6200, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.28% (0.5748 => 0.6109, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.23% (0.7061 => 0.7501, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.84% (0.7710 => 0.8160, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.79% (0.1986 => 0.2101, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 5.73% (0.7038 => 0.7441, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 5.42% (1.3693 => 1.4435, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.39% (0.2596 => 0.2736, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 5.24% (0.4328 => 0.4555, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.22% (0.5265 => 0.5540, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.96% (3.9660 => 4.1629, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.86% (0.2945 => 0.3088, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 4.71% (0.2781 => 0.2912, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 4.70% (0.4062 => 0.4253, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: 4.60% (0.2937 => 0.3072, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.51% (0.2726 => 0.2849, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.50% (0.3022 => 0.3158, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.46% (0.2782 => 0.2906, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.42% (0.2966 => 0.3097, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 4.39% (0.3578 => 0.3735, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.38% (0.6959 => 0.7264, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.37% (0.2655 => 0.2771, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 4.35% (0.2760 => 0.2880, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.33% (0.2607 => 0.2720, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.33% (0.3580 => 0.3735, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2765 => 0.2884, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.24% (0.2690 => 0.2804, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 4.22% (0.2628 => 0.2739, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 4.20% (0.3623 => 0.3775, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.18% (0.3899 => 0.4062, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.17% (1.9828 => 2.0654, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions: 4.16% (0.3914 => 0.4077, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.16% (0.3489 => 0.3634, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.15% (0.4390 => 0.4572, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.14% (0.3646 => 0.3797, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.12% (0.4003 => 0.4168, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.11% (13.8202 => 14.3888, std. dev.: 0.0126) SingleSource/UnitTests/ObjC/exceptions-2: 4.11% (0.3601 => 0.3749, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.11% (0.3650 => 0.3800, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 4.10% (0.3663 => 0.3813, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.09% (0.2761 => 0.2874, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 4.06% (0.3789 => 0.3943, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.04% (0.3940 => 0.4099, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.00% (13.2842 => 13.8152, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.97% (0.2696 => 0.2803, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3107 => 0.3230, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.96% (0.9199 => 0.9563, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.94% (0.5577 => 0.5797, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sieve: 3.94% (0.3453 => 0.3589, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 3.90% (16.6129 => 17.2601, std. dev.: 0.0179) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.89% (0.3756 => 0.3902, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.87% (0.3149 => 0.3271, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.86% (0.4016 => 0.4171, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (0.3485 => 0.3618, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (1.2193 => 1.2647, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.67% (0.3192 => 0.3309, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.66% (0.2925 => 0.3032, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 3.61% (0.2988 => 0.3096, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.61% (0.3293 => 0.3412, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.59% (1.4563 => 1.5086, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 3.54% (0.3534 => 0.3659, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 3.46% (0.3868 => 0.4002, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.43% (1.1364 => 1.1754, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.37% (1.3245 => 1.3692, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.36% (0.3246 => 0.3355, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.34% (0.5637 => 0.5825, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.29% (1.9270 => 1.9904, std. dev.: 0.0086) MultiSource/Applications/spiff/spiff: 3.24% (0.7506 => 0.7749, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 3.23% (3.8646 => 3.9894, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.22% (0.4379 => 0.4520, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.15% (1.1061 => 1.1409, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.05% (1.0594 => 1.0917, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.02% (1.3819 => 1.4237, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.96% (7.2180 => 7.4316, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.95% (4.9865 => 5.1335, std. dev.: 0.0145) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.92% (1.3813 => 1.4216, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 2.68% (1.2292 => 1.2622, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.60% (0.7460 => 0.7654, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.47% (16.2614 => 16.6627, std. dev.: 0.0168) MultiSource/Applications/siod/siod: 2.46% (2.1791 => 2.2326, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.28% (3.6692 => 3.7528, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.27% (0.6135 => 0.6274, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 2.24% (14.8535 => 15.1856, std. dev.: 0.0247) MultiSource/Applications/JM/ldecod/ldecod: 2.22% (6.5754 => 6.7215, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.22% (4.3801 => 4.4773, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.14% (4.4433 => 4.5383, std. dev.: 0.0106) MultiSource/Applications/d/make_dparser: 2.00% (3.1889 => 3.2526, std. dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 1.94% (1.2749 => 1.2996, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.91% (1.1333 => 1.1550, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 1.88% (14.5298 => 14.8031, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.87% (0.8698 => 0.8861, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.59% (0.6283 => 0.6383, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.49% (2.1007 => 2.1321, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.52% (1.8175 => 2.2632, std. dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1890, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.90% (0.9996 => 1.0786, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 6.54% (1.2998 => 1.3848, std. dev.: 0.0201) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7299, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9200, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.39% (1.7688 => 1.8288, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4785, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.80% (1.9199 => 1.9737, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.68% (3.6469 => 3.7081, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (1.5089 => 1.5338, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.30% (1.9290 => 1.9540, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.81% (22.5627 => 21.0255, std. dev.: 0.0295) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.07% (0.3511 => 0.3368, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.96% (0.8818 => 0.8557, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.48% (0.9108 => 0.8973, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.75% (0.0997 => 0.0840, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2308 => 1.1041, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (20.3410 => 18.6418, std. dev.: 0.0548) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3152, std. dev.: 0.0241) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.61% (2.6470 => 2.5514, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5987, std. dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4475, std. dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/health/health: -2.27% (0.4533 => 0.4430, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5010, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2527, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1234, std. dev.: 0.0342) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8602, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -1.39% (3.0263 => 2.9843, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8445, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2507, std. dev.: 0.0059) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2234, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 14:33:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 16:33:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120704213302.4A7632A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1778?compare_to=1775&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1778, Order: 159721, Start Time: 2012-07-04 20:14:25, End Time: 2012-07-04 21:32:59 To: 1775, Order: 159718, Start Time: 2012-07-04 18:28:18, End Time: 2012-07-04 19:47:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (54 on baseline) Performance Improvements: 3 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 927 (801 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.08% (1.8863 => 1.9066, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.02% (1.3020 => 1.3153, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.76% (13.7325 => 13.4910, std. dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.64% (0.0998 => 0.0822, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.68% (56.6071 => 54.5226, std. dev.: 0.3295) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.13% (10.3673 => 13.4910, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.02% (1.1194 => 1.2540, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.27% (1.7609 => 1.9066, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.43% (0.3473 => 0.3731, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.14% (0.3543 => 0.3796, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 7.14% (0.3516 => 0.3767, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/synchronized: 7.13% (0.3561 => 0.3815, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.12% (0.3497 => 0.3746, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 7.11% (0.3543 => 0.3795, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.98% (0.3694 => 0.3952, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.74% (2.2022 => 2.3507, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 6.64% (0.3886 => 0.4144, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.61% (0.3828 => 0.4081, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 6.60% (0.3927 => 0.4186, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.4879 => 0.5105, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.32% (7.0540 => 7.3586, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.31% (0.3177 => 0.3314, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 3.50% (0.3282 => 0.3397, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.46% (0.5925 => 0.6130, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 3.40% (0.6030 => 0.6235, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.29% (0.4615 => 0.4767, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 3.15% (0.7433 => 0.7667, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (10.4361 => 10.7487, std. dev.: 0.0072) SingleSource/UnitTests/ObjC++/property-reference: 2.77% (0.7326 => 0.7529, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.44% (0.5569 => 0.5705, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.29% (0.8172 => 0.8359, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (4.9449 => 5.0565, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (14.3668 => 14.6881, std. dev.: 0.0157) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.18% (5.0018 => 5.1110, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (9.4845 => 9.6753, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 1.93% (0.7835 => 0.7986, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.91% (4.2646 => 4.3461, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.86% (0.5860 => 0.5969, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.85% (8.1363 => 8.2869, std. dev.: 0.0051) MultiSource/Applications/d/make_dparser: 1.66% (3.3354 => 3.3907, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.59% (2.0273 => 2.0596, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.41% (1.1861 => 1.2028, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 1.40% (1.1642 => 1.1805, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 1.40% (1.5603 => 1.5821, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.29% (17.1811 => 17.4021, std. dev.: 0.0146) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7591 => 5.8306, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.24% (1.3050 => 1.3212, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.21% (3.8723 => 3.9193, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.09% (0.9765 => 0.9871, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.00% (1.4186 => 1.4328, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9743, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7470, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 2.18% (26.0924 => 26.6613, std. dev.: 0.0391) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4462, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2395, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.29% (2.6546 => 2.6889, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.94% (5.2763 => 3.1692, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.38% (5.3855 => 3.6955, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.05% (5.3526 => 3.6907, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.22% (2.9384 => 2.5499, std. dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: -12.73% (22.1758 => 19.3523, std. dev.: 0.0096) SingleSource/UnitTests/Vector/constpool: -4.93% (54.1659 => 51.4974, std. dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.27% (3.8922 => 3.8037, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.49% (0.8101 => 0.7980, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.64% (0.0998 => 0.0822, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.28% (1.2373 => 1.1101, std. dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.77% (19.9488 => 18.5989, std. dev.: 0.0307) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (8.1563 => 7.9161, std. dev.: 0.0100) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6875, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0861, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.05% (1.3677 => 1.3533, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 16:01:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 18:01:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120704230117.45B212A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1779?compare_to=1777&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1779, Order: 159724, Start Time: 2012-07-04 21:47:08, End Time: 2012-07-04 23:01:15 To: 1777, Order: 159721, Start Time: 2012-07-04 20:05:11, End Time: 2012-07-04 21:19:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (126 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (729 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.61% (1.3848 => 1.4071, std. dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.83% (2.0176 => 2.2967, std. dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.45% (0.5818 => 0.6193, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.07% (0.5748 => 0.6097, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.03% (0.7061 => 0.7487, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 5.95% (0.7038 => 0.7457, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.51% (0.4062 => 0.4286, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.45% (0.4328 => 0.4564, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.40% (1.3693 => 1.4432, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.34% (0.1986 => 0.2092, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.24% (0.5265 => 0.5541, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 5.14% (0.2781 => 0.2924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (0.2945 => 0.3096, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.08% (0.2596 => 0.2728, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.01% (0.7710 => 0.8096, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.98% (3.9660 => 4.1636, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.2721 => 0.2855, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.73% (0.3022 => 0.3165, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.66% (0.6959 => 0.7283, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 4.64% (0.2760 => 0.2888, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.64% (0.2782 => 0.2911, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.56% (0.2607 => 0.2726, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.56% (0.2765 => 0.2891, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.53% (0.2628 => 0.2747, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.52% (0.2655 => 0.2775, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.48% (1.9828 => 2.0717, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 4.46% (0.2690 => 0.2810, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.46% (0.2937 => 0.3068, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.44% (0.3899 => 0.4072, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.40% (0.2726 => 0.2846, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.38% (0.2966 => 0.3096, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.33% (0.3580 => 0.3735, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.33% (0.3489 => 0.3640, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.27% (0.2761 => 0.2879, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.24% (0.4390 => 0.4576, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.21% (13.2842 => 13.8430, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.19% (0.2696 => 0.2809, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.18% (0.3107 => 0.3237, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.17% (13.8202 => 14.3970, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/sieve: 4.17% (0.3453 => 0.3597, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.08% (0.4016 => 0.4180, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.08% (0.9199 => 0.9574, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.07% (0.3485 => 0.3627, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.05% (0.3756 => 0.3908, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.03% (0.3149 => 0.3276, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.01% (0.3192 => 0.3320, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.97% (16.6129 => 17.2722, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/lists: 3.83% (0.3293 => 0.3419, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.82% (0.2988 => 0.3102, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.73% (0.2925 => 0.3034, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 3.65% (0.3534 => 0.3663, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.64% (1.2193 => 1.2637, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.64% (0.5577 => 0.5780, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 3.61% (0.3578 => 0.3707, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.57% (0.3868 => 0.4006, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 3.55% (0.4003 => 0.4145, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.52% (3.8646 => 4.0007, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: 3.47% (0.3914 => 0.4050, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.47% (1.9270 => 1.9939, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.39% (1.3245 => 1.3694, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.39% (0.5637 => 0.5828, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.39% (0.3663 => 0.3787, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 3.38% (0.3789 => 0.3917, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-4: 3.37% (0.3646 => 0.3769, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.37% (0.3650 => 0.3773, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (1.4563 => 1.5053, std. dev.: 0.0091) SingleSource/UnitTests/ObjC/exceptions-2: 3.36% (0.3601 => 0.3722, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.33% (0.3246 => 0.3354, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.33% (1.1061 => 1.1429, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 3.31% (0.3623 => 0.3743, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 3.30% (0.3940 => 0.4070, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.27% (1.0594 => 1.0940, std. dev.: 0.0079) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.21% (1.1364 => 1.1729, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.17% (0.7506 => 0.7744, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.09% (4.9865 => 5.1406, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.01% (0.4379 => 0.4511, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.79% (1.2292 => 1.2635, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.74% (7.2180 => 7.4157, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.63% (1.3813 => 1.4176, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (1.3819 => 1.4179, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.60% (2.1791 => 2.2357, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.52% (0.7460 => 0.7648, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.42% (3.6692 => 3.7581, std. dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: 2.30% (14.8535 => 15.1946, std. dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 2.28% (16.2614 => 16.6314, std. dev.: 0.0146) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (6.5754 => 6.7195, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.14% (0.6135 => 0.6266, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.02% (4.3801 => 4.4685, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.97% (0.8698 => 0.8869, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.93% (3.1889 => 3.2504, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.92% (4.4433 => 4.5287, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.84% (1.1333 => 1.1541, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 1.75% (14.5298 => 14.7844, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.57% (2.1007 => 2.1336, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.52% (1.2749 => 1.2943, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.17% (1.8175 => 2.2750, std. dev.: 0.0208) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1913, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: 8.26% (1.2998 => 1.4071, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7299, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-5: 3.89% (1.9144 => 1.9888, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9219, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8311, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4782, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1892, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4563, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5346, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.52% (3.6469 => 3.7025, std. dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9583, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5149, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.5627 => 21.0501, std. dev.: 0.0196) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.90% (0.3511 => 0.3374, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.8818 => 0.8581, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.44% (0.9108 => 0.8977, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.05% (0.0997 => 0.0847, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.66% (1.2308 => 1.1119, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.05% (20.3410 => 18.4994, std. dev.: 0.0620) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.28% (2.4152 => 2.2636, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std. dev.: 0.0108) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5501, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.44% (8.8259 => 8.6103, std. dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5058, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2546, std. dev.: 0.0040) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1108, std. dev.: 0.0275) MultiSource/Applications/spiff/spiff: -1.50% (3.0263 => 2.9809, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8448, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2525, std. dev.: 0.0033) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2303, std. dev.: 0.0125) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 16:18:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 18:18:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120704231850.068462A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1780?compare_to=1778&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1780, Order: 159724, Start Time: 2012-07-04 22:00:21, End Time: 2012-07-04 23:18:46 To: 1778, Order: 159721, Start Time: 2012-07-04 20:14:25, End Time: 2012-07-04 21:32:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (54 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (800 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.45% (13.4910 => 13.2956, std. dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.69% (79.9934 => 78.6395, std. dev.: 0.3941) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.25% (10.3673 => 13.2956, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.12% (1.1194 => 1.2551, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.14% (1.7609 => 1.9042, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.31% (0.3473 => 0.3727, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.26% (0.1432 => 0.1536, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.04% (2.2022 => 2.3573, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.01% (0.3497 => 0.3742, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.00% (0.3543 => 0.3791, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.00% (0.3543 => 0.3791, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.99% (0.3561 => 0.3810, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.97% (0.3516 => 0.3761, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 6.82% (0.3694 => 0.3946, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.62% (0.3927 => 0.4187, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/property: 6.56% (0.3886 => 0.4141, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.56% (0.3828 => 0.4079, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.37% (7.0540 => 7.3626, std. dev.: 0.0090) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.25% (0.3177 => 0.3312, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 3.44% (0.5925 => 0.6129, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.41% (0.8172 => 0.8451, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 3.34% (0.7433 => 0.7681, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.17% (0.7326 => 0.7558, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 3.15% (0.6030 => 0.6220, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 3.14% (0.3282 => 0.3385, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.91% (10.4361 => 10.7396, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.32% (0.5569 => 0.5698, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.20% (5.0018 => 5.1116, std. dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.19% (0.4615 => 0.4716, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.12% (4.9449 => 5.0495, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (14.3668 => 14.6626, std. dev.: 0.0259) MultiSource/Benchmarks/mafft/pairlocalalign: 1.87% (9.4845 => 9.6615, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: 1.84% (0.7835 => 0.7979, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5860 => 0.5966, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.73% (4.2646 => 4.3385, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.69% (8.1363 => 8.2738, std. dev.: 0.0047) MultiSource/Applications/treecc/treecc: 1.57% (2.0273 => 2.0591, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.55% (3.3354 => 3.3870, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.42% (1.1861 => 1.2030, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 1.40% (5.7591 => 5.8395, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.36% (17.1811 => 17.4154, std. dev.: 0.0292) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.27% (1.5415 => 1.5611, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.27% (3.8723 => 3.9213, std. dev.: 0.0053) MultiSource/Applications/Burg/burg: 1.22% (1.1642 => 1.1784, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.10% (1.3050 => 1.3194, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 1.08% (1.5603 => 1.5772, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7514, std. dev.: 0.0050) MultiSource/Applications/lua/lua: 2.25% (26.0924 => 26.6784, std. dev.: 0.0110) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5086 => 1.5348, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2411, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6877, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.91% (5.2763 => 3.1707, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.27% (5.3855 => 3.7016, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.06% (5.3526 => 3.6900, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.32% (2.9384 => 2.5471, std. dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: -12.79% (22.1758 => 19.3406, std. dev.: 0.0196) SingleSource/UnitTests/Vector/constpool: -5.09% (54.1659 => 51.4063, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.45% (3.8922 => 3.7967, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (0.8101 => 0.7977, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.09% (7.9617 => 7.8751, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.30% (1.2373 => 1.1098, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.90% (19.9488 => 18.5714, std. dev.: 0.0462) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.97% (8.1563 => 7.9144, std. dev.: 0.0115) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.59% (32.5116 => 31.6703, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0830, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 16:30:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 18:30:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120704233036.17D0A2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1781?compare_to=1776&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1781, Order: 159722, Start Time: 2012-07-04 20:47:30, End Time: 2012-07-04 23:30:33 To: 1776, Order: 159718, Start Time: 2012-07-04 17:37:20, End Time: 2012-07-04 20:20:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (37 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (855 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.28% (2.3974 => 2.4280, std. dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 8.85% (0.3446 => 0.3751, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.83% (0.3465 => 0.3771, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.73% (0.3460 => 0.3762, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3469 => 0.3770, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.60% (0.3442 => 0.3738, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.52% (0.3496 => 0.3794, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.46% (0.3488 => 0.3783, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.14% (0.3650 => 0.3947, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.13% (0.3643 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.98% (0.3724 => 0.4021, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.43% (0.5826 => 0.6084, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.13% (0.5889 => 0.6132, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.64% (0.5900 => 0.6115, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.44% (0.4361 => 0.4511, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.40% (1.6211 => 1.6762, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.26% (3.5627 => 3.6788, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 3.00% (0.7171 => 0.7386, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.90% (0.5026 => 0.5172, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.78% (0.4029 => 0.4141, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.71% (1.3152 => 1.3508, std. dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 2.61% (4.2109 => 4.3207, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.34% (0.4994 => 0.5111, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.31% (0.9909 => 1.0138, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.18% (2.0673 => 2.1123, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.12% (0.5000 => 0.5106, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.04% (0.9697 => 0.9895, std. dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.97% (2.7292 => 2.7831, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.91% (1.9694 => 2.0071, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 1.91% (23.5202 => 23.9695, std. dev.: 0.0084) MultiSource/Applications/d/make_dparser: 1.90% (1.0781 => 1.0986, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.74% (1.9966 => 2.0314, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.72% (4.4195 => 4.4955, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 1.46% (1.8794 => 1.9069, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 1.43% (2.1653 => 2.1962, std. dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 1.41% (4.6177 => 4.6828, std. dev.: 0.0114) MultiSource/Benchmarks/mafft/pairlocalalign: 1.35% (2.1013 => 2.1296, std. dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 1.23% (5.5417 => 5.6098, std. dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.60% (11.9555 => 11.6444, std. dev.: 0.0065) SingleSource/UnitTests/Vector/constpool: -1.95% (2.4764 => 2.4280, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 18:41:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 20:41:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120705014151.B02802A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1782?compare_to=1779&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1782, Order: 159728, Start Time: 2012-07-05 00:27:43, End Time: 2012-07-05 01:41:48 To: 1779, Order: 159724, Start Time: 2012-07-04 21:47:08, End Time: 2012-07-04 23:01:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (120 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (735 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.03% (3.7612 => 3.8376, std. dev.: 0.0206) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.18% (2.0176 => 2.2835, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.25% (0.7061 => 0.7502, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.5818 => 0.6168, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.63% (0.7038 => 0.7434, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.60% (0.5748 => 0.6070, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.34% (0.1986 => 0.2092, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 5.27% (1.3693 => 1.4414, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.24% (0.5265 => 0.5541, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4062 => 0.4274, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.15% (0.4328 => 0.4551, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.12% (0.2596 => 0.2729, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.90% (0.7710 => 0.8088, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.70% (0.3022 => 0.3164, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.69% (3.9660 => 4.1519, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 4.60% (0.2781 => 0.2909, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.57% (0.2782 => 0.2909, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.31% (0.2760 => 0.2879, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.28% (0.6959 => 0.7257, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2690 => 0.2805, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.26% (0.2655 => 0.2768, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.19% (0.2937 => 0.3060, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.16% (0.2765 => 0.2880, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.12% (1.9828 => 2.0644, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.11% (0.2966 => 0.3088, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.10% (0.3489 => 0.3632, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.05% (0.3899 => 0.4057, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 3.98% (0.3192 => 0.3319, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.95% (0.2761 => 0.2870, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.93% (0.2696 => 0.2802, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.91% (0.3149 => 0.3272, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.90% (0.4390 => 0.4561, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.89% (13.8202 => 14.3580, std. dev.: 0.0250) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.88% (0.3580 => 0.3719, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.83% (0.3107 => 0.3226, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.83% (13.2842 => 13.7927, std. dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.83% (0.9199 => 0.9551, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.82% (0.3453 => 0.3585, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (0.3485 => 0.3618, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.81% (0.4016 => 0.4169, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.81% (0.3650 => 0.3789, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 3.76% (16.6129 => 17.2375, std. dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.3756 => 0.3894, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.55% (0.2988 => 0.3094, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.51% (1.2193 => 1.2621, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 3.49% (0.3578 => 0.3703, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.48% (0.3534 => 0.3657, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 3.45% (0.3914 => 0.4049, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 3.43% (0.3789 => 0.3919, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.36% (0.3868 => 0.3998, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 3.35% (0.4003 => 0.4137, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.35% (0.3646 => 0.3768, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.33% (0.3663 => 0.3785, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.32% (0.5577 => 0.5762, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.30% (0.3246 => 0.3353, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.29% (1.4563 => 1.5042, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-2: 3.28% (0.3601 => 0.3719, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 3.26% (0.3623 => 0.3741, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 3.25% (0.3940 => 0.4068, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.24% (1.3245 => 1.3674, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.23% (0.5637 => 0.5819, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.10% (1.1061 => 1.1404, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/gs/gs: 3.05% (3.8646 => 3.9823, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.04% (1.1364 => 1.1709, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.02% (0.7506 => 0.7733, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.98% (1.9270 => 1.9844, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.90% (0.4379 => 0.4506, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.85% (1.3813 => 1.4206, std. dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 2.83% (1.0594 => 1.0894, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.75% (1.3819 => 1.4199, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.60% (7.2180 => 7.4057, std. dev.: 0.0132) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.57% (4.9865 => 5.1146, std. dev.: 0.0119) MultiSource/Applications/hexxagon/hexxagon: 2.49% (1.2292 => 1.2598, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8310 => 0.8513, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (0.7460 => 0.7637, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 2.31% (2.1791 => 2.2295, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.07% (3.6692 => 3.7452, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 2.07% (16.2614 => 16.5982, std. dev.: 0.0165) MultiSource/Applications/JM/lencod/lencod: 2.07% (14.8535 => 15.1609, std. dev.: 0.0126) MultiSource/Applications/JM/ldecod/ldecod: 2.00% (6.5754 => 6.7067, std. dev.: 0.0160) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.84% (4.3801 => 4.4608, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.76% (0.6135 => 0.6243, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.70% (0.8698 => 0.8846, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.69% (3.1889 => 3.2429, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.69% (4.4433 => 4.5182, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.59% (1.1333 => 1.1513, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.57% (14.5298 => 14.7577, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.27% (2.1007 => 2.1273, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 25.14% (1.8175 => 2.2744, std. dev.: 0.0513) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1910, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9996 => 1.0782, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6988, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 7.30% (1.2998 => 1.3947, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7300, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6778, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8314, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4798, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.95% (4.1080 => 4.1882, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.91% (1.4298 => 1.4571, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 1.71% (3.7731 => 3.8376, std. dev.: 0.0206) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.50% (3.6469 => 3.7016, std. dev.: 0.0080) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2145, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.82% (22.5627 => 21.0250, std. dev.: 0.0179) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.70% (0.3511 => 0.3381, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.57% (0.8818 => 0.8591, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.68% (0.9108 => 0.8955, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.64% (1.2308 => 1.1121, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.02% (20.3410 => 18.5072, std. dev.: 0.0519) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.8259 => 8.5756, std. dev.: 0.0145) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5067, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2581, std. dev.: 0.0021) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1331, std. dev.: 0.0215) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: -1.40% (3.0263 => 2.9838, std. dev.: 0.0080) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8450, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.30% (0.9692 => 0.9566, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2181, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2579, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 18:46:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 20:46:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120705014632.81DF02A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1783?compare_to=1780&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1783, Order: 159728, Start Time: 2012-07-05 00:27:50, End Time: 2012-07-05 01:46:29 To: 1780, Order: 159724, Start Time: 2012-07-04 22:00:21, End Time: 2012-07-04 23:18:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (57 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (797 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.28% (55.4537 => 56.7154, std. dev.: 0.0329) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.02% (78.6395 => 80.2264, std. dev.: 0.5847) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.23% (10.3673 => 13.1902, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.38% (1.1194 => 1.2580, std. dev.: 0.0169) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.06% (1.7609 => 1.9028, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.25% (2.2022 => 2.3619, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 7.11% (0.3473 => 0.3720, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.98% (0.3497 => 0.3741, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.97% (0.3543 => 0.3790, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.97% (0.1622 => 0.1735, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.83% (0.3543 => 0.3785, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.80% (0.3516 => 0.3755, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 6.80% (0.3561 => 0.3803, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.61% (0.3694 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.39% (0.3927 => 0.4178, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.30% (0.3828 => 0.4069, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.28% (0.3886 => 0.4130, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.76% (0.4879 => 0.5111, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.55% (7.0540 => 7.3750, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.31% (0.3177 => 0.3314, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 3.81% (0.3282 => 0.3407, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.38% (0.6030 => 0.6234, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.34% (0.7433 => 0.7681, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.22% (0.5925 => 0.6116, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.69% (10.4361 => 10.7171, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference: 2.63% (0.7326 => 0.7519, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.30% (0.8172 => 0.8360, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.30% (0.5569 => 0.5697, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.30% (0.4615 => 0.4721, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.23% (5.0018 => 5.1131, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (14.3668 => 14.6849, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.21% (4.9449 => 5.0540, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.98% (4.2646 => 4.3492, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.98% (0.5860 => 0.5976, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: 1.94% (0.7835 => 0.7987, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 1.93% (9.4845 => 9.6680, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.78% (8.1363 => 8.2814, std. dev.: 0.0047) MultiSource/Applications/d/make_dparser: 1.63% (3.3354 => 3.3898, std. dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 1.56% (5.7591 => 5.8492, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.51% (1.5415 => 1.5648, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.44% (2.0273 => 2.0565, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.43% (0.8067 => 0.8182, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.42% (17.1811 => 17.4245, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.40% (1.1861 => 1.2027, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.26% (1.3050 => 1.3214, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 1.23% (1.1642 => 1.1785, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.20% (3.8723 => 3.9187, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.16% (0.9765 => 0.9878, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.13% (1.5603 => 1.5779, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.09% (1.4186 => 1.4340, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.73% (1.1277 => 1.1923, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7461, std. dev.: 0.0051) MultiSource/Applications/lua/lua: 2.15% (26.0924 => 26.6534, std. dev.: 0.0229) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5357, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4463, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2376, std. dev.: 0.0339) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6879, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.84% (5.2763 => 3.1743, std. dev.: 0.0144) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.15% (5.3855 => 3.7079, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.84% (5.3526 => 3.7019, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.36% (2.9384 => 2.5459, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -12.65% (22.1758 => 19.3715, std. dev.: 0.0163) SingleSource/UnitTests/Vector/constpool: -5.07% (54.1659 => 51.4195, std. dev.: 0.0372) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.29% (3.8922 => 3.8031, std. dev.: 0.0145) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.37% (0.8101 => 0.7990, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.07% (7.9617 => 7.8769, std. dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.68% (1.2373 => 1.1175, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.98% (19.9488 => 18.5562, std. dev.: 0.0436) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.87% (8.1563 => 7.9219, std. dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6898, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0858, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 19:40:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 4 Jul 2012 21:40:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120705024054.6CFA52A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1784?compare_to=1781&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1784, Order: 159724, Start Time: 2012-07-04 23:57:33, End Time: 2012-07-05 02:40:50 To: 1781, Order: 159722, Start Time: 2012-07-04 20:47:30, End Time: 2012-07-04 23:30:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (32 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 948 (860 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 6.81% (0.2262 => 0.2416, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.33% (125.1152 => 131.7826, std. dev.: 0.1869) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.34% (54.0040 => 54.7272, std. dev.: 0.1256) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.03% (2.0785 => 2.1000, std. dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 8.04% (0.3446 => 0.3723, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.02% (0.3465 => 0.3743, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.87% (0.3469 => 0.3742, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.86% (0.3460 => 0.3732, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.75% (0.3496 => 0.3767, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.73% (0.3442 => 0.3708, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.65% (0.3488 => 0.3755, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.42% (0.3650 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.27% (0.3643 => 0.3908, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 7.14% (0.3724 => 0.3990, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 3.66% (0.5826 => 0.6039, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.40% (0.5889 => 0.6089, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.95% (0.5900 => 0.6074, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.87% (0.4361 => 0.4486, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.82% (1.6211 => 1.6668, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.46% (3.5627 => 3.6503, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.46% (1.3152 => 1.3475, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.29% (0.5026 => 0.5141, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 2.26% (4.2109 => 4.3062, std. dev.: 0.0082) SingleSource/UnitTests/ObjC++/property-reference: 2.23% (0.7171 => 0.7331, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.04% (0.4994 => 0.5096, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.78% (0.9909 => 1.0085, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.78% (2.0673 => 2.1040, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.68% (1.0781 => 1.0962, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.64% (0.9697 => 0.9856, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.53% (1.9694 => 1.9995, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.47% (23.5202 => 23.8662, std. dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 1.42% (1.8794 => 1.9061, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.35% (1.9966 => 2.0235, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.32% (2.7292 => 2.7653, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.20% (4.4195 => 4.4725, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 1.05% (2.1653 => 2.1881, std. dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.17% (2.4764 => 2.3980, std. dev.: 0.0162) MultiSource/Applications/kimwitu++/kc: -2.88% (11.9555 => 11.6111, std. dev.: 0.0119) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 4 22:50:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 00:50:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120705055056.8C4332A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1785?compare_to=1784&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1785, Order: 159728, Start Time: 2012-07-05 03:07:52, End Time: 2012-07-05 05:50:54 To: 1784, Order: 159724, Start Time: 2012-07-04 23:57:33, End Time: 2012-07-05 02:40:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (35 on baseline) Performance Improvements: 1 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (857 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.21% (131.7826 => 126.2370, std. dev.: 1.8781) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 7.84% (0.3446 => 0.3716, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.73% (0.3469 => 0.3737, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3465 => 0.3732, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.60% (0.3460 => 0.3723, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.49% (0.3496 => 0.3758, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.47% (0.3442 => 0.3699, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.43% (0.3488 => 0.3747, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.15% (0.3650 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.14% (0.3643 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.87% (0.3724 => 0.3980, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.72% (0.5826 => 0.6043, std. dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 3.45% (0.5889 => 0.6092, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.35% (0.4361 => 0.4507, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.00% (1.6211 => 1.6698, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.97% (0.5900 => 0.6075, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.83% (0.5026 => 0.5168, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.62% (3.5627 => 3.6562, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.43% (1.3152 => 1.3471, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 2.38% (0.9909 => 1.0145, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 2.35% (4.2109 => 4.3097, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 2.31% (0.7171 => 0.7337, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.16% (2.0673 => 2.1120, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.08% (0.4994 => 0.5098, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.84% (1.9694 => 2.0057, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 1.66% (23.5202 => 23.9096, std. dev.: 0.0077) MultiSource/Applications/hbd/hbd: 1.63% (0.9697 => 0.9855, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 1.62% (1.0781 => 1.0956, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.53% (2.7292 => 2.7709, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.41% (4.4195 => 4.4818, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 1.37% (1.8794 => 1.9051, std. dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: 1.32% (2.1653 => 2.1939, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.31% (1.9966 => 2.0227, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.21% (4.6177 => 4.6736, std. dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 1.13% (2.1013 => 2.1251, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 1.04% (5.5417 => 5.5996, std. dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.58% (11.9555 => 11.6467, std. dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -2.31% (2.4764 => 2.4193, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 01:08:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 03:08:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120705080850.B47512A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1786?compare_to=1782&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1786, Order: 159729, Start Time: 2012-07-05 06:51:45, End Time: 2012-07-05 08:08:44 To: 1782, Order: 159728, Start Time: 2012-07-05 00:27:43, End Time: 2012-07-05 01:41:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (109 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (745 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.15% (2.0176 => 2.2830, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 5.81% (0.5818 => 0.6156, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 5.70% (0.7038 => 0.7439, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 5.60% (0.5748 => 0.6070, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.29% (1.3693 => 1.4418, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.28% (0.7061 => 0.7434, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.24% (0.1986 => 0.2090, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.15% (0.4062 => 0.4271, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.11% (0.4328 => 0.4549, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.10% (0.7710 => 0.8103, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.07% (0.5265 => 0.5532, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.97% (0.2596 => 0.2725, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 4.72% (0.2945 => 0.3084, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.71% (0.2781 => 0.2912, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2721 => 0.2849, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.70% (3.9660 => 4.1523, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.36% (0.3899 => 0.4069, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.31% (0.2782 => 0.2902, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.30% (0.2607 => 0.2719, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.28% (0.2760 => 0.2878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2690 => 0.2805, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.23% (0.2765 => 0.2882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.18% (0.2655 => 0.2766, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.11% (1.9828 => 2.0643, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.08% (0.2966 => 0.3087, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.02% (0.2937 => 0.3055, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 4.00% (0.2726 => 0.2835, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2628 => 0.2733, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.99% (0.6959 => 0.7237, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 3.91% (0.2761 => 0.2869, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.87% (0.3489 => 0.3624, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.86% (0.2696 => 0.2800, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.80% (0.9199 => 0.9549, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.78% (0.4016 => 0.4168, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.76% (0.3453 => 0.3583, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.76% (16.6129 => 17.2375, std. dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/ary3: 3.75% (0.3149 => 0.3267, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.74% (13.2842 => 13.7807, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary: 3.70% (0.3107 => 0.3222, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.64% (0.3485 => 0.3612, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.62% (0.3756 => 0.3892, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 3.54% (0.3192 => 0.3305, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 3.52% (0.3578 => 0.3704, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.51% (0.2988 => 0.3093, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.45% (0.2925 => 0.3026, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 3.42% (0.4003 => 0.4140, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.41% (1.2193 => 1.2609, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.40% (0.3650 => 0.3774, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.39% (0.5577 => 0.5766, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.37% (0.3293 => 0.3404, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.35% (0.3914 => 0.4045, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.34% (0.3534 => 0.3652, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 3.30% (0.3663 => 0.3784, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 3.30% (0.3789 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.28% (0.3601 => 0.3719, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.27% (0.3246 => 0.3352, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.26% (0.5637 => 0.5821, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.24% (0.3646 => 0.3764, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.23% (0.3868 => 0.3993, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 3.20% (0.3623 => 0.3739, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 3.20% (0.3940 => 0.4066, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.16% (1.3245 => 1.3663, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.12% (0.4390 => 0.4527, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.12% (1.4563 => 1.5017, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 3.06% (3.8646 => 3.9827, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.97% (1.1364 => 1.1702, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.96% (1.3819 => 1.4228, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.91% (1.3813 => 1.4215, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.85% (0.4379 => 0.4504, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.0594 => 1.0896, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.62% (4.9865 => 5.1172, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.53% (7.2180 => 7.4006, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.47% (0.7460 => 0.7644, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 2.36% (0.8310 => 0.8506, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.08% (3.6692 => 3.7454, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 2.00% (16.2614 => 16.5870, std. dev.: 0.0970) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.73% (4.3801 => 4.4557, std. dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.63% (0.8698 => 0.8840, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.62% (4.4433 => 4.5153, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (1.1333 => 1.1509, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/fbench: 25.06% (1.8175 => 2.2730, std. dev.: 0.0446) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.24% (2.0200 => 2.1864, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 6.54% (1.2998 => 1.3848, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7305, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9198, std. dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6777, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8292, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5355, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.52% (3.6469 => 3.7022, std. dev.: 0.0081) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.82% (22.5627 => 21.0228, std. dev.: 0.1296) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.59% (0.3511 => 0.3385, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.86% (0.8818 => 0.8566, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.61% (0.9108 => 0.8961, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.45% (0.0997 => 0.0843, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.65% (1.2308 => 1.1120, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.28% (20.3410 => 18.4533, std. dev.: 0.1157) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5822, std. dev.: 0.0183) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4474, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5086, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2565, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: -1.55% (3.0263 => 2.9793, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8569, std. dev.: 0.0086) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1518, std. dev.: 0.0194) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8433, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: -1.33% (9.3358 => 9.2118, std. dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2505, std. dev.: 0.0052) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 01:13:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 03:13:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120705081324.553592A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1787?compare_to=1783&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1787, Order: 159729, Start Time: 2012-07-05 06:51:44, End Time: 2012-07-05 08:13:20 To: 1783, Order: 159728, Start Time: 2012-07-05 00:27:50, End Time: 2012-07-05 01:46:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (49 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (806 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.27% (10.3673 => 13.1940, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.40% (1.1194 => 1.2582, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.12% (1.7609 => 1.9039, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.48% (0.3543 => 0.3808, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.29% (2.2022 => 2.3627, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/trivial-interface: 7.17% (0.3473 => 0.3722, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.97% (0.1622 => 0.1735, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.86% (0.3543 => 0.3786, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.83% (0.3497 => 0.3736, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 6.80% (0.3561 => 0.3803, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.77% (0.3516 => 0.3754, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 6.61% (0.3694 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.43% (0.3828 => 0.4074, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.41% (0.3886 => 0.4135, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.34% (0.3927 => 0.4176, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.98% (0.4879 => 0.5122, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.75% (0.3177 => 0.3328, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.63% (7.0540 => 7.3807, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/oourafft: 3.69% (0.3282 => 0.3403, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.48% (0.7433 => 0.7692, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 3.44% (0.5925 => 0.6129, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 3.13% (0.6030 => 0.6219, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 2.91% (10.4361 => 10.7403, std. dev.: 0.0956) SingleSource/UnitTests/ObjC++/property-reference: 2.80% (0.7326 => 0.7531, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.67% (0.8172 => 0.8390, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.57% (4.9449 => 5.0718, std. dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.36% (0.4615 => 0.4724, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.24% (0.5860 => 0.5991, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (14.3668 => 14.6847, std. dev.: 0.0221) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.21% (5.0018 => 5.1122, std. dev.: 0.0138) MultiSource/Benchmarks/mafft/pairlocalalign: 2.00% (9.4845 => 9.6744, std. dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.85% (8.1363 => 8.2872, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.85% (4.2646 => 4.3435, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.69% (1.5415 => 1.5676, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.49% (1.1861 => 1.2038, std. dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 1.39% (17.1811 => 17.4196, std. dev.: 0.0078) MultiSource/Applications/lua/lua: 1.38% (3.8723 => 3.9257, std. dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.26% (1.3050 => 1.3214, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.18% (1.4186 => 1.4353, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.09% (2.2024 => 2.2265, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.05% (0.9765 => 0.9868, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7536, std. dev.: 0.0048) MultiSource/Applications/lua/lua: 2.18% (26.0924 => 26.6614, std. dev.: 0.0518) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.5086 => 1.5376, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6883, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.87% (5.2763 => 3.1725, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.06% (5.3855 => 3.7129, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.69% (5.3526 => 3.7101, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.38% (2.9384 => 2.5452, std. dev.: 0.0104) MultiSource/Applications/ClamAV/clamscan: -12.51% (22.1758 => 19.4010, std. dev.: 0.0395) SingleSource/UnitTests/Vector/constpool: -5.08% (54.1659 => 51.4126, std. dev.: 0.0418) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.35% (3.8922 => 3.8006, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.01% (7.9617 => 7.8815, std. dev.: 0.0147) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.23% (0.0998 => 0.0846, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.88% (1.2373 => 1.1027, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.82% (19.9488 => 18.5887, std. dev.: 0.0587) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.81% (8.1563 => 7.9273, std. dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6893, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0862, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 02:37:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 04:37:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120705093716.ED6402A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1788?compare_to=1785&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1788, Order: 159729, Start Time: 2012-07-05 06:51:28, End Time: 2012-07-05 09:37:12 To: 1785, Order: 159728, Start Time: 2012-07-05 03:07:52, End Time: 2012-07-05 05:50:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (39 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (854 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 26.02% (0.3801 => 0.4790, std. dev.: 0.0333) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.96% (2.0670 => 2.1076, std. dev.: 0.0109) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 26.32% (0.3792 => 0.4790, std. dev.: 0.0333) SingleSource/UnitTests/ObjC/exceptions-2: 7.81% (0.3446 => 0.3715, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.76% (0.3465 => 0.3734, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.69% (0.3460 => 0.3726, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.65% (0.3488 => 0.3755, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 7.61% (0.3469 => 0.3733, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.55% (0.3496 => 0.3760, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.50% (0.3442 => 0.3700, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.15% (0.3650 => 0.3911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.11% (0.3643 => 0.3902, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.90% (0.3724 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.42% (0.5826 => 0.6025, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.31% (0.5900 => 0.6095, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (0.5026 => 0.5190, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 3.12% (0.5889 => 0.6073, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.07% (0.4361 => 0.4495, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.92% (1.6211 => 1.6685, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 2.79% (0.7171 => 0.7371, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.78% (0.9909 => 1.0184, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.58% (0.4994 => 0.5123, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.51% (1.3152 => 1.3482, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.46% (3.5627 => 3.6505, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 2.44% (4.2109 => 4.3138, std. dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.18% (0.5000 => 0.5109, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 1.93% (1.0781 => 1.0989, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.89% (1.9694 => 2.0066, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.78% (0.9697 => 0.9870, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.71% (2.0673 => 2.1026, std. dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: 1.57% (23.5202 => 23.8885, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 1.54% (1.8794 => 1.9083, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.49% (1.9966 => 2.0264, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 1.40% (4.6177 => 4.6824, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.35% (2.7292 => 2.7661, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 1.35% (2.1013 => 2.1297, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.27% (4.4195 => 4.4758, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 1.23% (5.5417 => 5.6098, std. dev.: 0.0106) MultiSource/Applications/JM/ldecod/ldecod: 1.21% (2.1653 => 2.1915, std. dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 1.16% (1.5932 => 1.6117, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.08% (1.4269 => 1.4423, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.77% (11.9555 => 11.6247, std. dev.: 0.0082) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 03:10:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 05:10:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120705101039.7A23F2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1789?compare_to=1786&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1789, Order: 159732, Start Time: 2012-07-05 08:56:08, End Time: 2012-07-05 10:10:35 To: 1786, Order: 159729, Start Time: 2012-07-05 06:51:45, End Time: 2012-07-05 08:08:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (127 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (729 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.50% (54.5797 => 56.4910, std. dev.: 0.0457) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.01% (18.4533 => 18.6400, std. dev.: 0.0264) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.20% (2.0176 => 2.2840, std. dev.: 0.0108) SingleSource/Regression/C++/ofstream_ctor: 6.58% (0.2781 => 0.2964, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.1986 => 0.2113, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.25% (0.7061 => 0.7502, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 5.95% (0.5818 => 0.6164, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 5.92% (0.7038 => 0.7455, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 5.53% (0.5748 => 0.6066, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.53% (0.7710 => 0.8136, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 5.31% (1.3693 => 1.4420, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 5.22% (0.4328 => 0.4554, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.20% (0.5265 => 0.5539, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 5.10% (0.4062 => 0.4269, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.82% (0.2596 => 0.2721, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.72% (0.2945 => 0.3084, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.71% (3.9660 => 4.1528, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.51% (0.6959 => 0.7273, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2782 => 0.2907, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hello: 4.33% (0.2607 => 0.2720, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.30% (0.3022 => 0.3152, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 4.28% (0.2760 => 0.2878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.20% (0.2690 => 0.2803, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.20% (0.2765 => 0.2881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.19% (0.2628 => 0.2738, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: 4.18% (0.3107 => 0.3237, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.18% (1.9828 => 2.0657, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.18% (0.2655 => 0.2766, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.13% (0.3899 => 0.4060, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.11% (0.2966 => 0.3088, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.07% (0.2726 => 0.2837, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.01% (0.3489 => 0.3629, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.99% (0.4390 => 0.4565, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 3.98% (0.2937 => 0.3054, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.94% (0.3580 => 0.3721, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.88% (0.4016 => 0.4172, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 3.88% (0.2761 => 0.2868, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.87% (13.8202 => 14.3553, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.86% (0.2696 => 0.2800, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.84% (0.9199 => 0.9552, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.82% (0.3453 => 0.3585, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.79% (16.6129 => 17.2433, std. dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.79% (13.2842 => 13.7875, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.79% (0.3485 => 0.3617, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.78% (0.3149 => 0.3268, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.75% (0.3756 => 0.3897, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.61% (1.4563 => 1.5088, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: 3.58% (0.3578 => 0.3706, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.57% (0.3192 => 0.3306, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.53% (0.5577 => 0.5774, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 3.51% (0.2988 => 0.3093, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.51% (1.2193 => 1.2621, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/09-vor/vor: 3.45% (0.2925 => 0.3026, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.45% (0.3534 => 0.3656, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: 3.40% (0.3293 => 0.3405, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 3.37% (0.3914 => 0.4046, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.37% (0.5637 => 0.5827, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 3.35% (0.4003 => 0.4137, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 3.32% (0.3646 => 0.3767, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 3.30% (0.3663 => 0.3784, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (1.3245 => 1.3680, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.27% (0.3246 => 0.3352, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 3.25% (0.3601 => 0.3718, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.25% (0.3789 => 0.3912, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.21% (0.3868 => 0.3992, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.21% (0.3650 => 0.3767, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 3.20% (0.3623 => 0.3739, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.20% (0.7506 => 0.7746, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 3.17% (0.3940 => 0.4065, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.12% (1.9270 => 1.9871, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (3.8646 => 3.9842, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.09% (1.1364 => 1.1715, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.97% (1.3819 => 1.4229, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.95% (1.3813 => 1.4220, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.88% (1.1061 => 1.1380, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.88% (0.4379 => 0.4505, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.76% (1.0594 => 1.0886, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.60% (4.9865 => 5.1160, std. dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: 2.59% (1.2292 => 1.2610, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.57% (0.7460 => 0.7652, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.54% (7.2180 => 7.4010, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.8310 => 0.8510, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.38% (2.1791 => 2.2309, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.15% (3.6692 => 3.7480, std. dev.: 0.0125) MultiSource/Applications/JM/lencod/lencod: 2.02% (14.8535 => 15.1542, std. dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: 2.01% (16.2614 => 16.5883, std. dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (6.5754 => 6.7065, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.89% (4.3801 => 4.4628, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.81% (0.6135 => 0.6246, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.72% (3.1889 => 3.2437, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.71% (0.8698 => 0.8847, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 1.66% (14.5298 => 14.7713, std. dev.: 0.0091) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.66% (4.4433 => 4.5169, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.61% (1.1333 => 1.1516, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2932, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.17% (2.1007 => 2.1252, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.15% (1.8175 => 2.2746, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1906, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.15% (0.9996 => 1.0811, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: 7.81% (1.2998 => 1.4013, std. dev.: 0.0069) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.83% (0.2093 => 0.2194, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.06% (7.4271 => 7.7290, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9195, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6792, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8319, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9615, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1897, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (1.5089 => 1.5368, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.75% (1.4298 => 1.4548, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.56% (3.6469 => 3.7038, std. dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9585, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.21% (10.7476 => 10.8773, std. dev.: 0.0389) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.84% (22.5627 => 21.0199, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.53% (0.3511 => 0.3387, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.8818 => 0.8585, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.59% (0.9108 => 0.8963, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.64% (1.2308 => 1.1121, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (20.3410 => 18.6400, std. dev.: 0.0264) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.38% (1.3780 => 1.3176, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5989, std. dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4464, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5121, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1225, std. dev.: 0.0143) SingleSource/Benchmarks/Shootout/lists: -1.48% (6.3560 => 6.2622, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: -1.47% (3.0263 => 2.9817, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.43% (9.3358 => 9.2021, std. dev.: 0.0354) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8446, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.28% (0.9692 => 0.9568, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2589, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 03:15:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 05:15:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120705101520.CFEC12A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1790?compare_to=1787&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1790, Order: 159732, Start Time: 2012-07-05 08:56:19, End Time: 2012-07-05 10:15:18 To: 1787, Order: 159729, Start Time: 2012-07-05 06:51:44, End Time: 2012-07-05 08:13:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (57 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (797 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (54.6192 => 56.5429, std. dev.: 0.0865) SingleSource/Benchmarks/McGill/chomp: 1.30% (1.1027 => 1.1170, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.23% (10.3673 => 13.1901, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.37% (1.1194 => 1.2579, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.23% (1.7609 => 1.9059, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.24% (2.2022 => 2.3617, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 7.17% (0.3473 => 0.3722, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.06% (0.3543 => 0.3793, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.97% (0.1622 => 0.1735, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 6.92% (0.3497 => 0.3739, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.86% (0.3543 => 0.3786, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.83% (0.3516 => 0.3756, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.82% (0.3561 => 0.3804, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.63% (0.3694 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.37% (0.3828 => 0.4072, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.32% (0.3927 => 0.4175, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.30% (0.3886 => 0.4131, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.71% (7.0540 => 7.3859, std. dev.: 0.0124) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.41% (0.3177 => 0.3317, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 3.78% (0.3282 => 0.3406, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 3.42% (0.7433 => 0.7687, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 3.34% (0.5925 => 0.6123, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.19% (0.8172 => 0.8433, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 3.07% (0.6030 => 0.6215, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.76% (0.7326 => 0.7528, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 2.73% (10.4361 => 10.7205, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.48% (0.5569 => 0.5707, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.31% (5.0018 => 5.1175, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.31% (4.9449 => 5.0589, std. dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.30% (0.4615 => 0.4721, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.29% (0.5860 => 0.5994, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (14.3668 => 14.6876, std. dev.: 0.0259) MultiSource/Benchmarks/mafft/pairlocalalign: 2.12% (9.4845 => 9.6851, std. dev.: 0.0074) MultiSource/Applications/spiff/spiff: 1.94% (0.7835 => 0.7987, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.83% (8.1363 => 8.2849, std. dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (4.2646 => 4.3405, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.68% (1.5415 => 1.5674, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 1.62% (3.3354 => 3.3894, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7591 => 5.8506, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 1.51% (2.0273 => 2.0579, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.41% (1.1861 => 1.2028, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.37% (17.1811 => 17.4167, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.28% (1.3050 => 1.3217, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.25% (1.1642 => 1.1787, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 1.23% (1.5603 => 1.5795, std. dev.: 0.0058) MultiSource/Applications/lua/lua: 1.18% (3.8723 => 3.9180, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.10% (1.4186 => 1.4342, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.09% (0.9765 => 0.9871, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.09% (2.2024 => 2.2263, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7496, std. dev.: 0.0048) MultiSource/Applications/lua/lua: 2.29% (26.0924 => 26.6899, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.5086 => 1.5376, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2368, std. dev.: 0.0450) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6877, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1276, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.80% (5.2763 => 3.1761, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.15% (5.3855 => 3.7080, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.80% (5.3526 => 3.7039, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.34% (2.9384 => 2.5465, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: -12.52% (22.1758 => 19.3993, std. dev.: 0.0088) SingleSource/UnitTests/Vector/constpool: -5.07% (54.1659 => 51.4182, std. dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.37% (3.8922 => 3.8001, std. dev.: 0.0176) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.36% (0.8101 => 0.7991, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (7.9617 => 7.8797, std. dev.: 0.0191) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -9.72% (1.2373 => 1.1170, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.68% (19.9488 => 18.6162, std. dev.: 0.0224) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.78% (8.1563 => 7.9294, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6927, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0858, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 04:52:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 06:52:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120705115216.763C02A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1791?compare_to=1789&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1791, Order: 159741, Start Time: 2012-07-05 10:37:53, End Time: 2012-07-05 11:52:14 To: 1789, Order: 159732, Start Time: 2012-07-05 08:56:08, End Time: 2012-07-05 10:10:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (122 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (732 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.58% (2.0176 => 2.2916, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.88% (0.7061 => 0.7547, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.62% (0.5818 => 0.6203, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.45% (0.5748 => 0.6119, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.01% (0.7710 => 0.8173, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 5.87% (0.7038 => 0.7451, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.66% (0.5265 => 0.5563, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.50% (1.3693 => 1.4446, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.49% (0.1986 => 0.2095, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.26% (0.2721 => 0.2864, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.24% (0.2596 => 0.2732, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.20% (0.4328 => 0.4553, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.04% (3.9660 => 4.1657, std. dev.: 0.0095) SingleSource/Regression/C++/ofstream_ctor: 5.03% (0.2781 => 0.2921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.71% (0.6959 => 0.7287, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 4.70% (0.4062 => 0.4253, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 4.67% (0.2760 => 0.2889, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.67% (0.3022 => 0.3163, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.54% (0.3899 => 0.4076, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.53% (0.2782 => 0.2908, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.46% (0.2937 => 0.3068, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.44% (0.2726 => 0.2847, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.42% (0.2690 => 0.2809, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.41% (0.2765 => 0.2887, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.41% (0.2655 => 0.2772, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.30% (1.9828 => 2.0680, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.27% (0.3580 => 0.3733, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.3489 => 0.3638, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2628 => 0.2740, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.25% (0.2966 => 0.3092, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.20% (0.2761 => 0.2877, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.17% (13.8202 => 14.3970, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.17% (0.4390 => 0.4573, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.12% (0.9199 => 0.9578, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.04% (0.2696 => 0.2805, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.01% (13.2842 => 13.8171, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary3: 4.00% (0.3149 => 0.3275, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 4.00% (0.3578 => 0.3721, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3485 => 0.3623, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.93% (1.4563 => 1.5135, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3107 => 0.3229, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 3.92% (0.3623 => 0.3765, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.91% (0.3756 => 0.3903, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.89% (1.2193 => 1.2667, std. dev.: 0.0084) MultiSource/Applications/kimwitu++/kc: 3.88% (16.6129 => 17.2583, std. dev.: 0.0225) SingleSource/UnitTests/ObjC/exceptions: 3.88% (0.3914 => 0.4066, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.86% (0.4016 => 0.4171, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.82% (0.3192 => 0.3314, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 3.80% (0.4003 => 0.4155, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.80% (0.3293 => 0.3418, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.79% (0.3453 => 0.3584, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.75% (0.2988 => 0.3100, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 3.73% (0.3646 => 0.3782, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.72% (0.3789 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.72% (0.3601 => 0.3735, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.70% (0.3650 => 0.3785, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 3.69% (0.3663 => 0.3798, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 3.68% (0.3940 => 0.4085, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.68% (1.3245 => 1.3732, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.64% (1.3819 => 1.4322, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.60% (0.5577 => 0.5778, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.60% (1.3813 => 1.4310, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 3.57% (0.3868 => 0.4006, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.51% (0.3534 => 0.3658, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.48% (0.3246 => 0.3359, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.48% (0.5637 => 0.5833, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.46% (1.1364 => 1.1757, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.44% (1.1061 => 1.1441, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.40% (1.0594 => 1.0954, std. dev.: 0.0114) MultiSource/Applications/spiff/spiff: 3.32% (0.7506 => 0.7755, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.28% (1.9270 => 1.9903, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 3.26% (3.8646 => 3.9905, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.13% (0.4379 => 0.4516, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.94% (7.2180 => 7.4301, std. dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: 2.86% (1.2292 => 1.2643, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.85% (4.9865 => 5.1288, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.82% (0.7460 => 0.7670, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.50% (3.6692 => 3.7611, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 2.49% (16.2614 => 16.6669, std. dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: 2.44% (14.8535 => 15.2162, std. dev.: 0.0040) MultiSource/Applications/siod/siod: 2.43% (2.1791 => 2.2321, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (4.3801 => 4.4820, std. dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 2.32% (6.5754 => 6.7279, std. dev.: 0.0197) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.20% (0.6135 => 0.6270, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.09% (4.4433 => 4.5360, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 2.00% (1.2749 => 1.3004, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.97% (3.1889 => 3.2518, std. dev.: 0.0095) MultiSource/Applications/ClamAV/clamscan: 1.96% (14.5298 => 14.8140, std. dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.92% (0.8698 => 0.8865, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.89% (1.1333 => 1.1547, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (2.1007 => 2.1313, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 25.24% (1.8175 => 2.2763, std. dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1912, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: 8.09% (1.2998 => 1.4049, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7356, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9192, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6786, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8294, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4790, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.63% (3.6469 => 3.7064, std. dev.: 0.0077) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.87% (22.5627 => 21.0135, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.22% (0.3511 => 0.3398, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.36% (0.8818 => 0.8610, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.33% (0.9108 => 0.8987, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.45% (0.0997 => 0.0843, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.80% (1.2308 => 1.0979, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.55% (20.3410 => 18.6011, std. dev.: 0.0291) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.13% (1.3780 => 1.3211, std. dev.: 0.0071) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9064, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5883, std. dev.: 0.0171) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4477, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.03% (0.8342 => 0.8173, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5058, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2554, std. dev.: 0.0051) MultiSource/Applications/spiff/spiff: -1.53% (3.0263 => 2.9799, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1534, std. dev.: 0.0135) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8440, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8678, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2187, std. dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2577, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 05:01:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 07:01:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120705120128.B80C22A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1792?compare_to=1790&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1792, Order: 159741, Start Time: 2012-07-05 10:42:44, End Time: 2012-07-05 12:01:28 To: 1790, Order: 159732, Start Time: 2012-07-05 08:56:19, End Time: 2012-07-05 10:15:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (57 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (799 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.64% (13.1901 => 13.6698, std. dev.: 0.0163) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.85% (10.3673 => 13.6698, std. dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.07% (1.1194 => 1.2545, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.17% (1.7609 => 1.9048, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 8.10% (0.1432 => 0.1548, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.64% (0.1622 => 0.1746, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.42% (2.2022 => 2.3655, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/trivial-interface: 6.91% (0.3473 => 0.3713, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.72% (0.3543 => 0.3781, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 6.69% (0.3497 => 0.3731, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.66% (0.3516 => 0.3750, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.63% (0.3543 => 0.3778, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.57% (0.3561 => 0.3795, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.42% (0.3694 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.24% (0.3828 => 0.4067, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.23% (0.3886 => 0.4128, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.21% (0.3927 => 0.4171, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.88% (0.4879 => 0.5117, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.62% (7.0540 => 7.3797, std. dev.: 0.0107) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.34% (0.3177 => 0.3315, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 3.87% (0.3282 => 0.3409, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.61% (0.7433 => 0.7701, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.39% (10.4361 => 10.7894, std. dev.: 0.0071) SingleSource/UnitTests/ObjC++/property-reference-object: 3.30% (0.6030 => 0.6229, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.24% (0.5925 => 0.6117, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.17% (0.7326 => 0.7558, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.81% (0.8172 => 0.8402, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.63% (5.0018 => 5.1335, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.47% (0.4615 => 0.4729, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.46% (0.5569 => 0.5706, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.44% (14.3668 => 14.7178, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.36% (4.9449 => 5.0618, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 2.09% (0.7835 => 0.7999, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 2.03% (9.4845 => 9.6768, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.02% (4.2646 => 4.3507, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.01% (0.5860 => 0.5978, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.86% (8.1363 => 8.2874, std. dev.: 0.0068) MultiSource/Applications/d/make_dparser: 1.80% (3.3354 => 3.3954, std. dev.: 0.0051) MultiSource/Applications/treecc/treecc: 1.78% (2.0273 => 2.0633, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.64% (0.8067 => 0.8199, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 1.60% (1.1642 => 1.1828, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 1.57% (5.7591 => 5.8493, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (1.1861 => 1.2046, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.54% (1.5415 => 1.5653, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.51% (17.1811 => 17.4410, std. dev.: 0.0058) MultiSource/Applications/lua/lua: 1.47% (3.8723 => 3.9294, std. dev.: 0.0051) MultiSource/Applications/hbd/hbd: 1.47% (1.5603 => 1.5833, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.36% (1.3050 => 1.3227, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.26% (0.9765 => 0.9888, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.22% (2.2024 => 2.2293, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.21% (1.4186 => 1.4358, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7556, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 2.10% (26.0924 => 26.6397, std. dev.: 0.0186) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.03% (1.5086 => 1.5392, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.29% (2.6546 => 2.6888, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.93% (5.2763 => 3.1695, std. dev.: 0.0131) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.23% (5.3855 => 3.7036, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.93% (5.3526 => 3.6971, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.24% (2.9384 => 2.5495, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -12.61% (22.1758 => 19.3801, std. dev.: 0.0257) SingleSource/UnitTests/Vector/constpool: -4.80% (54.1659 => 51.5634, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.45% (3.8922 => 3.7968, std. dev.: 0.0159) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.73% (0.0998 => 0.0841, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.11% (1.2373 => 1.1122, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.76% (19.9488 => 18.6000, std. dev.: 0.0369) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.82% (8.1563 => 7.9259, std. dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6859, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0851, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 05:48:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 07:48:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120705124801.D44292A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1793?compare_to=1788&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1793, Order: 159736, Start Time: 2012-07-05 10:04:38, End Time: 2012-07-05 12:48:01 To: 1788, Order: 159729, Start Time: 2012-07-05 06:51:28, End Time: 2012-07-05 09:37:12 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (35 on baseline) Performance Improvements: 1 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (857 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 4.81% (0.2268 => 0.2377, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.67% (2.4666 => 2.4255, std. dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 8.04% (0.3446 => 0.3723, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.92% (0.3460 => 0.3734, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.91% (0.3465 => 0.3739, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.87% (0.3469 => 0.3742, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.76% (0.3442 => 0.3709, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.75% (0.3496 => 0.3767, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.71% (0.3488 => 0.3757, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.38% (0.3643 => 0.3912, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.37% (0.3650 => 0.3919, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.12% (0.3724 => 0.3989, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 3.31% (0.5826 => 0.6019, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.17% (0.5900 => 0.6087, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 2.97% (0.5889 => 0.6064, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.86% (1.6211 => 1.6674, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.71% (0.4361 => 0.4479, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.62% (3.5627 => 3.6560, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.42% (0.4994 => 0.5115, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.39% (1.3152 => 1.3466, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 2.36% (4.2109 => 4.3103, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.31% (2.0673 => 2.1151, std. dev.: 0.0120) MultiSource/Applications/hexxagon/hexxagon: 2.30% (0.9909 => 1.0137, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.27% (0.5026 => 0.5140, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 1.92% (0.7171 => 0.7309, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 1.81% (1.0781 => 1.0976, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.63% (0.9697 => 0.9855, std. dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 1.62% (23.5202 => 23.9016, std. dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.50% (1.9694 => 1.9989, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.44% (4.4195 => 4.4831, std. dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (2.7292 => 2.7680, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.36% (1.9966 => 2.0238, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 1.33% (1.8794 => 1.9044, std. dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 1.24% (4.6177 => 4.6751, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (2.1653 => 2.1897, std. dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 1.12% (5.5417 => 5.6040, std. dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 1.03% (2.1013 => 2.1230, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.66% (11.9555 => 11.6372, std. dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: -2.06% (2.4764 => 2.4255, std. dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 06:33:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 08:33:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120705133356.DDCEE2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1794?compare_to=1791&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1794, Order: 159745, Start Time: 2012-07-05 12:19:37, End Time: 2012-07-05 13:33:54 To: 1791, Order: 159741, Start Time: 2012-07-05 10:37:53, End Time: 2012-07-05 11:52:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (125 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (729 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.37% (78.5655 => 80.4238, std. dev.: 0.6313) SingleSource/Benchmarks/McGill/chomp: 1.38% (1.0979 => 1.1130, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.25% (2.0176 => 2.2849, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 6.02% (0.7061 => 0.7486, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 5.83% (0.7038 => 0.7448, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 5.81% (0.5818 => 0.6156, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.78% (0.7710 => 0.8156, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 5.45% (0.5748 => 0.6061, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.37% (1.3693 => 1.4428, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.29% (0.1986 => 0.2091, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.28% (0.5265 => 0.5543, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 5.24% (0.4062 => 0.4275, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 5.18% (0.4328 => 0.4552, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.15% (0.2721 => 0.2861, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.12% (0.2596 => 0.2729, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2945 => 0.3089, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.82% (3.9660 => 4.1573, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.47% (0.3022 => 0.3157, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 4.42% (0.2781 => 0.2904, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.38% (0.6959 => 0.7264, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.36% (0.3899 => 0.4069, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.31% (0.2782 => 0.2902, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2690 => 0.2805, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.3489 => 0.3638, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.26% (0.2607 => 0.2718, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.25% (0.2966 => 0.3092, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.22% (0.2655 => 0.2767, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.21% (1.9828 => 2.0662, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.16% (0.3580 => 0.3729, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 4.13% (0.2760 => 0.2874, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.07% (13.8202 => 14.3830, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/strcat: 4.07% (0.2726 => 0.2837, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.07% (0.2628 => 0.2735, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 4.05% (0.2937 => 0.3056, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.05% (0.2765 => 0.2877, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.05% (16.6129 => 17.2858, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 4.03% (0.3149 => 0.3276, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.02% (0.2761 => 0.2872, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.01% (0.9199 => 0.9568, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.95% (13.2842 => 13.8091, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.93% (0.2696 => 0.2802, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.89% (0.3107 => 0.3228, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.73% (0.3485 => 0.3615, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.73% (0.3192 => 0.3311, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.70% (0.3246 => 0.3366, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 3.69% (0.2925 => 0.3033, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 3.68% (0.3453 => 0.3580, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.64% (1.4563 => 1.5093, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.4016 => 0.4162, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.62% (1.2193 => 1.2634, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.59% (0.3756 => 0.3891, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.59% (0.5577 => 0.5777, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.55% (0.3293 => 0.3410, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.54% (0.7506 => 0.7772, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/lists1: 3.51% (0.3534 => 0.3658, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.48% (1.3245 => 1.3706, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 3.45% (0.2988 => 0.3091, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 3.40% (0.4003 => 0.4139, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.38% (0.3578 => 0.3699, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.35% (0.5637 => 0.5826, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: 3.35% (0.3914 => 0.4045, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 3.34% (0.3868 => 0.3997, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 3.33% (0.3601 => 0.3721, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.27% (3.8646 => 3.9910, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.26% (0.4390 => 0.4533, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.24% (1.9270 => 1.9894, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 3.17% (0.3940 => 0.4065, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 3.17% (0.3789 => 0.3909, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.17% (0.3663 => 0.3779, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.16% (1.1061 => 1.1411, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 3.15% (0.3646 => 0.3761, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.14% (1.1364 => 1.1721, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.07% (0.3650 => 0.3762, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.07% (1.3819 => 1.4243, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-3: 3.04% (0.3623 => 0.3733, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.00% (1.3813 => 1.4227, std. dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.99% (0.4379 => 0.4510, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.0594 => 1.0898, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.83% (0.7460 => 0.7671, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.74% (2.1791 => 2.2387, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.73% (7.2180 => 7.4149, std. dev.: 0.0102) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.69% (4.9865 => 5.1205, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8310 => 0.8525, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 2.57% (1.2292 => 1.2608, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.25% (3.6692 => 3.7519, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.24% (16.2614 => 16.6252, std. dev.: 0.0406) MultiSource/Applications/JM/lencod/lencod: 2.14% (14.8535 => 15.1718, std. dev.: 0.0156) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (6.5754 => 6.7131, std. dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.00% (0.6135 => 0.6258, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.95% (4.3801 => 4.4656, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.82% (1.1333 => 1.1539, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.75% (2.1007 => 2.1375, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.72% (4.4433 => 4.5197, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.70% (0.8698 => 0.8846, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 1.66% (3.1889 => 3.2417, std. dev.: 0.0079) MultiSource/Applications/ClamAV/clamscan: 1.63% (14.5298 => 14.7669, std. dev.: 0.0082) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (1.2749 => 1.2942, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.52% (1.8175 => 2.2632, std. dev.: 0.0513) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.57% (2.0200 => 2.1932, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 8.32% (1.2998 => 1.4079, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0058) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.83% (7.4271 => 7.7116, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9200, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6781, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4785, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1907, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4562, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.82% (3.6469 => 3.7132, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (1.9290 => 1.9560, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1936, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.80% (22.5627 => 21.0274, std. dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.99% (0.3511 => 0.3406, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.8818 => 0.8569, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.49% (0.9108 => 0.8972, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.57% (1.2308 => 1.1130, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.72% (20.3410 => 18.5666, std. dev.: 0.0457) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.58% (1.3780 => 1.3149, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.68% (2.6470 => 2.5497, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5973, std. dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -2.51% (2.5089 => 2.4460, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5001, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -1.55% (3.0263 => 2.9795, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2578, std. dev.: 0.0028) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1112, std. dev.: 0.0421) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4903, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8438, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8650, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2198, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2530, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 06:47:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 08:47:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120705134727.629FC2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1795?compare_to=1792&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1795, Order: 159745, Start Time: 2012-07-05 12:28:42, End Time: 2012-07-05 13:47:25 To: 1792, Order: 159741, Start Time: 2012-07-05 10:42:44, End Time: 2012-07-05 12:01:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (55 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (800 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.57% (13.6698 => 13.8847, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.53% (55.2180 => 56.0643, std. dev.: 0.1916) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.93% (10.3673 => 13.8847, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.84% (1.1194 => 1.2519, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 8.10% (0.1432 => 0.1548, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.91% (1.7609 => 1.9001, std. dev.: 0.0098) SingleSource/UnitTests/ObjC/trivial-interface: 7.49% (0.3473 => 0.3733, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.31% (0.3516 => 0.3773, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.29% (2.2022 => 2.3628, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: 7.23% (0.3497 => 0.3750, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.23% (0.3543 => 0.3799, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.20% (0.3543 => 0.3798, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.19% (0.3561 => 0.3817, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 7.15% (0.1622 => 0.1738, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.07% (0.3694 => 0.3955, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 6.82% (0.3886 => 0.4151, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.74% (0.3828 => 0.4086, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.70% (0.3927 => 0.4190, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.86% (7.0540 => 7.3966, std. dev.: 0.0179) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.4879 => 0.5103, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.22% (0.3177 => 0.3311, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.78% (0.5925 => 0.6149, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.63% (0.6030 => 0.6249, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.60% (0.7326 => 0.7590, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 3.50% (0.3282 => 0.3397, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 3.42% (0.7433 => 0.7687, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (0.8172 => 0.8401, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 2.73% (10.4361 => 10.7212, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.35% (0.5569 => 0.5700, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.28% (0.4615 => 0.4720, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.24% (5.0018 => 5.1139, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (14.3668 => 14.6831, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.18% (4.9449 => 5.0528, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.99% (9.4845 => 9.6730, std. dev.: 0.0081) MultiSource/Applications/spiff/spiff: 1.91% (0.7835 => 0.7985, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.77% (0.5860 => 0.5964, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.75% (4.2646 => 4.3393, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.74% (8.1363 => 8.2779, std. dev.: 0.0079) MultiSource/Applications/d/make_dparser: 1.57% (3.3354 => 3.3878, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 1.51% (2.0273 => 2.0580, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 1.37% (1.1642 => 1.1802, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.36% (3.8723 => 3.9248, std. dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: 1.33% (17.1811 => 17.4089, std. dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.29% (1.1861 => 1.2014, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.24% (0.8067 => 0.8167, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 1.22% (5.7591 => 5.8295, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 1.20% (1.5603 => 1.5790, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.14% (1.5415 => 1.5591, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.11% (1.3050 => 1.3195, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7498, std. dev.: 0.0051) MultiSource/Applications/lua/lua: 2.27% (26.0924 => 26.6852, std. dev.: 0.0317) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (1.5086 => 1.5382, std. dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/dry: 1.42% (2.4116 => 2.4459, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2393, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6880, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1250, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.97% (5.2763 => 3.1676, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.10% (5.3855 => 3.7105, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.85% (5.3526 => 3.7012, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.36% (2.9384 => 2.5459, std. dev.: 0.0085) MultiSource/Applications/ClamAV/clamscan: -12.72% (22.1758 => 19.3554, std. dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -5.17% (54.1659 => 51.3655, std. dev.: 0.0593) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.49% (3.8922 => 3.7951, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.43% (0.8101 => 0.7985, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.73% (0.0998 => 0.0841, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1166, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.39% (19.9488 => 18.6732, std. dev.: 0.0156) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.75% (8.1563 => 7.9319, std. dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6892, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0849, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 08:15:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 10:15:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120705151522.63EAA2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1796?compare_to=1794&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1796, Order: 159746, Start Time: 2012-07-05 14:01:10, End Time: 2012-07-05 15:15:21 To: 1794, Order: 159745, Start Time: 2012-07-05 12:19:37, End Time: 2012-07-05 13:33:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (126 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (729 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.34% (7.9421 => 8.0484, std. dev.: 0.0145) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.78% (2.0176 => 2.2957, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.49% (0.7061 => 0.7519, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.15% (0.5818 => 0.6176, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 5.83% (0.7038 => 0.7448, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/Hello: 5.74% (0.5748 => 0.6078, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.59% (0.2596 => 0.2741, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.55% (0.4328 => 0.4568, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.47% (1.3693 => 1.4442, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.46% (0.7710 => 0.8131, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.44% (0.1986 => 0.2094, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.34% (0.5265 => 0.5546, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.2721 => 0.2865, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (0.2945 => 0.3097, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.07% (3.9660 => 4.1670, std. dev.: 0.0062) SingleSource/Regression/C++/ofstream_ctor: 4.89% (0.2781 => 0.2917, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 4.78% (0.4062 => 0.4256, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.73% (0.3022 => 0.3165, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.67% (0.2782 => 0.2912, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.65% (0.2966 => 0.3104, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hello: 4.64% (0.2607 => 0.2728, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.60% (0.2655 => 0.2777, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.47% (0.3489 => 0.3645, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.47% (0.3580 => 0.3740, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.46% (0.2690 => 0.2810, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.46% (0.2937 => 0.3068, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 4.45% (0.2761 => 0.2884, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.45% (0.2628 => 0.2745, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.43% (1.9828 => 2.0706, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 4.38% (0.2760 => 0.2881, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.38% (0.6959 => 0.7264, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.34% (0.2765 => 0.2885, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2726 => 0.2844, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.28% (0.3899 => 0.4066, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 4.25% (0.3107 => 0.3239, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.25% (0.3485 => 0.3633, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 4.22% (0.3149 => 0.3282, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.21% (13.8202 => 14.4027, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.16% (13.2842 => 13.8362, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.08% (0.2696 => 0.2806, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.07% (0.5577 => 0.5804, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.04% (0.9199 => 0.9571, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 3.95% (0.3192 => 0.3318, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.88% (0.3453 => 0.3587, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.86% (1.2193 => 1.2664, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.3756 => 0.3901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 3.83% (0.3578 => 0.3715, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.81% (0.4016 => 0.4169, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 3.80% (16.6129 => 17.2444, std. dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/lists1: 3.79% (0.3534 => 0.3668, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (0.3293 => 0.3416, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 3.72% (0.4003 => 0.4152, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.71% (0.2988 => 0.3099, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 3.65% (0.3646 => 0.3779, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 3.64% (0.3789 => 0.3927, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.2925 => 0.3031, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.58% (0.3914 => 0.4054, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 3.55% (0.3601 => 0.3729, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.55% (1.3819 => 1.4310, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.54% (0.3246 => 0.3361, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.53% (1.4563 => 1.5077, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.53% (1.3245 => 1.3712, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 3.52% (0.3868 => 0.4004, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.51% (1.1364 => 1.1763, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.50% (1.3813 => 1.4297, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.50% (0.7506 => 0.7769, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 3.49% (0.3663 => 0.3791, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.4390 => 0.4543, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.45% (0.3650 => 0.3776, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 3.45% (0.3623 => 0.3748, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 3.43% (0.3940 => 0.4075, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.34% (0.5637 => 0.5825, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (3.8646 => 3.9902, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 3.22% (1.9270 => 1.9890, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 3.19% (1.1061 => 1.1414, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.15% (0.4379 => 0.4517, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.0594 => 1.0922, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.86% (7.2180 => 7.4244, std. dev.: 0.0105) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.2292 => 1.2642, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.85% (4.9865 => 5.1284, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.84% (0.7460 => 0.7672, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8310 => 0.8535, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.62% (2.1791 => 2.2361, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 2.46% (6.5754 => 6.7370, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.44% (3.6692 => 3.7586, std. dev.: 0.0068) MultiSource/Applications/JM/lencod/lencod: 2.37% (14.8535 => 15.2050, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.34% (16.2614 => 16.6415, std. dev.: 0.0212) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.14% (0.6135 => 0.6266, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.08% (4.3801 => 4.4712, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.99% (4.4433 => 4.5318, std. dev.: 0.0101) MultiSource/Applications/d/make_dparser: 1.93% (3.1889 => 3.2505, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.91% (1.1333 => 1.1549, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.8698 => 0.8863, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.89% (2.1007 => 2.1405, std. dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: 1.89% (14.5298 => 14.8041, std. dev.: 0.0120) MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.2749 => 1.2969, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.64% (0.6283 => 0.6386, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 26.80% (1.8175 => 2.3046, std. dev.: 0.0330) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1908, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: 8.12% (1.2998 => 1.4054, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9996 => 1.0772, std. dev.: 0.0071) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.20% (7.4271 => 7.7391, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6786, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1920, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.65% (3.6469 => 3.7069, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.59% (1.5089 => 1.5329, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (1.9290 => 1.9563, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.86% (22.5627 => 21.0142, std. dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.62% (0.3511 => 0.3384, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.57% (0.8818 => 0.8591, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.26% (0.9108 => 0.8993, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.75% (0.0997 => 0.0840, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.59% (1.2308 => 1.1128, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.85% (20.3410 => 18.5413, std. dev.: 0.0991) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.46% (1.3780 => 1.3165, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5947, std. dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.01% (6.6320 => 6.4989, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2509, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8580, std. dev.: 0.0195) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9827, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1552, std. dev.: 0.0268) MultiSource/Benchmarks/mafft/pairlocalalign: -1.33% (28.2225 => 27.8460, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2563, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 08:33:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 10:33:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120705153322.5D2B72A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1797?compare_to=1795&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1797, Order: 159746, Start Time: 2012-07-05 14:14:43, End Time: 2012-07-05 15:33:21 To: 1795, Order: 159745, Start Time: 2012-07-05 12:28:42, End Time: 2012-07-05 13:47:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (57 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (798 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.06% (7.9594 => 8.0440, std. dev.: 0.0141) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.67% (10.3673 => 13.8576, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.66% (1.1194 => 1.2499, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.18% (1.7609 => 1.9050, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 8.03% (0.1432 => 0.1547, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.31% (0.3473 => 0.3727, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 7.27% (0.1622 => 0.1740, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.10% (0.3561 => 0.3814, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.03% (0.3543 => 0.3792, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 7.01% (0.3497 => 0.3742, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.00% (0.3543 => 0.3791, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.98% (2.2022 => 2.3560, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 6.97% (0.3516 => 0.3761, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.88% (0.3694 => 0.3948, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.53% (0.3828 => 0.4078, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.48% (0.3886 => 0.4138, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 6.47% (0.3927 => 0.4181, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.69% (0.3817 => 0.4034, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.4879 => 0.5119, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.73% (7.0540 => 7.3876, std. dev.: 0.0159) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.34% (0.3177 => 0.3315, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.63% (0.5925 => 0.6140, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.50% (0.6030 => 0.6241, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.44% (0.7433 => 0.7689, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/oourafft: 3.44% (0.3282 => 0.3395, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.83% (0.7326 => 0.7533, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (10.4361 => 10.7274, std. dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.47% (0.4615 => 0.4729, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.37% (0.5569 => 0.5701, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.26% (0.8172 => 0.8357, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.17% (5.0018 => 5.1103, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.13% (4.9449 => 5.0504, std. dev.: 0.0087) MultiSource/Applications/spiff/spiff: 2.08% (0.7835 => 0.7998, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.07% (14.3668 => 14.6649, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 2.00% (9.4845 => 9.6745, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.96% (0.5860 => 0.5975, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (4.2646 => 4.3397, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.71% (8.1363 => 8.2752, std. dev.: 0.0079) MultiSource/Applications/treecc/treecc: 1.70% (2.0273 => 2.0618, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 1.56% (3.3354 => 3.3875, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.48% (1.1861 => 1.2037, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.43% (1.1642 => 1.1808, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.32% (3.8723 => 3.9236, std. dev.: 0.0118) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.31% (1.5415 => 1.5617, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.30% (0.8067 => 0.8172, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.23% (1.3050 => 1.3211, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.23% (1.5603 => 1.5795, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 1.22% (5.7591 => 5.8294, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.14% (17.1811 => 17.3764, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.01% (1.4186 => 1.4329, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7480, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 2.13% (26.0924 => 26.6487, std. dev.: 0.0209) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (1.5086 => 1.5362, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.60% (9.1159 => 9.2620, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6898, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.01% (5.2763 => 3.1653, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.31% (5.3855 => 3.6993, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.96% (5.3526 => 3.6955, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.44% (2.9384 => 2.5434, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -12.77% (22.1758 => 19.3430, std. dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -4.98% (54.1659 => 51.4661, std. dev.: 0.0490) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.35% (3.8922 => 3.8007, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.43% (0.8101 => 0.7985, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.20% (1.2373 => 1.1111, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.58% (19.9488 => 18.6368, std. dev.: 0.0457) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (8.1563 => 7.9201, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6830, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0826, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 08:58:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 10:58:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120705155837.25EDC2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1798?compare_to=1793&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1798, Order: 159745, Start Time: 2012-07-05 13:15:19, End Time: 2012-07-05 15:58:36 To: 1793, Order: 159736, Start Time: 2012-07-05 10:04:38, End Time: 2012-07-05 12:48:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (37 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (855 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 7.63% (0.3446 => 0.3709, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.62% (0.3465 => 0.3729, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3460 => 0.3721, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.47% (0.3469 => 0.3728, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.38% (0.3496 => 0.3754, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.38% (0.3442 => 0.3696, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.28% (0.3488 => 0.3742, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 7.16% (0.3643 => 0.3904, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.07% (0.3650 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.98% (0.3724 => 0.3984, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.54% (0.5826 => 0.6032, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.18% (0.5889 => 0.6076, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.05% (1.6211 => 1.6706, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.04% (0.4994 => 0.5146, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 3.03% (0.4029 => 0.4151, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (0.4361 => 0.4489, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.78% (3.5627 => 3.6617, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.71% (1.3152 => 1.3508, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.61% (0.5026 => 0.5157, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.58% (0.5900 => 0.6052, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 2.46% (4.2109 => 4.3143, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.32% (0.5000 => 0.5116, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 2.12% (0.7171 => 0.7323, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.94% (0.9909 => 1.0101, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.90% (2.0673 => 2.1066, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.88% (23.5202 => 23.9625, std. dev.: 0.0142) MultiSource/Applications/d/make_dparser: 1.87% (1.0781 => 1.0983, std. dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.75% (2.7292 => 2.7770, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.74% (1.9694 => 2.0036, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.66% (4.4195 => 4.4928, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.62% (1.9966 => 2.0289, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 1.60% (1.8794 => 1.9094, std. dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 1.39% (4.6177 => 4.6820, std. dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 1.33% (2.1653 => 2.1942, std. dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 1.23% (5.5417 => 5.6097, std. dev.: 0.0098) MultiSource/Applications/hbd/hbd: 1.09% (0.9697 => 0.9803, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 1.04% (1.4269 => 1.4417, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.49% (11.9555 => 11.6577, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.03% (2.4764 => 2.4262, std. dev.: 0.0170) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 09:57:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 11:57:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120705165701.7373F2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1799?compare_to=1796&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1799, Order: 159747, Start Time: 2012-07-05 15:42:36, End Time: 2012-07-05 16:56:59 To: 1796, Order: 159746, Start Time: 2012-07-05 14:01:10, End Time: 2012-07-05 15:15:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (126 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (728 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.17% (79.8523 => 80.7892, std. dev.: 0.2028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.80% (2.0176 => 2.2960, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.01% (0.7061 => 0.7556, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.75% (0.5818 => 0.6211, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.54% (0.5748 => 0.6124, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.83% (1.3693 => 1.4491, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.74% (0.7038 => 0.7442, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.68% (0.4328 => 0.4574, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.49% (0.1986 => 0.2095, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.2945 => 0.3104, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.32% (0.4062 => 0.4278, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.30% (0.5265 => 0.5544, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.24% (0.2596 => 0.2732, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.23% (0.7710 => 0.8113, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.18% (0.2721 => 0.2862, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 5.11% (0.2781 => 0.2923, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.03% (0.2782 => 0.2922, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 5.03% (0.2726 => 0.2863, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.00% (0.3022 => 0.3173, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.93% (3.9660 => 4.1616, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wc: 4.83% (0.2937 => 0.3079, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.79% (0.2966 => 0.3108, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.78% (0.2655 => 0.2782, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 4.76% (0.2690 => 0.2818, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.72% (0.2628 => 0.2752, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 4.71% (0.2760 => 0.2890, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.70% (1.9828 => 2.0759, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 4.68% (0.2607 => 0.2729, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.67% (0.2765 => 0.2894, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.60% (0.6959 => 0.7279, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.59% (0.3489 => 0.3649, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.58% (0.3580 => 0.3744, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.57% (0.3899 => 0.4077, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 4.56% (0.2761 => 0.2887, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 4.51% (0.3107 => 0.3247, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (0.3149 => 0.3288, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.38% (0.2696 => 0.2814, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.36% (0.4016 => 0.4191, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.25% (0.3485 => 0.3633, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.22% (0.9199 => 0.9587, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sieve: 4.14% (0.3453 => 0.3596, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (0.3756 => 0.3909, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 4.03% (13.8202 => 14.3770, std. dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.99% (13.2842 => 13.8142, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/lists1: 3.96% (0.3534 => 0.3674, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 3.95% (0.3192 => 0.3318, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2988 => 0.3104, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 3.87% (0.4003 => 0.4158, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.83% (0.3914 => 0.4064, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 3.82% (16.6129 => 17.2471, std. dev.: 0.0090) SingleSource/UnitTests/ObjC/trivial-interface: 3.80% (0.3578 => 0.3714, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.78% (1.2193 => 1.2654, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.77% (0.3868 => 0.4014, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.77% (0.3293 => 0.3417, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.76% (0.4390 => 0.4555, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.70% (0.3246 => 0.3366, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.69% (0.3789 => 0.3929, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.68% (0.5577 => 0.5782, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 3.67% (0.3601 => 0.3733, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 3.64% (0.3623 => 0.3755, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 3.62% (0.3646 => 0.3778, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 3.58% (0.3663 => 0.3794, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.56% (0.3650 => 0.3780, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.2925 => 0.3028, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 3.48% (0.3940 => 0.4077, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.47% (1.4563 => 1.5069, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.44% (1.1364 => 1.1755, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.44% (1.3245 => 1.3700, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.42% (0.5637 => 0.5830, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.39% (1.1061 => 1.1436, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.28% (0.7506 => 0.7752, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.24% (1.0594 => 1.0937, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 3.21% (1.9270 => 1.9889, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 3.20% (3.8646 => 3.9884, std. dev.: 0.0078) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.11% (1.3813 => 1.4243, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.06% (1.3819 => 1.4242, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.95% (1.2292 => 1.2654, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.92% (0.4379 => 0.4507, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.89% (4.9865 => 5.1304, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.77% (7.2180 => 7.4182, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 2.74% (0.8310 => 0.8538, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3755 => 0.3855, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.61% (2.1791 => 2.2359, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.53% (0.7460 => 0.7649, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.36% (3.6692 => 3.7557, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.34% (14.8535 => 15.2008, std. dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 2.30% (6.5754 => 6.7269, std. dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 2.29% (16.2614 => 16.6344, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.95% (4.3801 => 4.4657, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.95% (4.4433 => 4.5300, std. dev.: 0.0067) MultiSource/Applications/d/make_dparser: 1.93% (3.1889 => 3.2505, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.93% (0.8698 => 0.8866, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.86% (1.1333 => 1.1544, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.78% (14.5298 => 14.7887, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 1.76% (1.2749 => 1.2973, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.63% (2.1007 => 2.1349, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.09% (1.8175 => 2.2736, std. dev.: 0.0229) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.30% (2.0200 => 2.1876, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0067) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.14% (1.2998 => 1.3796, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.22% (7.4271 => 7.7406, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9218, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6779, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5089 => 1.5332, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.51% (3.6469 => 3.7021, std. dev.: 0.0055) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5123, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.71% (22.5627 => 21.0492, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.76% (0.3511 => 0.3379, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.52% (0.8818 => 0.8596, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.33% (0.9108 => 0.8987, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.85% (0.0997 => 0.0839, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.54% (1.2308 => 1.1011, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.18% (20.3410 => 18.4746, std. dev.: 0.1270) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3155, std. dev.: 0.0070) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.8259 => 8.5785, std. dev.: 0.0091) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4996, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2564, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: -1.54% (3.0263 => 2.9797, std. dev.: 0.0018) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1182, std. dev.: 0.0246) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.48% (0.9692 => 0.9549, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8433, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2129, std. dev.: 0.0177) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2507, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 10:19:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 12:19:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120705171915.65EED2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1800?compare_to=1797&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1800, Order: 159747, Start Time: 2012-07-05 16:00:35, End Time: 2012-07-05 17:19:14 To: 1797, Order: 159746, Start Time: 2012-07-05 14:14:43, End Time: 2012-07-05 15:33:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (57 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (798 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.42% (54.7311 => 56.6052, std. dev.: 0.1041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -5.64% (1.1924 => 1.1251, std. dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.37% (10.3673 => 13.8272, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.67% (1.1194 => 1.2500, std. dev.: 0.0164) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.57% (1.7609 => 1.8942, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.23% (0.3473 => 0.3724, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.97% (0.1622 => 0.1735, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 6.95% (0.3497 => 0.3740, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.94% (0.3543 => 0.3789, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.92% (0.3543 => 0.3788, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.91% (0.3561 => 0.3807, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.88% (0.3516 => 0.3758, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.82% (0.3694 => 0.3946, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.64% (2.2022 => 2.3485, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.50% (0.3828 => 0.4077, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.47% (0.3927 => 0.4181, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.46% (0.3886 => 0.4137, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.65% (0.4879 => 0.5106, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.60% (7.0540 => 7.3787, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.41% (0.3177 => 0.3317, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 3.82% (0.7326 => 0.7606, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 3.65% (0.5925 => 0.6141, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.58% (0.6030 => 0.6246, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.55% (0.7433 => 0.7697, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 3.26% (0.3282 => 0.3389, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (10.4361 => 10.7606, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.23% (0.5569 => 0.5693, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.20% (5.0018 => 5.1116, std. dev.: 0.0086) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.17% (0.8172 => 0.8349, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.15% (4.9449 => 5.0510, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.09% (14.3668 => 14.6666, std. dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (9.4845 => 9.6811, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 1.94% (0.7835 => 0.7987, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.91% (0.5860 => 0.5972, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.80% (4.2646 => 4.3414, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.77% (2.0273 => 2.0631, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.59% (8.1363 => 8.2657, std. dev.: 0.0092) MultiSource/Applications/d/make_dparser: 1.55% (3.3354 => 3.3870, std. dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.52% (1.1861 => 1.2041, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.39% (1.5859 => 1.6080, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 1.37% (1.1642 => 1.1802, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 1.33% (3.8723 => 3.9238, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.28% (1.5415 => 1.5612, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.27% (17.1811 => 17.3987, std. dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.26% (0.8067 => 0.8169, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 1.23% (5.7591 => 5.8298, std. dev.: 0.0153) MultiSource/Applications/hbd/hbd: 1.22% (1.5603 => 1.5793, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.17% (1.3050 => 1.3203, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.15% (2.2024 => 2.2278, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.04% (1.4186 => 1.4334, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.02% (0.9765 => 0.9865, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7505, std. dev.: 0.0048) MultiSource/Applications/lua/lua: 2.18% (26.0924 => 26.6613, std. dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.62% (1.3045 => 1.3256, std. dev.: 0.0036) MultiSource/Applications/minisat/minisat: 1.58% (9.1159 => 9.2599, std. dev.: 0.0293) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4463, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6880, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.46% (0.8651 => 0.1690, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.84% (5.2763 => 3.1742, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.53% (5.3855 => 3.6874, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.18% (5.3526 => 3.6836, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.16% (2.9384 => 2.5517, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -12.74% (22.1758 => 19.3506, std. dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -4.82% (54.1659 => 51.5553, std. dev.: 0.0795) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.35% (3.8922 => 3.8006, std. dev.: 0.0176) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.27% (0.8101 => 0.7998, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.18% (1.2373 => 1.1114, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.20% (19.9488 => 18.5131, std. dev.: 0.0811) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9209, std. dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6918, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0840, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 11:38:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 13:38:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120705183826.7A40C2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1801?compare_to=1799&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1801, Order: 159753, Start Time: 2012-07-05 17:24:12, End Time: 2012-07-05 18:38:24 To: 1799, Order: 159747, Start Time: 2012-07-05 15:42:36, End Time: 2012-07-05 16:56:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (125 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (729 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.77% (55.0269 => 56.5510, std. dev.: 0.0531) SingleSource/Benchmarks/Misc/mandel-2: 1.32% (1.3796 => 1.3978, std. dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 1.04% (1.1011 => 1.1125, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.83% (2.0176 => 2.2966, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 6.71% (0.7061 => 0.7535, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.70% (0.5818 => 0.6208, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.51% (0.5748 => 0.6122, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.93% (1.3693 => 1.4505, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 5.59% (0.4328 => 0.4570, std. dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 5.50% (0.7038 => 0.7425, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 5.26% (0.2945 => 0.3100, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.17% (0.5265 => 0.5537, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.15% (0.2721 => 0.2861, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.14% (0.1986 => 0.2088, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.11% (0.2781 => 0.2923, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.08% (0.7710 => 0.8102, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.05% (0.2596 => 0.2727, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.00% (0.2782 => 0.2921, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.96% (0.3022 => 0.3172, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.90% (3.9660 => 4.1605, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/hash: 4.90% (0.4062 => 0.4261, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2607 => 0.2733, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.79% (0.2966 => 0.3108, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.69% (1.9828 => 2.0758, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 4.66% (0.2726 => 0.2853, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.63% (0.2655 => 0.2778, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.57% (0.2690 => 0.2813, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.57% (0.2760 => 0.2886, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.56% (0.2937 => 0.3071, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.56% (0.2696 => 0.2819, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.52% (0.2765 => 0.2890, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.50% (0.3489 => 0.3646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.49% (0.2628 => 0.2746, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.45% (0.2761 => 0.2884, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.41% (0.6959 => 0.7266, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.35% (0.3107 => 0.3242, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.33% (0.3580 => 0.3735, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 4.26% (0.3149 => 0.3283, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.23% (0.3899 => 0.4064, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 4.08% (0.3453 => 0.3594, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.07% (0.3534 => 0.3678, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.07% (0.3485 => 0.3627, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.07% (0.9199 => 0.9573, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.02% (13.8202 => 14.3761, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.02% (13.2842 => 13.8185, std. dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/matrix: 3.92% (0.2988 => 0.3105, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.89% (0.3756 => 0.3902, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 3.88% (0.3192 => 0.3316, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.86% (0.4016 => 0.4171, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 3.83% (0.3578 => 0.3715, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.80% (0.3293 => 0.3418, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 3.77% (0.4003 => 0.4154, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.71% (0.5577 => 0.5784, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 3.69% (0.3789 => 0.3929, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.68% (16.6129 => 17.2239, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.67% (1.2193 => 1.2640, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 3.65% (0.3914 => 0.4057, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 3.65% (0.3646 => 0.3779, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.58% (0.4390 => 0.4547, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: 3.58% (0.3663 => 0.3794, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 3.56% (0.3623 => 0.3752, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.55% (0.3601 => 0.3729, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.51% (0.3246 => 0.3360, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.51% (0.3650 => 0.3778, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.49% (0.3868 => 0.4003, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.47% (1.1061 => 1.1445, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.45% (1.4563 => 1.5066, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 3.45% (0.3940 => 0.4076, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.44% (1.1364 => 1.1755, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 3.42% (0.2925 => 0.3025, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.41% (1.3813 => 1.4284, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.33% (1.3245 => 1.3686, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.32% (0.5637 => 0.5824, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.21% (1.0594 => 1.0934, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.16% (1.9270 => 1.9878, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.12% (1.3819 => 1.4250, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.08% (0.7506 => 0.7737, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 3.06% (3.8646 => 3.9830, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.95% (0.4379 => 0.4508, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.89% (1.2292 => 1.2647, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.82% (7.2180 => 7.4213, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.69% (4.9865 => 5.1208, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.55% (0.7460 => 0.7650, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.47% (2.1791 => 2.2330, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 2.45% (6.5754 => 6.7364, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.40% (3.6692 => 3.7571, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 2.34% (14.8535 => 15.2015, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 2.21% (16.2614 => 16.6213, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.00% (0.6135 => 0.6258, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.95% (4.3801 => 4.4656, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.89% (0.8698 => 0.8862, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.88% (4.4433 => 4.5270, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.84% (1.1333 => 1.1541, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.80% (3.1889 => 3.2463, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 1.79% (14.5298 => 14.7902, std. dev.: 0.0250) MultiSource/Applications/SIBsim4/SIBsim4: 1.66% (1.2749 => 1.2961, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (2.1007 => 2.1324, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.89% (1.8175 => 2.3063, std. dev.: 0.0345) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1916, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 7.54% (1.2998 => 1.3978, std. dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7324, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6781, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4790, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1895, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.91% (3.6469 => 3.7166, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.10% (1.9290 => 1.9503, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.91% (22.5627 => 21.0040, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.79% (0.3511 => 0.3378, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.53% (0.8818 => 0.8595, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.32% (0.9108 => 0.8988, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.61% (1.2308 => 1.1125, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.48% (20.3410 => 18.6169, std. dev.: 0.0527) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3118, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5875, std. dev.: 0.0107) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5043, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2565, std. dev.: 0.0023) MultiSource/Applications/lua/lua: -1.54% (26.5159 => 26.1087, std. dev.: 0.0246) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.48% (2.5254 => 2.4881, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -1.45% (3.0263 => 2.9824, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8439, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.29% (0.9692 => 0.9567, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8679, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2547, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8472, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 12:05:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 14:05:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120705190528.3C27B2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1802?compare_to=1800&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1802, Order: 159753, Start Time: 2012-07-05 17:46:38, End Time: 2012-07-05 19:05:27 To: 1800, Order: 159747, Start Time: 2012-07-05 16:00:35, End Time: 2012-07-05 17:19:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (56 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (799 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.04% (3.8322 => 3.7540, std. dev.: 0.0242) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.46% (10.3673 => 13.8364, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.86% (1.1194 => 1.2522, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.25% (1.7609 => 1.9062, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.95% (0.1622 => 0.1751, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.00% (0.3473 => 0.3716, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.92% (2.2022 => 2.3547, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 6.75% (0.3543 => 0.3782, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.72% (0.3497 => 0.3732, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.71% (0.3516 => 0.3752, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.71% (0.3561 => 0.3800, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.69% (0.3543 => 0.3780, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 6.50% (0.3694 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.27% (0.3828 => 0.4068, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.21% (0.3927 => 0.4171, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.18% (0.3886 => 0.4126, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.4879 => 0.5123, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.78% (7.0540 => 7.3912, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.44% (0.3177 => 0.3318, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 3.63% (0.6030 => 0.6249, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.61% (0.5925 => 0.6139, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.61% (0.7433 => 0.7701, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.47% (0.7326 => 0.7580, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 3.38% (0.3282 => 0.3393, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.22% (10.4361 => 10.7720, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.48% (0.5569 => 0.5707, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.25% (0.4615 => 0.4719, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.21% (4.9449 => 5.0540, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.19% (5.0018 => 5.1114, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (14.3668 => 14.6798, std. dev.: 0.0124) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (9.4845 => 9.6804, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.06% (0.8172 => 0.8340, std. dev.: 0.0054) MultiSource/Applications/spiff/spiff: 1.97% (0.7835 => 0.7989, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.92% (4.2646 => 4.3463, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.84% (0.5860 => 0.5968, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.74% (2.0273 => 2.0625, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.67% (8.1363 => 8.2720, std. dev.: 0.0066) MultiSource/Applications/d/make_dparser: 1.62% (3.3354 => 3.3895, std. dev.: 0.0092) MultiSource/Applications/lua/lua: 1.48% (3.8723 => 3.9295, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.42% (1.1861 => 1.2030, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.42% (17.1811 => 17.4255, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.40% (0.8067 => 0.8180, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 1.39% (1.1642 => 1.1804, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.38% (1.5415 => 1.5628, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.30% (2.2024 => 2.2310, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 1.29% (1.5603 => 1.5805, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 1.28% (5.7591 => 5.8330, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.24% (1.3050 => 1.3212, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.08% (1.4186 => 1.4339, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7592, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 2.22% (26.0924 => 26.6715, std. dev.: 0.0195) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (1.5086 => 1.5381, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4460, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2366, std. dev.: 0.0247) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6896, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.95% (5.2763 => 3.1685, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.23% (5.3855 => 3.7036, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.88% (5.3526 => 3.6997, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.42% (2.9384 => 2.5441, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -12.74% (22.1758 => 19.3501, std. dev.: 0.0106) SingleSource/UnitTests/Vector/constpool: -4.89% (54.1659 => 51.5191, std. dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.19% (3.8922 => 3.8068, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (0.8101 => 0.7977, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.54% (1.2373 => 1.1069, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.43% (19.9488 => 18.4663, std. dev.: 0.0917) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9184, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6939, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0851, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 12:08:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 14:08:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120705190857.6F4792A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1803?compare_to=1798&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1803, Order: 159752, Start Time: 2012-07-05 16:25:44, End Time: 2012-07-05 19:08:56 To: 1798, Order: 159745, Start Time: 2012-07-05 13:15:19, End Time: 2012-07-05 15:58:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (35 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (857 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 7.72% (0.3460 => 0.3727, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-2: 7.69% (0.3446 => 0.3711, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.65% (0.3465 => 0.3730, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.60% (0.3488 => 0.3753, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 7.55% (0.3469 => 0.3731, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.47% (0.3442 => 0.3699, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.38% (0.3496 => 0.3754, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.15% (0.3650 => 0.3911, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.03% (0.3643 => 0.3899, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.87% (0.3724 => 0.3980, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.90% (0.5826 => 0.6053, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.68% (0.5889 => 0.6106, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.03% (0.4361 => 0.4493, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.02% (1.6211 => 1.6701, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.90% (0.4029 => 0.4146, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.81% (0.5026 => 0.5167, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.77% (3.5627 => 3.6614, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.64% (0.4994 => 0.5126, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.59% (1.3152 => 1.3492, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 2.54% (0.7171 => 0.7353, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.49% (0.5900 => 0.6047, std. dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: 2.41% (4.2109 => 4.3124, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 2.07% (0.9909 => 1.0114, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.97% (2.0673 => 2.1080, std. dev.: 0.0080) MultiSource/Applications/d/make_dparser: 1.84% (1.0781 => 1.0979, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.80% (0.9697 => 0.9872, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.70% (4.4195 => 4.4946, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.58% (2.7292 => 2.7724, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.58% (1.9694 => 2.0005, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.47% (1.9966 => 2.0260, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (2.1013 => 2.1311, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.37% (4.6177 => 4.6811, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 1.36% (2.1653 => 2.1948, std. dev.: 0.0081) MultiSource/Benchmarks/MallocBench/gs/gs: 1.28% (1.8794 => 1.9035, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 1.23% (23.5202 => 23.8091, std. dev.: 0.0150) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.81% (11.9555 => 11.6192, std. dev.: 0.0071) SingleSource/UnitTests/Vector/constpool: -2.56% (2.4764 => 2.4129, std. dev.: 0.0230) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 13:19:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 15:19:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120705201950.D4C592A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1804?compare_to=1801&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1804, Order: 159760, Start Time: 2012-07-05 19:05:45, End Time: 2012-07-05 20:19:49 To: 1801, Order: 159753, Start Time: 2012-07-05 17:24:12, End Time: 2012-07-05 18:38:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (125 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (729 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.45% (2.0176 => 2.3091, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.79% (0.5818 => 0.6213, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.64% (0.7061 => 0.7530, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.61% (0.5748 => 0.6128, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 5.96% (1.3693 => 1.4509, std. dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: 5.66% (0.7038 => 0.7436, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.52% (0.4328 => 0.4567, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.34% (0.1986 => 0.2092, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.22% (0.5265 => 0.5540, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.18% (0.2781 => 0.2925, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.15% (0.2721 => 0.2861, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.14% (3.9660 => 4.1700, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.12% (0.2596 => 0.2729, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.10% (0.4062 => 0.4269, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.05% (0.7710 => 0.8099, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.89% (0.2782 => 0.2918, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.79% (0.2966 => 0.3108, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.78% (1.9828 => 2.0776, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 4.78% (0.2761 => 0.2893, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.76% (0.2607 => 0.2731, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.71% (0.2760 => 0.2890, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.70% (0.2726 => 0.2854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.68% (0.2690 => 0.2816, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.66% (0.2937 => 0.3074, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.64% (0.2628 => 0.2750, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.63% (0.2655 => 0.2778, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.61% (0.3489 => 0.3650, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.56% (0.2765 => 0.2891, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.3899 => 0.4073, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.44% (0.3107 => 0.3245, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.44% (0.6959 => 0.7268, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (0.3149 => 0.3288, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.38% (0.2696 => 0.2814, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.33% (0.3580 => 0.3735, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.25% (0.3485 => 0.3633, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.21% (0.9199 => 0.9586, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.10% (0.3192 => 0.3323, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.10% (0.3534 => 0.3679, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.04% (0.3293 => 0.3426, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.00% (13.8202 => 14.3727, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.99% (0.5637 => 0.5862, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.97% (13.2842 => 13.8118, std. dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/sieve: 3.97% (0.3453 => 0.3590, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3756 => 0.3905, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.86% (0.4016 => 0.4171, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.85% (0.4390 => 0.4559, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 3.85% (0.2988 => 0.3103, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.83% (0.3578 => 0.3715, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.82% (16.6129 => 17.2479, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.82% (1.2193 => 1.2659, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 3.77% (0.4003 => 0.4154, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.71% (0.5577 => 0.5784, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.65% (0.3914 => 0.4057, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 3.64% (0.3789 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 3.62% (0.3646 => 0.3778, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 3.61% (0.3601 => 0.3731, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 3.56% (0.3623 => 0.3752, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 3.55% (0.3663 => 0.3793, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.54% (0.3868 => 0.4005, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.54% (1.1364 => 1.1766, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.53% (0.3650 => 0.3779, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 3.50% (0.3940 => 0.4078, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.2925 => 0.3027, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.48% (0.3246 => 0.3359, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.45% (0.7506 => 0.7765, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.43% (1.4563 => 1.5063, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.41% (1.3245 => 1.3697, std. dev.: 0.0110) MultiSource/Applications/treecc/treecc: 3.26% (1.9270 => 1.9898, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 3.24% (3.8646 => 3.9897, std. dev.: 0.0091) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.24% (1.3813 => 1.4260, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.20% (1.0594 => 1.0933, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.20% (0.4379 => 0.4519, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.18% (1.3819 => 1.4259, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 3.10% (1.1061 => 1.1404, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.99% (1.2292 => 1.2659, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.84% (7.2180 => 7.4227, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8310 => 0.8543, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.71% (4.9865 => 5.1214, std. dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.65% (3.6692 => 3.7664, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.64% (0.7460 => 0.7657, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.57% (1.1333 => 1.1624, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 2.52% (2.1791 => 2.2340, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 2.43% (14.8535 => 15.2143, std. dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 2.30% (6.5754 => 6.7268, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.24% (16.2614 => 16.6251, std. dev.: 0.0188) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.12% (0.6135 => 0.6265, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.05% (4.3801 => 4.4697, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.94% (0.8698 => 0.8867, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.94% (4.4433 => 4.5294, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 1.89% (3.1889 => 3.2492, std. dev.: 0.0105) MultiSource/Applications/ClamAV/clamscan: 1.85% (14.5298 => 14.7991, std. dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.2749 => 1.2969, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.16% (1.8175 => 2.2748, std. dev.: 0.0458) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1908, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.82% (1.2998 => 1.3884, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.06% (7.4271 => 7.7285, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9222, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6781, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8311, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4790, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.73% (3.6469 => 3.7100, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5337, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/fldry: 1.33% (1.9290 => 1.9546, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.12% (10.7476 => 10.8681, std. dev.: 0.0163) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.90% (22.5627 => 21.0053, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.85% (0.3511 => 0.3376, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.51% (0.8818 => 0.8597, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.24% (0.9108 => 0.8995, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1126, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (20.3410 => 18.6320, std. dev.: 0.0074) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3130, std. dev.: 0.0071) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5909, std. dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5056, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2565, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: -1.53% (3.0263 => 2.9799, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.47% (0.9692 => 0.9550, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1419, std. dev.: 0.0106) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8434, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2162, std. dev.: 0.0306) SingleSource/Benchmarks/Shootout/heapsort: -1.12% (3.9173 => 3.8735, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2592, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 13:51:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 15:51:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120705205118.C0DBF2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1805?compare_to=1802&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1805, Order: 159767, Start Time: 2012-07-05 19:32:48, End Time: 2012-07-05 20:51:17 To: 1802, Order: 159753, Start Time: 2012-07-05 17:46:38, End Time: 2012-07-05 19:05:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (798 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.41% (10.3673 => 13.8314, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.83% (1.1194 => 1.2518, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.08% (0.1622 => 0.1753, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.71% (1.7609 => 1.8966, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.66% (0.3473 => 0.3739, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 7.51% (0.3516 => 0.3780, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.41% (0.3497 => 0.3756, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.39% (0.3543 => 0.3805, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.34% (0.3543 => 0.3803, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.33% (0.3561 => 0.3822, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.15% (0.3694 => 0.3958, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.97% (0.3886 => 0.4157, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.90% (0.3927 => 0.4198, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.90% (0.3828 => 0.4092, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.86% (2.2022 => 2.3533, std. dev.: 0.0162) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.4879 => 0.5119, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.60% (0.3177 => 0.3323, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.44% (7.0540 => 7.3673, std. dev.: 0.0086) SingleSource/UnitTests/ObjC++/Hello: 4.14% (0.5925 => 0.6170, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.08% (0.6030 => 0.6276, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.73% (0.7433 => 0.7710, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 3.53% (0.3282 => 0.3398, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 3.33% (0.7326 => 0.7570, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 3.22% (10.4361 => 10.7724, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.50% (0.5569 => 0.5708, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.38% (0.4615 => 0.4725, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.28% (0.8172 => 0.8358, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.19% (5.0018 => 5.1114, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.17% (4.9449 => 5.0524, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.14% (14.3668 => 14.6744, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 2.09% (9.4845 => 9.6832, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.00% (0.5860 => 0.5977, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 1.97% (0.7835 => 0.7989, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.91% (4.2646 => 4.3461, std. dev.: 0.0085) MultiSource/Applications/treecc/treecc: 1.84% (2.0273 => 2.0647, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.79% (8.1363 => 8.2822, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 1.59% (1.1642 => 1.1827, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.58% (1.1861 => 1.2048, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.57% (0.8067 => 0.8194, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.56% (3.3354 => 3.3875, std. dev.: 0.0035) MultiSource/Applications/lua/lua: 1.47% (3.8723 => 3.9292, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.41% (1.5415 => 1.5632, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.35% (1.5603 => 1.5814, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.28% (17.1811 => 17.4018, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.27% (1.3050 => 1.3216, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 1.21% (5.7591 => 5.8286, std. dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.17% (2.2024 => 2.2281, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.12% (0.9765 => 0.9874, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.07% (1.4186 => 1.4338, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7554, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 2.04% (26.0924 => 26.6248, std. dev.: 0.0228) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (1.5086 => 1.5373, std. dev.: 0.0048) MultiSource/Applications/minisat/minisat: 1.48% (9.1159 => 9.2512, std. dev.: 0.0330) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6876, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1250, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.33% (0.8651 => 0.1702, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.87% (5.2763 => 3.1724, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.41% (5.3855 => 3.6937, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.04% (5.3526 => 3.6910, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.15% (2.9384 => 2.5519, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: -12.71% (22.1758 => 19.3570, std. dev.: 0.0113) SingleSource/UnitTests/Vector/constpool: -4.73% (54.1659 => 51.6051, std. dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.34% (3.8922 => 3.8011, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.25% (0.8101 => 0.8000, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.83% (0.0998 => 0.0840, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.07% (1.2373 => 1.1127, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.90% (19.9488 => 18.5726, std. dev.: 0.0534) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.76% (8.1563 => 7.9313, std. dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6896, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0850, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 15:01:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 17:01:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120705220115.D04002A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1806?compare_to=1804&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1806, Order: 159772, Start Time: 2012-07-05 20:47:07, End Time: 2012-07-05 22:01:14 To: 1804, Order: 159760, Start Time: 2012-07-05 19:05:45, End Time: 2012-07-05 20:19:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.68% (79.0888 => 80.4162, std. dev.: 0.4825) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.76% (2.0176 => 2.2952, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.53% (0.5818 => 0.6198, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.33% (0.7061 => 0.7508, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5748 => 0.6102, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.02% (0.7038 => 0.7462, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.54% (1.3693 => 1.4452, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hash2: 5.45% (0.4328 => 0.4564, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.40% (0.7710 => 0.8126, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 5.39% (0.4062 => 0.4281, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.34% (0.1986 => 0.2092, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.34% (0.5265 => 0.5546, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.08% (0.2596 => 0.2728, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.07% (0.2721 => 0.2859, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.94% (3.9660 => 4.1620, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.60% (0.3022 => 0.3161, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.60% (0.6959 => 0.7279, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.48% (0.2966 => 0.3099, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.46% (0.2781 => 0.2905, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.44% (0.3899 => 0.4072, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.41% (0.3580 => 0.3738, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 4.32% (16.6129 => 17.3310, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.31% (0.2782 => 0.2902, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.29% (1.9828 => 2.0678, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/except: 4.24% (0.2760 => 0.2877, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.24% (13.8202 => 14.4060, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hello: 4.22% (0.2607 => 0.2717, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.20% (0.9199 => 0.9585, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 4.19% (0.2937 => 0.3060, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.18% (13.2842 => 13.8397, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 4.16% (0.2690 => 0.2802, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.15% (1.2193 => 1.2699, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 4.11% (0.2628 => 0.2736, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.11% (0.2655 => 0.2764, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.10% (0.3489 => 0.3632, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.09% (0.2761 => 0.2874, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.07% (0.2726 => 0.2837, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.02% (0.3485 => 0.3625, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.01% (0.2765 => 0.2876, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3107 => 0.3230, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.94% (0.3149 => 0.3273, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.92% (0.4390 => 0.4562, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.82% (0.2696 => 0.2799, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.71% (0.4016 => 0.4165, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.70% (0.3650 => 0.3785, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 3.68% (0.3534 => 0.3664, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.68% (0.5577 => 0.5782, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.60% (0.3246 => 0.3363, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.59% (0.3756 => 0.3891, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 3.59% (0.3453 => 0.3577, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.59% (0.2925 => 0.3030, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.57% (0.3192 => 0.3306, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.57% (3.8646 => 4.0025, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.49% (1.3245 => 1.3707, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.47% (1.4563 => 1.5069, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: 3.45% (0.2988 => 0.3091, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.5637 => 0.5831, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.44% (1.1364 => 1.1755, std. dev.: 0.0115) SingleSource/UnitTests/ObjC/parameter-passing: 3.42% (0.4003 => 0.4140, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 3.40% (0.3293 => 0.3405, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.0594 => 1.0953, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: 3.38% (0.3578 => 0.3699, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.37% (0.3914 => 0.4046, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.26% (0.3868 => 0.3994, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 3.22% (0.3789 => 0.3911, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.22% (1.1061 => 1.1417, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 3.20% (0.3940 => 0.4066, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.19% (1.9270 => 1.9885, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.18% (0.7506 => 0.7745, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 3.18% (0.3646 => 0.3762, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 3.17% (0.3601 => 0.3715, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.14% (0.3663 => 0.3778, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 3.12% (0.3623 => 0.3736, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.08% (0.7460 => 0.7690, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.06% (1.3813 => 1.4236, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.96% (1.3819 => 1.4228, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.95% (4.9865 => 5.1337, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.95% (0.4379 => 0.4508, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.94% (0.8310 => 0.8554, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.75% (7.2180 => 7.4167, std. dev.: 0.0046) MultiSource/Applications/siod/siod: 2.69% (2.1791 => 2.2378, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.68% (1.2292 => 1.2621, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.51% (14.8535 => 15.2261, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.44% (3.6692 => 3.7589, std. dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 2.40% (6.5754 => 6.7330, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.29% (16.2614 => 16.6337, std. dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.28% (0.4791 => 0.4900, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6135 => 0.6272, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.17% (4.3801 => 4.4751, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.99% (4.4433 => 4.5315, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.95% (0.8698 => 0.8868, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.95% (1.1333 => 1.1554, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 1.94% (3.1889 => 3.2509, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.81% (14.5298 => 14.7927, std. dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: 1.80% (1.2749 => 1.2979, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.80% (0.6283 => 0.6396, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.76% (2.1007 => 2.1377, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2594, std. dev.: 0.0320) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.28% (2.0200 => 2.1873, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.44% (1.5824 => 1.7001, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.52% (1.2998 => 1.3845, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7333, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9196, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6779, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.34% (1.7688 => 1.8279, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4780, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4546, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.72% (3.6469 => 3.7096, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5089 => 1.5332, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.26% (1.9290 => 1.9533, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2143, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.54% (22.5627 => 21.0875, std. dev.: 0.0171) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.65% (0.3511 => 0.3383, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.35% (0.8818 => 0.8611, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.04% (1.2308 => 1.1072, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.89% (20.3410 => 18.5324, std. dev.: 0.0656) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.20% (1.3780 => 1.3201, std. dev.: 0.0062) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5981, std. dev.: 0.0280) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4478, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5043, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.61% (0.6589 => 0.6483, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2538, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.56% (26.5159 => 26.1020, std. dev.: 0.0163) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9826, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8618, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.35% (28.2225 => 27.8426, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2491, std. dev.: 0.0067) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2207, std. dev.: 0.0336) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8494, std. dev.: 0.0144) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 15:19:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 17:19:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120705221931.942BB2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1807?compare_to=1803&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1807, Order: 159767, Start Time: 2012-07-05 19:36:13, End Time: 2012-07-05 22:19:29 To: 1803, Order: 159752, Start Time: 2012-07-05 16:25:44, End Time: 2012-07-05 19:08:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (33 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (859 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 10.66% (0.3932 => 0.4351, std. dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 14.74% (0.3792 => 0.4351, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-2: 7.60% (0.3446 => 0.3708, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.59% (0.3465 => 0.3728, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3460 => 0.3721, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.41% (0.3469 => 0.3726, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.24% (0.3496 => 0.3749, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.22% (0.3488 => 0.3740, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 7.21% (0.3442 => 0.3690, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.96% (0.3650 => 0.3904, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.86% (0.3643 => 0.3893, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/parameter-passing: 6.71% (0.3724 => 0.3974, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.86% (0.5826 => 0.6051, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.53% (0.5889 => 0.6097, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.68% (0.4361 => 0.4478, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.67% (1.6211 => 1.6644, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.66% (0.4994 => 0.5127, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.37% (0.5900 => 0.6040, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.34% (3.5627 => 3.6459, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 2.23% (0.7171 => 0.7331, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.06% (1.3152 => 1.3423, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 2.05% (4.2109 => 4.2973, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.05% (0.5026 => 0.5129, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.56% (2.0673 => 2.0996, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.49% (1.9694 => 1.9988, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 1.48% (0.9909 => 1.0056, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.36% (1.0781 => 1.0928, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.30% (4.4195 => 4.4768, std. dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.25% (2.7292 => 2.7632, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.22% (1.9966 => 2.0210, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 1.07% (1.8794 => 1.8996, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 1.05% (4.6177 => 4.6662, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (2.1653 => 2.1872, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.39% (2.0820 => 2.1110, std. dev.: 0.0107) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.85% (11.9555 => 11.6147, std. dev.: 0.0070) SingleSource/UnitTests/Vector/constpool: -2.79% (2.4764 => 2.4072, std. dev.: 0.0108) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 15:37:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 17:37:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120705223724.3D5322A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1808?compare_to=1805&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1808, Order: 159776, Start Time: 2012-07-05 21:18:38, End Time: 2012-07-05 22:37:21 To: 1805, Order: 159767, Start Time: 2012-07-05 19:32:48, End Time: 2012-07-05 20:51:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (55 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (800 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.80% (54.8844 => 56.4212, std. dev.: 0.0868) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.02% (13.8314 => 13.5522, std. dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.72% (10.3673 => 13.5522, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.64% (1.1194 => 1.2497, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.76% (1.7609 => 1.8975, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.48% (2.2022 => 2.3670, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 7.21% (0.1622 => 0.1739, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 6.36% (0.3473 => 0.3694, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/synchronized: 6.12% (0.3561 => 0.3779, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 6.09% (0.3516 => 0.3730, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.07% (0.3543 => 0.3758, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 6.06% (0.3497 => 0.3709, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.04% (0.3543 => 0.3757, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 5.98% (0.3694 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.72% (0.3828 => 0.4047, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.68% (0.3927 => 0.4150, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 5.66% (0.3886 => 0.4106, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.80% (7.0540 => 7.3923, std. dev.: 0.0257) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.55% (0.4879 => 0.5101, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.22% (0.3177 => 0.3311, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 4.11% (0.3282 => 0.3417, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.57% (0.7433 => 0.7698, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.21% (0.5925 => 0.6115, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 3.20% (10.4361 => 10.7700, std. dev.: 0.0084) SingleSource/UnitTests/ObjC++/property-reference-object: 3.07% (0.6030 => 0.6215, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.55% (0.7326 => 0.7513, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.36% (0.4615 => 0.4724, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.32% (0.5569 => 0.5698, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 2.25% (9.4845 => 9.6978, std. dev.: 0.0127) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.23% (0.8172 => 0.8354, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.23% (5.0018 => 5.1131, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.21% (4.9449 => 5.0543, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (14.3668 => 14.6807, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.95% (0.7835 => 0.7988, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.89% (0.5860 => 0.5971, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.77% (4.2646 => 4.3402, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.74% (8.1363 => 8.2782, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 1.68% (3.3354 => 3.3914, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 1.67% (5.7591 => 5.8554, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 1.65% (2.0273 => 2.0608, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.50% (1.1861 => 1.2039, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.49% (0.8067 => 0.8187, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.43% (2.2024 => 2.2339, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.41% (1.5415 => 1.5632, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 1.33% (3.8723 => 3.9239, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.27% (1.3050 => 1.3216, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.26% (1.5603 => 1.5800, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 1.25% (17.1811 => 17.3962, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.09% (1.4186 => 1.4341, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9741, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7594, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 2.24% (26.0924 => 26.6769, std. dev.: 0.0128) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5367, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.66% (9.1159 => 9.2669, std. dev.: 0.0307) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.39% (2.6546 => 2.6915, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1272, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.01% (5.2763 => 3.1650, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.30% (5.3855 => 3.7001, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.93% (5.3526 => 3.6971, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.69% (2.9384 => 2.5361, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -12.74% (22.1758 => 19.3504, std. dev.: 0.0149) SingleSource/UnitTests/Vector/constpool: -5.15% (54.1659 => 51.3771, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.39% (3.8922 => 3.7993, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.43% (0.8101 => 0.7985, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.79% (1.2373 => 1.1162, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.68% (19.9488 => 18.6171, std. dev.: 0.0367) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.87% (8.1563 => 7.9221, std. dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6824, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0820, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 16:42:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 18:42:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120705234245.5C4A22A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1809?compare_to=1806&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1809, Order: 159783, Start Time: 2012-07-05 22:28:29, End Time: 2012-07-05 23:42:43 To: 1806, Order: 159772, Start Time: 2012-07-05 20:47:07, End Time: 2012-07-05 22:01:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.27% (55.2700 => 56.5224, std. dev.: 0.0976) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.39% (2.0176 => 2.2877, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 7.87% (0.5818 => 0.6276, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.60% (0.5748 => 0.6185, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.56% (0.7061 => 0.7595, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 6.03% (1.3693 => 1.4519, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 5.95% (0.7038 => 0.7457, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.64% (0.4328 => 0.4572, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.59% (0.1986 => 0.2097, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.45% (0.5265 => 0.5552, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 5.39% (0.4062 => 0.4281, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.26% (0.2945 => 0.3100, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.14% (3.9660 => 4.1699, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.12% (0.2596 => 0.2729, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.03% (0.7710 => 0.8098, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 4.93% (0.2781 => 0.2918, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.90% (0.3022 => 0.3170, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.78% (0.2782 => 0.2915, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.72% (0.2607 => 0.2730, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.69% (0.2966 => 0.3105, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.63% (1.9828 => 2.0747, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.63% (0.2655 => 0.2778, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.63% (0.2765 => 0.2893, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.62% (0.2726 => 0.2852, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.57% (0.2628 => 0.2748, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.57% (0.2760 => 0.2886, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.53% (0.2937 => 0.3070, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.51% (0.3899 => 0.4075, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.51% (0.6959 => 0.7273, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.50% (0.3489 => 0.3646, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.48% (0.3149 => 0.3290, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 4.47% (0.3107 => 0.3246, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 4.45% (0.2761 => 0.2884, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.41% (0.3580 => 0.3738, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.30% (0.2696 => 0.2812, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.30% (13.8202 => 14.4143, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.28% (0.3485 => 0.3634, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.26% (0.4390 => 0.4577, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.23% (0.3453 => 0.3599, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.21% (0.4016 => 0.4185, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.19% (13.2842 => 13.8406, std. dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: 4.18% (16.6129 => 17.3069, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.16% (0.9199 => 0.9582, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 4.10% (0.3192 => 0.3323, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.10% (0.4003 => 0.4167, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.00% (1.2193 => 1.2681, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 4.00% (0.3578 => 0.3721, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.95% (0.2988 => 0.3106, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 3.91% (0.3789 => 0.3937, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.89% (0.5577 => 0.5794, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.89% (0.3756 => 0.3902, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: 3.89% (0.3293 => 0.3421, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 3.88% (0.3663 => 0.3805, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.86% (0.2925 => 0.3038, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-2: 3.86% (0.3601 => 0.3740, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.86% (0.3914 => 0.4065, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 3.86% (0.3940 => 0.4092, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3534 => 0.3670, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 3.84% (0.3646 => 0.3786, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.75% (0.3650 => 0.3787, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 3.73% (0.3623 => 0.3758, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.3868 => 0.4011, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.61% (3.8646 => 4.0040, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.58% (0.5637 => 0.5839, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.54% (0.3246 => 0.3361, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.52% (1.4563 => 1.5076, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.50% (1.3245 => 1.3708, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.46% (0.7506 => 0.7766, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.46% (1.1364 => 1.1757, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.44% (1.9270 => 1.9932, std. dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 3.42% (1.0594 => 1.0956, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.21% (1.1061 => 1.1416, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.20% (0.7460 => 0.7699, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.13% (0.4379 => 0.4516, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.07% (1.3813 => 1.4237, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 3.07% (1.2292 => 1.2669, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.04% (4.9865 => 5.1381, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.02% (1.3819 => 1.4236, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (0.8310 => 0.8552, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.90% (7.2180 => 7.4276, std. dev.: 0.0079) MultiSource/Applications/siod/siod: 2.79% (2.1791 => 2.2400, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3755 => 0.3855, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.58% (3.6692 => 3.7639, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 2.46% (14.8535 => 15.2189, std. dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.42% (0.4791 => 0.4907, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.42% (6.5754 => 6.7345, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.32% (4.3801 => 4.4817, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6135 => 0.6272, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 2.19% (16.2614 => 16.6168, std. dev.: 0.0230) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.18% (0.8698 => 0.8888, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.13% (4.4433 => 4.5379, std. dev.: 0.0054) MultiSource/Applications/d/make_dparser: 2.11% (3.1889 => 3.2561, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.07% (1.1333 => 1.1568, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.96% (14.5298 => 14.8142, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.85% (0.6283 => 0.6399, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.76% (1.2749 => 1.2974, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.66% (2.1007 => 2.1356, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/fbench: 24.88% (1.8175 => 2.2697, std. dev.: 0.0553) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.57% (2.0200 => 2.1931, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 7.66% (1.2998 => 1.3993, std. dev.: 0.0105) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.31% (7.4271 => 7.7469, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9200, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6777, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8289, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1889, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.94% (1.4298 => 1.4575, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.81% (3.6469 => 3.7128, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5089 => 1.5358, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0068) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.42% (22.5627 => 21.1149, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.53% (0.3511 => 0.3387, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.22% (0.8818 => 0.8622, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.10% (0.9108 => 0.9008, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.65% (1.2308 => 1.1120, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.91% (20.3410 => 18.5290, std. dev.: 0.1003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.60% (1.3780 => 1.3146, std. dev.: 0.0076) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6015, std. dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.04% (6.6320 => 6.4964, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2548, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8568, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: -1.46% (3.0263 => 2.9821, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.5254 => 2.4886, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1389, std. dev.: 0.0169) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8432, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2208, std. dev.: 0.0137) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2564, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8477, std. dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 17:23:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 19:23:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120706002329.0EAAB2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1810?compare_to=1808&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1810, Order: 159784, Start Time: 2012-07-05 23:04:43, End Time: 2012-07-06 00:23:28 To: 1808, Order: 159776, Start Time: 2012-07-05 21:18:38, End Time: 2012-07-05 22:37:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (799 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.53% (10.3673 => 13.5328, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.63% (1.1194 => 1.2496, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.87% (2.2022 => 2.3756, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.63% (1.7609 => 1.8952, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 7.11% (0.3473 => 0.3720, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.86% (0.3543 => 0.3786, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 6.85% (0.3516 => 0.3757, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.83% (0.3497 => 0.3736, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.83% (0.3543 => 0.3785, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.77% (0.3561 => 0.3802, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 6.58% (0.3694 => 0.3937, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 6.36% (0.3886 => 0.4133, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.35% (0.3828 => 0.4071, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 6.32% (0.3927 => 0.4175, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.82% (7.0540 => 7.3943, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.38% (0.3177 => 0.3316, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 3.74% (10.4361 => 10.8265, std. dev.: 0.0175) MultiSource/Applications/lambda-0_1_3/lambda: 3.40% (0.7433 => 0.7686, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 3.40% (0.6030 => 0.6235, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 3.38% (0.5925 => 0.6125, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.15% (0.7326 => 0.7557, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.41% (0.5569 => 0.5703, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.32% (0.7835 => 0.8017, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (4.9449 => 5.0568, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (14.3668 => 14.6910, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.25% (0.4615 => 0.4719, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.22% (5.0018 => 5.1129, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 2.21% (9.4845 => 9.6944, std. dev.: 0.0073) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.18% (0.8172 => 0.8350, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 2.00% (5.7591 => 5.8745, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.91% (0.5860 => 0.5972, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.82% (4.2646 => 4.3423, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.80% (8.1363 => 8.2830, std. dev.: 0.0096) MultiSource/Applications/treecc/treecc: 1.76% (2.0273 => 2.0629, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 1.74% (1.1642 => 1.1844, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 1.69% (3.3354 => 3.3919, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.48% (0.8067 => 0.8186, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.47% (1.1861 => 1.2035, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.39% (17.1811 => 17.4198, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.34% (1.3050 => 1.3225, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.28% (1.5415 => 1.5613, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.26% (3.8723 => 3.9211, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.25% (1.5603 => 1.5798, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.18% (2.2024 => 2.2284, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.09% (1.4186 => 1.4340, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9743, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7547, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 2.05% (26.0924 => 26.6275, std. dev.: 0.0267) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (1.5086 => 1.5372, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4460, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2383, std. dev.: 0.0267) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.23% (2.6546 => 2.6872, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.33% (0.8651 => 0.1702, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.93% (5.2763 => 3.1697, std. dev.: 0.0140) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.08% (5.3855 => 3.7115, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.72% (5.3526 => 3.7083, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.57% (2.9384 => 2.5396, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -12.72% (22.1758 => 19.3555, std. dev.: 0.0134) SingleSource/UnitTests/Vector/constpool: -5.29% (54.1659 => 51.3029, std. dev.: 0.0433) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.40% (3.8922 => 3.7986, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.47% (0.8101 => 0.7982, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.53% (0.0998 => 0.0843, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2373 => 1.1100, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.91% (19.9488 => 18.5697, std. dev.: 0.0474) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.83% (8.1563 => 7.9253, std. dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6812, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 18:24:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 20:24:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120706012435.070FB2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1811?compare_to=1809&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1811, Order: 159785, Start Time: 2012-07-06 00:10:12, End Time: 2012-07-06 01:24:32 To: 1809, Order: 159783, Start Time: 2012-07-05 22:28:29, End Time: 2012-07-05 23:42:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.06% (1.3993 => 1.4141, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.05% (3.8670 => 3.7876, std. dev.: 0.0202) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.38% (2.0176 => 2.2875, std. dev.: 0.0129) SingleSource/UnitTests/ObjC++/property-reference: 7.86% (0.7061 => 0.7616, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.85% (0.5818 => 0.6275, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 7.65% (0.5748 => 0.6188, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 6.05% (1.3693 => 1.4521, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 5.88% (0.7038 => 0.7452, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.64% (0.1986 => 0.2098, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.59% (0.4328 => 0.4570, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.47% (0.7710 => 0.8132, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.47% (0.2945 => 0.3106, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.43% (0.5265 => 0.5551, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 5.34% (0.4062 => 0.4279, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.26% (0.2721 => 0.2864, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.20% (0.2596 => 0.2731, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.11% (3.9660 => 4.1688, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 5.03% (0.2781 => 0.2921, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.96% (0.2966 => 0.3113, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.93% (0.3022 => 0.3171, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.78% (0.2782 => 0.2915, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.73% (1.9828 => 2.0765, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hello: 4.72% (0.2607 => 0.2730, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.70% (0.2765 => 0.2895, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.66% (0.2937 => 0.3074, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.66% (0.2726 => 0.2853, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.66% (0.6959 => 0.7283, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 4.61% (0.2690 => 0.2814, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.60% (0.2760 => 0.2887, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.59% (0.3899 => 0.4078, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.57% (0.2628 => 0.2748, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.56% (0.2655 => 0.2776, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.53% (0.3489 => 0.3647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.49% (0.2761 => 0.2885, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.47% (0.3580 => 0.3740, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.41% (0.3107 => 0.3244, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.38% (0.2696 => 0.2814, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.35% (0.3149 => 0.3286, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.33% (13.8202 => 14.4181, std. dev.: 0.0143) SingleSource/UnitTests/ObjC/trivial-interface: 4.22% (0.3578 => 0.3729, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.20% (0.3453 => 0.3598, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.20% (0.9199 => 0.9585, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.17% (13.2842 => 13.8382, std. dev.: 0.0200) MultiSource/Applications/kimwitu++/kc: 4.14% (16.6129 => 17.3014, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.11% (0.4016 => 0.4181, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 4.03% (0.3601 => 0.3746, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.00% (0.4003 => 0.4163, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.99% (0.3534 => 0.3675, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.98% (0.3192 => 0.3319, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.98% (1.2193 => 1.2678, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-4: 3.98% (0.3646 => 0.3791, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.96% (0.3789 => 0.3939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.91% (0.3756 => 0.3903, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.89% (0.5577 => 0.5794, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.89% (0.3650 => 0.3792, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.89% (0.3293 => 0.3421, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2988 => 0.3104, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 3.88% (0.3663 => 0.3805, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.86% (0.3914 => 0.4065, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 3.81% (0.3940 => 0.4090, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.80% (0.4390 => 0.4557, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.76% (0.2925 => 0.3035, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 3.73% (0.3623 => 0.3758, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.3868 => 0.4011, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.60% (1.3245 => 1.3722, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 3.59% (3.8646 => 4.0035, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.58% (1.4563 => 1.5085, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.57% (0.3246 => 0.3362, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.55% (0.5637 => 0.5837, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.51% (1.1364 => 1.1763, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 3.45% (1.0594 => 1.0959, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.42% (0.7506 => 0.7763, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.39% (1.9270 => 1.9924, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.28% (1.3813 => 1.4266, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.23% (1.3819 => 1.4266, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.17% (0.4379 => 0.4518, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.14% (1.1061 => 1.1408, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 3.08% (1.2292 => 1.2670, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.03% (7.2180 => 7.4368, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.99% (4.9865 => 5.1355, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.90% (0.7460 => 0.7676, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.89% (2.1791 => 2.2420, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 2.84% (0.8310 => 0.8546, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3755 => 0.3856, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.62% (0.6135 => 0.6296, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.55% (3.6692 => 3.7628, std. dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 2.54% (6.5754 => 6.7426, std. dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 2.48% (14.8535 => 15.2217, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.36% (0.4791 => 0.4904, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 2.27% (1.2749 => 1.3038, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 2.26% (16.2614 => 16.6288, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.24% (4.3801 => 4.4783, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.24% (4.4433 => 4.5428, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.16% (0.8698 => 0.8886, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.13% (1.1333 => 1.1574, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 2.06% (3.1889 => 3.2547, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.95% (14.5298 => 14.8128, std. dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.93% (0.6283 => 0.6404, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.71% (2.1007 => 2.1367, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/fbench: 23.84% (1.8175 => 2.2508, std. dev.: 0.0562) SingleSource/Benchmarks/Misc/mandel-2: 8.79% (1.2998 => 1.4141, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.40% (2.0200 => 2.1897, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9996 => 1.0782, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.04% (7.4271 => 7.7271, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (12.4560 => 12.9187, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6789, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1915, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4562, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5345, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9596, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.46% (3.6469 => 3.7003, std. dev.: 0.0075) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.41% (22.5627 => 21.1169, std. dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.50% (0.3511 => 0.3388, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.49% (0.8818 => 0.8598, std. dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.15% (0.0997 => 0.0836, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1126, std. dev.: 0.0162) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.53% (20.3410 => 18.6057, std. dev.: 0.0485) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.58% (1.3780 => 1.3149, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5864, std. dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: -2.51% (2.5089 => 2.4460, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5030, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2544, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: -1.54% (3.0263 => 2.9796, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8608, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1534, std. dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.33% (28.2225 => 27.8476, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.31% (9.3358 => 9.2131, std. dev.: 0.0411) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2532, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8497, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 18:29:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 20:29:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120706012956.8448C2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1812?compare_to=1807&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1812, Order: 159783, Start Time: 2012-07-05 22:46:45, End Time: 2012-07-06 01:29:56 To: 1807, Order: 159767, Start Time: 2012-07-05 19:36:13, End Time: 2012-07-05 22:19:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (41 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (851 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.40% (0.7331 => 0.7434, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 1.31% (1.6018 => 1.6228, std. dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 8.01% (0.3460 => 0.3737, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.91% (0.3465 => 0.3739, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 7.84% (0.3446 => 0.3716, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.73% (0.3469 => 0.3737, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.64% (0.3496 => 0.3763, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.61% (0.3442 => 0.3704, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.60% (0.3488 => 0.3753, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 7.45% (0.3650 => 0.3922, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: 7.30% (0.3643 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.04% (0.3724 => 0.3986, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 5.20% (0.5826 => 0.6129, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 4.91% (0.5889 => 0.6178, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 3.67% (0.7171 => 0.7434, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (1.6211 => 1.6785, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.51% (0.4361 => 0.4514, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (0.5026 => 0.5200, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.40% (0.4994 => 0.5164, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.12% (0.5900 => 0.6084, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.08% (3.5627 => 3.6724, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: 2.88% (0.4029 => 0.4145, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.82% (1.3152 => 1.3523, std. dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 2.82% (4.2109 => 4.3296, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.80% (0.3930 => 0.4040, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.42% (0.5000 => 0.5121, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 2.16% (1.0781 => 1.1014, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.01% (1.9694 => 2.0089, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.95% (2.0673 => 2.1077, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.91% (0.9909 => 1.0098, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (2.7292 => 2.7804, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 1.86% (1.5932 => 1.6228, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.86% (4.4195 => 4.5015, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.83% (1.9966 => 2.0331, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 1.78% (5.5417 => 5.6403, std. dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: 1.76% (23.5202 => 23.9349, std. dev.: 0.0107) MultiSource/Benchmarks/MallocBench/gs/gs: 1.70% (1.8794 => 1.9113, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 1.66% (2.1653 => 2.2012, std. dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (2.1013 => 2.1350, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 1.52% (4.6177 => 4.6880, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 1.46% (0.7875 => 0.7990, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 1.45% (0.9697 => 0.9838, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 1.28% (1.4269 => 1.4452, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.24% (11.9555 => 11.6882, std. dev.: 0.0067) SingleSource/UnitTests/Vector/constpool: -1.91% (2.4764 => 2.4290, std. dev.: 0.0111) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 19:09:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 21:09:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120706020925.7161F2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1813?compare_to=1810&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1813, Order: 159788, Start Time: 2012-07-06 00:50:46, End Time: 2012-07-06 02:09:24 To: 1810, Order: 159784, Start Time: 2012-07-05 23:04:43, End Time: 2012-07-06 00:23:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (56 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (799 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.63% (13.5328 => 13.7538, std. dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.13% (2.3756 => 2.3487, std. dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.67% (10.3673 => 13.7538, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.01% (1.1194 => 1.2427, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 7.37% (0.3473 => 0.3729, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.25% (0.3543 => 0.3800, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 7.18% (0.3497 => 0.3748, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.14% (0.3543 => 0.3796, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.08% (0.3516 => 0.3765, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.08% (1.7609 => 1.8855, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/synchronized: 7.02% (0.3561 => 0.3811, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 6.88% (0.3694 => 0.3948, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.65% (2.2022 => 2.3487, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 6.62% (0.3927 => 0.4187, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.61% (0.3828 => 0.4081, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.54% (0.3886 => 0.4140, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.17% (7.0540 => 7.3482, std. dev.: 0.0310) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.4879 => 0.5080, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.97% (0.3177 => 0.3303, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 3.83% (0.5925 => 0.6152, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.81% (0.6030 => 0.6260, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.50% (0.7433 => 0.7693, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.32% (10.4361 => 10.7827, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/oourafft: 3.20% (0.3282 => 0.3387, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.96% (0.7326 => 0.7543, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.28% (0.5569 => 0.5696, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.27% (14.3668 => 14.6931, std. dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.23% (0.4615 => 0.4718, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.17% (0.5860 => 0.5987, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.13% (4.9449 => 5.0502, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.11% (5.0018 => 5.1074, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.08% (0.8172 => 0.8342, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.02% (0.7835 => 0.7993, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 1.89% (9.4845 => 9.6633, std. dev.: 0.0103) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.87% (4.2646 => 4.3445, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.81% (8.1363 => 8.2834, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 1.74% (2.0273 => 2.0626, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.65% (3.3354 => 3.3905, std. dev.: 0.0043) MultiSource/Applications/hbd/hbd: 1.60% (1.5603 => 1.5853, std. dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 1.56% (5.7591 => 5.8490, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.54% (1.1861 => 1.2044, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 1.50% (1.1642 => 1.1817, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.41% (1.5415 => 1.5632, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.38% (0.8067 => 0.8178, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.31% (17.1811 => 17.4059, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.23% (2.0665 => 2.0919, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.22% (3.8723 => 3.9196, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.20% (1.3050 => 1.3207, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.14% (2.2024 => 2.2275, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.05% (0.9765 => 0.9868, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9742, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (3.6395 => 3.7477, std. dev.: 0.0075) MultiSource/Applications/lua/lua: 1.85% (26.0924 => 26.5742, std. dev.: 0.0741) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5086 => 1.5361, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4461, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2386, std. dev.: 0.0302) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.22% (2.6546 => 2.6869, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1246, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.31% (5.2763 => 3.1495, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.60% (5.3855 => 3.6838, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.24% (5.3526 => 3.6805, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.84% (2.9384 => 2.5318, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -12.93% (22.1758 => 19.3079, std. dev.: 0.0162) SingleSource/UnitTests/Vector/constpool: -5.22% (54.1659 => 51.3375, std. dev.: 0.0477) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.57% (3.8922 => 3.7920, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.26% (0.8101 => 0.7999, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.58% (1.2373 => 1.1064, std. dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.66% (19.9488 => 18.6193, std. dev.: 0.0277) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.78% (8.1563 => 7.9297, std. dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6840, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0850, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 20:06:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 22:06:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120706030620.4CB932A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1814?compare_to=1811&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1814, Order: 159797, Start Time: 2012-07-06 01:52:05, End Time: 2012-07-06 03:06:18 To: 1811, Order: 159785, Start Time: 2012-07-06 00:10:12, End Time: 2012-07-06 01:24:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (127 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (727 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.15% (2.0176 => 2.3031, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.25% (0.7061 => 0.7573, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.12% (0.5818 => 0.6232, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.77% (0.5748 => 0.6137, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.29% (0.7038 => 0.7481, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 5.85% (1.3693 => 1.4494, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.74% (0.1986 => 0.2100, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.57% (0.5265 => 0.5558, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.51% (0.2721 => 0.2871, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.48% (0.4328 => 0.4565, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.37% (3.9660 => 4.1789, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.35% (0.2596 => 0.2735, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.21% (0.7710 => 0.8112, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2945 => 0.3093, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.90% (0.4062 => 0.4261, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 4.86% (0.3578 => 0.3752, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.75% (0.3914 => 0.4100, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.72% (0.4003 => 0.4192, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.70% (0.3022 => 0.3164, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 4.67% (0.3789 => 0.3966, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.67% (0.6959 => 0.7284, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/property: 4.64% (0.3940 => 0.4123, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 4.64% (0.3601 => 0.3768, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-4: 4.61% (0.3646 => 0.3814, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.60% (13.8202 => 14.4563, std. dev.: 0.0179) SingleSource/Regression/C++/ofstream_ctor: 4.60% (0.2781 => 0.2909, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 4.59% (0.3663 => 0.3831, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.59% (0.3489 => 0.3649, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.57% (0.3899 => 0.4077, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.57% (0.2782 => 0.2909, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.52% (0.3650 => 0.3815, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 4.50% (0.3623 => 0.3786, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.41% (0.9199 => 0.9605, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.41% (0.2655 => 0.2772, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 4.38% (0.2760 => 0.2881, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.38% (0.2966 => 0.3096, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.38% (16.6129 => 17.3401, std. dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.36% (0.3485 => 0.3637, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2726 => 0.2844, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.31% (0.2690 => 0.2806, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.29% (0.2937 => 0.3063, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.29% (13.2842 => 13.8537, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2628 => 0.2740, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.9828 => 2.0664, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.20% (0.2765 => 0.2881, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.13% (0.2761 => 0.2875, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.12% (0.3107 => 0.3235, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.10% (0.3149 => 0.3278, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.08% (0.2696 => 0.2806, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.06% (1.2193 => 1.2688, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 3.93% (0.2925 => 0.3040, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.93% (0.5577 => 0.5796, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.91% (0.4016 => 0.4173, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.79% (0.3453 => 0.3584, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.78% (0.2988 => 0.3101, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.75% (0.3756 => 0.3897, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.74% (0.7506 => 0.7787, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (1.3245 => 1.3740, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.73% (3.8646 => 4.0088, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 3.70% (0.3192 => 0.3310, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.68% (1.0594 => 1.0984, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.4563 => 1.5098, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.67% (0.3246 => 0.3365, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.65% (0.5637 => 0.5843, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.61% (0.3293 => 0.3412, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.60% (1.9270 => 1.9964, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 3.54% (0.3868 => 0.4005, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.52% (1.1364 => 1.1764, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.52% (1.1061 => 1.1450, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.4390 => 0.4543, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.43% (0.4379 => 0.4529, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.25% (1.3813 => 1.4262, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.24% (4.9865 => 5.1481, std. dev.: 0.0063) MultiSource/Applications/siod/siod: 3.19% (2.1791 => 2.2487, std. dev.: 0.0177) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.12% (1.3819 => 1.4250, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 3.07% (0.8310 => 0.8565, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.06% (7.2180 => 7.4389, std. dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.94% (0.7460 => 0.7679, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.92% (3.6692 => 3.7765, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 2.84% (1.2292 => 1.2641, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.78% (0.4791 => 0.4924, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.71% (14.8535 => 15.2566, std. dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: 2.57% (6.5754 => 6.7442, std. dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.51% (0.6135 => 0.6289, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (4.3801 => 4.4883, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.47% (16.2614 => 16.6630, std. dev.: 0.0149) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.30% (4.4433 => 4.5457, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.28% (0.6283 => 0.6426, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 2.27% (3.1889 => 3.2612, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.26% (0.8698 => 0.8895, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.21% (1.1333 => 1.1584, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.06% (2.1007 => 2.1440, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 2.06% (1.2749 => 1.3011, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 2.04% (14.5298 => 14.8257, std. dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.13% (3.2742 => 3.3113, std. dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (8.4961 => 8.5867, std. dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.03% (1.8175 => 2.2725, std. dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.09% (2.0200 => 2.1835, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.04% (0.9996 => 1.0800, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 7.72% (1.2998 => 1.4001, std. dev.: 0.0193) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.04% (7.4271 => 7.7275, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9199, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6772, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8290, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1896, std. dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.98% (1.4298 => 1.4581, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.57% (3.6469 => 3.7041, std. dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.5627 => 21.1301, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.22% (0.3511 => 0.3398, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.37% (0.8818 => 0.8609, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.48% (1.2308 => 1.1018, std. dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.31% (20.3410 => 18.4480, std. dev.: 0.0968) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.76% (1.3780 => 1.3262, std. dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5961, std. dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5005, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2563, std. dev.: 0.0022) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1256, std. dev.: 0.0449) MultiSource/Applications/spiff/spiff: -1.47% (3.0263 => 2.9819, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8435, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2157, std. dev.: 0.0184) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2550, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: -1.02% (7.3305 => 7.2559, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 20:55:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 22:55:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120706035529.0A9B12A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1815?compare_to=1813&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1815, Order: 159797, Start Time: 2012-07-06 02:36:52, End Time: 2012-07-06 03:55:28 To: 1813, Order: 159788, Start Time: 2012-07-06 00:50:46, End Time: 2012-07-06 02:09:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (59 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (797 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 2.78% (19.3079 => 19.8454, std. dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.43% (13.7538 => 13.5565, std. dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.76% (10.3673 => 13.5565, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.01% (1.1194 => 1.2426, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/trivial-interface: 8.38% (0.3473 => 0.3764, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.21% (0.3543 => 0.3834, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.03% (0.1432 => 0.1547, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.99% (0.3543 => 0.3826, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.98% (0.3561 => 0.3845, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 7.96% (0.3516 => 0.3796, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.92% (0.3497 => 0.3774, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 7.77% (0.3694 => 0.3981, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.69% (0.3927 => 0.4229, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.60% (0.3828 => 0.4119, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.46% (0.3886 => 0.4176, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 7.46% (0.1622 => 0.1743, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.19% (1.7609 => 1.8875, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.56% (2.2022 => 2.3467, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.36% (7.0540 => 7.3619, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.31% (0.3177 => 0.3314, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.18% (0.4879 => 0.5083, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.13% (0.7433 => 0.7740, std. dev.: 0.0054) SingleSource/UnitTests/ObjC++/Hello: 3.59% (0.5925 => 0.6138, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.55% (0.6030 => 0.6244, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3092 => 0.3201, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 3.47% (0.3282 => 0.3396, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.27% (0.3180 => 0.3284, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 2.96% (0.7326 => 0.7543, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.86% (10.4361 => 10.7341, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.84% (0.5569 => 0.5727, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.65% (4.9449 => 5.0760, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.58% (14.3668 => 14.7378, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.51% (0.7835 => 0.8032, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.51% (0.8172 => 0.8377, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.51% (5.0018 => 5.1272, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.32% (0.5860 => 0.5996, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 2.26% (9.4845 => 9.6993, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.22% (4.2646 => 4.3592, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.19% (2.0273 => 2.0717, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.09% (8.1363 => 8.3061, std. dev.: 0.0050) MultiSource/Applications/d/make_dparser: 2.04% (3.3354 => 3.4034, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 2.02% (5.7591 => 5.8755, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.95% (0.8067 => 0.8224, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.93% (1.5415 => 1.5713, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.92% (1.1861 => 1.2089, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.83% (3.8723 => 3.9432, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.75% (1.3050 => 1.3279, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.75% (0.6450 => 0.6563, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.66% (0.9765 => 0.9927, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.63% (2.2024 => 2.2383, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.63% (17.1811 => 17.4606, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 1.60% (1.5603 => 1.5853, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.45% (1.4186 => 1.4392, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.07% (2.2969 => 2.3215, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.16% (3.6395 => 3.7545, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (1.5086 => 1.5373, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 1.86% (26.0924 => 26.5769, std. dev.: 0.0622) MultiSource/Applications/minisat/minisat: 1.80% (9.1159 => 9.2801, std. dev.: 0.0221) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6902, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.52% (0.8651 => 0.1685, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.35% (5.2763 => 3.1472, std. dev.: 0.0153) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.44% (5.3855 => 3.6921, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.04% (5.3526 => 3.6912, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.84% (2.9384 => 2.5317, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -10.51% (22.1758 => 19.8454, std. dev.: 0.0097) SingleSource/UnitTests/Vector/constpool: -5.28% (54.1659 => 51.3083, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.14% (3.8922 => 3.8089, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.56% (1.2373 => 1.1066, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.35% (19.9488 => 18.4824, std. dev.: 0.0628) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.75% (8.1563 => 7.9316, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6799, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0828, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 21:40:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 23:40:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120706044036.92F222A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1816?compare_to=1812&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1816, Order: 159797, Start Time: 2012-07-06 01:57:12, End Time: 2012-07-06 04:40:34 To: 1812, Order: 159783, Start Time: 2012-07-05 22:46:45, End Time: 2012-07-06 01:29:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (41 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (852 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.43% (0.4272 => 0.4168, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 9.34% (0.3446 => 0.3768, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.34% (0.3460 => 0.3783, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.32% (0.3465 => 0.3788, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.17% (0.3469 => 0.3787, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.12% (0.3442 => 0.3756, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.12% (0.3488 => 0.3806, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.10% (0.3496 => 0.3814, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.74% (0.3650 => 0.3969, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.67% (0.3643 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.40% (0.3724 => 0.4037, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.48% (0.5826 => 0.6087, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 4.25% (0.5889 => 0.6139, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.68% (1.6211 => 1.6807, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 3.52% (0.4029 => 0.4171, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.50% (0.4994 => 0.5169, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.46% (0.4361 => 0.4512, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.43% (3.5627 => 3.6849, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.32% (0.5900 => 0.6096, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 3.11% (0.7171 => 0.7394, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.02% (0.5026 => 0.5178, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 2.99% (4.2109 => 4.3368, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.84% (1.3152 => 1.3526, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (0.3930 => 0.4041, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.45% (2.7292 => 2.7960, std. dev.: 0.0039) MultiSource/Applications/d/make_dparser: 2.41% (1.0781 => 1.1041, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.38% (0.5000 => 0.5119, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (1.9694 => 2.0152, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 2.29% (0.9909 => 1.0136, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.21% (1.9966 => 2.0407, std. dev.: 0.0069) MultiSource/Applications/JM/ldecod/ldecod: 2.13% (2.1653 => 2.2114, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.11% (4.4195 => 4.5127, std. dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 2.10% (23.5202 => 24.0135, std. dev.: 0.0182) MultiSource/Applications/treecc/treecc: 1.97% (0.7875 => 0.8030, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.93% (0.9697 => 0.9884, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 1.93% (5.5417 => 5.6484, std. dev.: 0.0137) MultiSource/Benchmarks/MallocBench/gs/gs: 1.86% (1.8794 => 1.9144, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.84% (2.0673 => 2.1054, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.78% (4.6177 => 4.6998, std. dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 1.69% (2.1013 => 2.1368, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.44% (1.4269 => 1.4475, std. dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 1.04% (1.5932 => 1.6097, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.29% (11.9555 => 11.6821, std. dev.: 0.0140) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 21:47:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 5 Jul 2012 23:47:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120706044757.86D6B2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1817?compare_to=1814&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1817, Order: 159802, Start Time: 2012-07-06 03:33:42, End Time: 2012-07-06 04:47:53 To: 1814, Order: 159797, Start Time: 2012-07-06 01:52:05, End Time: 2012-07-06 03:06:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (727 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: 1.06% (18.4480 => 18.6435, std. dev.: 0.0405) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.19% (2.0176 => 2.3039, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.25% (0.7061 => 0.7573, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.05% (0.5818 => 0.6228, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.87% (0.5748 => 0.6143, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.52% (0.7038 => 0.7497, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.94% (1.3693 => 1.4506, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.64% (0.1986 => 0.2098, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.59% (0.4062 => 0.4289, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.52% (0.4328 => 0.4567, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.44% (0.2721 => 0.2869, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.43% (0.5265 => 0.5551, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.36% (3.9660 => 4.1787, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.35% (0.2596 => 0.2735, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.30% (0.7710 => 0.8119, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2945 => 0.3093, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.87% (0.6959 => 0.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.80% (0.3022 => 0.3167, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 4.78% (0.3578 => 0.3749, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 4.75% (0.4003 => 0.4193, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.72% (0.3899 => 0.4083, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 4.68% (0.3914 => 0.4097, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.67% (0.2781 => 0.2911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.65% (0.3789 => 0.3965, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.64% (0.3940 => 0.4123, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.64% (0.2782 => 0.2911, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.63% (13.8202 => 14.4601, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.61% (0.3489 => 0.3650, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.61% (0.3601 => 0.3767, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 4.59% (0.3663 => 0.3831, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.58% (0.3646 => 0.3813, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.56% (16.6129 => 17.3706, std. dev.: 0.0098) SingleSource/UnitTests/ObjC/exceptions-3: 4.53% (0.3623 => 0.3787, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.52% (0.3650 => 0.3815, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.49% (0.2760 => 0.2884, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.47% (0.3580 => 0.3740, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.45% (0.2966 => 0.3098, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.39% (0.3485 => 0.3638, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.37% (0.9199 => 0.9601, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.33% (0.2655 => 0.2770, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2726 => 0.2844, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.32% (1.9828 => 2.0685, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 4.31% (0.2690 => 0.2806, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.30% (0.2628 => 0.2741, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.26% (13.2842 => 13.8496, std. dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/wc: 4.26% (0.2937 => 0.3062, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.18% (0.3107 => 0.3237, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.17% (0.2761 => 0.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.16% (0.3149 => 0.3280, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.16% (0.2765 => 0.2880, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.10% (0.2925 => 0.3045, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.08% (0.2696 => 0.2806, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.07% (1.2193 => 1.2689, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.96% (0.4016 => 0.4175, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.95% (0.3293 => 0.3423, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 3.90% (0.3534 => 0.3672, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (1.3245 => 1.3753, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 3.82% (0.2988 => 0.3102, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.78% (0.5577 => 0.5788, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.78% (0.3756 => 0.3898, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.76% (0.3246 => 0.3368, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.74% (1.4563 => 1.5107, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.73% (0.3192 => 0.3311, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.71% (3.8646 => 4.0079, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.5637 => 0.5842, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.59% (1.0594 => 1.0974, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.57% (1.9270 => 1.9957, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.56% (0.4379 => 0.4535, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.55% (1.1364 => 1.1767, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.53% (0.4390 => 0.4545, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.47% (1.1061 => 1.1445, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 3.46% (0.3868 => 0.4002, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.42% (0.7506 => 0.7763, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.35% (4.9865 => 5.1534, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.15% (1.3813 => 1.4248, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 3.14% (2.1791 => 2.2476, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.09% (1.3819 => 1.4246, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.06% (7.2180 => 7.4387, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 3.06% (0.8310 => 0.8564, std. dev.: 0.0091) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.98% (0.7460 => 0.7682, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.94% (0.4791 => 0.4932, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.91% (1.2292 => 1.2650, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.76% (3.6692 => 3.7706, std. dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 2.74% (14.8535 => 15.2610, std. dev.: 0.0085) MultiSource/Applications/JM/ldecod/ldecod: 2.74% (6.5754 => 6.7553, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (4.3801 => 4.4911, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.53% (16.2614 => 16.6722, std. dev.: 0.0092) MultiSource/Applications/d/make_dparser: 2.38% (3.1889 => 3.2649, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.38% (0.6135 => 0.6281, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.38% (4.4433 => 4.5490, std. dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.30% (0.8698 => 0.8898, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.26% (0.6283 => 0.6425, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.22% (1.1333 => 1.1585, std. dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.14% (2.1007 => 2.1457, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.05% (14.5298 => 14.8281, std. dev.: 0.0159) MultiSource/Applications/SIBsim4/SIBsim4: 1.98% (1.2749 => 1.3001, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (3.2742 => 3.3135, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.02% (1.5188 => 1.5343, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.76% (1.8175 => 2.2676, std. dev.: 0.0426) SingleSource/Benchmarks/Misc/mandel-2: 8.72% (1.2998 => 1.4131, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.15% (2.0200 => 2.1847, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9996 => 1.0782, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7333, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9200, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6793, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4562, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5089 => 1.5357, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.47% (3.6469 => 3.7005, std. dev.: 0.0083) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5105, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2143, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.28% (22.5627 => 21.1455, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.28% (0.3511 => 0.3396, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.30% (0.8818 => 0.8615, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.45% (0.0997 => 0.0843, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0962, std. dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (20.3410 => 18.6435, std. dev.: 0.0405) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3108, std. dev.: 0.0082) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.49% (1.9762 => 1.9072, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.8259 => 8.5789, std. dev.: 0.0146) SingleSource/Benchmarks/Dhrystone/dry: -2.52% (2.5089 => 2.4456, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5087, std. dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2574, std. dev.: 0.0173) MultiSource/Applications/spiff/spiff: -1.46% (3.0263 => 2.9822, std. dev.: 0.0010) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1326, std. dev.: 0.0193) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8645, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8433, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2145, std. dev.: 0.0410) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2503, std. dev.: 0.0073) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 22:41:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 00:41:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120706054128.E7B532A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1818?compare_to=1815&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1818, Order: 159804, Start Time: 2012-07-06 04:22:50, End Time: 2012-07-06 05:41:28 To: 1815, Order: 159797, Start Time: 2012-07-06 02:36:52, End Time: 2012-07-06 03:55:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (796 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.87% (10.3673 => 13.5674, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.01% (1.1194 => 1.2426, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 8.26% (0.3473 => 0.3760, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.07% (0.3543 => 0.3829, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 8.03% (0.1432 => 0.1547, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.02% (0.3543 => 0.3827, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 8.00% (0.3561 => 0.3846, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.96% (0.3516 => 0.3796, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.92% (0.3497 => 0.3774, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/for-in: 7.69% (0.3694 => 0.3978, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 7.46% (0.1622 => 0.1743, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.42% (0.3828 => 0.4112, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.38% (0.3927 => 0.4217, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 7.33% (0.3886 => 0.4171, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.20% (1.7609 => 1.8877, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.57% (2.2022 => 2.3469, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.28% (0.3177 => 0.3313, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.18% (7.0540 => 7.3487, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.16% (0.4879 => 0.5082, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 3.82% (0.3092 => 0.3210, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 3.51% (0.5925 => 0.6133, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 3.44% (0.3282 => 0.3395, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 3.43% (0.6030 => 0.6237, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.96% (0.5569 => 0.5734, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 2.93% (0.7326 => 0.7541, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.90% (0.4615 => 0.4749, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (0.8172 => 0.8401, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (10.4361 => 10.7245, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.68% (4.9449 => 5.0772, std. dev.: 0.0147) MultiSource/Applications/spiff/spiff: 2.62% (0.7835 => 0.8040, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.58% (2.0273 => 2.0797, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (14.3668 => 14.7367, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.51% (5.0018 => 5.1272, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.42% (4.2646 => 4.3678, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.39% (0.5860 => 0.6000, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.38% (0.8067 => 0.8259, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 2.34% (9.4845 => 9.7064, std. dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.34% (1.1861 => 1.2138, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.08% (1.1642 => 1.1884, std. dev.: 0.0060) MultiSource/Applications/d/make_dparser: 2.07% (3.3354 => 3.4043, std. dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 2.03% (5.7591 => 5.8761, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.02% (8.1363 => 8.3005, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 1.77% (3.8723 => 3.9409, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.73% (1.5415 => 1.5681, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.71% (2.2024 => 2.2400, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.68% (1.3050 => 1.3269, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.57% (0.6450 => 0.6551, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.55% (17.1811 => 17.4470, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.55% (0.9765 => 0.9916, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.52% (1.4186 => 1.4402, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.50% (1.5603 => 1.5837, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.20% (1.5859 => 1.6050, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.01% (2.2969 => 2.3200, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9743, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7460, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 2.06% (26.0924 => 26.6312, std. dev.: 0.0212) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (1.5086 => 1.5368, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2360, std. dev.: 0.0353) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6891, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.52% (0.8651 => 0.1685, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.41% (5.2763 => 3.1443, std. dev.: 0.0141) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.51% (5.3855 => 3.6884, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.10% (5.3526 => 3.6881, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.85% (2.9384 => 2.5315, std. dev.: 0.0155) MultiSource/Applications/ClamAV/clamscan: -10.58% (22.1758 => 19.8304, std. dev.: 0.0192) SingleSource/UnitTests/Vector/constpool: -5.31% (54.1659 => 51.2892, std. dev.: 0.0368) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.67% (3.8922 => 3.8273, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.30% (1.2373 => 1.1098, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.13% (19.9488 => 18.5265, std. dev.: 0.0848) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.00% (8.1563 => 7.9116, std. dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6893, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0840, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 5 23:29:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 01:29:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120706062953.3199F2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1819?compare_to=1817&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1819, Order: 159804, Start Time: 2012-07-06 05:15:23, End Time: 2012-07-06 06:29:52 To: 1817, Order: 159802, Start Time: 2012-07-06 03:33:42, End Time: 2012-07-06 04:47:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (130 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.35% (3.7727 => 3.8613, std. dev.: 0.0274) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.09% (55.4576 => 56.6152, std. dev.: 0.0647) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.47% (1.4131 => 1.3923, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.20% (2.0176 => 2.3042, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.35% (0.3130 => 0.3360, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 7.29% (0.7061 => 0.7576, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.08% (0.5818 => 0.6230, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.85% (0.5748 => 0.6142, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.42% (0.7038 => 0.7490, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 5.89% (1.3693 => 1.4500, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.64% (0.1986 => 0.2098, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.60% (0.5265 => 0.5560, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 5.48% (0.4328 => 0.4565, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.48% (0.2721 => 0.2870, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.43% (0.2596 => 0.2737, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.36% (3.9660 => 4.1784, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.30% (0.7710 => 0.8119, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.06% (0.3022 => 0.3175, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (0.2945 => 0.3094, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.95% (0.4062 => 0.4263, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 4.81% (0.3578 => 0.3750, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.80% (0.3899 => 0.4086, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.68% (0.6959 => 0.7285, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 4.67% (0.2781 => 0.2911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 4.67% (0.4003 => 0.4190, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.64% (0.3940 => 0.4123, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.62% (0.3914 => 0.4095, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 4.62% (0.3789 => 0.3964, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.62% (13.8202 => 14.4583, std. dev.: 0.0125) SingleSource/UnitTests/ObjC/exceptions-2: 4.61% (0.3601 => 0.3767, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.61% (0.3646 => 0.3814, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.56% (0.3489 => 0.3648, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 4.53% (0.3663 => 0.3829, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.53% (0.2782 => 0.2908, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.53% (0.3580 => 0.3742, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 4.50% (0.3623 => 0.3786, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.49% (0.3650 => 0.3814, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.45% (16.6129 => 17.3520, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.44% (0.9199 => 0.9607, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.42% (0.2690 => 0.2809, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.42% (0.3485 => 0.3639, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.38% (0.2966 => 0.3096, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.35% (0.2760 => 0.2880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.33% (0.2655 => 0.2770, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2726 => 0.2844, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.30% (0.2607 => 0.2719, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2628 => 0.2740, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.26% (1.9828 => 2.0673, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 4.26% (0.2937 => 0.3062, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.24% (0.2761 => 0.2878, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.20% (0.2765 => 0.2881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.18% (0.3107 => 0.3237, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.17% (13.2842 => 13.8380, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.07% (1.2193 => 1.2689, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.06% (0.3149 => 0.3277, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.04% (0.2696 => 0.2805, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.97% (0.2925 => 0.3041, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.93% (0.4016 => 0.4174, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.90% (0.3534 => 0.3672, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3192 => 0.3315, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.84% (0.5577 => 0.5791, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 3.82% (0.2988 => 0.3102, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 3.79% (0.3453 => 0.3584, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3246 => 0.3369, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.78% (1.4563 => 1.5114, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.78% (0.3756 => 0.3898, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.76% (1.3245 => 1.3743, std. dev.: 0.0122) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (3.8646 => 4.0061, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.65% (0.5637 => 0.5843, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.64% (0.3293 => 0.3413, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.55% (1.0594 => 1.0970, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.54% (1.1061 => 1.1453, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 3.53% (1.9270 => 1.9950, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.53% (1.1364 => 1.1765, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 3.52% (0.3868 => 0.4004, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4390 => 0.4544, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 3.48% (0.7506 => 0.7767, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.30% (4.9865 => 5.1511, std. dev.: 0.0169) MultiSource/Applications/siod/siod: 3.22% (2.1791 => 2.2493, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.19% (1.3813 => 1.4253, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 3.18% (0.8310 => 0.8574, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.12% (1.3819 => 1.4250, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.03% (0.7460 => 0.7686, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.00% (7.2180 => 7.4349, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.87% (1.2292 => 1.2645, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.78% (0.4791 => 0.4924, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.75% (3.6692 => 3.7700, std. dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 2.68% (6.5754 => 6.7519, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 2.63% (14.8535 => 15.2441, std. dev.: 0.0176) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.59% (0.6135 => 0.6294, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.43% (4.3801 => 4.4867, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 2.43% (16.2614 => 16.6560, std. dev.: 0.0246) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.37% (4.4433 => 4.5485, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.31% (0.8698 => 0.8899, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.30% (3.1889 => 3.2622, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.29% (1.1333 => 1.1593, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.23% (0.6283 => 0.6423, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.05% (2.1007 => 2.1437, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 2.04% (14.5298 => 14.8261, std. dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 1.95% (1.2749 => 1.2997, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.18% (3.2742 => 3.3128, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.06% (1.5188 => 1.5349, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2602, std. dev.: 0.0500) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.27% (2.0200 => 2.1870, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 7.12% (1.2998 => 1.3923, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.21% (7.4271 => 7.7400, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9197, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6793, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8291, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 2.34% (3.7731 => 3.8613, std. dev.: 0.0274) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5089 => 1.5360, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6469 => 3.7090, std. dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9551, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.41% (22.5627 => 21.1169, std. dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.22% (0.3511 => 0.3398, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.28% (0.8818 => 0.8617, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.27% (1.2308 => 1.1044, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.05% (20.3410 => 18.5007, std. dev.: 0.0677) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6075, std. dev.: 0.0091) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2508, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1125, std. dev.: 0.0392) MultiSource/Applications/spiff/spiff: -1.46% (3.0263 => 2.9822, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4889, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8437, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std. dev.: 0.0074) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2154, std. dev.: 0.0123) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2513, std. dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.3305 => 7.2546, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 00:53:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 02:53:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120706075347.EC4BD2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1820?compare_to=1816&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1820, Order: 159804, Start Time: 2012-07-06 05:08:03, End Time: 2012-07-06 07:53:46 To: 1816, Order: 159797, Start Time: 2012-07-06 01:57:12, End Time: 2012-07-06 04:40:34 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (41 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (852 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.39% (54.0876 => 54.8387, std. dev.: 0.0519) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.35% (0.3465 => 0.3789, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.34% (0.3446 => 0.3768, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 9.25% (0.3460 => 0.3780, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.22% (0.3469 => 0.3789, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.12% (0.3488 => 0.3806, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.10% (0.3496 => 0.3814, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.06% (0.3442 => 0.3754, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.74% (0.3650 => 0.3969, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.70% (0.3643 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.43% (0.3724 => 0.4038, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.53% (0.5826 => 0.6090, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 4.23% (0.5889 => 0.6138, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.90% (0.2566 => 0.2666, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.86% (0.5900 => 0.6128, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.71% (1.6211 => 1.6813, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.52% (0.4994 => 0.5170, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 3.47% (0.7171 => 0.7420, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (0.5026 => 0.5199, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.35% (0.4361 => 0.4507, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.28% (3.5627 => 3.6795, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: 3.18% (0.4029 => 0.4157, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.15% (1.3152 => 1.3566, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 2.92% (4.2109 => 4.3337, std. dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (0.3930 => 0.4041, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.82% (0.5000 => 0.5141, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.59% (1.9694 => 2.0204, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.49% (2.7292 => 2.7972, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.33% (1.9966 => 2.0431, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 2.29% (1.0781 => 1.1028, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (4.4195 => 4.5125, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.09% (2.0673 => 2.1105, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 2.08% (1.8794 => 1.9185, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 2.08% (0.6634 => 0.6772, std. dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 2.08% (23.5202 => 24.0092, std. dev.: 0.0219) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (2.1653 => 2.2083, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 1.96% (5.5417 => 5.6503, std. dev.: 0.0095) MultiSource/Applications/JM/lencod/lencod: 1.91% (4.6177 => 4.7060, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (2.1013 => 2.1378, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 1.71% (0.7875 => 0.8010, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 1.67% (0.9697 => 0.9859, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.58% (1.4269 => 1.4494, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.27% (11.9555 => 11.6846, std. dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 00:59:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 02:59:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120706075908.4F7312A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1821?compare_to=1818&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1821, Order: 159807, Start Time: 2012-07-06 06:36:43, End Time: 2012-07-06 07:59:06 To: 1818, Order: 159804, Start Time: 2012-07-06 04:22:50, End Time: 2012-07-06 05:41:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (56 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (801 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (0.8401 => 0.8536, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.99% (54.8455 => 56.4876, std. dev.: 0.1837) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.79% (10.3673 => 13.5594, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.01% (1.1194 => 1.2427, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 8.23% (0.3473 => 0.3759, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: 8.03% (0.1432 => 0.1547, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 7.98% (0.3497 => 0.3776, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/exceptions-4: 7.93% (0.3543 => 0.3824, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions-3: 7.91% (0.3516 => 0.3794, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/synchronized: 7.89% (0.3561 => 0.3842, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.85% (0.3543 => 0.3821, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/for-in: 7.74% (0.3694 => 0.3980, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/richards_benchmark: 7.46% (0.1622 => 0.1743, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.42% (0.3828 => 0.4112, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/property: 7.41% (0.3886 => 0.4174, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/parameter-passing: 7.41% (0.3927 => 0.4218, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.26% (1.7609 => 1.8887, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.60% (2.2022 => 2.3476, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.3177 => 0.3333, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.75% (0.2758 => 0.2889, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.45% (0.8172 => 0.8536, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.33% (7.0540 => 7.3597, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.22% (0.4879 => 0.5085, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 4.05% (0.7433 => 0.7734, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.90% (0.4615 => 0.4795, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.61% (0.5569 => 0.5770, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 3.49% (0.3092 => 0.3200, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 3.47% (0.3282 => 0.3396, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 3.25% (0.7835 => 0.8090, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.04% (4.9449 => 5.0950, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 2.82% (10.4361 => 10.7306, std. dev.: 0.0150) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.73% (5.0018 => 5.1385, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.60% (0.8067 => 0.8277, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.60% (14.3668 => 14.7406, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (4.2646 => 4.3695, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.42% (0.5860 => 0.6002, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 2.41% (1.1642 => 1.1923, std. dev.: 0.0084) MultiSource/Applications/d/make_dparser: 2.19% (3.3354 => 3.4086, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.19% (8.1363 => 8.3145, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 2.12% (3.8723 => 3.9543, std. dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.11% (0.6450 => 0.6586, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.10% (5.7591 => 5.8801, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.07% (1.1861 => 1.2107, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 2.06% (1.5603 => 1.5925, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.4186 => 1.4452, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.75% (1.3050 => 1.3279, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.65% (17.1811 => 17.4649, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.63% (2.2024 => 2.2384, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.56% (0.7115 => 0.7226, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.43% (2.2969 => 2.3298, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.14% (1.5859 => 1.6040, std. dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 1.06% (1.1840 => 1.1965, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7557, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.17% (26.0924 => 26.6587, std. dev.: 0.0157) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (1.5086 => 1.5394, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6895, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2320, std. dev.: 0.0392) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.53% (0.8651 => 0.1684, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.45% (5.2763 => 3.1420, std. dev.: 0.0105) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.47% (5.3855 => 3.6905, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.98% (5.3526 => 3.6943, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.78% (2.9384 => 2.5335, std. dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: -10.39% (22.1758 => 19.8712, std. dev.: 0.0374) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.07% (3.8922 => 3.8115, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.49% (1.2373 => 1.1075, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.88% (19.9488 => 18.3761, std. dev.: 0.1178) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (8.1563 => 7.9174, std. dev.: 0.0160) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6877, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0840, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.06% (1.3677 => 1.3532, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 01:13:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 03:13:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120706081331.135D22A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1822?compare_to=1819&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1822, Order: 159807, Start Time: 2012-07-06 06:57:32, End Time: 2012-07-06 08:13:29 To: 1819, Order: 159804, Start Time: 2012-07-06 05:15:23, End Time: 2012-07-06 06:29:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (103 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (753 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.33% (80.3072 => 81.3761, std. dev.: 0.2781) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.30% (3.8613 => 3.7724, std. dev.: 0.0196) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.29% (2.0176 => 2.3059, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.35% (0.3130 => 0.3360, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.22% (0.7061 => 0.7571, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 6.98% (0.5818 => 0.6224, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.80% (0.5748 => 0.6139, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 6.37% (0.7038 => 0.7486, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 6.05% (1.3693 => 1.4521, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.89% (0.1986 => 0.2103, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.70% (0.2721 => 0.2876, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 5.68% (0.4328 => 0.4574, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.64% (0.7710 => 0.8145, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.64% (0.5265 => 0.5562, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.59% (0.2596 => 0.2741, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.46% (3.9660 => 4.1826, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.46% (0.2655 => 0.2800, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (0.2945 => 0.3099, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.18% (0.3899 => 0.4101, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.87% (0.6959 => 0.7298, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 4.86% (0.3578 => 0.3752, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.80% (0.3580 => 0.3752, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.79% (0.2966 => 0.3108, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.73% (0.3914 => 0.4099, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-2: 4.72% (0.3601 => 0.3771, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.72% (0.3646 => 0.3818, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.70% (0.4003 => 0.4191, std. dev.: 0.0029) SingleSource/Regression/C++/ofstream_ctor: 4.67% (0.2781 => 0.2911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.67% (0.3789 => 0.3966, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.65% (0.2690 => 0.2815, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.64% (0.2782 => 0.2911, std. dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 4.63% (16.6129 => 17.3815, std. dev.: 0.0249) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.61% (0.3489 => 0.3650, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.60% (0.3650 => 0.3818, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 4.57% (0.3940 => 0.4120, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 4.56% (13.8202 => 14.4503, std. dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.55% (1.9828 => 2.0730, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/synchronized: 4.53% (0.3663 => 0.3829, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.46% (0.9199 => 0.9609, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.45% (0.2761 => 0.2884, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-3: 4.42% (0.3623 => 0.3783, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.39% (0.2937 => 0.3066, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.23% (0.5577 => 0.5813, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.19% (13.2842 => 13.8413, std. dev.: 0.0164) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.15% (1.4563 => 1.5168, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 4.14% (0.2925 => 0.3046, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.13% (1.2193 => 1.2697, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.03% (0.4390 => 0.4567, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 3.92% (0.2988 => 0.3105, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.91% (1.3245 => 1.3763, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 3.89% (3.8646 => 4.0151, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.82% (0.3246 => 0.3370, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (1.1364 => 1.1782, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.65% (0.5637 => 0.5843, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.58% (0.7506 => 0.7775, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.55% (1.9270 => 1.9954, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 3.53% (1.1061 => 1.1452, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.52% (0.4379 => 0.4533, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.47% (0.2914 => 0.3015, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.36% (1.3813 => 1.4277, std. dev.: 0.0169) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.22% (0.7460 => 0.7700, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.12% (7.2180 => 7.4434, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.10% (1.3819 => 1.4247, std. dev.: 0.0034) MultiSource/Applications/siod/siod: 3.09% (2.1791 => 2.2465, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/football/football: 3.09% (0.8310 => 0.8567, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.98% (3.6692 => 3.7787, std. dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 2.79% (14.8535 => 15.2672, std. dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (6.5754 => 6.7528, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.66% (4.3801 => 4.4967, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.62% (0.6135 => 0.6296, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 2.58% (0.4113 => 0.4219, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.53% (3.1889 => 3.2695, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.44% (16.2614 => 16.6583, std. dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.29% (1.1333 => 1.1592, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.13% (14.5298 => 14.8395, std. dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 2.00% (1.2749 => 1.3004, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 95.34% (0.1824 => 0.3563, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/fbench: 25.38% (1.8175 => 2.2787, std. dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.30% (2.0200 => 2.1876, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: 6.82% (1.2998 => 1.3884, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 4.17% (7.4271 => 7.7369, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9227, std. dev.: 0.0337) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6785, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4802, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0260) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.91% (3.6469 => 3.7164, std. dev.: 0.0196) MultiSource/Applications/lemon/lemon: 1.87% (1.4298 => 1.4566, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5330, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5073, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 1.26% (10.7476 => 10.8827, std. dev.: 0.0422) SingleSource/Benchmarks/Dhrystone/fldry: 1.13% (1.9290 => 1.9508, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.34% (22.5627 => 21.1315, std. dev.: 0.0267) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.94% (0.2670 => 0.2538, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3511 => 0.3399, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.95% (0.8818 => 0.8646, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.05% (0.0997 => 0.0837, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2308 => 1.1041, std. dev.: 0.0169) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.71% (20.3410 => 18.5695, std. dev.: 0.0382) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6013, std. dev.: 0.0118) SingleSource/Benchmarks/Dhrystone/dry: -2.52% (2.5089 => 2.4456, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5078, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2450, std. dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.61% (3.9173 => 3.8544, std. dev.: 0.0132) MultiSource/Applications/spiff/spiff: -1.52% (3.0263 => 2.9804, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1497, std. dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8430, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.30% (0.9692 => 0.9566, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2547, std. dev.: 0.0047) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2300, std. dev.: 0.0248) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 03:00:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 05:00:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120706100045.50A592A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1823?compare_to=1822&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1823, Order: 159809, Start Time: 2012-07-06 08:46:30, End Time: 2012-07-06 10:00:43 To: 1822, Order: 159807, Start Time: 2012-07-06 06:57:32, End Time: 2012-07-06 08:13:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (129 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (728 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.72% (81.3761 => 79.1608, std. dev.: 0.6521) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.19% (2.0176 => 2.3039, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.44% (0.3130 => 0.3363, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.32% (0.7061 => 0.7578, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.13% (0.5818 => 0.6233, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 6.91% (0.5748 => 0.6145, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.51% (0.7038 => 0.7496, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.94% (1.3693 => 1.4507, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.64% (0.1986 => 0.2098, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.62% (0.2721 => 0.2874, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.52% (0.4328 => 0.4567, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.47% (0.7710 => 0.8132, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.43% (0.5265 => 0.5551, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.35% (0.2596 => 0.2735, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.30% (3.9660 => 4.1762, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (0.2945 => 0.3096, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.92% (0.4062 => 0.4262, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.86% (0.3022 => 0.3169, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.85% (0.2781 => 0.2916, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.80% (0.6959 => 0.7293, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: 4.73% (0.3914 => 0.4099, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 4.72% (0.3578 => 0.3747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.72% (0.4003 => 0.4192, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 4.72% (0.3940 => 0.4126, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.69% (0.3899 => 0.4082, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 4.64% (0.3663 => 0.3833, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 4.64% (0.3646 => 0.3815, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.63% (0.3650 => 0.3819, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/for-in: 4.62% (0.3789 => 0.3964, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.61% (0.3489 => 0.3650, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.60% (0.2760 => 0.2887, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.59% (0.2966 => 0.3102, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.58% (13.8202 => 14.4530, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.57% (0.2782 => 0.2909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.53% (0.3601 => 0.3764, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 4.50% (0.3623 => 0.3786, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.47% (0.3580 => 0.3740, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.46% (0.2690 => 0.2810, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.44% (0.2726 => 0.2847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.43% (0.2937 => 0.3067, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.41% (0.2607 => 0.2722, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.40% (1.9828 => 2.0700, std. dev.: 0.0097) MultiSource/Applications/kimwitu++/kc: 4.39% (16.6129 => 17.3419, std. dev.: 0.0310) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.37% (0.2655 => 0.2771, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.34% (0.9199 => 0.9598, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.33% (0.3485 => 0.3636, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2765 => 0.2884, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.30% (0.2628 => 0.2741, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.28% (0.4390 => 0.4578, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 4.24% (0.2761 => 0.2878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.18% (0.3107 => 0.3237, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.18% (13.2842 => 13.8393, std. dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.10% (1.2193 => 1.2693, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.10% (0.3149 => 0.3278, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.08% (0.2696 => 0.2806, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.98% (0.4016 => 0.4176, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.96% (0.5577 => 0.5798, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/sieve: 3.94% (0.3453 => 0.3589, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.93% (0.2925 => 0.3040, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.88% (0.3534 => 0.3671, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.80% (0.3293 => 0.3418, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 3.79% (0.3192 => 0.3313, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.75% (0.2988 => 0.3100, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (1.3245 => 1.3741, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.73% (0.3756 => 0.3896, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.70% (1.4563 => 1.5102, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.70% (0.3246 => 0.3366, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.67% (0.3868 => 0.4010, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.59% (3.8646 => 4.0033, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.58% (0.5637 => 0.5839, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.58% (1.0594 => 1.0973, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.57% (1.1364 => 1.1770, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.52% (0.4379 => 0.4533, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.44% (1.9270 => 1.9933, std. dev.: 0.0130) MultiSource/Applications/spiff/spiff: 3.44% (0.7506 => 0.7764, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 3.38% (1.1061 => 1.1435, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.37% (4.9865 => 5.1544, std. dev.: 0.0046) MultiSource/Applications/siod/siod: 3.22% (2.1791 => 2.2492, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.20% (1.3819 => 1.4261, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.17% (1.3813 => 1.4251, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 3.09% (0.8310 => 0.8567, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.08% (0.7460 => 0.7690, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.00% (7.2180 => 7.4342, std. dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 2.86% (1.2292 => 1.2644, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.84% (0.4791 => 0.4927, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.74% (3.6692 => 3.7698, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 2.69% (14.8535 => 15.2527, std. dev.: 0.0120) MultiSource/Applications/JM/ldecod/ldecod: 2.61% (6.5754 => 6.7469, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.56% (0.6135 => 0.6292, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.42% (16.2614 => 16.6549, std. dev.: 0.0188) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.39% (4.3801 => 4.4846, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.37% (4.4433 => 4.5484, std. dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.32% (0.6283 => 0.6429, std. dev.: 0.0050) MultiSource/Applications/d/make_dparser: 2.28% (3.1889 => 3.2615, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.26% (1.1333 => 1.1589, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.24% (0.8698 => 0.8893, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.06% (14.5298 => 14.8297, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.92% (1.2749 => 1.2994, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.89% (2.1007 => 2.1403, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.25% (3.2742 => 3.3150, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.48% (1.8175 => 2.2624, std. dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1919, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: 7.72% (1.2998 => 1.4002, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.72% (0.9996 => 1.0768, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.7000, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.88% (7.4271 => 7.7151, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.72% (11.2619 => 11.6812, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4800, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1896, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.78% (3.6469 => 3.7117, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5343, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.61% (1.9433 => 1.9745, std. dev.: 0.0086) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1964, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.34% (22.5627 => 21.1326, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.06% (0.2670 => 0.2535, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3511 => 0.3399, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.05% (0.0997 => 0.0847, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1126, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.97% (20.3410 => 18.5170, std. dev.: 0.0347) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.53% (1.9762 => 1.9065, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5874, std. dev.: 0.0062) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5036, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2499, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8574, std. dev.: 0.0083) MultiSource/Applications/spiff/spiff: -1.49% (3.0263 => 2.9811, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1314, std. dev.: 0.0353) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8453, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2126, std. dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.29% (0.9692 => 0.9567, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2554, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 03:05:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 05:05:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120706100524.A1B1F2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1824?compare_to=1821&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1824, Order: 159809, Start Time: 2012-07-06 08:46:39, End Time: 2012-07-06 10:05:24 To: 1821, Order: 159807, Start Time: 2012-07-06 06:36:43, End Time: 2012-07-06 07:59:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (58 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (798 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.31% (77.7992 => 80.3722, std. dev.: 0.5033) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.06% (18.3761 => 18.5710, std. dev.: 0.0478) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.11% (56.4876 => 55.2952, std. dev.: 0.3101) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.73% (10.3673 => 13.5535, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.18% (1.1194 => 1.2445, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/trivial-interface: 8.35% (0.3473 => 0.3763, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.13% (0.3543 => 0.3831, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 8.04% (0.3497 => 0.3778, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 8.03% (0.1432 => 0.1547, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3543 => 0.3823, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 7.88% (0.3516 => 0.3793, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 7.83% (0.3561 => 0.3840, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.69% (0.3694 => 0.3978, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.59% (0.3927 => 0.4225, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 7.52% (0.1622 => 0.1744, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.47% (0.3828 => 0.4114, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.39% (0.3886 => 0.4173, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.23% (1.7609 => 1.8883, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.63% (2.2022 => 2.3482, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.66% (0.3177 => 0.3325, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.4879 => 0.5087, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.18% (7.0540 => 7.3492, std. dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 4.08% (0.7433 => 0.7736, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 3.60% (0.3282 => 0.3400, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 3.58% (0.5925 => 0.6137, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.47% (0.6030 => 0.6239, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.97% (0.8172 => 0.8415, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference: 2.89% (0.7326 => 0.7538, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.82% (0.5569 => 0.5726, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.78% (0.5860 => 0.6023, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (10.4361 => 10.7243, std. dev.: 0.0176) MultiSource/Applications/spiff/spiff: 2.59% (0.7835 => 0.8038, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.58% (4.9449 => 5.0726, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.56% (5.0018 => 5.1299, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.56% (14.3668 => 14.7343, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 2.33% (9.4845 => 9.7052, std. dev.: 0.0089) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.32% (4.2646 => 4.3635, std. dev.: 0.0058) MultiSource/Applications/treecc/treecc: 2.29% (2.0273 => 2.0737, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.17% (8.1363 => 8.3132, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.17% (0.8067 => 0.8242, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 2.06% (5.7591 => 5.8775, std. dev.: 0.0047) MultiSource/Applications/d/make_dparser: 2.04% (3.3354 => 3.4034, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.04% (1.1642 => 1.1879, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.97% (1.5415 => 1.5718, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.94% (1.1861 => 1.2091, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 1.91% (3.8723 => 3.9463, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.80% (0.6450 => 0.6566, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.72% (1.3050 => 1.3275, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.60% (2.2024 => 2.2376, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.58% (0.9765 => 0.9919, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.57% (1.5603 => 1.5848, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.56% (17.1811 => 17.4491, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.52% (1.4186 => 1.4401, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 1.08% (2.2969 => 2.3218, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (3.6395 => 3.7601, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 2.06% (26.0924 => 26.6304, std. dev.: 0.0212) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (1.5086 => 1.5362, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4472, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2387, std. dev.: 0.0341) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6902, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.42% (5.2763 => 3.1437, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.55% (5.3855 => 3.6865, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.08% (5.3526 => 3.6889, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.91% (2.9384 => 2.5298, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -10.54% (22.1758 => 19.8392, std. dev.: 0.0159) SingleSource/UnitTests/Vector/constpool: -5.21% (54.1659 => 51.3430, std. dev.: 0.0676) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.06% (3.8922 => 3.8122, std. dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -9.71% (1.2373 => 1.1172, std. dev.: 0.0253) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.91% (19.9488 => 18.5710, std. dev.: 0.0478) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (8.1563 => 7.9111, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6807, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0849, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 04:04:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 06:04:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120706110442.2F1A92A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/1825?compare_to=1820&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1825, Order: 159807, Start Time: 2012-07-06 08:21:32, End Time: 2012-07-06 11:04:43 To: 1820, Order: 159804, Start Time: 2012-07-06 05:08:03, End Time: 2012-07-06 07:53:46 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (42 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (851 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 9.45% (0.3460 => 0.3787, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 9.38% (0.3465 => 0.3790, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.37% (0.3446 => 0.3769, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.20% (0.3469 => 0.3788, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.12% (0.3496 => 0.3815, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.09% (0.3442 => 0.3755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.03% (0.3488 => 0.3803, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 8.79% (0.3650 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.73% (0.3643 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.43% (0.3724 => 0.4038, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.63% (0.5826 => 0.6096, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 4.25% (0.5889 => 0.6139, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.66% (1.6211 => 1.6804, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.51% (0.4361 => 0.4514, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.31% (3.5627 => 3.6806, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 3.12% (0.7171 => 0.7395, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.09% (1.3152 => 1.3558, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 3.06% (4.2109 => 4.3396, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (0.5026 => 0.5179, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.03% (0.5900 => 0.6079, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 3.03% (0.4029 => 0.4151, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.88% (0.3930 => 0.4043, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.82% (0.4994 => 0.5135, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.66% (0.4658 => 0.4782, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.54% (0.5000 => 0.5127, std. dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.53% (2.7292 => 2.7982, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.37% (1.9694 => 2.0160, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.32% (1.9966 => 2.0430, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 2.32% (1.0781 => 1.1031, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 2.15% (23.5202 => 24.0252, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (4.4195 => 4.5124, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 2.00% (0.9909 => 1.0107, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 1.94% (5.5417 => 5.6494, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.90% (2.0673 => 2.1066, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 1.89% (2.1653 => 2.2063, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.86% (1.8794 => 1.9143, std. dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 1.84% (4.6177 => 4.7028, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (2.1013 => 2.1364, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 1.62% (0.9697 => 0.9854, std. dev.: 0.0053) MultiSource/Applications/treecc/treecc: 1.61% (0.7875 => 0.8002, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.55% (1.4269 => 1.4490, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 4.71% (0.2122 => 0.2222, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.25% (11.9555 => 11.6865, std. dev.: 0.0118) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 04:42:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 06:42:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120706114226.DEB832A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1826?compare_to=1823&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1826, Order: 159811, Start Time: 2012-07-06 10:28:19, End Time: 2012-07-06 11:42:26 To: 1823, Order: 159809, Start Time: 2012-07-06 08:46:30, End Time: 2012-07-06 10:00:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.23% (3.7659 => 3.8122, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.88% (56.5275 => 54.3347, std. dev.: 0.7146) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.74% (2.0176 => 2.2949, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.51% (0.7061 => 0.7591, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 7.43% (0.5818 => 0.6250, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.19% (0.5748 => 0.6161, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.87% (0.7038 => 0.7451, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.74% (0.1986 => 0.2100, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.61% (1.3693 => 1.4461, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.54% (0.7710 => 0.8137, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 5.50% (0.4328 => 0.4566, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.45% (0.3578 => 0.3773, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.36% (0.5265 => 0.5547, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 5.35% (0.4003 => 0.4217, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.34% (0.3914 => 0.4123, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.32% (0.3646 => 0.3840, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 5.28% (0.3789 => 0.3989, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.28% (0.2596 => 0.2733, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-2: 5.28% (0.3601 => 0.3791, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.27% (0.3623 => 0.3814, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.25% (0.3940 => 0.4147, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 5.24% (0.3663 => 0.3855, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.15% (0.3650 => 0.3838, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.15% (3.9660 => 4.1701, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.15% (0.2721 => 0.2861, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.87% (0.6959 => 0.7298, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 4.78% (0.4062 => 0.4256, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.74% (0.2782 => 0.2914, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.70% (0.3489 => 0.3653, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.70% (0.3022 => 0.3164, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 4.64% (0.2781 => 0.2910, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.61% (0.2690 => 0.2814, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.60% (0.2607 => 0.2727, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.52% (0.2966 => 0.3100, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.48% (0.2655 => 0.2774, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3485 => 0.3641, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.3899 => 0.4073, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.46% (0.2760 => 0.2883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.45% (0.2628 => 0.2745, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 4.40% (13.8202 => 14.4287, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.38% (0.9199 => 0.9602, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.38% (1.9828 => 2.0696, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2726 => 0.2844, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.30% (0.2696 => 0.2812, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.27% (0.3580 => 0.3733, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.20% (0.2761 => 0.2877, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.20% (0.2765 => 0.2881, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.18% (16.6129 => 17.3077, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ary: 4.12% (0.3107 => 0.3235, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.06% (0.3149 => 0.3277, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.91% (13.2842 => 13.8031, std. dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.86% (0.4016 => 0.4171, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: 3.79% (0.3453 => 0.3584, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 3.79% (0.3534 => 0.3668, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/09-vor/vor: 3.76% (0.2925 => 0.3035, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (1.2193 => 1.2647, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.70% (0.3756 => 0.3895, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.69% (0.5577 => 0.5783, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 3.65% (0.2988 => 0.3097, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.64% (0.7506 => 0.7779, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 3.63% (0.3192 => 0.3308, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.62% (1.3245 => 1.3724, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.61% (0.3293 => 0.3412, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.60% (3.8646 => 4.0036, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3868 => 0.4007, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.58% (1.4563 => 1.5084, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.57% (0.3246 => 0.3362, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.51% (0.5637 => 0.5835, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.45% (0.4379 => 0.4530, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.43% (1.1061 => 1.1440, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.37% (0.4390 => 0.4538, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 3.31% (1.9270 => 1.9907, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.29% (1.1364 => 1.1738, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.26% (4.9865 => 5.1492, std. dev.: 0.0189) MultiSource/Benchmarks/nbench/nbench: 3.24% (1.0594 => 1.0937, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.00% (1.3819 => 1.4234, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.99% (0.7460 => 0.7683, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.95% (1.3813 => 1.4221, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.94% (7.2180 => 7.4302, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 2.80% (2.1791 => 2.2402, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 2.77% (1.2292 => 1.2632, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.48% (3.6692 => 3.7603, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.42% (4.3801 => 4.4860, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.41% (0.6135 => 0.6283, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.40% (0.4791 => 0.4906, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (6.5754 => 6.7323, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 2.35% (14.8535 => 15.2024, std. dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.18% (1.1333 => 1.1580, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.16% (4.4433 => 4.5392, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 2.12% (16.2614 => 16.6064, std. dev.: 0.0061) MultiSource/Applications/d/make_dparser: 2.08% (3.1889 => 3.2553, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.8698 => 0.8863, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (2.1007 => 2.1398, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 1.85% (1.2749 => 1.2985, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 1.81% (14.5298 => 14.7921, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.73% (0.6283 => 0.6392, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.11% (1.8175 => 2.2920, std. dev.: 0.0389) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1916, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.46% (1.5824 => 1.7004, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: 7.25% (1.2998 => 1.3941, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7296, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9195, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6788, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.05% (4.1080 => 4.1924, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.63% (3.6469 => 3.7062, std. dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5119, std. dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.04% (3.7731 => 3.8122, std. dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.58% (22.5627 => 21.0782, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.79% (0.3511 => 0.3378, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.25% (0.9108 => 0.8994, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.62% (1.0460 => 0.8617, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.64% (1.2308 => 1.1121, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.52% (20.3410 => 18.6073, std. dev.: 0.0376) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.55% (1.3780 => 1.3153, std. dev.: 0.0072) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5988, std. dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5136, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2520, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.54% (3.0263 => 2.9798, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8579, std. dev.: 0.0041) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1349, std. dev.: 0.0153) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8446, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.27% (0.9692 => 0.9569, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2568, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: -1.05% (9.3358 => 9.2374, std. dev.: 0.0315) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 04:51:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 06:51:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120706115143.2E2852A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1827?compare_to=1824&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1827, Order: 159811, Start Time: 2012-07-06 10:33:03, End Time: 2012-07-06 11:51:42 To: 1824, Order: 159809, Start Time: 2012-07-06 08:46:39, End Time: 2012-07-06 10:05:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (799 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.66% (10.3673 => 13.6495, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.93% (1.1194 => 1.2417, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.41% (0.3473 => 0.3765, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.18% (0.3497 => 0.3783, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.07% (0.3543 => 0.3829, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.03% (0.3561 => 0.3847, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.99% (0.3543 => 0.3826, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.96% (0.3516 => 0.3796, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 7.83% (0.1622 => 0.1749, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.77% (0.3694 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.60% (0.3828 => 0.4119, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.56% (0.3927 => 0.4224, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.46% (0.3886 => 0.4176, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.21% (1.7609 => 1.8879, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.62% (2.2022 => 2.3479, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.2065 => 0.2169, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.28% (0.3177 => 0.3313, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.24% (0.4879 => 0.5086, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (7.0540 => 7.3435, std. dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: 3.94% (0.7433 => 0.7726, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.54% (0.5925 => 0.6135, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 3.50% (0.6030 => 0.6241, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 3.41% (0.3282 => 0.3394, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.03% (10.4361 => 10.7525, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.84% (0.5569 => 0.5727, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.73% (0.4615 => 0.4741, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.58% (4.9449 => 5.0727, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.56% (0.8172 => 0.8381, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.50% (5.0018 => 5.1266, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (14.3668 => 14.7191, std. dev.: 0.0148) MultiSource/Applications/spiff/spiff: 2.41% (0.7835 => 0.8024, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.32% (0.5860 => 0.5996, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.25% (4.2646 => 4.3606, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 2.20% (9.4845 => 9.6936, std. dev.: 0.0133) MultiSource/Applications/treecc/treecc: 2.12% (2.0273 => 2.0703, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.04% (8.1363 => 8.3022, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 1.99% (5.7591 => 5.8735, std. dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.91% (0.8067 => 0.8221, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 1.89% (3.3354 => 3.3983, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.88% (1.1861 => 1.2084, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.87% (1.5415 => 1.5703, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 1.83% (1.1642 => 1.1855, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.71% (3.8723 => 3.9385, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.58% (1.3050 => 1.3256, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.48% (2.2024 => 2.2350, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.48% (17.1811 => 17.4349, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.47% (1.4186 => 1.4394, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.45% (0.9765 => 0.9907, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 1.45% (1.5603 => 1.5829, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7548, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 2.01% (26.0924 => 26.6165, std. dev.: 0.0219) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.81% (1.5086 => 1.5359, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 1.56% (9.1159 => 9.2581, std. dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4472, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6899, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.33% (5.2763 => 3.1483, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.65% (5.3855 => 3.6810, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.16% (5.3526 => 3.6847, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.98% (2.9384 => 2.5276, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -10.66% (22.1758 => 19.8116, std. dev.: 0.0298) SingleSource/UnitTests/Vector/constpool: -5.21% (54.1659 => 51.3420, std. dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.28% (3.8922 => 3.8035, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.03% (0.0998 => 0.0838, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -10.57% (1.2373 => 1.1065, std. dev.: 0.0217) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.01% (19.9488 => 18.5498, std. dev.: 0.0524) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.86% (8.1563 => 7.9232, std. dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6921, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0869, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 06:24:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 08:24:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120706132440.0F14D2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1828?compare_to=1826&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1828, Order: 159817, Start Time: 2012-07-06 12:10:14, End Time: 2012-07-06 13:24:39 To: 1826, Order: 159811, Start Time: 2012-07-06 10:28:19, End Time: 2012-07-06 11:42:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (126 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.98% (54.3347 => 56.4950, std. dev.: 0.1307) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.71% (2.0176 => 2.2942, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.59% (0.7061 => 0.7597, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.46% (0.5818 => 0.6252, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.13% (0.5748 => 0.6158, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.95% (0.7038 => 0.7457, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.79% (0.1986 => 0.2101, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.77% (0.5265 => 0.5569, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.71% (1.3693 => 1.4475, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 5.57% (0.4328 => 0.4569, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 5.48% (0.3578 => 0.3774, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.40% (0.3646 => 0.3843, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.40% (0.7710 => 0.8126, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 5.38% (0.3789 => 0.3993, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.37% (0.4003 => 0.4218, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.33% (0.3601 => 0.3793, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.2945 => 0.3101, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.27% (0.3623 => 0.3814, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.27% (0.3663 => 0.3856, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.26% (0.3914 => 0.4120, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.24% (0.2596 => 0.2732, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.23% (3.9660 => 4.1736, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.23% (0.3650 => 0.3841, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.18% (0.2721 => 0.2862, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.18% (0.3940 => 0.4144, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 5.02% (0.4062 => 0.4266, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.96% (0.2782 => 0.2920, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.86% (0.3022 => 0.3169, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2607 => 0.2733, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.80% (0.3899 => 0.4086, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.72% (0.2628 => 0.2752, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.71% (0.2655 => 0.2780, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.65% (0.2690 => 0.2815, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 4.64% (0.2760 => 0.2888, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.62% (0.2966 => 0.3103, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 4.60% (0.2937 => 0.3072, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.59% (0.3489 => 0.3649, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.56% (0.3485 => 0.3644, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.50% (1.9828 => 2.0720, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 4.50% (13.8202 => 14.4417, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.47% (0.6959 => 0.7270, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.45% (0.2696 => 0.2816, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.44% (0.3580 => 0.3739, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.44% (0.2726 => 0.2847, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.38% (0.2761 => 0.2882, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.33% (0.9199 => 0.9597, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.31% (0.3107 => 0.3241, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.29% (16.6129 => 17.3251, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary3: 4.22% (0.3149 => 0.3282, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.08% (0.4016 => 0.4180, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3453 => 0.3591, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.93% (0.3534 => 0.3673, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.92% (13.2842 => 13.8051, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/09-vor/vor: 3.90% (0.2925 => 0.3039, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3192 => 0.3315, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.83% (0.3293 => 0.3419, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.81% (0.3756 => 0.3899, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.77% (1.2193 => 1.2653, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 3.75% (0.2988 => 0.3100, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (1.3245 => 1.3741, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.73% (0.5577 => 0.5785, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.70% (0.3246 => 0.3366, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.69% (0.7506 => 0.7783, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.4563 => 1.5098, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4390 => 0.4550, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.46% (3.8646 => 3.9984, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.45% (1.1364 => 1.1756, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.5637 => 0.5831, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3220 => 0.3330, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 3.36% (1.9270 => 1.9917, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.31% (0.4379 => 0.4524, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.27% (1.1061 => 1.1423, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.19% (1.0594 => 1.0932, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.19% (1.3813 => 1.4253, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.05% (4.9865 => 5.1384, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.04% (7.2180 => 7.4373, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.01% (1.2292 => 1.2662, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.99% (0.7460 => 0.7683, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.93% (2.1791 => 2.2429, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.91% (1.3819 => 1.4221, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8310 => 0.8536, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3755 => 0.3856, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (6.5754 => 6.7388, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.48% (3.6692 => 3.7601, std. dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 2.45% (14.8535 => 15.2177, std. dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.43% (4.3801 => 4.4867, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.38% (0.4791 => 0.4905, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.28% (4.4433 => 4.5444, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 2.19% (16.2614 => 16.6168, std. dev.: 0.0239) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.18% (0.6135 => 0.6269, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.13% (1.1333 => 1.1574, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 2.04% (3.1889 => 3.2541, std. dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.02% (0.8698 => 0.8874, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6283 => 0.6398, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.81% (2.1007 => 2.1388, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 1.79% (14.5298 => 14.7903, std. dev.: 0.0085) MultiSource/Applications/SIBsim4/SIBsim4: 1.69% (1.2749 => 1.2965, std. dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2638, std. dev.: 0.0220) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1930, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.92% (0.9996 => 1.0788, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 6.78% (1.2998 => 1.3879, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7299, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6785, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8292, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (1.5089 => 1.5372, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4562, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9591, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.40% (3.6469 => 3.6981, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.54% (22.5627 => 21.0879, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.70% (0.3511 => 0.3381, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.72% (0.8818 => 0.8578, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.20% (0.9108 => 0.8999, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.42% (1.2308 => 1.1025, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.89% (20.3410 => 18.5337, std. dev.: 0.0675) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3081, std. dev.: 0.0075) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.61% (2.6470 => 2.5515, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5846, std. dev.: 0.0292) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4463, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.47% (0.4867 => 0.4747, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5111, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.55% (3.0263 => 2.9795, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2580, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0163) MultiSource/Benchmarks/mafft/pairlocalalign: -1.35% (28.2225 => 27.8422, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (0.9692 => 0.9564, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1681, std. dev.: 0.0190) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2158, std. dev.: 0.0188) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2489, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8492, std. dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: -1.01% (7.3305 => 7.2565, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 06:37:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 08:37:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120706133756.72DF02A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1829?compare_to=1827&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1829, Order: 159817, Start Time: 2012-07-06 12:19:26, End Time: 2012-07-06 13:37:56 To: 1827, Order: 159811, Start Time: 2012-07-06 10:33:03, End Time: 2012-07-06 11:51:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (799 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.59% (10.3673 => 13.6423, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.00% (1.1194 => 1.2425, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.29% (0.3473 => 0.3761, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.13% (0.3543 => 0.3831, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 8.09% (0.3497 => 0.3780, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.08% (0.3516 => 0.3800, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.04% (0.3543 => 0.3828, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.98% (0.3561 => 0.3845, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.77% (0.3694 => 0.3981, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.77% (0.1622 => 0.1748, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.50% (0.3828 => 0.4115, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.46% (0.3886 => 0.4176, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/parameter-passing: 7.46% (0.3927 => 0.4220, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.16% (1.7609 => 1.8869, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.59% (2.2022 => 2.3474, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.4879 => 0.5089, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.22% (0.3177 => 0.3311, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.16% (7.0540 => 7.3475, std. dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: 3.93% (0.7433 => 0.7725, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.58% (0.5925 => 0.6137, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 3.50% (0.6030 => 0.6241, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 3.47% (0.3282 => 0.3396, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (10.4361 => 10.7487, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.96% (0.8172 => 0.8414, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.89% (0.5569 => 0.5730, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 2.80% (0.7326 => 0.7531, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.77% (0.4615 => 0.4743, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.67% (5.0018 => 5.1354, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.54% (4.9449 => 5.0704, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.53% (14.3668 => 14.7297, std. dev.: 0.0079) MultiSource/Applications/spiff/spiff: 2.43% (0.7835 => 0.8025, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 2.31% (9.4845 => 9.7033, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.30% (0.5860 => 0.5995, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.24% (4.2646 => 4.3602, std. dev.: 0.0044) MultiSource/Applications/treecc/treecc: 2.06% (2.0273 => 2.0690, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.03% (8.1363 => 8.3013, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.98% (0.8067 => 0.8227, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 1.93% (5.7591 => 5.8704, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.90% (3.3354 => 3.3988, std. dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.87% (1.1861 => 1.2083, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.84% (1.5415 => 1.5698, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 1.82% (1.1642 => 1.1854, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.67% (3.8723 => 3.9371, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.66% (1.3050 => 1.3266, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.59% (1.5603 => 1.5851, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.57% (0.6450 => 0.6551, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.48% (2.2024 => 2.2351, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.40% (0.9765 => 0.9902, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.39% (17.1811 => 17.4206, std. dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.37% (1.4186 => 1.4381, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7501, std. dev.: 0.0068) MultiSource/Applications/lua/lua: 2.05% (26.0924 => 26.6281, std. dev.: 0.0265) MultiSource/Applications/minisat/minisat: 1.63% (9.1159 => 9.2644, std. dev.: 0.0187) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.17% (2.6546 => 2.6857, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.53% (0.8651 => 0.1684, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.32% (5.2763 => 3.1487, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.58% (5.3855 => 3.6845, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.11% (5.3526 => 3.6876, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.88% (2.9384 => 2.5305, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -10.64% (22.1758 => 19.8153, std. dev.: 0.0102) SingleSource/UnitTests/Vector/constpool: -5.23% (54.1659 => 51.3349, std. dev.: 0.0413) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.30% (3.8922 => 3.8028, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.40% (1.2373 => 1.1086, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.88% (19.9488 => 18.5762, std. dev.: 0.0282) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.72% (8.1563 => 7.9342, std. dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6937, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0837, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 07:15:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 09:15:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120706141514.B5FCF2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1830?compare_to=1825&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1830, Order: 159811, Start Time: 2012-07-06 11:32:10, End Time: 2012-07-06 14:15:14 To: 1825, Order: 159807, Start Time: 2012-07-06 08:21:32, End Time: 2012-07-06 11:04:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (41 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (852 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 6.73% (0.2260 => 0.2412, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.26% (2.0578 => 2.0838, std. dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 9.52% (0.3446 => 0.3774, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.47% (0.3465 => 0.3793, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.45% (0.3460 => 0.3787, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.40% (0.3469 => 0.3795, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.24% (0.3496 => 0.3819, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.21% (0.3442 => 0.3759, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.12% (0.3488 => 0.3806, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.81% (0.3643 => 0.3964, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.77% (0.3650 => 0.3970, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/parameter-passing: 8.62% (0.3724 => 0.4045, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.72% (0.5826 => 0.6101, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.47% (0.5889 => 0.6152, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (1.6211 => 1.6784, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.39% (3.5627 => 3.6834, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.32% (0.4361 => 0.4506, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.18% (0.7171 => 0.7399, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 3.06% (4.2109 => 4.3396, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.02% (0.5900 => 0.6078, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.00% (0.5026 => 0.5177, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.96% (1.3152 => 1.3541, std. dev.: 0.0047) MultiSource/Applications/spiff/spiff: 2.95% (0.4029 => 0.4148, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (0.3930 => 0.4041, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.78% (0.4994 => 0.5133, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.62% (2.7292 => 2.8008, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.46% (0.5000 => 0.5123, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.33% (1.0781 => 1.1032, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.31% (1.9694 => 2.0149, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.23% (1.9966 => 2.0411, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (4.4195 => 4.5155, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 2.10% (23.5202 => 24.0137, std. dev.: 0.0115) MultiSource/Applications/hexxagon/hexxagon: 1.92% (0.9909 => 1.0099, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 1.91% (2.1653 => 2.2066, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 1.85% (5.5417 => 5.6444, std. dev.: 0.0167) MultiSource/Applications/JM/lencod/lencod: 1.84% (4.6177 => 4.7027, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 1.77% (1.8794 => 1.9127, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 1.75% (2.1013 => 2.1381, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.70% (2.0673 => 2.1024, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.60% (0.7875 => 0.8001, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.52% (0.9697 => 0.9844, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 1.37% (1.4269 => 1.4465, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.96% (0.2122 => 0.2291, std. dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.45% (11.9555 => 11.6625, std. dev.: 0.0123) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 08:06:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 10:06:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120706150631.C63A92A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1831?compare_to=1828&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1831, Order: 159820, Start Time: 2012-07-06 13:52:18, End Time: 2012-07-06 15:06:32 To: 1828, Order: 159817, Start Time: 2012-07-06 12:10:14, End Time: 2012-07-06 13:24:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (126 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (728 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.11% (7.9786 => 8.0670, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.02% (3.8872 => 3.8477, std. dev.: 0.0144) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.69% (2.0176 => 2.2939, std. dev.: 0.0148) SingleSource/UnitTests/ObjC++/property-reference: 7.68% (0.7061 => 0.7603, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.39% (0.5818 => 0.6248, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.20% (0.5748 => 0.6162, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.00% (0.7038 => 0.7460, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.79% (0.1986 => 0.2101, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.65% (1.3693 => 1.4466, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.56% (0.3578 => 0.3777, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.50% (0.7710 => 0.8134, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.50% (0.4328 => 0.4566, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 5.50% (0.4003 => 0.4223, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.49% (0.5265 => 0.5554, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 5.40% (0.3646 => 0.3843, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.39% (0.2596 => 0.2736, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 5.38% (0.3789 => 0.3993, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.38% (0.3663 => 0.3860, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 5.37% (0.4062 => 0.4280, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.37% (0.3914 => 0.4124, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 5.33% (0.3601 => 0.3793, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.32% (0.3650 => 0.3844, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.2721 => 0.2865, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 5.28% (0.3940 => 0.4148, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 5.13% (0.3623 => 0.3809, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.13% (3.9660 => 4.1694, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2945 => 0.3093, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.85% (0.2782 => 0.2917, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.80% (0.3022 => 0.3167, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 4.78% (0.2781 => 0.2914, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.64% (0.2607 => 0.2728, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.63% (0.2655 => 0.2778, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.63% (0.2937 => 0.3073, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.59% (0.3899 => 0.4078, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 4.57% (0.2690 => 0.2813, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.55% (0.2966 => 0.3101, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.53% (0.6959 => 0.7274, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (0.3485 => 0.3642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.45% (0.2628 => 0.2745, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.3489 => 0.3643, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.40% (1.9828 => 2.0701, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 4.38% (13.8202 => 14.4252, std. dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/strcat: 4.37% (0.2726 => 0.2845, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.35% (0.2760 => 0.2880, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2765 => 0.2884, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.30% (0.3580 => 0.3734, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.27% (0.2761 => 0.2879, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.27% (0.2696 => 0.2811, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.18% (16.6129 => 17.3080, std. dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/ary: 4.15% (0.3107 => 0.3236, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.14% (0.9199 => 0.9580, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 4.13% (0.3149 => 0.3279, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.03% (0.4390 => 0.4567, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.88% (13.2842 => 13.7993, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.84% (1.2193 => 1.2661, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.83% (0.4016 => 0.4170, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.82% (0.3453 => 0.3585, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.82% (0.3534 => 0.3669, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.79% (0.2925 => 0.3036, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.76% (0.3192 => 0.3312, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.75% (0.3756 => 0.3897, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.73% (0.5577 => 0.5785, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 3.70% (0.3293 => 0.3415, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 3.68% (0.2988 => 0.3098, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.64% (0.3246 => 0.3364, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.57% (3.8646 => 4.0024, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.49% (0.5637 => 0.5834, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.49% (0.3868 => 0.4003, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.47% (1.4563 => 1.5069, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.43% (1.3245 => 1.3699, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 3.34% (0.7506 => 0.7757, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.34% (1.1364 => 1.1744, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.29% (0.4379 => 0.4523, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (4.9865 => 5.1504, std. dev.: 0.0157) MultiSource/Applications/treecc/treecc: 3.28% (1.9270 => 1.9903, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 3.22% (1.1061 => 1.1417, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.0594 => 1.0929, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.02% (1.3819 => 1.4236, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.01% (1.3813 => 1.4229, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.96% (7.2180 => 7.4318, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.86% (1.2292 => 1.2644, std. dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.84% (0.7460 => 0.7672, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.79% (2.1791 => 2.2398, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8310 => 0.8528, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.46% (3.6692 => 3.7596, std. dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.44% (0.4791 => 0.4908, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.36% (14.8535 => 15.2040, std. dev.: 0.0138) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (6.5754 => 6.7262, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.27% (4.3801 => 4.4796, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6135 => 0.6272, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.18% (4.4433 => 4.5402, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 2.15% (16.2614 => 16.6105, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.04% (3.1889 => 3.2541, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.93% (0.8698 => 0.8866, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.88% (0.6283 => 0.6401, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.78% (14.5298 => 14.7890, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (2.1007 => 2.1353, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.19% (1.8175 => 2.2572, std. dev.: 0.0551) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.36% (2.0200 => 2.1888, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: 8.09% (1.2998 => 1.4049, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.13% (7.4271 => 7.7337, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6793, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.10% (4.1080 => 4.1943, std. dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 1.98% (3.7731 => 3.8477, std. dev.: 0.0144) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4556, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5089 => 1.5324, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.47% (3.6469 => 3.7006, std. dev.: 0.0065) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5113, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1937, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.57% (22.5627 => 21.0812, std. dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.79% (0.3511 => 0.3378, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.53% (0.8818 => 0.8595, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.31% (0.9108 => 0.8989, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.65% (0.0997 => 0.0841, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.36% (1.2308 => 1.1033, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.22% (20.3410 => 18.4646, std. dev.: 0.0802) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.14% (1.3780 => 1.3072, std. dev.: 0.0075) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5856, std. dev.: 0.0117) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4477, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5096, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.58% (3.0263 => 2.9785, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2559, std. dev.: 0.0099) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.56% (2.5254 => 2.4859, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0020) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1416, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8430, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.19% (0.9692 => 0.9577, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2569, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2383, std. dev.: 0.0297) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8491, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 08:24:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 10:24:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120706152418.C20B22A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1832?compare_to=1829&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1832, Order: 159820, Start Time: 2012-07-06 14:05:31, End Time: 2012-07-06 15:24:19 To: 1829, Order: 159817, Start Time: 2012-07-06 12:19:26, End Time: 2012-07-06 13:37:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (58 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (798 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.39% (78.0915 => 81.5171, std. dev.: 0.9292) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.60% (10.3673 => 13.6430, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.97% (1.1194 => 1.2422, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.44% (0.3473 => 0.3766, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 8.17% (0.3561 => 0.3852, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.16% (0.3543 => 0.3832, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.08% (0.3516 => 0.3800, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.07% (0.3543 => 0.3829, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.06% (0.3497 => 0.3779, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.88% (0.3694 => 0.3985, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.77% (0.1622 => 0.1748, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.66% (0.3927 => 0.4228, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 7.65% (0.3828 => 0.4121, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.57% (0.3886 => 0.4180, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.16% (1.7609 => 1.8869, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.61% (2.2022 => 2.3478, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.28% (0.3177 => 0.3313, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.20% (0.4879 => 0.5084, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.19% (7.0540 => 7.3499, std. dev.: 0.0131) MultiSource/Applications/lambda-0_1_3/lambda: 3.78% (0.7433 => 0.7714, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 3.75% (0.5925 => 0.6147, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.55% (0.6030 => 0.6244, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 3.44% (0.3282 => 0.3395, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 3.40% (0.3092 => 0.3197, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 3.05% (10.4361 => 10.7542, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.93% (0.5569 => 0.5732, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.88% (0.8172 => 0.8407, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 2.85% (0.7326 => 0.7535, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.75% (0.4615 => 0.4742, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.59% (4.9449 => 5.0729, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.52% (5.0018 => 5.1280, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.47% (14.3668 => 14.7221, std. dev.: 0.0041) MultiSource/Applications/spiff/spiff: 2.43% (0.7835 => 0.8025, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 2.31% (9.4845 => 9.7032, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.25% (0.5860 => 0.5992, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.24% (4.2646 => 4.3602, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.12% (8.1363 => 8.3089, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 2.09% (2.0273 => 2.0697, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 1.96% (5.7591 => 5.8718, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.95% (3.3354 => 3.4006, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.92% (0.8067 => 0.8222, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 1.91% (1.1642 => 1.1864, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.90% (1.1861 => 1.2086, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.68% (3.8723 => 3.9374, std. dev.: 0.0159) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.65% (1.5415 => 1.5669, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.57% (1.3050 => 1.3255, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.56% (1.5603 => 1.5847, std. dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 1.48% (17.1811 => 17.4356, std. dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.47% (1.4186 => 1.4395, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.43% (2.2024 => 2.2340, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.40% (0.9765 => 0.9902, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7558, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 2.05% (26.0924 => 26.6285, std. dev.: 0.0334) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5086 => 1.5348, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.52% (9.1159 => 9.2546, std. dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6877, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.52% (0.8651 => 0.1685, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.32% (5.2763 => 3.1489, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.61% (5.3855 => 3.6830, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.11% (5.3526 => 3.6876, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.94% (2.9384 => 2.5289, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -10.58% (22.1758 => 19.8287, std. dev.: 0.0134) SingleSource/UnitTests/Vector/constpool: -5.15% (54.1659 => 51.3742, std. dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.23% (3.8922 => 3.8053, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.67% (1.2373 => 1.1053, std. dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.84% (19.9488 => 18.5834, std. dev.: 0.0235) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.88% (8.1563 => 7.9210, std. dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6782, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0819, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 09:48:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 11:48:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120706164828.DD1172A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1833?compare_to=1831&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1833, Order: 159826, Start Time: 2012-07-06 15:34:12, End Time: 2012-07-06 16:48:29 To: 1831, Order: 159820, Start Time: 2012-07-06 13:52:18, End Time: 2012-07-06 15:06:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (126 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (728 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.75% (2.0176 => 2.2951, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference-object: 7.36% (0.5818 => 0.6246, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.24% (0.7061 => 0.7572, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.06% (0.5748 => 0.6154, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.97% (0.7038 => 0.7458, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.94% (0.1986 => 0.2104, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.68% (1.3693 => 1.4471, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: 5.61% (0.4062 => 0.4290, std. dev.: 0.0086) SingleSource/UnitTests/ObjC/trivial-interface: 5.53% (0.3578 => 0.3776, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.48% (0.4328 => 0.4565, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.46% (0.3646 => 0.3845, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: 5.44% (0.3601 => 0.3797, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.43% (0.7710 => 0.8129, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 5.41% (0.3789 => 0.3994, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.40% (0.4003 => 0.4219, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 5.32% (0.3663 => 0.3858, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.28% (0.5265 => 0.5543, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.28% (0.2596 => 0.2733, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.26% (0.3914 => 0.4120, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.23% (0.3650 => 0.3841, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.18% (0.2721 => 0.2862, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 5.16% (0.3623 => 0.3810, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.13% (0.3940 => 0.4142, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.09% (3.9660 => 4.1680, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2945 => 0.3093, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.79% (0.2966 => 0.3108, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.71% (0.2781 => 0.2912, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.71% (0.2782 => 0.2913, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.70% (0.3022 => 0.3164, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.60% (0.2655 => 0.2777, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.54% (0.6959 => 0.7275, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 4.54% (0.2690 => 0.2812, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 4.49% (0.2628 => 0.2746, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3899 => 0.4074, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.47% (0.3580 => 0.3740, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (0.3485 => 0.3640, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3489 => 0.3642, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.37% (13.8202 => 14.4236, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/wc: 4.36% (0.2937 => 0.3065, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.32% (1.9828 => 2.0685, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 4.31% (0.2760 => 0.2879, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.29% (0.2726 => 0.2843, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.27% (0.2696 => 0.2811, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 4.25% (16.6129 => 17.3189, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.23% (0.2765 => 0.2882, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.17% (0.2761 => 0.2876, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.15% (0.4390 => 0.4572, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.12% (0.9199 => 0.9578, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary: 4.09% (0.3107 => 0.3234, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.03% (0.3149 => 0.3276, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.83% (13.2842 => 13.7936, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.83% (1.2193 => 1.2660, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: 3.82% (0.3534 => 0.3669, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.79% (0.3453 => 0.3584, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.78% (0.4016 => 0.4168, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.77% (0.3293 => 0.3417, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 3.76% (0.2925 => 0.3035, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.75% (0.3756 => 0.3897, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.73% (0.5577 => 0.5785, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (1.4563 => 1.5092, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 3.58% (0.2988 => 0.3095, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.57% (0.3192 => 0.3306, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.54% (0.3246 => 0.3361, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.51% (1.3245 => 1.3710, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.48% (0.5637 => 0.5833, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 3.42% (3.8646 => 3.9969, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.32% (1.1364 => 1.1741, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 3.31% (0.3868 => 0.3996, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.28% (0.7506 => 0.7752, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.22% (0.4379 => 0.4520, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.20% (1.0594 => 1.0933, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 3.16% (1.1061 => 1.1410, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 3.14% (1.9270 => 1.9875, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.96% (1.3813 => 1.4222, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.94% (0.7460 => 0.7679, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.91% (4.9865 => 5.1318, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.91% (7.2180 => 7.4278, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.90% (1.3819 => 1.4220, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 2.73% (1.2292 => 1.2628, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.69% (2.1791 => 2.2377, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8310 => 0.8528, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.47% (3.6692 => 3.7598, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.36% (0.4791 => 0.4904, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.36% (14.8535 => 15.2038, std. dev.: 0.0071) MultiSource/Applications/JM/ldecod/ldecod: 2.33% (6.5754 => 6.7287, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.28% (4.3801 => 4.4798, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 2.17% (16.2614 => 16.6141, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.09% (4.4433 => 4.5361, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 2.02% (3.1889 => 3.2534, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.98% (1.1333 => 1.1557, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.86% (0.8698 => 0.8860, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.78% (14.5298 => 14.7879, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.77% (0.6283 => 0.6394, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (2.1007 => 2.1341, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2937, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2612, std. dev.: 0.0230) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.30% (2.0200 => 2.1877, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.90% (1.2998 => 1.3895, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.91% (7.4271 => 7.7174, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9194, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6789, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8319, std. dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0076) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.59% (1.5089 => 1.5329, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.47% (3.6469 => 3.7004, std. dev.: 0.0084) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.22% (1.9290 => 1.9526, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.5627 => 21.0499, std. dev.: 0.0171) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.56% (0.3511 => 0.3386, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.8818 => 0.8581, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.34% (0.9108 => 0.8986, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.13% (1.2308 => 1.1061, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.59% (20.3410 => 18.5934, std. dev.: 0.0202) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.22% (1.3780 => 1.3061, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.40% (8.8259 => 8.6145, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2528, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1089, std. dev.: 0.0197) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.48% (2.5254 => 2.4879, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8594, std. dev.: 0.0078) MultiSource/Applications/spiff/spiff: -1.45% (3.0263 => 2.9824, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8448, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2275, std. dev.: 0.0249) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2563, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8475, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 10:10:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 12:10:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120706171034.EEF902A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1834?compare_to=1832&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1834, Order: 159826, Start Time: 2012-07-06 15:52:00, End Time: 2012-07-06 17:10:35 To: 1832, Order: 159820, Start Time: 2012-07-06 14:05:31, End Time: 2012-07-06 15:24:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (796 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.54% (10.3673 => 13.6375, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.01% (1.1194 => 1.2426, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.26% (0.3473 => 0.3760, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.17% (0.3561 => 0.3852, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.11% (0.3516 => 0.3801, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.09% (0.3497 => 0.3780, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.07% (0.3543 => 0.3829, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.07% (0.3543 => 0.3829, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 7.96% (0.3694 => 0.3988, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.77% (0.1622 => 0.1748, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 7.64% (0.3886 => 0.4183, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.58% (0.3828 => 0.4118, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.3927 => 0.4221, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.29% (1.7609 => 1.8893, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.68% (2.2022 => 2.3492, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.28% (0.3177 => 0.3313, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.24% (0.4879 => 0.5086, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.14% (7.0540 => 7.3460, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 3.70% (0.7433 => 0.7708, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 3.63% (0.6030 => 0.6249, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: 3.63% (0.5925 => 0.6140, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 3.41% (0.3282 => 0.3394, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 2.98% (10.4361 => 10.7470, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.89% (0.5569 => 0.5730, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 2.87% (0.7326 => 0.7536, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.71% (0.4615 => 0.4740, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.58% (0.8172 => 0.8383, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.54% (0.5860 => 0.6009, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (4.9449 => 5.0699, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.47% (5.0018 => 5.1255, std. dev.: 0.0045) MultiSource/Applications/spiff/spiff: 2.46% (0.7835 => 0.8028, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (14.3668 => 14.7186, std. dev.: 0.0209) MultiSource/Benchmarks/mafft/pairlocalalign: 2.37% (9.4845 => 9.7095, std. dev.: 0.0079) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.18% (4.2646 => 4.3576, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.13% (2.0273 => 2.0704, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.07% (8.1363 => 8.3050, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.98% (0.8067 => 0.8227, std. dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 1.96% (5.7591 => 5.8720, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.91% (1.1861 => 1.2088, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.89% (3.3354 => 3.3986, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 1.88% (1.1642 => 1.1861, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.80% (1.5415 => 1.5692, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.71% (3.8723 => 3.9386, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.61% (0.9765 => 0.9922, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.59% (1.3050 => 1.3257, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.58% (0.6450 => 0.6552, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.46% (17.1811 => 17.4327, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (2.2024 => 2.2346, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 1.40% (1.5603 => 1.5821, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.38% (1.4186 => 1.4382, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 1.02% (2.2969 => 2.3204, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.10% (2.6778 => 2.9750, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7528, std. dev.: 0.0047) MultiSource/Applications/lua/lua: 2.13% (26.0924 => 26.6488, std. dev.: 0.0143) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5086 => 1.5355, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2385, std. dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6894, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -80.53% (0.8651 => 0.1684, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.36% (5.2763 => 3.1467, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.62% (5.3855 => 3.6825, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.11% (5.3526 => 3.6872, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.90% (2.9384 => 2.5300, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -10.70% (22.1758 => 19.8023, std. dev.: 0.0251) SingleSource/UnitTests/Vector/constpool: -5.16% (54.1659 => 51.3707, std. dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.22% (3.8922 => 3.8056, std. dev.: 0.0172) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -50.00% (0.0400 => 0.0200, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2373 => 1.1057, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.80% (19.9488 => 18.5930, std. dev.: 0.0346) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.87% (8.1563 => 7.9221, std. dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6866, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -1.98% (10.2830 => 10.0792, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 10:25:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 12:25:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120706172539.B77162A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1835?compare_to=1830&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1835, Order: 159820, Start Time: 2012-07-06 14:42:36, End Time: 2012-07-06 17:25:40 To: 1830, Order: 159811, Start Time: 2012-07-06 11:32:10, End Time: 2012-07-06 14:15:14 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (41 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 948 (852 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.22% (2.4245 => 2.4541, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.67% (128.7415 => 130.8904, std. dev.: 0.4585) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.14% (54.1924 => 54.8076, std. dev.: 0.0552) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.08% (2.0838 => 2.1064, std. dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.58% (0.3465 => 0.3797, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.55% (0.3446 => 0.3775, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.54% (0.3460 => 0.3790, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.48% (0.3469 => 0.3798, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.30% (0.3496 => 0.3821, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.27% (0.3442 => 0.3761, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.15% (0.3488 => 0.3807, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 8.93% (0.3650 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.87% (0.3643 => 0.3966, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.59% (0.3724 => 0.4044, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.72% (0.5826 => 0.6101, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.48% (0.5889 => 0.6153, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.76% (1.6211 => 1.6821, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.42% (3.5627 => 3.6845, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.39% (0.4361 => 0.4509, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.32% (0.7171 => 0.7409, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.12% (0.5900 => 0.6084, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.10% (0.3930 => 0.4052, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.08% (0.4029 => 0.4153, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.98% (0.5026 => 0.5176, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.92% (1.3152 => 1.3536, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.91% (4.2109 => 4.3333, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.82% (0.4994 => 0.5135, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.58% (2.7292 => 2.7995, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.52% (0.5000 => 0.5126, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (1.9694 => 2.0167, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.38% (1.0781 => 1.1038, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.24% (1.9966 => 2.0413, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (4.4195 => 4.5166, std. dev.: 0.0118) MultiSource/Benchmarks/Bullet/bullet: 2.16% (23.5202 => 24.0272, std. dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: 1.96% (2.1653 => 2.2078, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 1.89% (4.6177 => 4.7051, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 1.88% (0.9909 => 1.0095, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 1.85% (5.5417 => 5.6440, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 1.84% (1.8794 => 1.9140, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (2.0673 => 2.1039, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (2.1013 => 2.1366, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 1.64% (0.7875 => 0.8004, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 1.54% (0.9697 => 0.9846, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 1.01% (1.5932 => 1.6093, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.17% (2.0820 => 2.1064, std. dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.33% (11.9555 => 11.6764, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 11:32:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 13:32:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120706183253.7FB5F2A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/1836?compare_to=1833&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1836, Order: 159834, Start Time: 2012-07-06 17:18:23, End Time: 2012-07-06 18:32:53 To: 1833, Order: 159826, Start Time: 2012-07-06 15:34:12, End Time: 2012-07-06 16:48:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (122 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (731 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.52% (54.9686 => 56.3517, std. dev.: 0.1543) SingleSource/Benchmarks/Misc/mandel-2: 1.34% (1.3895 => 1.4081, std. dev.: 0.0071) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.96% (2.0176 => 2.2992, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.77% (0.7061 => 0.7539, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.65% (0.5818 => 0.6205, std. dev.: 0.0070) SingleSource/UnitTests/ObjC++/Hello: 6.28% (0.5748 => 0.6109, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.98% (0.7038 => 0.7459, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.48% (1.3693 => 1.4443, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.44% (0.1986 => 0.2094, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.39% (0.5265 => 0.5549, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 5.27% (0.4328 => 0.4556, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.27% (0.7710 => 0.8116, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4062 => 0.4274, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.16% (0.2596 => 0.2730, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.13% (3.9660 => 4.1696, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.2721 => 0.2857, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.65% (0.2945 => 0.3082, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.56% (0.6959 => 0.7276, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.40% (0.3022 => 0.3155, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 4.36% (0.3578 => 0.3734, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.30% (0.3789 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.25% (0.4003 => 0.4173, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 4.24% (0.3914 => 0.4080, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 4.22% (0.3646 => 0.3800, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 4.22% (0.3601 => 0.3753, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.21% (0.2782 => 0.2899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.20% (0.3663 => 0.3817, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.19% (13.8202 => 14.3986, std. dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.18% (0.3489 => 0.3635, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.16% (0.9199 => 0.9582, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.16% (0.3940 => 0.4104, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.13% (0.3899 => 0.4060, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 4.11% (0.3623 => 0.3772, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.08% (0.3650 => 0.3799, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.08% (0.2966 => 0.3087, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.05% (0.3485 => 0.3626, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.04% (16.6129 => 17.2837, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/hello: 3.99% (0.2607 => 0.2711, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.94% (0.3580 => 0.3721, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.92% (0.2655 => 0.2759, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 3.91% (0.2760 => 0.2868, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2726 => 0.2832, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.88% (1.2193 => 1.2666, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.87% (13.2842 => 13.7988, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: 3.87% (0.2690 => 0.2794, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.86% (1.9828 => 2.0593, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: 3.85% (0.2937 => 0.3050, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.80% (0.3107 => 0.3225, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 3.77% (0.2761 => 0.2865, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.73% (0.5577 => 0.5785, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.73% (0.2925 => 0.3034, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.68% (0.3149 => 0.3265, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.59% (1.3245 => 1.3720, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.57% (0.3246 => 0.3362, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.56% (0.4016 => 0.4159, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.53% (0.3453 => 0.3575, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.52% (1.4563 => 1.5076, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 3.48% (0.3534 => 0.3657, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.46% (1.1364 => 1.1757, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.45% (1.0594 => 1.0960, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 3.44% (3.8646 => 3.9977, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.5637 => 0.5831, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.40% (0.7506 => 0.7761, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.35% (0.3756 => 0.3882, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.32% (1.9270 => 1.9910, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.32% (0.3192 => 0.3298, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.26% (0.4390 => 0.4533, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.24% (0.4379 => 0.4521, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (0.3293 => 0.3399, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.20% (1.1061 => 1.1415, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 3.18% (0.3868 => 0.3991, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.02% (4.9865 => 5.1372, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.91% (1.3813 => 1.4215, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8310 => 0.8547, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.84% (0.7460 => 0.7672, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.82% (7.2180 => 7.4218, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.82% (1.3819 => 1.4209, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 2.74% (2.1791 => 2.2388, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.61% (0.4791 => 0.4916, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.55% (1.2292 => 1.2606, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.54% (3.6692 => 3.7623, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 2.49% (14.8535 => 15.2237, std. dev.: 0.0103) MultiSource/Applications/JM/ldecod/ldecod: 2.46% (6.5754 => 6.7374, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.33% (0.6135 => 0.6278, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.23% (16.2614 => 16.6241, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.22% (4.3801 => 4.4774, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.08% (4.4433 => 4.5358, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.06% (1.1333 => 1.1566, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.95% (3.1889 => 3.2510, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.92% (0.8698 => 0.8865, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.88% (0.6283 => 0.6401, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.86% (14.5298 => 14.7997, std. dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (2.1007 => 2.1391, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.80% (1.2749 => 1.2979, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.71% (1.8175 => 2.2666, std. dev.: 0.0503) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1930, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.52% (0.9996 => 1.0848, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: 8.33% (1.2998 => 1.4081, std. dev.: 0.0071) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.06% (7.4271 => 7.7285, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9218, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6790, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8294, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4790, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.05% (4.1080 => 4.1921, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.72% (3.6469 => 3.7096, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.58% (22.5627 => 21.0791, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.82% (0.3511 => 0.3377, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.35% (0.8818 => 0.8611, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.45% (0.0997 => 0.0843, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.73% (1.2308 => 1.1110, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.99% (20.3410 => 18.5124, std. dev.: 0.0714) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.76% (1.3780 => 1.3124, std. dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5906, std. dev.: 0.0216) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5102, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2498, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.53% (3.0263 => 2.9801, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8588, std. dev.: 0.0175) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1398, std. dev.: 0.0284) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.34% (28.2225 => 27.8433, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8455, std. dev.: 0.0069) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2345, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2598, std. dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -1.07% (7.3305 => 7.2522, std. dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 11:56:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 13:56:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120706185657.24D9F2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1837?compare_to=1834&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1837, Order: 159834, Start Time: 2012-07-06 17:38:18, End Time: 2012-07-06 18:56:57 To: 1834, Order: 159826, Start Time: 2012-07-06 15:52:00, End Time: 2012-07-06 17:10:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (797 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.78% (10.3673 => 13.7661, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.02% (1.1194 => 1.2428, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 8.01% (0.1622 => 0.1752, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.66% (0.3473 => 0.3739, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3516 => 0.3781, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.54% (0.3543 => 0.3810, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.48% (0.3543 => 0.3808, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.44% (0.3561 => 0.3826, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.43% (0.3497 => 0.3757, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.23% (0.3694 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.11% (0.3828 => 0.4100, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.08% (0.3927 => 0.4205, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.99% (1.7609 => 1.8840, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.97% (0.3886 => 0.4157, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.83% (2.2022 => 2.3526, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.32% (7.0540 => 7.3588, std. dev.: 0.0158) MultiSource/Applications/lambda-0_1_3/lambda: 4.14% (0.7433 => 0.7741, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.06% (0.3177 => 0.3306, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.4879 => 0.5076, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 3.50% (0.3282 => 0.3397, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 3.36% (0.3092 => 0.3196, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 3.29% (0.5925 => 0.6120, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.28% (0.6030 => 0.6228, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.88% (10.4361 => 10.7369, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.80% (0.5569 => 0.5725, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.80% (0.4615 => 0.4744, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 2.69% (0.7835 => 0.8046, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.64% (0.8172 => 0.8388, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (14.3668 => 14.7258, std. dev.: 0.0115) SingleSource/UnitTests/ObjC++/property-reference: 2.50% (0.7326 => 0.7509, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.45% (4.9449 => 5.0662, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.41% (0.5860 => 0.6001, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.36% (5.0018 => 5.1198, std. dev.: 0.0087) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (4.2646 => 4.3619, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.23% (2.0273 => 2.0726, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 2.21% (9.4845 => 9.6941, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.09% (0.8067 => 0.8236, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 2.01% (5.7591 => 5.8747, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.99% (8.1363 => 8.2983, std. dev.: 0.0126) MultiSource/Applications/d/make_dparser: 1.96% (3.3354 => 3.4008, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.94% (3.8723 => 3.9475, std. dev.: 0.0040) MultiSource/Applications/Burg/burg: 1.92% (1.1642 => 1.1865, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.90% (1.1861 => 1.2086, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.74% (1.5415 => 1.5683, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.72% (2.2969 => 2.3365, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.68% (2.2024 => 2.2395, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.60% (0.6450 => 0.6553, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.54% (17.1811 => 17.4456, std. dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.49% (1.3050 => 1.3245, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.44% (0.9765 => 0.9906, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.42% (1.4186 => 1.4388, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.33% (1.5603 => 1.5811, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7516, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 2.09% (26.0924 => 26.6389, std. dev.: 0.0319) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4460, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2388, std. dev.: 0.0287) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.19% (2.6546 => 2.6861, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.55% (0.8651 => 0.1683, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.43% (5.2763 => 3.1430, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.53% (5.3855 => 3.6877, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.04% (5.3526 => 3.6914, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.89% (2.9384 => 2.5302, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -10.62% (22.1758 => 19.8210, std. dev.: 0.0107) SingleSource/UnitTests/Vector/constpool: -5.20% (54.1659 => 51.3470, std. dev.: 0.0601) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.16% (3.8922 => 3.8082, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.73% (0.0998 => 0.0831, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -10.16% (1.2373 => 1.1116, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.17% (19.9488 => 18.5180, std. dev.: 0.0753) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (8.1563 => 7.9198, std. dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6826, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0857, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 13:14:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 15:14:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120706201437.E8CF12A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1838?compare_to=1836&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1838, Order: 159845, Start Time: 2012-07-06 19:00:29, End Time: 2012-07-06 20:14:37 To: 1836, Order: 159834, Start Time: 2012-07-06 17:18:23, End Time: 2012-07-06 18:32:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (126 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (729 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.65% (1.0981 => 1.1711, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.34% (1.0322 => 1.0564, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.13% (2.2992 => 2.2733, std. dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.67% (2.0176 => 2.2733, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 7.20% (0.5818 => 0.6237, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.00% (0.7061 => 0.7555, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.73% (0.5748 => 0.6135, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.12% (0.7038 => 0.7469, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.60% (0.7710 => 0.8142, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.49% (0.1986 => 0.2095, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.45% (1.3693 => 1.4439, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 5.13% (0.4328 => 0.4550, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.11% (0.5265 => 0.5534, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.07% (0.3650 => 0.3835, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.05% (0.2596 => 0.2727, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 4.81% (0.3578 => 0.3750, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 4.78% (0.3789 => 0.3970, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 4.78% (0.3601 => 0.3773, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.74% (3.9660 => 4.1540, std. dev.: 0.0519) SingleSource/Benchmarks/Shootout-C++/objinst: 4.72% (0.2945 => 0.3084, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 4.69% (0.3646 => 0.3817, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: 4.67% (0.3663 => 0.3834, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.60% (0.3914 => 0.4094, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.57% (0.4003 => 0.4186, std. dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 4.57% (0.2781 => 0.2908, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.49% (0.3940 => 0.4117, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 4.48% (0.4062 => 0.4244, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 4.42% (0.3623 => 0.3783, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.37% (0.3022 => 0.3154, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.31% (0.2782 => 0.2902, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.24% (0.2690 => 0.2804, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.22% (0.2607 => 0.2717, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2726 => 0.2840, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.15% (0.3107 => 0.3236, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.13% (0.3489 => 0.3633, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.11% (0.2966 => 0.3088, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.11% (0.2655 => 0.2764, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.6959 => 0.7244, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 4.09% (0.2937 => 0.3057, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.07% (0.2628 => 0.2735, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.06% (0.2760 => 0.2872, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.05% (1.9828 => 2.0631, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.03% (0.3899 => 0.4056, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.99% (0.3580 => 0.3723, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.94% (0.3149 => 0.3273, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.92% (13.8202 => 14.3615, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.91% (0.2765 => 0.2873, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.89% (0.2696 => 0.2801, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.84% (13.2842 => 13.7944, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 3.84% (0.2761 => 0.2867, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 3.78% (16.6129 => 17.2401, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.77% (0.9199 => 0.9546, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3485 => 0.3616, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.73% (1.2193 => 1.2648, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 3.71% (0.3453 => 0.3581, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.62% (0.3756 => 0.3892, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.56% (0.4016 => 0.4159, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.56% (0.2925 => 0.3029, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.55% (0.5577 => 0.5775, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.48% (0.3534 => 0.3657, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.48% (0.3192 => 0.3303, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.40% (0.3293 => 0.3405, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.35% (0.2988 => 0.3088, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.34% (1.4563 => 1.5050, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 3.23% (3.8646 => 3.9894, std. dev.: 0.0340) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.21% (0.5637 => 0.5818, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.19% (0.4390 => 0.4530, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.17% (1.3245 => 1.3665, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.14% (0.3246 => 0.3348, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.09% (0.7506 => 0.7738, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 3.08% (0.3868 => 0.3987, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.97% (1.1364 => 1.1701, std. dev.: 0.0082) MultiSource/Applications/treecc/treecc: 2.95% (1.9270 => 1.9838, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 2.94% (1.1061 => 1.1386, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.83% (1.0594 => 1.0894, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.76% (0.4379 => 0.4500, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.70% (7.2180 => 7.4128, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.66% (1.3813 => 1.4181, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.58% (1.3819 => 1.4176, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.57% (4.9865 => 5.1147, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.38% (1.2292 => 1.2585, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8310 => 0.8501, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.29% (2.1791 => 2.2291, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.13% (3.6692 => 3.7474, std. dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 2.12% (14.8535 => 15.1687, std. dev.: 0.0105) MultiSource/Applications/JM/ldecod/ldecod: 2.03% (6.5754 => 6.7088, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.98% (4.3801 => 4.4669, std. dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 1.77% (16.2614 => 16.5492, std. dev.: 0.0202) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.76% (4.4433 => 4.5217, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.68% (0.8698 => 0.8844, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 1.68% (3.1889 => 3.2424, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.66% (1.1333 => 1.1521, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.65% (0.6135 => 0.6236, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 1.46% (14.5298 => 14.7423, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.30% (2.1007 => 2.1280, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.18% (1.2749 => 1.2900, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.09% (1.8175 => 2.2735, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/17-bintr/bintr: 11.60% (0.0957 => 0.1068, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.41% (2.0200 => 2.1898, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 7.99% (1.2998 => 1.4037, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9996 => 1.0764, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.4271 => 7.7251, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6795, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4786, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.93% (4.1080 => 4.1873, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.58% (3.6469 => 3.7044, std. dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.95% (22.5627 => 20.9945, std. dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.62% (0.3511 => 0.3384, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.95% (0.8818 => 0.8558, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2308 => 1.1015, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.87% (20.3410 => 18.5363, std. dev.: 0.0551) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0135) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5500, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.49% (8.8259 => 8.6057, std. dev.: 0.0112) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.32% (0.4867 => 0.4754, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.29% (0.4533 => 0.4429, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5031, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.68% (28.2225 => 27.7475, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2510, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0008) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1464, std. dev.: 0.0232) MultiSource/Applications/spiff/spiff: -1.38% (3.0263 => 2.9846, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2122, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.25% (0.9692 => 0.9571, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8693, std. dev.: 0.0156) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2519, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 13:36:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 15:36:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120706203604.A89C42A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1839?compare_to=1835&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1839, Order: 159835, Start Time: 2012-07-06 17:53:02, End Time: 2012-07-06 20:36:05 To: 1835, Order: 159820, Start Time: 2012-07-06 14:42:36, End Time: 2012-07-06 17:25:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (42 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (851 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.19% (1.6093 => 1.6284, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.20% (111.5904 => 118.5116, std. dev.: 0.0289) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 8.37% (0.3465 => 0.3755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.33% (0.3446 => 0.3733, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.32% (0.3460 => 0.3748, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.22% (0.3469 => 0.3754, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.09% (0.3496 => 0.3779, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.05% (0.3442 => 0.3719, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.03% (0.3488 => 0.3768, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 7.81% (0.3650 => 0.3935, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.77% (0.3643 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.57% (0.3724 => 0.4006, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 4.09% (0.5826 => 0.6064, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.82% (0.5889 => 0.6114, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.69% (0.4361 => 0.4522, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (1.6211 => 1.6779, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.23% (3.5627 => 3.6777, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.90% (0.4994 => 0.5139, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (0.5026 => 0.5170, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 2.85% (4.2109 => 4.3311, std. dev.: 0.0065) MultiSource/Applications/spiff/spiff: 2.83% (0.4029 => 0.4143, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.80% (1.3152 => 1.3520, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (0.5900 => 0.6065, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.77% (0.3930 => 0.4039, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.72% (0.5000 => 0.5136, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 2.61% (0.7171 => 0.7358, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.21% (1.5932 => 1.6284, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.13% (1.0781 => 1.1011, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.02% (4.4195 => 4.5089, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.00% (1.9694 => 2.0087, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (2.7292 => 2.7833, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 1.91% (1.8794 => 1.9153, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.88% (1.9966 => 2.0341, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 1.76% (4.6177 => 4.6988, std. dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: 1.71% (2.1653 => 2.2024, std. dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 1.70% (5.5417 => 5.6359, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 1.67% (0.9909 => 1.0074, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.61% (23.5202 => 23.8986, std. dev.: 0.0152) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (2.1013 => 2.1343, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.51% (2.0673 => 2.0985, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.33% (0.7875 => 0.7980, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.24% (1.4269 => 1.4446, std. dev.: 0.0056) MultiSource/Applications/hbd/hbd: 1.20% (0.9697 => 0.9813, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.23% (2.0820 => 2.1076, std. dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.57% (11.9555 => 11.6482, std. dev.: 0.0138) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 13:43:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 15:43:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120706204321.45AC62A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1840?compare_to=1837&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1840, Order: 159845, Start Time: 2012-07-06 19:24:39, End Time: 2012-07-06 20:43:21 To: 1837, Order: 159834, Start Time: 2012-07-06 17:38:18, End Time: 2012-07-06 18:56:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (60 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 926 (796 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.51% (10.7369 => 10.8993, std. dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (2.5302 => 2.5567, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.73% (1.1152 => 1.1902, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0318 => 1.0565, std. dev.: 0.0003) MultiSource/Benchmarks/llubenchmark/llu: 1.29% (3.7780 => 3.8266, std. dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.23% (2.3005 => 2.2721, std. dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.61% (10.3673 => 13.7482, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.35% (1.1194 => 1.2465, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 8.10% (0.1432 => 0.1548, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.06% (0.3473 => 0.3753, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.86% (0.3561 => 0.3841, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.85% (0.3543 => 0.3821, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.78% (0.3497 => 0.3769, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.73% (0.3543 => 0.3817, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 7.72% (0.3694 => 0.3979, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.71% (0.3516 => 0.3787, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.39% (0.3886 => 0.4173, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.36% (1.7609 => 1.8905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.31% (0.3927 => 0.4214, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.26% (0.3828 => 0.4106, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (0.1622 => 0.1737, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.34% (2.2022 => 2.3419, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.60% (0.3177 => 0.3323, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.51% (0.4879 => 0.5099, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.44% (10.4361 => 10.8993, std. dev.: 0.0147) MultiSource/Applications/lambda-0_1_3/lambda: 4.00% (0.7433 => 0.7730, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.90% (7.0540 => 7.3292, std. dev.: 0.0368) MultiSource/Benchmarks/Olden/bh/bh: 3.27% (0.3092 => 0.3193, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.23% (0.6030 => 0.6225, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 3.20% (0.3282 => 0.3387, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.17% (0.5925 => 0.6113, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.69% (0.5569 => 0.5719, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.64% (0.8172 => 0.8388, std. dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.60% (0.4615 => 0.4735, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (14.3668 => 14.7254, std. dev.: 0.0072) SingleSource/UnitTests/ObjC++/property-reference: 2.46% (0.7326 => 0.7506, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.43% (4.9449 => 5.0652, std. dev.: 0.0048) MultiSource/Applications/spiff/spiff: 2.41% (0.7835 => 0.8024, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.31% (5.0018 => 5.1174, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5860 => 0.5986, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.11% (8.1363 => 8.3083, std. dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 2.09% (9.4845 => 9.6832, std. dev.: 0.0125) MultiSource/Applications/treecc/treecc: 2.09% (2.0273 => 2.0697, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.03% (4.2646 => 4.3511, std. dev.: 0.0084) MultiSource/Applications/Burg/burg: 1.84% (1.1642 => 1.1856, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.82% (0.8067 => 0.8214, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.73% (1.1861 => 1.2066, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.72% (3.3354 => 3.3927, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.66% (3.8723 => 3.9364, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.60% (1.5415 => 1.5662, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7591 => 5.8466, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.42% (2.2024 => 2.2336, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.40% (1.5603 => 1.5822, std. dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 1.34% (17.1811 => 17.4121, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.26% (0.9765 => 0.9888, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.24% (1.4186 => 1.4362, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.24% (3.6395 => 3.7573, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.18% (26.0924 => 26.6613, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (1.5086 => 1.5372, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0009) MultiSource/Benchmarks/llubenchmark/llu: 1.28% (3.7781 => 3.8266, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6882, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.12% (2.9346 => 2.9674, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.84% (5.2763 => 3.1741, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.59% (5.3855 => 3.6841, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.08% (5.3526 => 3.6891, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.99% (2.9384 => 2.5567, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -10.56% (22.1758 => 19.8335, std. dev.: 0.0215) SingleSource/UnitTests/Vector/constpool: -4.67% (54.1659 => 51.6378, std. dev.: 0.1183) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.32% (3.8922 => 3.8018, std. dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.52% (1.2373 => 1.1071, std. dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.04% (19.9488 => 18.5451, std. dev.: 0.1093) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (8.1563 => 7.9248, std. dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6850, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0848, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 15:22:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 17:22:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120706222215.63E422A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1841?compare_to=1838&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1841, Order: 159854, Start Time: 2012-07-06 21:08:11, End Time: 2012-07-06 22:22:15 To: 1838, Order: 159845, Start Time: 2012-07-06 19:00:29, End Time: 2012-07-06 20:14:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (125 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (730 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.98% (2.0176 => 2.2795, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 7.48% (0.5818 => 0.6253, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.46% (0.7061 => 0.7588, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.80% (0.5748 => 0.6139, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.00% (0.7038 => 0.7460, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.44% (0.1986 => 0.2094, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.37% (1.3693 => 1.4428, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.19% (0.7710 => 0.8110, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 5.06% (0.4328 => 0.4547, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.96% (0.5265 => 0.5526, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.2945 => 0.3090, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.89% (0.2596 => 0.2723, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.81% (0.2721 => 0.2852, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.70% (0.3022 => 0.3164, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.67% (0.2781 => 0.2911, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.62% (3.9660 => 4.1493, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2782 => 0.2907, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.48% (0.2966 => 0.3099, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 4.39% (0.3578 => 0.3735, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.38% (0.4062 => 0.4240, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 4.37% (0.2726 => 0.2845, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.31% (0.2760 => 0.2879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2690 => 0.2805, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.26% (0.2607 => 0.2718, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.22% (0.2655 => 0.2767, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 4.19% (0.3914 => 0.4078, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.18% (0.6959 => 0.7250, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/parameter-passing: 4.17% (0.4003 => 0.4170, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.16% (0.3489 => 0.3634, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 4.14% (0.3789 => 0.3946, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.12% (0.2765 => 0.2879, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.11% (0.3646 => 0.3796, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.11% (1.9828 => 2.0643, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 4.11% (0.2628 => 0.2736, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.09% (0.2937 => 0.3057, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.06% (0.2761 => 0.2873, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.05% (0.3601 => 0.3747, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.03% (0.3149 => 0.3276, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.03% (0.3899 => 0.4056, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 4.01% (0.3663 => 0.3810, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.00% (0.3650 => 0.3796, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3107 => 0.3231, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3580 => 0.3722, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 3.93% (0.3940 => 0.4095, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 3.92% (0.3623 => 0.3765, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.86% (0.2696 => 0.2800, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.83% (13.8202 => 14.3494, std. dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 3.77% (16.6129 => 17.2393, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.76% (13.2842 => 13.7834, std. dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (0.3485 => 0.3614, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.70% (0.9199 => 0.9539, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.69% (0.5577 => 0.5783, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.65% (0.3756 => 0.3893, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.4016 => 0.4162, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.59% (0.3453 => 0.3577, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.59% (0.2925 => 0.3030, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 3.51% (0.2988 => 0.3093, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.48% (0.3534 => 0.3657, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.45% (0.3192 => 0.3302, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.43% (0.3293 => 0.3406, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.35% (1.2193 => 1.2601, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.4390 => 0.4535, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 3.18% (0.7506 => 0.7745, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.14% (1.3245 => 1.3661, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 3.10% (0.3868 => 0.3988, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3246 => 0.3346, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.4563 => 1.5007, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 3.02% (3.8646 => 3.9813, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5637 => 0.5802, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.90% (0.4379 => 0.4506, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.89% (1.1061 => 1.1381, std. dev.: 0.0070) MultiSource/Applications/treecc/treecc: 2.80% (1.9270 => 1.9810, std. dev.: 0.0141) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.80% (1.1364 => 1.1682, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0889, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.59% (7.2180 => 7.4051, std. dev.: 0.0097) MultiSource/Applications/hexxagon/hexxagon: 2.54% (1.2292 => 1.2604, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.48% (4.9865 => 5.1102, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.46% (1.3813 => 1.4153, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.40% (1.3819 => 1.4151, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.36% (0.7460 => 0.7636, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.29% (2.1791 => 2.2289, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.8310 => 0.8498, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.15% (3.6692 => 3.7481, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.92% (14.8535 => 15.1390, std. dev.: 0.0156) MultiSource/Applications/JM/ldecod/ldecod: 1.89% (6.5754 => 6.6999, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.83% (4.3801 => 4.4602, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.75% (4.4433 => 4.5212, std. dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 1.61% (16.2614 => 16.5226, std. dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.61% (1.1333 => 1.1515, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.54% (0.8698 => 0.8832, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.54% (3.1889 => 3.2379, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.32% (14.5298 => 14.7218, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.16% (2.1007 => 2.1251, std. dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (1.2749 => 1.2893, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.63% (1.8175 => 2.2833, std. dev.: 0.0183) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1907, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.15% (1.2998 => 1.3928, std. dev.: 0.0190) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7294, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6782, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0310 => 1.0567, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1916, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (3.6469 => 3.7084, std. dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1966, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.06% (22.5627 => 20.9688, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.30% (0.3511 => 0.3395, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.07% (0.8818 => 0.8547, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.59% (0.9108 => 0.8963, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -10.63% (1.2308 => 1.1000, std. dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.69% (20.3410 => 18.5729, std. dev.: 0.0418) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.8259 => 8.5785, std. dev.: 0.0294) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4476, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5099, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.70% (28.2225 => 27.7434, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2542, std. dev.: 0.0033) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1178, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -1.35% (3.0263 => 2.9853, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2179, std. dev.: 0.0165) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2497, std. dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 15:29:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 17:29:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120706222941.E068E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1842?compare_to=1840&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1842, Order: 159854, Start Time: 2012-07-06 21:11:02, End Time: 2012-07-06 22:29:42 To: 1840, Order: 159845, Start Time: 2012-07-06 19:24:39, End Time: 2012-07-06 20:43:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (58 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (798 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.66% (55.1051 => 56.5686, std. dev.: 0.0805) SingleSource/Benchmarks/Misc/lowercase: 1.48% (7.9557 => 8.0731, std. dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.45% (10.3673 => 13.6274, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.11% (1.1194 => 1.2438, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 8.03% (0.1432 => 0.1547, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.69% (1.7609 => 1.8964, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.69% (0.3473 => 0.3740, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.32% (0.3497 => 0.3753, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.28% (0.3543 => 0.3801, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.25% (0.3543 => 0.3800, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.25% (0.3561 => 0.3819, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.20% (0.3516 => 0.3769, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.12% (0.3694 => 0.3957, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.00% (0.3927 => 0.4202, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.92% (0.3886 => 0.4155, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.84% (0.3828 => 0.4090, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.13% (2.2022 => 2.3371, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.4879 => 0.5089, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.14% (0.7433 => 0.7741, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.12% (0.3177 => 0.3308, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.82% (7.0540 => 7.3234, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 3.81% (10.4361 => 10.8336, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference-object: 3.50% (0.6030 => 0.6241, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.38% (0.5925 => 0.6125, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.78% (0.5569 => 0.5724, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.70% (0.8172 => 0.8393, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.67% (0.4615 => 0.4738, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.65% (0.7326 => 0.7520, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.40% (0.7835 => 0.8023, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.29% (4.9449 => 5.0580, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.22% (0.5860 => 0.5990, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (14.3668 => 14.6829, std. dev.: 0.0183) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.19% (5.0018 => 5.1112, std. dev.: 0.0069) MultiSource/Applications/treecc/treecc: 2.15% (2.0273 => 2.0708, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (9.4845 => 9.6804, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.01% (8.1363 => 8.3002, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.99% (4.2646 => 4.3496, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.94% (1.1642 => 1.1868, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.74% (3.8723 => 3.9398, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (1.1861 => 1.2063, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.70% (0.8067 => 0.8204, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.59% (3.3354 => 3.3885, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.54% (1.5415 => 1.5652, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 1.46% (5.7591 => 5.8432, std. dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 1.37% (17.1811 => 17.4170, std. dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.37% (2.2024 => 2.2325, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.31% (0.9765 => 0.9893, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.25% (1.4186 => 1.4363, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.19% (1.5603 => 1.5788, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.18% (2.2969 => 2.3240, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.80% (1.1145 => 1.1903, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7596, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 2.22% (26.0924 => 26.6707, std. dev.: 0.0207) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5357, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4460, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (2.6546 => 2.6919, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2411, std. dev.: 0.0133) MultiSource/Applications/spiff/spiff: 1.16% (2.9346 => 2.9685, std. dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.95% (5.2763 => 3.1683, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.63% (5.3855 => 3.6821, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.26% (5.3526 => 3.6796, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.26% (2.9384 => 2.5488, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -10.56% (22.1758 => 19.8339, std. dev.: 0.0244) SingleSource/UnitTests/Vector/constpool: -4.76% (54.1659 => 51.5896, std. dev.: 0.0285) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.33% (3.8922 => 3.8016, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.78% (1.2373 => 1.1163, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.23% (19.9488 => 18.5058, std. dev.: 0.0244) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9133, std. dev.: 0.0147) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6869, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0847, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 16:46:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 18:46:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120706234637.0484C2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1843?compare_to=1839&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1843, Order: 159854, Start Time: 2012-07-06 21:03:28, End Time: 2012-07-06 23:46:38 To: 1839, Order: 159835, Start Time: 2012-07-06 17:53:02, End Time: 2012-07-06 20:36:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (42 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (851 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.38% (0.3465 => 0.3790, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.35% (0.3496 => 0.3823, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.34% (0.3446 => 0.3768, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.34% (0.3460 => 0.3783, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3442 => 0.3763, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.22% (0.3469 => 0.3789, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.17% (0.3488 => 0.3808, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.03% (0.3643 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.88% (0.3650 => 0.3974, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.62% (0.3724 => 0.4045, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.01% (0.5826 => 0.6118, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.72% (0.5889 => 0.6167, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.04% (1.6211 => 1.6866, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.92% (0.4361 => 0.4532, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.86% (3.5627 => 3.7001, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 3.52% (0.4029 => 0.4171, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.44% (0.5900 => 0.6103, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 3.43% (0.7171 => 0.7417, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.33% (1.3152 => 1.3590, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.22% (0.4994 => 0.5155, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (0.5026 => 0.5187, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.18% (4.2109 => 4.3447, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.10% (0.3930 => 0.4052, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.88% (0.5000 => 0.5144, std. dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.68% (2.7292 => 2.8023, std. dev.: 0.0100) MultiSource/Applications/d/make_dparser: 2.61% (1.0781 => 1.1062, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.50% (1.9966 => 2.0466, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.49% (0.9909 => 1.0156, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.47% (2.0673 => 2.1184, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.46% (1.9694 => 2.0179, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.28% (0.4658 => 0.4764, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 2.26% (23.5202 => 24.0528, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (4.4195 => 4.5174, std. dev.: 0.0111) MultiSource/Applications/JM/ldecod/ldecod: 2.06% (2.1653 => 2.2099, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 2.06% (1.8794 => 1.9181, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 2.03% (2.1013 => 2.1440, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 1.98% (5.5417 => 5.6517, std. dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 1.97% (1.5932 => 1.6246, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.92% (4.6177 => 4.7062, std. dev.: 0.0135) MultiSource/Applications/hbd/hbd: 1.84% (0.9697 => 0.9875, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.77% (1.4269 => 1.4521, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.77% (0.7875 => 0.8014, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.22% (11.9555 => 11.6906, std. dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 17:04:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 19:04:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120707000400.F17CC2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1844?compare_to=1841&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1844, Order: 159869, Start Time: 2012-07-06 22:49:47, End Time: 2012-07-07 00:03:59 To: 1841, Order: 159854, Start Time: 2012-07-06 21:08:11, End Time: 2012-07-06 22:22:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (129 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.08% (54.3864 => 56.0641, std. dev.: 0.2358) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.55% (78.0708 => 80.0632, std. dev.: 0.3739) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.88% (2.0176 => 2.2775, std. dev.: 0.0139) SingleSource/UnitTests/ObjC++/property-reference: 7.70% (0.7061 => 0.7605, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 7.65% (0.5818 => 0.6263, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.34% (0.5748 => 0.6170, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 5.58% (1.3693 => 1.4457, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 5.51% (0.3578 => 0.3775, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.49% (0.1986 => 0.2095, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 5.47% (0.7038 => 0.7423, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.2945 => 0.3105, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 5.43% (0.4328 => 0.4563, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 5.24% (0.3914 => 0.4119, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 5.23% (0.3789 => 0.3987, std. dev.: 0.0060) SingleSource/Regression/C++/ofstream_ctor: 5.21% (0.2781 => 0.2926, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.21% (0.2782 => 0.2927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.21% (0.3650 => 0.3840, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 5.19% (0.3601 => 0.3788, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.17% (0.5265 => 0.5537, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 5.16% (0.3646 => 0.3834, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.12% (0.4003 => 0.4208, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.08% (0.3623 => 0.3807, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.03% (0.3022 => 0.3174, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.03% (0.2726 => 0.2863, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.02% (0.3663 => 0.3847, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.02% (0.7710 => 0.8097, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 5.00% (0.4062 => 0.4265, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 4.95% (0.2607 => 0.2736, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.95% (0.2628 => 0.2758, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.92% (0.2966 => 0.3112, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.91% (0.2690 => 0.2822, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.90% (0.3940 => 0.4133, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.90% (0.2655 => 0.2785, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.85% (0.2596 => 0.2722, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 4.82% (0.2760 => 0.2893, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.77% (1.9828 => 2.0774, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: 4.77% (0.2937 => 0.3077, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.70% (0.2765 => 0.2895, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.67% (0.2696 => 0.2822, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.64% (3.9660 => 4.1499, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary3: 4.64% (0.3149 => 0.3295, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.64% (0.2761 => 0.2889, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.63% (0.3107 => 0.3251, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.59% (0.3489 => 0.3649, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.44% (0.3580 => 0.3739, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.44% (0.3899 => 0.4072, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.20% (0.3453 => 0.3598, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.19% (0.3485 => 0.3631, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.11% (0.6959 => 0.7245, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/matrix: 4.08% (0.2988 => 0.3110, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.07% (0.3192 => 0.3322, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.05% (0.3756 => 0.3908, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.03% (0.4016 => 0.4178, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.99% (0.3534 => 0.3675, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.92% (0.4390 => 0.4562, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.92% (0.3293 => 0.3422, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.88% (13.8202 => 14.3562, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.78% (0.9199 => 0.9547, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3868 => 0.4013, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.71% (13.2842 => 13.7768, std. dev.: 0.0068) MultiSource/Applications/kimwitu++/kc: 3.66% (16.6129 => 17.2216, std. dev.: 0.0209) MultiSource/Benchmarks/McCat/09-vor/vor: 3.56% (0.2925 => 0.3029, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.37% (0.5577 => 0.5765, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.32% (1.2193 => 1.2598, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.08% (1.4563 => 1.5011, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 3.02% (0.7506 => 0.7733, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.02% (0.5637 => 0.5807, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 3.00% (3.8646 => 3.9806, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.3245 => 1.3639, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.93% (1.9270 => 1.9835, std. dev.: 0.0103) MultiSource/Applications/hexxagon/hexxagon: 2.91% (1.2292 => 1.2650, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.87% (1.1364 => 1.1690, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3755 => 0.3862, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.84% (1.0594 => 1.0895, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.78% (1.1061 => 1.1369, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.76% (0.4379 => 0.4500, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.60% (7.2180 => 7.4057, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.55% (1.3813 => 1.4165, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.44% (1.3819 => 1.4156, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.40% (0.7460 => 0.7639, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.37% (0.8310 => 0.8507, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.28% (4.9865 => 5.1000, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.14% (3.6692 => 3.7477, std. dev.: 0.0093) MultiSource/Applications/siod/siod: 2.04% (2.1791 => 2.2235, std. dev.: 0.0091) MultiSource/Applications/JM/lencod/lencod: 2.00% (14.8535 => 15.1504, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.88% (4.3801 => 4.4623, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.87% (6.5754 => 6.6983, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.85% (0.8698 => 0.8859, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.72% (4.4433 => 4.5199, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.70% (0.6135 => 0.6239, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.54% (16.2614 => 16.5118, std. dev.: 0.0239) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.51% (1.1333 => 1.1504, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.41% (3.1889 => 3.2339, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 1.28% (14.5298 => 14.7158, std. dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.26% (2.1007 => 2.1272, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.10% (1.2749 => 1.2889, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 25.28% (1.8175 => 2.2769, std. dev.: 0.0300) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1913, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: 7.73% (1.2998 => 1.4003, std. dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7294, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6781, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4789, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5333, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.54% (3.6469 => 3.7031, std. dev.: 0.0058) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1940, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0005) MultiSource/Benchmarks/llubenchmark/llu: 1.25% (3.7731 => 3.8202, std. dev.: 0.0168) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.19% (1.9290 => 1.9520, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.08% (22.5627 => 20.9655, std. dev.: 0.0239) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.39% (0.3511 => 0.3392, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.62% (0.8818 => 0.8587, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.69% (0.9108 => 0.8954, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.69% (1.2308 => 1.0992, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.18% (20.3410 => 18.4745, std. dev.: 0.0454) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.11% (1.3780 => 1.3076, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5898, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4461, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5077, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7457, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2541, std. dev.: 0.0020) MultiSource/Applications/lua/lua: -1.54% (26.5159 => 26.1086, std. dev.: 0.0406) MultiSource/Applications/spiff/spiff: -1.47% (3.0263 => 2.9819, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8603, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2530, std. dev.: 0.0045) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2284, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 17:16:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 19:16:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120707001605.C378C2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1845?compare_to=1842&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1845, Order: 159869, Start Time: 2012-07-06 22:57:22, End Time: 2012-07-07 00:16:06 To: 1842, Order: 159854, Start Time: 2012-07-06 21:11:02, End Time: 2012-07-06 22:29:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (61 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.36% (13.6274 => 13.4414, std. dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.65% (10.3673 => 13.4414, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.49% (1.1194 => 1.2480, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.18% (0.3473 => 0.3757, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.03% (0.3561 => 0.3847, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.01% (0.3497 => 0.3777, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.99% (0.3543 => 0.3826, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 7.94% (0.3516 => 0.3795, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.93% (0.3543 => 0.3824, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.74% (0.3694 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.51% (0.3886 => 0.4178, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.3927 => 0.4221, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.47% (1.7609 => 1.8925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.45% (0.3828 => 0.4113, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.48% (2.2022 => 2.3449, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.63% (0.3177 => 0.3324, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.15% (10.4361 => 10.8688, std. dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 3.91% (0.7433 => 0.7724, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.86% (7.0540 => 7.3264, std. dev.: 0.0090) SingleSource/UnitTests/ObjC++/property-reference-object: 3.62% (0.6030 => 0.6248, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.53% (0.5925 => 0.6134, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3092 => 0.3201, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 3.11% (0.3282 => 0.3384, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.88% (0.4615 => 0.4748, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.74% (0.8172 => 0.8396, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.58% (4.9449 => 5.0725, std. dev.: 0.0073) MultiSource/Applications/spiff/spiff: 2.55% (0.7835 => 0.8035, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.51% (14.3668 => 14.7275, std. dev.: 0.0159) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.49% (5.0018 => 5.1262, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.43% (9.4845 => 9.7150, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.34% (0.5860 => 0.5997, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.29% (2.0273 => 2.0738, std. dev.: 0.0117) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.26% (4.2646 => 4.3608, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.19% (8.1363 => 8.3147, std. dev.: 0.0064) MultiSource/Applications/lua/lua: 2.17% (3.8723 => 3.9563, std. dev.: 0.0085) MultiSource/Applications/Burg/burg: 2.02% (1.1642 => 1.1877, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.88% (0.8067 => 0.8219, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.87% (1.1861 => 1.2083, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.5415 => 1.5700, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 1.85% (3.3354 => 3.3970, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.71% (17.1811 => 17.4755, std. dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.64% (0.6450 => 0.6556, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.58% (1.3050 => 1.3256, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 1.56% (5.7591 => 5.8490, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.50% (1.4186 => 1.4399, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.43% (2.2024 => 2.2338, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.41% (0.9765 => 0.9903, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.40% (1.5603 => 1.5821, std. dev.: 0.0049) MultiSource/Applications/siod/siod: 1.01% (2.2969 => 2.3202, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.81% (1.1145 => 1.1904, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.32% (3.6395 => 3.7604, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.28% (26.0924 => 26.6863, std. dev.: 0.0271) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (1.5086 => 1.5363, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 1.49% (2.4116 => 2.4475, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2397, std. dev.: 0.0377) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6880, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 1.10% (2.9346 => 2.9670, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.86% (5.2763 => 3.1732, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.63% (5.3855 => 3.6818, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.22% (5.3526 => 3.6814, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.93% (2.9384 => 2.5585, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -10.44% (22.1758 => 19.8609, std. dev.: 0.0153) SingleSource/UnitTests/Vector/constpool: -4.61% (54.1659 => 51.6674, std. dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.24% (3.8922 => 3.8049, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.91% (1.2373 => 1.1023, std. dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.17% (19.9488 => 18.5193, std. dev.: 0.0919) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.80% (8.1563 => 7.9283, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6909, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0865, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 18:45:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 20:45:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120707014513.400AF2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1846?compare_to=1844&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1846, Order: 159879, Start Time: 2012-07-07 00:31:33, End Time: 2012-07-07 01:45:12 To: 1844, Order: 159869, Start Time: 2012-07-06 22:49:47, End Time: 2012-07-07 00:03:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (124 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (729 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.50% (2.2775 => 2.3117, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.26% (1.0992 => 1.1130, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.5628 => 0.0003, std. dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.58% (2.0176 => 2.3117, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.25% (0.7061 => 0.7573, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.98% (0.5818 => 0.6224, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.59% (0.5748 => 0.6127, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.75% (0.7038 => 0.7443, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.69% (0.1986 => 0.2099, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.67% (1.3693 => 1.4469, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.66% (0.4062 => 0.4292, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.41% (0.4328 => 0.4562, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.22% (0.5265 => 0.5540, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.20% (0.2596 => 0.2731, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.18% (0.2721 => 0.2862, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.16% (3.9660 => 4.1705, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.07% (0.2782 => 0.2923, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.03% (0.2781 => 0.2921, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.03% (0.7710 => 0.8098, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2607 => 0.2733, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 4.72% (0.3578 => 0.3747, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.69% (0.2966 => 0.3105, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.67% (0.3489 => 0.3652, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.67% (0.2655 => 0.2779, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 4.62% (0.2726 => 0.2852, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.60% (0.2760 => 0.2887, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.59% (0.2765 => 0.2892, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.58% (0.6959 => 0.7278, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 4.57% (0.2690 => 0.2813, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.57% (0.2628 => 0.2748, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 4.56% (0.2937 => 0.3071, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 4.55% (0.3914 => 0.4092, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.52% (0.4003 => 0.4184, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.51% (0.3789 => 0.3960, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.50% (1.9828 => 2.0720, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 4.50% (0.3646 => 0.3810, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 4.49% (0.2761 => 0.2885, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.47% (0.3580 => 0.3740, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.45% (0.3663 => 0.3826, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 4.42% (0.3623 => 0.3783, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.42% (0.3601 => 0.3760, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.38% (0.3107 => 0.3243, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.37% (0.3940 => 0.4112, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.36% (0.3899 => 0.4069, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.36% (0.3650 => 0.3809, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.35% (0.3149 => 0.3286, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.30% (0.2696 => 0.2812, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.29% (13.8202 => 14.4136, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/sieve: 4.29% (0.3453 => 0.3601, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.19% (0.9199 => 0.9584, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.18% (0.4016 => 0.4184, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.10% (0.3485 => 0.3628, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.10% (0.3534 => 0.3679, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 4.09% (16.6129 => 17.2926, std. dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.08% (13.2842 => 13.8266, std. dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.02% (0.3756 => 0.3907, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.01% (0.3192 => 0.3320, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.98% (0.2988 => 0.3107, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3293 => 0.3420, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.83% (0.2925 => 0.3037, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.81% (1.2193 => 1.2658, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.74% (0.4390 => 0.4554, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.60% (0.5577 => 0.5778, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.5637 => 0.5831, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.43% (1.0594 => 1.0957, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.40% (1.4563 => 1.5058, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.38% (1.3245 => 1.3693, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.31% (1.1364 => 1.1740, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: 3.24% (3.8646 => 3.9900, std. dev.: 0.0051) MultiSource/Applications/treecc/treecc: 3.24% (1.9270 => 1.9894, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3246 => 0.3351, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.20% (1.1061 => 1.1415, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.20% (0.4379 => 0.4519, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.18% (1.3819 => 1.4259, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.17% (0.7506 => 0.7744, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.11% (1.3813 => 1.4242, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.96% (7.2180 => 7.4315, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.95% (4.9865 => 5.1336, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.92% (0.7460 => 0.7678, std. dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 2.86% (1.2292 => 1.2643, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.71% (3.6692 => 3.7687, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8310 => 0.8535, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3755 => 0.3856, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 2.55% (14.8535 => 15.2327, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.48% (0.4791 => 0.4910, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.46% (6.5754 => 6.7371, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.39% (2.1791 => 2.2312, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.22% (4.3801 => 4.4774, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.12% (1.1333 => 1.1573, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.10% (0.6135 => 0.6264, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.06% (0.8698 => 0.8877, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.05% (4.4433 => 4.5345, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 1.96% (16.2614 => 16.5797, std. dev.: 0.0239) MultiSource/Applications/d/make_dparser: 1.89% (3.1889 => 3.2493, std. dev.: 0.0187) MultiSource/Applications/SIBsim4/SIBsim4: 1.68% (1.2749 => 1.2963, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 1.66% (14.5298 => 14.7703, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (2.1007 => 2.1325, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.83% (0.4846 => 0.6970, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.75% (1.8175 => 2.2673, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.44% (2.0200 => 2.1904, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.15% (1.2998 => 1.3927, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7331, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6782, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.50% (1.7688 => 1.8307, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4798, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0310 => 1.0562, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5089 => 1.5356, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.62% (3.6469 => 3.7060, std. dev.: 0.0078) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.63% (22.5627 => 21.0675, std. dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.22% (0.3511 => 0.3398, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.34% (0.8818 => 0.8612, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.19% (0.9108 => 0.9000, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.57% (1.2308 => 1.1130, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.25% (20.3410 => 18.4588, std. dev.: 0.0434) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std. dev.: 0.0085) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5957, std. dev.: 0.0173) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5065, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2476, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7456, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1189, std. dev.: 0.0639) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: -1.37% (3.0263 => 2.9849, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2123, std. dev.: 0.0197) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2491, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -1.03% (7.3305 => 7.2549, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 19:02:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 21:02:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120707020216.22ECA2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1847?compare_to=1845&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1847, Order: 159879, Start Time: 2012-07-07 00:43:55, End Time: 2012-07-07 02:02:17 To: 1845, Order: 159869, Start Time: 2012-07-06 22:57:22, End Time: 2012-07-07 00:16:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (73 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 928 (782 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (13.4414 => 13.6897, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.14% (1.1023 => 1.1149, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: -8.77% (0.1140 => 0.1040, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4056 => 0.0003, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.05% (10.3673 => 13.6897, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.49% (1.1194 => 1.2480, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.80% (0.1432 => 0.1558, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.29% (0.3473 => 0.3761, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.27% (1.7609 => 1.9066, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.10% (0.3543 => 0.3830, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.06% (0.3497 => 0.3779, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.04% (0.3543 => 0.3828, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.03% (0.3561 => 0.3847, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.99% (0.3516 => 0.3797, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.93% (0.3694 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.64% (0.3886 => 0.4183, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: 7.59% (0.3927 => 0.4225, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.58% (0.3828 => 0.4118, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 7.34% (0.1622 => 0.1741, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.91% (2.2022 => 2.3544, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.18% (0.2065 => 0.2172, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.16% (0.3177 => 0.3341, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.08% (0.4879 => 0.5127, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.96% (10.4361 => 10.9542, std. dev.: 0.0130) MultiSource/Applications/lambda-0_1_3/lambda: 4.45% (0.7433 => 0.7764, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.38% (7.0540 => 7.3630, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 4.28% (0.6030 => 0.6288, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.22% (0.5925 => 0.6175, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 3.90% (0.3282 => 0.3410, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 3.72% (0.3092 => 0.3207, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 3.54% (0.7326 => 0.7585, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.30% (0.5569 => 0.5753, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.29% (0.4615 => 0.4767, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.18% (0.3180 => 0.3281, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.11% (4.9449 => 5.0985, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.09% (14.3668 => 14.8101, std. dev.: 0.0068) MultiSource/Applications/spiff/spiff: 3.05% (0.7835 => 0.8074, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.03% (0.8172 => 0.8420, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.0018 => 5.1532, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/18-imp/imp: 2.95% (0.3423 => 0.3524, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.91% (4.2646 => 4.3888, std. dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 2.91% (9.4845 => 9.7603, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.78% (0.5860 => 0.6023, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 2.77% (1.1642 => 1.1965, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.76% (8.1363 => 8.3606, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 2.72% (2.0273 => 2.0824, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.59% (3.3354 => 3.4217, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.52% (0.8067 => 0.8270, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.46% (0.4103 => 0.4204, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.43% (1.1861 => 1.2149, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.22% (3.8723 => 3.9582, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.20% (1.5415 => 1.5754, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.19% (1.5603 => 1.5945, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.17% (1.3050 => 1.3333, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.15% (5.7591 => 5.8831, std. dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.14% (0.6450 => 0.6588, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.96% (0.5105 => 0.5205, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.94% (17.1811 => 17.5146, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.94% (2.2024 => 2.2451, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.4186 => 1.4456, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.89% (0.9765 => 0.9950, std. dev.: 0.0038) MultiSource/Applications/minisat/minisat: 1.71% (0.7115 => 0.7237, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.71% (0.5981 => 0.6083, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.43% (1.1840 => 1.2009, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 1.34% (2.2969 => 2.3277, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.21% (2.0665 => 2.0915, std. dev.: 0.0029) MultiSource/Applications/lemon/lemon: 1.19% (1.0722 => 1.0850, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.80% (1.1145 => 1.1903, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7464, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.26% (26.0924 => 26.6824, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (1.5086 => 1.5362, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4463, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6895, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2343, std. dev.: 0.0121) MultiSource/Applications/spiff/spiff: 1.13% (2.9346 => 2.9679, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1261, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.63% (5.2763 => 3.1855, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.54% (5.3855 => 3.6868, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.11% (5.3526 => 3.6874, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.82% (2.9384 => 2.5618, std. dev.: 0.0196) MultiSource/Applications/ClamAV/clamscan: -10.07% (22.1758 => 19.9422, std. dev.: 0.0080) SingleSource/UnitTests/Vector/constpool: -4.56% (54.1659 => 51.6983, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.49% (3.8922 => 3.8344, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.63% (0.0998 => 0.0842, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -9.89% (1.2373 => 1.1149, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.44% (19.9488 => 18.6647, std. dev.: 0.0340) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9146, std. dev.: 0.0092) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6898, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0833, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 19:57:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 21:57:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120707025700.941482A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1848?compare_to=1843&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1848, Order: 159878, Start Time: 2012-07-07 00:14:06, End Time: 2012-07-07 02:57:00 To: 1843, Order: 159854, Start Time: 2012-07-06 21:03:28, End Time: 2012-07-06 23:46:38 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (41 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 949 (852 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 11.89% (0.2127 => 0.2380, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.47% (54.1621 => 54.9596, std. dev.: 0.0286) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.14% (1.6246 => 1.6061, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 8.94% (0.3446 => 0.3754, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.92% (0.3465 => 0.3774, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.90% (0.3496 => 0.3807, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.87% (0.3460 => 0.3767, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.83% (0.3442 => 0.3746, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.82% (0.3469 => 0.3775, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.77% (0.3488 => 0.3794, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.65% (0.3643 => 0.3958, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.44% (0.3650 => 0.3958, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.19% (0.3724 => 0.4029, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 4.29% (0.5826 => 0.6076, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.97% (0.5889 => 0.6123, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.68% (0.5900 => 0.6117, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.44% (0.4361 => 0.4511, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.42% (1.6211 => 1.6766, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.15% (3.5627 => 3.6748, std. dev.: 0.0059) MultiSource/Applications/spiff/spiff: 2.95% (0.4029 => 0.4148, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.85% (0.3930 => 0.4042, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (0.5026 => 0.5169, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 2.78% (0.7171 => 0.7370, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.76% (4.2109 => 4.3271, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.75% (1.3152 => 1.3514, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.42% (0.4994 => 0.5115, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.36% (0.5000 => 0.5118, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.16% (2.7292 => 2.7881, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.10% (1.9694 => 2.0107, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.96% (1.0781 => 1.0992, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (4.4195 => 4.5028, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 1.85% (1.8794 => 1.9141, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.84% (1.9966 => 2.0333, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (2.0673 => 2.1038, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.74% (0.9909 => 1.0081, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (2.1013 => 2.1346, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 1.54% (5.5417 => 5.6272, std. dev.: 0.0133) MultiSource/Applications/siod/siod: 1.54% (0.6634 => 0.6736, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 1.44% (2.1653 => 2.1965, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 1.36% (0.7875 => 0.7982, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 1.33% (23.5202 => 23.8332, std. dev.: 0.0118) MultiSource/Applications/JM/lencod/lencod: 1.30% (4.6177 => 4.6778, std. dev.: 0.0097) MultiSource/Applications/hbd/hbd: 1.26% (0.9697 => 0.9819, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.21% (1.4269 => 1.4442, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.58% (11.9555 => 11.6471, std. dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 20:26:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 22:26:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120707032637.6B9F42A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1849?compare_to=1846&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1849, Order: 159881, Start Time: 2012-07-07 02:12:44, End Time: 2012-07-07 03:26:35 To: 1846, Order: 159879, Start Time: 2012-07-07 00:31:33, End Time: 2012-07-07 01:45:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (127 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.84% (56.5069 => 54.3352, std. dev.: 0.7940) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.99% (2.0176 => 2.3201, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.04% (0.7061 => 0.7558, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.67% (0.5818 => 0.6206, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.40% (0.5748 => 0.6116, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.61% (0.7038 => 0.7433, std. dev.: 0.0062) MultiSource/Applications/hbd/hbd: 5.56% (1.3693 => 1.4455, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 5.49% (0.4062 => 0.4285, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.38% (0.4328 => 0.4561, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.33% (0.2721 => 0.2866, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.24% (0.1986 => 0.2090, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.14% (3.9660 => 4.1698, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.07% (0.5265 => 0.5532, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.07% (0.2781 => 0.2922, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.97% (0.2596 => 0.2725, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.90% (0.7710 => 0.8088, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.74% (0.2782 => 0.2914, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.70% (0.3022 => 0.3164, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.64% (0.2607 => 0.2728, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 4.57% (0.2690 => 0.2813, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.55% (0.2966 => 0.3101, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.52% (0.2655 => 0.2775, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.51% (0.6959 => 0.7273, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 4.50% (0.3578 => 0.3739, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.49% (0.2760 => 0.2884, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.3899 => 0.4073, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.45% (1.9828 => 2.0711, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.45% (0.2628 => 0.2745, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.44% (0.3489 => 0.3644, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.44% (0.2726 => 0.2847, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.41% (0.2765 => 0.2887, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.39% (0.2937 => 0.3066, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 4.34% (0.3663 => 0.3822, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 4.33% (0.3646 => 0.3804, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 4.33% (0.3789 => 0.3953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.31% (0.2761 => 0.2880, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.30% (0.3580 => 0.3734, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.30% (0.3650 => 0.3807, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 4.28% (0.3601 => 0.3755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.27% (0.4003 => 0.4174, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.27% (0.2696 => 0.2811, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.25% (0.3107 => 0.3239, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.24% (13.8202 => 14.4066, std. dev.: 0.0106) SingleSource/UnitTests/ObjC/exceptions: 4.24% (0.3914 => 0.4080, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.19% (0.3149 => 0.3281, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.09% (13.2842 => 13.8271, std. dev.: 0.0133) SingleSource/UnitTests/ObjC/exceptions-3: 4.09% (0.3623 => 0.3771, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.05% (0.9199 => 0.9572, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 4.04% (0.3940 => 0.4099, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.02% (0.3485 => 0.3625, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.96% (0.4016 => 0.4175, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.92% (0.3192 => 0.3317, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.90% (16.6129 => 17.2612, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/sieve: 3.88% (0.3453 => 0.3587, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.3756 => 0.3901, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.76% (0.3534 => 0.3667, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 3.75% (0.2988 => 0.3100, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.71% (1.2193 => 1.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.67% (0.3293 => 0.3414, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (0.4390 => 0.4551, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.2925 => 0.3028, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.48% (0.5577 => 0.5771, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 3.45% (1.0594 => 1.0960, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.42% (0.5637 => 0.5830, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.39% (0.3868 => 0.3999, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.38% (1.4563 => 1.5055, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (1.3245 => 1.3683, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.26% (1.3819 => 1.4269, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.25% (1.1364 => 1.1733, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.12% (1.1061 => 1.1406, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 3.09% (0.7506 => 0.7738, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3246 => 0.3346, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.08% (3.8646 => 3.9836, std. dev.: 0.0063) MultiSource/Applications/treecc/treecc: 3.07% (1.9270 => 1.9861, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.00% (1.3813 => 1.4228, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.97% (0.4379 => 0.4509, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.81% (7.2180 => 7.4205, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 2.77% (0.8310 => 0.8540, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.77% (4.9865 => 5.1245, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.76% (0.7460 => 0.7666, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.76% (1.2292 => 1.2631, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.55% (3.6692 => 3.7629, std. dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (6.5754 => 6.7357, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.38% (0.4791 => 0.4905, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.37% (14.8535 => 15.2056, std. dev.: 0.0181) MultiSource/Applications/siod/siod: 2.36% (2.1791 => 2.2306, std. dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.02% (4.3801 => 4.4686, std. dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 1.99% (16.2614 => 16.5842, std. dev.: 0.0194) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.93% (4.4433 => 4.5290, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.92% (1.1333 => 1.1551, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.89% (3.1889 => 3.2492, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.8698 => 0.8857, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.83% (0.6135 => 0.6247, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.68% (1.2749 => 1.2963, std. dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.60% (14.5298 => 14.7619, std. dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.39% (2.1007 => 2.1300, std. dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2670, std. dev.: 0.0539) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.54% (2.0200 => 2.1926, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 7.53% (1.2998 => 1.3977, std. dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7295, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9235, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6788, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.82% (1.4298 => 1.4558, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6469 => 3.7090, std. dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.39% (1.9433 => 1.9703, std. dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (1.9290 => 1.9552, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.62% (0.4657 => 0.3976, std. dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.65% (22.5627 => 21.0617, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.28% (0.3511 => 0.3396, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.45% (0.8818 => 0.8602, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.22% (0.9108 => 0.8997, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.55% (0.0997 => 0.0842, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.53% (1.2308 => 1.1012, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.67% (20.3410 => 18.5767, std. dev.: 0.0493) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5862, std. dev.: 0.0101) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5086, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.68% (28.2225 => 27.7471, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2556, std. dev.: 0.0058) MultiSource/Applications/lua/lua: -1.55% (26.5159 => 26.1055, std. dev.: 0.0370) MultiSource/Applications/minisat/minisat: -1.41% (9.3358 => 9.2041, std. dev.: 0.0170) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -1.39% (3.0263 => 2.9843, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std. dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2526, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 20:48:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 6 Jul 2012 22:48:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120707034834.5FE5A2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1850?compare_to=1847&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1850, Order: 159881, Start Time: 2012-07-07 02:29:56, End Time: 2012-07-07 03:48:35 To: 1847, Order: 159879, Start Time: 2012-07-07 00:43:55, End Time: 2012-07-07 02:02:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (68 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (787 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.00% (10.3673 => 13.6853, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2484, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 8.23% (0.3473 => 0.3759, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.07% (0.3543 => 0.3829, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.00% (1.7609 => 1.9017, std. dev.: 0.0093) SingleSource/UnitTests/ObjC/exceptions-2: 7.92% (0.3497 => 0.3774, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.89% (0.3561 => 0.3842, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.87% (0.3543 => 0.3822, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.85% (0.3516 => 0.3792, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 7.83% (0.1622 => 0.1749, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 7.74% (0.3694 => 0.3980, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.51% (0.3886 => 0.4178, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.3927 => 0.4221, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: 7.39% (0.3828 => 0.4111, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.73% (2.2022 => 2.3504, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.19% (10.4361 => 10.9773, std. dev.: 0.0201) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.16% (0.3177 => 0.3341, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.4879 => 0.5123, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.84% (0.2065 => 0.2165, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.35% (7.0540 => 7.3609, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 4.26% (0.7433 => 0.7750, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 3.81% (0.3282 => 0.3407, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 3.65% (0.5925 => 0.6141, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 3.59% (0.3092 => 0.3203, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.53% (0.6030 => 0.6243, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.30% (0.5569 => 0.5753, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.16% (0.4615 => 0.4761, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.03% (14.3668 => 14.8021, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.94% (0.5860 => 0.6032, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.93% (4.9449 => 5.0897, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.92% (0.7326 => 0.7540, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.90% (0.8172 => 0.8409, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.81% (5.0018 => 5.1422, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: 2.72% (0.7835 => 0.8048, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.68% (4.2646 => 4.3791, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.63% (8.1363 => 8.3504, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 2.56% (9.4845 => 9.7275, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 2.50% (2.0273 => 2.0780, std. dev.: 0.0078) MultiSource/Applications/d/make_dparser: 2.34% (3.3354 => 3.4136, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.19% (1.1861 => 1.2121, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.16% (0.8067 => 0.8241, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 2.08% (1.1642 => 1.1884, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.03% (1.5415 => 1.5728, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.03% (3.8723 => 3.9508, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.99% (1.3050 => 1.3310, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 1.97% (5.7591 => 5.8725, std. dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: 1.93% (17.1811 => 17.5125, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.88% (0.6450 => 0.6571, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 1.87% (1.5603 => 1.5895, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.77% (0.9765 => 0.9938, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.77% (1.4186 => 1.4437, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.64% (2.2024 => 2.2385, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.42% (0.7115 => 0.7216, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.26% (1.1840 => 1.1989, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 1.17% (2.2969 => 2.3238, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.13% (1.5859 => 1.6038, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.04% (1.0722 => 1.0834, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7508, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.21% (26.0924 => 26.6689, std. dev.: 0.0168) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5366, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.47% (2.6546 => 2.6937, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.41% (9.1159 => 9.2440, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.16% (2.9346 => 2.9687, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.78% (5.2763 => 3.1773, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.37% (5.3855 => 3.6960, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.96% (5.3526 => 3.6954, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.87% (2.9384 => 2.5603, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.26% (22.1758 => 19.9016, std. dev.: 0.0164) SingleSource/UnitTests/Vector/constpool: -4.65% (54.1659 => 51.6489, std. dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.33% (3.8922 => 3.8404, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.53% (0.0998 => 0.0843, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.50% (1.2373 => 1.1074, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.02% (19.9488 => 18.5493, std. dev.: 0.0567) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.76% (8.1563 => 7.9312, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.51% (32.5116 => 31.6950, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0858, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 22:08:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 00:08:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120707050803.846762A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1851?compare_to=1849&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1851, Order: 159887, Start Time: 2012-07-07 03:54:21, End Time: 2012-07-07 05:08:03 To: 1849, Order: 159881, Start Time: 2012-07-07 02:12:44, End Time: 2012-07-07 03:26:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (128 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.04% (54.3352 => 56.5305, std. dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.11% (1.3074 => 1.3219, std. dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.11% (2.0176 => 2.3022, std. dev.: 0.0124) SingleSource/UnitTests/ObjC++/property-reference-object: 7.17% (0.5818 => 0.6235, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.89% (0.5748 => 0.6144, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.85% (0.7061 => 0.7545, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 5.74% (0.7038 => 0.7442, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 5.62% (1.3693 => 1.4463, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.4062 => 0.4288, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.54% (0.1986 => 0.2096, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.43% (0.4328 => 0.4563, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.22% (0.5265 => 0.5540, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.13% (3.9660 => 4.1695, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.11% (0.2721 => 0.2860, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.10% (0.7710 => 0.8103, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 5.07% (0.2781 => 0.2922, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.01% (0.2596 => 0.2726, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2782 => 0.2919, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.90% (0.3022 => 0.3170, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 4.86% (0.3578 => 0.3752, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.78% (0.2761 => 0.2893, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.77% (0.2726 => 0.2856, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.76% (0.2607 => 0.2731, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 4.75% (0.3914 => 0.4100, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.75% (0.2760 => 0.2891, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.75% (0.2655 => 0.2781, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.72% (0.3789 => 0.3968, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.72% (0.2690 => 0.2817, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 4.72% (0.3601 => 0.3771, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 4.69% (0.3646 => 0.3817, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 4.67% (0.4003 => 0.4190, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.67% (0.3940 => 0.4124, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 4.66% (0.3623 => 0.3792, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.65% (0.2966 => 0.3104, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 4.61% (0.3663 => 0.3832, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.59% (1.9828 => 2.0739, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.59% (0.2765 => 0.2892, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.58% (0.3580 => 0.3744, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.53% (0.3489 => 0.3647, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3899 => 0.4074, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.47% (0.3107 => 0.3246, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.46% (0.2937 => 0.3068, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.45% (0.3149 => 0.3289, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.41% (0.2696 => 0.2815, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.38% (0.6959 => 0.7264, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 4.20% (13.8202 => 14.4004, std. dev.: 0.0190) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.13% (0.3485 => 0.3629, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.10% (0.9199 => 0.9576, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.09% (16.6129 => 17.2923, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.08% (0.4016 => 0.4180, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3453 => 0.3593, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.04% (0.3192 => 0.3321, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.02% (0.3534 => 0.3676, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.95% (0.2988 => 0.3106, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3293 => 0.3420, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.85% (13.2842 => 13.7961, std. dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.85% (0.4390 => 0.4559, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.83% (1.2193 => 1.2660, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 3.83% (0.2925 => 0.3037, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.75% (0.3756 => 0.3897, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.67% (0.3868 => 0.4010, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.62% (1.4563 => 1.5090, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.59% (0.5577 => 0.5777, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.50% (0.2945 => 0.3048, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.5637 => 0.5831, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.37% (1.3245 => 1.3691, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.34% (1.0594 => 1.0948, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.30% (0.3246 => 0.3353, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.28% (3.8646 => 3.9912, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.20% (1.1364 => 1.1728, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.18% (0.7506 => 0.7745, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.11% (1.9270 => 1.9870, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.11% (1.3819 => 1.4249, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.08% (0.4379 => 0.4514, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.04% (1.1061 => 1.1397, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 2.97% (1.2292 => 1.2657, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.90% (1.3813 => 1.4213, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.85% (4.9865 => 5.1285, std. dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.80% (7.2180 => 7.4201, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3755 => 0.3857, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.67% (0.7460 => 0.7659, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.64% (3.6692 => 3.7660, std. dev.: 0.0097) MultiSource/Applications/siod/siod: 2.42% (2.1791 => 2.2319, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.38% (0.4791 => 0.4905, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (6.5754 => 6.7263, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.28% (14.8535 => 15.1929, std. dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.12% (0.6135 => 0.6265, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.00% (4.3801 => 4.4679, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.95% (4.4433 => 4.5298, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.94% (0.8698 => 0.8867, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.89% (1.1333 => 1.1547, std. dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 1.85% (16.2614 => 16.5616, std. dev.: 0.0074) MultiSource/Applications/d/make_dparser: 1.77% (3.1889 => 3.2452, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.76% (1.2749 => 1.2973, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.64% (0.6283 => 0.6386, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.63% (14.5298 => 14.7666, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (2.1007 => 2.1325, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.39% (1.8175 => 2.2789, std. dev.: 0.0432) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.41% (2.0200 => 2.1899, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.33% (1.2998 => 1.3951, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7236, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4804, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0310 => 1.0557, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1889, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.86% (1.4298 => 1.4564, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5342, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.45% (3.6469 => 3.6998, std. dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1961, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.50% (0.4657 => 0.3935, std. dev.: 0.0109) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.84% (22.5627 => 21.0204, std. dev.: 0.0251) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.36% (0.8818 => 0.8610, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.17% (0.9108 => 0.9001, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.66% (1.2308 => 1.0996, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.31% (20.3410 => 18.4477, std. dev.: 0.0949) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.07% (1.3780 => 1.3219, std. dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.49% (8.8259 => 8.6059, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.01% (6.6320 => 6.4986, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7456, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2563, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1182, std. dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.49% (0.9692 => 0.9548, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4887, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -1.43% (3.0263 => 2.9830, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2154, std. dev.: 0.0343) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2501, std. dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 22:34:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 00:34:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120707053424.A697E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1852?compare_to=1850&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1852, Order: 159888, Start Time: 2012-07-07 04:16:10, End Time: 2012-07-07 05:34:24 To: 1850, Order: 159881, Start Time: 2012-07-07 02:29:56, End Time: 2012-07-07 03:48:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (64 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (791 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.10% (13.6853 => 13.8354, std. dev.: 0.0086) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.45% (10.3673 => 13.8354, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.32% (1.1194 => 1.2461, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.35% (0.3473 => 0.3763, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.11% (1.7609 => 1.9037, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.07% (0.3543 => 0.3829, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 8.02% (0.3543 => 0.3827, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 8.01% (0.3497 => 0.3777, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.99% (0.3516 => 0.3797, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 7.98% (0.3561 => 0.3845, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.82% (0.3694 => 0.3983, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.55% (0.3828 => 0.4117, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 7.54% (0.3886 => 0.4179, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 7.51% (0.3927 => 0.4222, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 7.21% (0.1622 => 0.1739, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.80% (2.2022 => 2.3519, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.86% (0.4879 => 0.5116, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 4.77% (10.4361 => 10.9338, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.63% (0.3177 => 0.3324, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.33% (7.0540 => 7.3596, std. dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 3.98% (0.7433 => 0.7729, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 3.93% (0.5925 => 0.6158, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 3.85% (0.6030 => 0.6262, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 3.50% (0.3282 => 0.3397, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.40% (0.3092 => 0.3197, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.03% (0.7326 => 0.7548, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5569 => 0.5733, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.90% (0.4615 => 0.4749, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.83% (14.3668 => 14.7738, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.80% (4.9449 => 5.0832, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (5.0018 => 5.1363, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.68% (0.8172 => 0.8391, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.59% (0.7835 => 0.8038, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.49% (4.2646 => 4.3708, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 2.48% (9.4845 => 9.7199, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.44% (0.5860 => 0.6003, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.41% (8.1363 => 8.3323, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 2.41% (2.0273 => 2.0761, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.29% (0.8067 => 0.8252, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.07% (3.3354 => 3.4044, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.06% (1.1861 => 1.2105, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 2.03% (1.1642 => 1.1878, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.84% (1.5415 => 1.5699, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.81% (0.6450 => 0.6567, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 1.80% (5.7591 => 5.8629, std. dev.: 0.0139) MultiSource/Applications/lua/lua: 1.80% (3.8723 => 3.9419, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.76% (17.1811 => 17.4840, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.76% (1.3050 => 1.3280, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.61% (0.9765 => 0.9922, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.58% (1.5603 => 1.5849, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.56% (1.4186 => 1.4407, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.43% (2.2024 => 2.2340, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.09% (1.1840 => 1.1969, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.08% (2.2969 => 2.3216, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9749, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7510, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.06% (26.0924 => 26.6306, std. dev.: 0.0519) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5086 => 1.5360, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4473, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6893, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2319, std. dev.: 0.0051) MultiSource/Applications/spiff/spiff: 1.12% (2.9346 => 2.9675, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.06% (5.2763 => 3.1626, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.43% (5.3855 => 3.6928, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.04% (5.3526 => 3.6913, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.23% (2.9384 => 2.5497, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -10.27% (22.1758 => 19.8985, std. dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -4.77% (54.1659 => 51.5819, std. dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.80% (3.8922 => 3.8221, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.59% (1.2373 => 1.1063, std. dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.74% (19.9488 => 18.6047, std. dev.: 0.0241) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.97% (8.1563 => 7.9140, std. dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6895, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0817, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 23:08:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 01:08:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120707060821.76C1A2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1853?compare_to=1848&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1853, Order: 159886, Start Time: 2012-07-07 03:25:18, End Time: 2012-07-07 06:08:22 To: 1848, Order: 159878, Start Time: 2012-07-07 00:14:06, End Time: 2012-07-07 02:57:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (43 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (850 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.04% (122.8127 => 126.5431, std. dev.: 0.6401) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.17% (2.0848 => 2.0604, std. dev.: 0.0086) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 8.14% (0.3465 => 0.3747, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.09% (0.3496 => 0.3779, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.01% (0.3469 => 0.3747, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.01% (0.3446 => 0.3722, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.95% (0.3460 => 0.3735, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.93% (0.3442 => 0.3715, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.86% (0.3488 => 0.3762, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.74% (0.3643 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.70% (0.3650 => 0.3931, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 7.38% (0.3724 => 0.3999, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 4.05% (0.5826 => 0.6062, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 3.79% (0.5889 => 0.6112, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.45% (1.6211 => 1.6770, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.42% (0.4361 => 0.4510, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.25% (0.5900 => 0.6092, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.17% (3.5627 => 3.6755, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.92% (0.5026 => 0.5173, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (0.3930 => 0.4041, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.80% (0.4029 => 0.4142, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.78% (4.2109 => 4.3281, std. dev.: 0.0071) SingleSource/UnitTests/ObjC++/property-reference: 2.69% (0.7171 => 0.7364, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.66% (0.4994 => 0.5127, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.66% (1.3152 => 1.3502, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 2.55% (0.9909 => 1.0162, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.53% (2.0673 => 2.1197, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.50% (0.5000 => 0.5125, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (4.4195 => 4.5159, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.11% (1.9694 => 2.0109, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.11% (1.0781 => 1.1008, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.03% (0.9697 => 0.9894, std. dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (2.7292 => 2.7833, std. dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 1.88% (23.5202 => 23.9625, std. dev.: 0.0139) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.84% (1.9966 => 2.0333, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 1.77% (5.5417 => 5.6396, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 1.69% (1.8794 => 1.9112, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.68% (0.6435 => 0.6543, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.67% (0.6634 => 0.6745, std. dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 1.63% (1.5932 => 1.6192, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 1.58% (2.1653 => 2.1995, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (2.1013 => 2.1334, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.47% (0.7875 => 0.7991, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.47% (4.6177 => 4.6857, std. dev.: 0.0072) MultiSource/Applications/lua/lua: 1.43% (1.4269 => 1.4473, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.34% (11.9555 => 11.6760, std. dev.: 0.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 6 23:49:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 01:49:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120707064920.3DDB52A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1854?compare_to=1851&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1854, Order: 159891, Start Time: 2012-07-07 05:35:41, End Time: 2012-07-07 06:49:20 To: 1851, Order: 159887, Start Time: 2012-07-07 03:54:21, End Time: 2012-07-07 05:08:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (129 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (723 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.14% (1.0996 => 1.1121, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.02% (18.4477 => 18.6353, std. dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.27% (2.0176 => 2.3056, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.00% (0.7061 => 0.7555, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.86% (0.5818 => 0.6217, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.47% (0.5748 => 0.6120, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.06% (1.3693 => 1.4523, std. dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 5.88% (0.7038 => 0.7452, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.59% (0.1986 => 0.2097, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.38% (0.4328 => 0.4561, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.32% (0.5265 => 0.5545, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.16% (0.2596 => 0.2730, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.16% (3.9660 => 4.1706, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.11% (0.2721 => 0.2860, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.97% (0.7710 => 0.8093, std. dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 4.78% (0.2781 => 0.2914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 4.67% (0.3578 => 0.3745, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.65% (0.2966 => 0.3104, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.58% (0.6959 => 0.7278, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 4.56% (0.2607 => 0.2726, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.52% (0.4003 => 0.4184, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.50% (0.3022 => 0.3158, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 4.50% (0.3914 => 0.4090, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.49% (0.3789 => 0.3959, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 4.44% (0.3646 => 0.3808, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.42% (0.2690 => 0.2809, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.42% (0.2782 => 0.2905, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.42% (0.3601 => 0.3760, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.3489 => 0.3643, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.40% (0.3663 => 0.3824, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.36% (0.3580 => 0.3736, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 4.34% (0.3940 => 0.4111, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.34% (0.2628 => 0.2742, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.33% (0.3899 => 0.4068, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 4.33% (0.3623 => 0.3780, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.33% (0.2655 => 0.2770, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2726 => 0.2844, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.31% (0.2760 => 0.2879, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.30% (0.3650 => 0.3807, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.27% (13.8202 => 14.4110, std. dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.23% (0.2765 => 0.2882, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.19% (0.3149 => 0.3281, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.19% (1.9828 => 2.0659, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 4.19% (16.6129 => 17.3083, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.15% (0.2696 => 0.2808, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.15% (0.2937 => 0.3059, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.15% (0.3107 => 0.3236, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.13% (0.2761 => 0.2875, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.96% (0.9199 => 0.9563, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.90% (0.3485 => 0.3621, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.84% (13.2842 => 13.7941, std. dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/sieve: 3.76% (0.3453 => 0.3583, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.75% (1.2193 => 1.2650, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 3.74% (0.3534 => 0.3666, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.4016 => 0.4166, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.73% (0.2925 => 0.3034, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.68% (0.2988 => 0.3098, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.60% (0.3192 => 0.3307, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.59% (0.3756 => 0.3891, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.58% (0.3293 => 0.3411, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.55% (0.5577 => 0.5775, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.54% (1.4563 => 1.5079, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.46% (0.5637 => 0.5832, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (0.4390 => 0.4541, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.44% (1.1061 => 1.1441, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.42% (0.7506 => 0.7763, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.40% (1.3245 => 1.3695, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.39% (0.3246 => 0.3356, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 3.34% (0.3868 => 0.3997, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.32% (3.8646 => 3.9929, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.29% (1.1364 => 1.1738, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.25% (1.0594 => 1.0938, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 3.24% (1.9270 => 1.9894, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.20% (0.4379 => 0.4519, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.95% (1.3819 => 1.4226, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.92% (4.9865 => 5.1320, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.86% (1.3813 => 1.4208, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.83% (7.2180 => 7.4226, std. dev.: 0.0066) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.80% (0.7460 => 0.7669, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8310 => 0.8542, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.63% (1.2292 => 1.2615, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.56% (14.8535 => 15.2334, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.55% (3.6692 => 3.7627, std. dev.: 0.0047) MultiSource/Applications/siod/siod: 2.55% (2.1791 => 2.2346, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 2.40% (6.5754 => 6.7331, std. dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.34% (0.4791 => 0.4903, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.09% (4.3801 => 4.4715, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.00% (0.6135 => 0.6258, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.00% (16.2614 => 16.5873, std. dev.: 0.0116) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.96% (4.4433 => 4.5303, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.92% (1.1333 => 1.1551, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.89% (0.8698 => 0.8862, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 1.80% (3.1889 => 3.2464, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 1.63% (14.5298 => 14.7668, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.6283 => 0.6384, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.57% (1.2749 => 1.2949, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.1007 => 2.1303, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.63% (1.8175 => 2.2651, std. dev.: 0.0454) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1892, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 7.05% (1.2998 => 1.3914, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.74% (7.4271 => 7.7048, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6797, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8312, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4800, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.95% (4.1080 => 4.1880, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4553, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.77% (3.6469 => 3.7115, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5336, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.24% (3.7731 => 3.8198, std. dev.: 0.0180) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.68% (0.4657 => 0.3880, std. dev.: 0.0082) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.62% (22.5627 => 21.0691, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.22% (0.3511 => 0.3398, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.45% (0.8818 => 0.8602, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.28% (0.9108 => 0.8991, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.64% (1.2308 => 1.1121, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (20.3410 => 18.6353, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.76% (1.3780 => 1.3124, std. dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5905, std. dev.: 0.0273) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5034, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7456, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2540, std. dev.: 0.0051) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1165, std. dev.: 0.0154) MultiSource/Applications/spiff/spiff: -1.46% (3.0263 => 2.9821, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.5254 => 2.4886, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8613, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2187, std. dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2522, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 00:22:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 02:22:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120707072258.DF0862A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1855?compare_to=1852&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1855, Order: 159891, Start Time: 2012-07-07 06:02:03, End Time: 2012-07-07 07:22:57 To: 1852, Order: 159888, Start Time: 2012-07-07 04:16:10, End Time: 2012-07-07 05:34:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (55 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (801 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.85% (13.8354 => 13.3031, std. dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.32% (10.3673 => 13.3031, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.47% (1.1194 => 1.2478, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.12% (1.7609 => 1.9039, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 8.12% (0.3473 => 0.3755, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.89% (0.3497 => 0.3773, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.82% (0.3543 => 0.3820, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3516 => 0.3789, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.76% (0.3543 => 0.3818, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.75% (0.3561 => 0.3837, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.61% (0.3694 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.39% (0.3886 => 0.4173, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.36% (0.3927 => 0.4216, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 7.34% (0.3828 => 0.4109, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.82% (2.2022 => 2.3524, std. dev.: 0.0142) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.82% (0.4879 => 0.5114, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 4.69% (10.4361 => 10.9252, std. dev.: 0.0209) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.56% (0.3177 => 0.3322, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.07% (7.0540 => 7.3412, std. dev.: 0.0115) MultiSource/Applications/lambda-0_1_3/lambda: 3.97% (0.7433 => 0.7728, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 3.60% (0.6030 => 0.6247, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.49% (0.5925 => 0.6132, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 3.32% (0.3282 => 0.3391, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.89% (0.5569 => 0.5730, std. dev.: 0.0053) MultiSource/Applications/spiff/spiff: 2.80% (0.7835 => 0.8054, std. dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference: 2.77% (0.7326 => 0.7529, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.71% (0.4615 => 0.4740, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (14.3668 => 14.7234, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.48% (4.9449 => 5.0676, std. dev.: 0.0117) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.47% (5.0018 => 5.1251, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.33% (8.1363 => 8.3262, std. dev.: 0.0123) MultiSource/Benchmarks/mafft/pairlocalalign: 2.31% (9.4845 => 9.7034, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.27% (0.5860 => 0.5993, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.13% (4.2646 => 4.3556, std. dev.: 0.0097) MultiSource/Applications/treecc/treecc: 2.09% (2.0273 => 2.0696, std. dev.: 0.0042) MultiSource/Applications/Burg/burg: 2.04% (1.1642 => 1.1880, std. dev.: 0.0082) MultiSource/Applications/d/make_dparser: 1.96% (3.3354 => 3.4009, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.75% (1.1861 => 1.2069, std. dev.: 0.0038) MultiSource/Applications/lua/lua: 1.67% (3.8723 => 3.9369, std. dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: 1.60% (17.1811 => 17.4555, std. dev.: 0.0192) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.57% (1.5415 => 1.5657, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.56% (1.3050 => 1.3254, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.55% (0.6450 => 0.6550, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 1.51% (5.7591 => 5.8458, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.35% (0.9765 => 0.9897, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.21% (1.4186 => 1.4357, std. dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7590, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.19% (26.0924 => 26.6646, std. dev.: 0.0241) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.07% (1.5086 => 1.5398, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4463, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2452, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6902, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.19% (2.9346 => 2.9695, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.01% (5.2763 => 3.1650, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.38% (5.3855 => 3.6956, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.98% (5.3526 => 3.6941, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.30% (2.9384 => 2.5477, std. dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: -10.32% (22.1758 => 19.8874, std. dev.: 0.0420) SingleSource/UnitTests/Vector/constpool: -5.02% (54.1659 => 51.4475, std. dev.: 0.0241) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.53% (0.0998 => 0.0833, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.18% (1.2373 => 1.1113, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.68% (19.9488 => 18.6165, std. dev.: 0.0335) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.82% (8.1563 => 7.9263, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.51% (32.5116 => 31.6945, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0837, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 01:35:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 03:35:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120707083519.7184F2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1856?compare_to=1854&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1856, Order: 159894, Start Time: 2012-07-07 07:21:27, End Time: 2012-07-07 08:35:19 To: 1854, Order: 159891, Start Time: 2012-07-07 05:35:41, End Time: 2012-07-07 06:49:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (132 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (721 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.52% (2.0176 => 2.3106, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.94% (0.5818 => 0.6222, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.66% (0.5748 => 0.6131, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.21% (0.7038 => 0.7475, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 6.16% (0.7061 => 0.7496, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.99% (0.1986 => 0.2105, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 5.79% (1.3693 => 1.4486, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/trivial-interface: 5.59% (0.3578 => 0.3778, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.50% (3.9660 => 4.1840, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.47% (0.5265 => 0.5553, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: 5.47% (0.3914 => 0.4128, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/parameter-passing: 5.42% (0.4003 => 0.4220, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.40% (0.2721 => 0.2868, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.38% (0.4328 => 0.4561, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.35% (0.2596 => 0.2735, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.32% (0.3650 => 0.3844, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 5.30% (0.3789 => 0.3990, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 5.28% (0.3601 => 0.3791, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.24% (0.3646 => 0.3837, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.7710 => 0.8111, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 5.19% (0.3663 => 0.3853, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 5.18% (0.3940 => 0.4144, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 5.13% (0.3623 => 0.3809, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.94% (0.6959 => 0.7303, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 4.93% (0.2781 => 0.2918, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.85% (0.4062 => 0.4259, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 4.58% (13.8202 => 14.4538, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.53% (0.3022 => 0.3159, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.53% (0.2782 => 0.2908, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3899 => 0.4074, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.44% (0.3489 => 0.3644, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 4.42% (0.2760 => 0.2882, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.42% (0.2966 => 0.3097, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.40% (0.9199 => 0.9604, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.40% (13.2842 => 13.8689, std. dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: 4.37% (16.6129 => 17.3389, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.37% (0.2655 => 0.2771, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2726 => 0.2844, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: 4.31% (0.2690 => 0.2806, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.30% (0.2607 => 0.2719, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.28% (1.9828 => 2.0676, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.24% (0.2925 => 0.3049, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.23% (0.2765 => 0.2882, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.19% (0.3149 => 0.3281, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.19% (0.2628 => 0.2738, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.17% (1.2193 => 1.2701, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.16% (0.3580 => 0.3729, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 4.15% (0.2937 => 0.3059, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 4.09% (0.3107 => 0.3234, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.01% (0.2696 => 0.2804, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.99% (0.3485 => 0.3624, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.94% (0.5577 => 0.5797, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.92% (1.0594 => 1.1009, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.88% (0.4016 => 0.4172, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.83% (1.4563 => 1.5121, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/sieve: 3.82% (0.3453 => 0.3585, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.79% (0.3534 => 0.3668, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.79% (0.3192 => 0.3313, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (1.3245 => 1.3740, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.73% (0.3756 => 0.3896, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.71% (0.5637 => 0.5846, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.69% (3.8646 => 4.0071, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 3.68% (0.2988 => 0.3098, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.67% (0.3868 => 0.4010, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.64% (1.9270 => 1.9972, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.63% (1.1364 => 1.1776, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 3.61% (0.3293 => 0.3412, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 3.61% (0.7506 => 0.7777, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.60% (0.4390 => 0.4548, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.53% (0.2914 => 0.3017, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.51% (0.3246 => 0.3360, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.51% (1.1061 => 1.1449, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.35% (4.9865 => 5.1537, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (0.8310 => 0.8586, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.30% (7.2180 => 7.4561, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.19% (0.4791 => 0.4944, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.11% (0.7460 => 0.7692, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.08% (1.3813 => 1.4239, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.08% (3.6692 => 3.7821, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.05% (1.3819 => 1.4241, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 3.04% (0.4113 => 0.4238, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.00% (14.8535 => 15.2990, std. dev.: 0.0206) MultiSource/Applications/siod/siod: 2.96% (2.1791 => 2.2436, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 2.84% (6.5754 => 6.7621, std. dev.: 0.0119) MultiSource/Applications/hexxagon/hexxagon: 2.73% (1.2292 => 1.2628, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.67% (0.6135 => 0.6299, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.62% (4.3801 => 4.4950, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.56% (4.4433 => 4.5570, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.36% (1.1333 => 1.1600, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.35% (3.1889 => 3.2637, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 2.23% (16.2614 => 16.6242, std. dev.: 0.0184) MultiSource/Applications/SIBsim4/SIBsim4: 2.19% (1.2749 => 1.3028, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.02% (0.6283 => 0.6410, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.1007 => 2.1423, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.98% (14.5298 => 14.8171, std. dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.31% (3.2742 => 3.3172, std. dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 1.25% (8.4961 => 8.6027, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.13% (1.5188 => 1.5360, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.01% (1.0313 => 1.0417, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.95% (1.8175 => 2.2710, std. dev.: 0.0188) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.57% (2.0200 => 2.1931, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 6.59% (1.2998 => 1.3854, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.98% (7.4271 => 7.7230, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6792, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4789, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.07% (1.0310 => 1.0523, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (3.6469 => 3.7086, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.34% (1.9290 => 1.9549, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1224, std. dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.99% (0.3511 => 0.3406, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.78% (0.8818 => 0.8661, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.05% (0.0997 => 0.0847, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.14% (1.2308 => 1.1060, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.83% (20.3410 => 18.5449, std. dev.: 0.0552) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.68% (1.3780 => 1.3135, std. dev.: 0.0115) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9062, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5860, std. dev.: 0.0817) MultiSource/Benchmarks/Olden/health/health: -2.51% (0.4533 => 0.4419, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4474, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5135, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7449, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.46% (6.3560 => 6.2629, std. dev.: 0.0048) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9827, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8626, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4904, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1779, std. dev.: 0.0282) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2225, std. dev.: 0.0156) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2541, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8488, std. dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 02:09:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 04:09:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120707090943.73FD52A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1857?compare_to=1855&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1857, Order: 159895, Start Time: 2012-07-07 07:51:05, End Time: 2012-07-07 09:09:43 To: 1855, Order: 159891, Start Time: 2012-07-07 06:02:03, End Time: 2012-07-07 07:22:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (60 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.01% (55.2675 => 54.7081, std. dev.: 0.1126) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.55% (10.3673 => 13.2237, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.69% (1.1194 => 1.2503, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.92% (1.7609 => 1.9003, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.26% (0.3473 => 0.3725, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.11% (0.3543 => 0.3795, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: 7.01% (0.3497 => 0.3742, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.97% (0.3516 => 0.3761, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 6.94% (0.3561 => 0.3808, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.92% (0.3543 => 0.3788, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.82% (0.3694 => 0.3946, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.78% (0.1622 => 0.1732, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.59% (0.3886 => 0.4142, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.53% (0.3828 => 0.4078, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.52% (0.3927 => 0.4183, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.36% (2.2022 => 2.3423, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.4879 => 0.5112, std. dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 4.77% (10.4361 => 10.9335, std. dev.: 0.0164) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.66% (0.3177 => 0.3325, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.85% (7.0540 => 7.3255, std. dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: 3.77% (0.7433 => 0.7713, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 3.53% (0.3282 => 0.3398, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.49% (0.3092 => 0.3200, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 3.15% (0.6030 => 0.6220, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.11% (0.5925 => 0.6109, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.85% (0.5860 => 0.6027, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.82% (0.5569 => 0.5726, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.77% (0.4615 => 0.4743, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (14.3668 => 14.7617, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.68% (4.9449 => 5.0772, std. dev.: 0.0101) SingleSource/UnitTests/ObjC++/property-reference: 2.63% (0.7326 => 0.7519, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.41% (5.0018 => 5.1221, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.38% (0.8067 => 0.8259, std. dev.: 0.0043) MultiSource/Applications/spiff/spiff: 2.36% (0.7835 => 0.8020, std. dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 2.29% (9.4845 => 9.7018, std. dev.: 0.0115) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.19% (4.2646 => 4.3578, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.13% (8.1363 => 8.3096, std. dev.: 0.0055) MultiSource/Applications/treecc/treecc: 1.92% (2.0273 => 2.0663, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.87% (1.5415 => 1.5703, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.84% (1.1861 => 1.2079, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 1.78% (3.3354 => 3.3947, std. dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 1.58% (17.1811 => 17.4519, std. dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.57% (1.3050 => 1.3255, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.55% (0.6450 => 0.6550, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7591 => 5.8469, std. dev.: 0.0065) MultiSource/Applications/lua/lua: 1.52% (3.8723 => 3.9312, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.36% (0.9765 => 0.9898, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.20% (1.4186 => 1.4356, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.08% (2.2024 => 2.2261, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9742, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.83% (1.1145 => 1.1906, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7595, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.34% (1.0313 => 1.0554, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.20% (26.0924 => 26.6672, std. dev.: 0.0378) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.5086 => 1.5376, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6900, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2343, std. dev.: 0.0143) MultiSource/Applications/spiff/spiff: 1.10% (2.9346 => 2.9669, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1276, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.69% (5.2763 => 3.1820, std. dev.: 0.0152) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.37% (5.3855 => 3.6958, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.04% (5.3526 => 3.6912, std. dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.99% (2.9384 => 2.5567, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -10.42% (22.1758 => 19.8656, std. dev.: 0.0271) SingleSource/UnitTests/Vector/constpool: -4.90% (54.1659 => 51.5106, std. dev.: 0.0250) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.33% (3.8922 => 3.8016, std. dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.26% (1.2373 => 1.1104, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.77% (19.9488 => 18.5979, std. dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (8.1563 => 7.9084, std. dev.: 0.0121) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6837, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0845, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 02:21:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 04:21:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120707092159.44E2F2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1858?compare_to=1853&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1858, Order: 159892, Start Time: 2012-07-07 06:35:50, End Time: 2012-07-07 09:21:59 To: 1853, Order: 159886, Start Time: 2012-07-07 03:25:18, End Time: 2012-07-07 06:08:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (42 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (851 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.76% (126.5431 => 131.3068, std. dev.: 0.8901) SingleSource/Benchmarks/Misc/whetstone: 1.08% (2.8088 => 2.8392, std. dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 8.35% (0.3460 => 0.3749, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.34% (0.3488 => 0.3779, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 8.34% (0.3465 => 0.3754, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.33% (0.3446 => 0.3733, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.32% (0.3496 => 0.3787, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.30% (0.3469 => 0.3757, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/trivial-interface: 8.25% (0.3442 => 0.3726, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3643 => 0.3937, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.95% (0.3650 => 0.3940, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 7.60% (0.3724 => 0.4007, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 4.24% (0.5826 => 0.6073, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 3.75% (0.5889 => 0.6110, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.55% (1.6211 => 1.6787, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.24% (0.5900 => 0.6091, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.23% (3.5627 => 3.6776, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.14% (0.4361 => 0.4498, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 3.12% (0.7171 => 0.7395, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.08% (0.4029 => 0.4153, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.04% (0.4994 => 0.5146, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (1.3152 => 1.3528, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.75% (0.5026 => 0.5164, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.72% (0.3930 => 0.4037, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.72% (0.5000 => 0.5136, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.63% (4.2109 => 4.3218, std. dev.: 0.0121) MultiSource/Applications/hexxagon/hexxagon: 2.44% (0.9909 => 1.0151, std. dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.34% (2.7292 => 2.7931, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.30% (0.4658 => 0.4765, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.16% (2.0673 => 2.1120, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (4.4195 => 4.5062, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.90% (1.9694 => 2.0068, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.88% (1.9966 => 2.0342, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 1.84% (1.8794 => 1.9139, std. dev.: 0.0039) MultiSource/Applications/d/make_dparser: 1.75% (1.0781 => 1.0970, std. dev.: 0.0063) MultiSource/Applications/hbd/hbd: 1.60% (0.9697 => 0.9852, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 1.54% (5.5417 => 5.6268, std. dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 1.47% (2.1653 => 2.1971, std. dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (2.1013 => 2.1312, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 1.41% (0.7875 => 0.7986, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.39% (23.5202 => 23.8476, std. dev.: 0.0211) MultiSource/Applications/JM/lencod/lencod: 1.32% (4.6177 => 4.6786, std. dev.: 0.0069) MultiSource/Applications/lua/lua: 1.30% (1.4269 => 1.4455, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.27% (2.8036 => 2.8392, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.56% (11.9555 => 11.6500, std. dev.: 0.0078) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 03:17:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 05:17:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120707101707.5B8282A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1859?compare_to=1856&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1859, Order: 159895, Start Time: 2012-07-07 09:03:02, End Time: 2012-07-07 10:17:06 To: 1856, Order: 159894, Start Time: 2012-07-07 07:21:27, End Time: 2012-07-07 08:35:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (131 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.36% (55.1188 => 56.4198, std. dev.: 0.0227) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.60% (78.8343 => 80.0977, std. dev.: 0.2550) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.32% (2.0176 => 2.3065, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.57% (0.3130 => 0.3367, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.39% (0.5818 => 0.6190, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.15% (0.7038 => 0.7471, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.07% (0.5748 => 0.6097, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.84% (0.1986 => 0.2102, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.76% (1.3693 => 1.4482, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.66% (0.7061 => 0.7461, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.50% (0.4328 => 0.4566, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.49% (0.5265 => 0.5554, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2596 => 0.2738, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.43% (3.9660 => 4.1814, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.40% (0.2721 => 0.2868, std. dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 5.32% (0.2781 => 0.2929, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.15% (0.7710 => 0.8107, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 4.87% (0.4062 => 0.4260, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.74% (0.6959 => 0.7289, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 4.67% (0.2760 => 0.2889, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.64% (13.8202 => 14.4617, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.64% (0.2782 => 0.2911, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.63% (0.3022 => 0.3162, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.53% (0.3489 => 0.3647, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 4.53% (0.3578 => 0.3740, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 4.53% (0.2607 => 0.2725, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.52% (0.2655 => 0.2775, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.50% (0.2690 => 0.2811, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3899 => 0.4074, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 4.45% (0.3914 => 0.4088, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 4.43% (0.3789 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.42% (0.4003 => 0.4180, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.41% (0.2628 => 0.2744, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.40% (0.2726 => 0.2846, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.39% (0.9199 => 0.9603, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.39% (0.3580 => 0.3737, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.36% (0.2937 => 0.3065, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.34% (0.3940 => 0.4111, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.33% (0.3646 => 0.3804, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 4.33% (0.3623 => 0.3780, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.33% (0.3601 => 0.3757, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.33% (1.9828 => 2.0686, std. dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: 4.31% (16.6129 => 17.3285, std. dev.: 0.0184) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.30% (0.3650 => 0.3807, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 4.26% (0.3663 => 0.3819, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.25% (0.3107 => 0.3239, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.23% (13.2842 => 13.8456, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 4.17% (0.2761 => 0.2876, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.15% (0.2696 => 0.2808, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.14% (0.2925 => 0.3046, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.13% (0.3149 => 0.3279, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.02% (0.3485 => 0.3625, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.99% (1.2193 => 1.2679, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.94% (0.5577 => 0.5797, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.91% (0.3453 => 0.3588, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3192 => 0.3315, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3534 => 0.3670, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.83% (0.4016 => 0.4170, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.80% (0.3293 => 0.3418, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.78% (1.3245 => 1.3746, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.75% (0.3756 => 0.3897, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.75% (0.2988 => 0.3100, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.4563 => 1.5098, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.67% (0.3246 => 0.3365, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.62% (0.4390 => 0.4549, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.62% (1.0594 => 1.0977, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.60% (0.5637 => 0.5840, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.59% (1.1364 => 1.1772, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.57% (1.1061 => 1.1456, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 3.57% (0.3868 => 0.4006, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.54% (0.4379 => 0.4534, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 3.48% (0.7506 => 0.7767, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 3.47% (3.8646 => 3.9986, std. dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.47% (0.2914 => 0.3015, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.43% (1.9270 => 1.9931, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 3.23% (0.8310 => 0.8578, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.20% (7.2180 => 7.4490, std. dev.: 0.0107) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.12% (4.9865 => 5.1419, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (3.6692 => 3.7800, std. dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 2.97% (14.8535 => 15.2946, std. dev.: 0.0118) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.87% (1.3813 => 1.4209, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.84% (0.7460 => 0.7672, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.82% (6.5754 => 6.7610, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.82% (1.3819 => 1.4209, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.80% (0.4791 => 0.4925, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.77% (1.2292 => 1.2633, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.75% (2.1791 => 2.2391, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 2.70% (0.4113 => 0.4224, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3755 => 0.3856, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.58% (0.6135 => 0.6293, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.43% (4.3801 => 4.4866, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.34% (4.4433 => 4.5471, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.33% (1.1333 => 1.1597, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 2.22% (3.1889 => 3.2596, std. dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 2.21% (16.2614 => 16.6200, std. dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.20% (0.8698 => 0.8889, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.04% (0.6283 => 0.6411, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.95% (1.2749 => 1.2997, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.89% (14.5298 => 14.8047, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.76% (2.1007 => 2.1377, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (3.2742 => 3.3134, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.80% (1.8175 => 2.2682, std. dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.31% (2.0200 => 2.1878, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.93% (0.9996 => 1.0789, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.42% (1.2998 => 1.3963, std. dev.: 0.0067) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7171, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-5: 3.75% (1.9144 => 1.9862, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.92% (1.4298 => 1.4572, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.67% (3.6469 => 3.7079, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5334, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.95% (0.4657 => 0.3821, std. dev.: 0.0090) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.54% (22.5627 => 21.0861, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.62% (1.0460 => 0.8617, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.26% (1.2308 => 1.1045, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.78% (20.3410 => 18.5541, std. dev.: 0.0805) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.27% (1.3780 => 1.3054, std. dev.: 0.0066) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6022, std. dev.: 0.0180) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.02% (6.6320 => 6.4980, std. dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7460, std. dev.: 0.1093) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.61% (0.6589 => 0.6483, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2546, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.5254 => 2.4885, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1302, std. dev.: 0.0453) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: -1.43% (3.0263 => 2.9829, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2209, std. dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2571, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 03:55:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 05:55:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120707105553.C24432A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1860?compare_to=1857&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1860, Order: 159896, Start Time: 2012-07-07 09:37:33, End Time: 2012-07-07 10:55:55 To: 1857, Order: 159895, Start Time: 2012-07-07 07:51:05, End Time: 2012-07-07 09:09:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (792 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.74% (10.3673 => 13.2432, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.82% (1.1194 => 1.2517, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.44% (0.3543 => 0.3842, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.44% (0.3473 => 0.3766, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3516 => 0.3806, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.21% (0.3497 => 0.3784, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.16% (0.3543 => 0.3832, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: 8.09% (0.3561 => 0.3849, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.04% (0.3694 => 0.3991, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.90% (1.7609 => 1.9000, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.81% (0.3828 => 0.4127, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.3927 => 0.4231, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.67% (0.3886 => 0.4184, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.57% (2.2022 => 2.3469, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.16% (0.3177 => 0.3341, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.99% (0.2065 => 0.2168, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.51% (10.4361 => 10.9068, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.24% (0.2758 => 0.2875, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.99% (7.0540 => 7.3354, std. dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 3.91% (0.7433 => 0.7724, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 3.67% (0.6030 => 0.6251, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.65% (0.3092 => 0.3205, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 3.53% (0.5925 => 0.6134, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 3.41% (0.3282 => 0.3394, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.14% (0.5569 => 0.5744, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.03% (0.8172 => 0.8420, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.97% (0.4615 => 0.4752, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.91% (0.7326 => 0.7539, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.88% (14.3668 => 14.7800, std. dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (4.9449 => 5.0769, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.66% (0.5860 => 0.6016, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.60% (5.0018 => 5.1319, std. dev.: 0.0055) MultiSource/Applications/spiff/spiff: 2.53% (0.7835 => 0.8033, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 2.40% (9.4845 => 9.7120, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.37% (8.1363 => 8.3295, std. dev.: 0.0110) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.29% (4.2646 => 4.3624, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.19% (2.0273 => 2.0717, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.96% (1.1861 => 1.2094, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.93% (3.3354 => 3.3997, std. dev.: 0.0134) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.90% (1.5415 => 1.5708, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.82% (0.8067 => 0.8214, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 1.80% (1.1642 => 1.1852, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.80% (1.3050 => 1.3285, std. dev.: 0.0071) MultiSource/Applications/lua/lua: 1.77% (3.8723 => 3.9409, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.66% (17.1811 => 17.4662, std. dev.: 0.0140) MultiSource/Applications/oggenc/oggenc: 1.65% (5.7591 => 5.8540, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 1.54% (1.5603 => 1.5843, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.51% (0.9765 => 0.9912, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.31% (1.4186 => 1.4372, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.10% (2.2024 => 2.2267, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7590, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.16% (26.0924 => 26.6563, std. dev.: 0.0231) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5086 => 1.5361, std. dev.: 0.0099) MultiSource/Applications/minisat/minisat: 1.73% (9.1159 => 9.2732, std. dev.: 0.0266) SingleSource/Benchmarks/Dhrystone/dry: 1.42% (2.4116 => 2.4458, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6880, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 1.16% (2.9346 => 2.9685, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1255, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.69% (5.2763 => 3.1820, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.26% (5.3855 => 3.7020, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.96% (5.3526 => 3.6956, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.02% (2.9384 => 2.5559, std. dev.: 0.0076) MultiSource/Applications/ClamAV/clamscan: -10.30% (22.1758 => 19.8919, std. dev.: 0.0133) SingleSource/UnitTests/Vector/constpool: -4.93% (54.1659 => 51.4967, std. dev.: 0.0237) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.29% (3.8922 => 3.8030, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.80% (1.2373 => 1.1037, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.63% (19.9488 => 18.6256, std. dev.: 0.0710) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.73% (8.1563 => 7.9336, std. dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6931, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0858, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 05:01:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 07:01:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120707120118.680842A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1861?compare_to=1859&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1861, Order: 159897, Start Time: 2012-07-07 10:47:24, End Time: 2012-07-07 12:01:19 To: 1859, Order: 159895, Start Time: 2012-07-07 09:03:02, End Time: 2012-07-07 10:17:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (133 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (720 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.91% (7.9256 => 8.0766, std. dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.84% (2.0176 => 2.3170, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.82% (0.5818 => 0.6215, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.56% (0.5748 => 0.6125, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.50% (0.1986 => 0.2115, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.29% (0.7038 => 0.7481, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 6.16% (0.7061 => 0.7496, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 5.95% (1.3693 => 1.4508, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.85% (0.5265 => 0.5573, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.76% (0.7710 => 0.8154, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.74% (0.2596 => 0.2745, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.71% (3.9660 => 4.1923, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.2721 => 0.2872, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.35% (0.6959 => 0.7331, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.31% (0.4328 => 0.4558, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.25% (0.3578 => 0.3766, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.11% (0.3601 => 0.3785, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 5.10% (0.3940 => 0.4141, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 5.07% (0.3646 => 0.3831, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.07% (0.3789 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.06% (0.3914 => 0.4112, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.05% (0.3663 => 0.3848, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.02% (0.4003 => 0.4204, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.99% (0.3650 => 0.3832, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 4.97% (0.3623 => 0.3803, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.78% (0.2782 => 0.2915, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.75% (0.4062 => 0.4255, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 4.72% (13.8202 => 14.4729, std. dev.: 0.0038) SingleSource/Regression/C++/ofstream_ctor: 4.67% (0.2781 => 0.2911, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.67% (0.2655 => 0.2779, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 4.64% (0.2607 => 0.2728, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (13.2842 => 13.8936, std. dev.: 0.0172) MultiSource/Applications/kimwitu++/kc: 4.57% (16.6129 => 17.3729, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.57% (0.3022 => 0.3160, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.57% (0.9199 => 0.9619, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 4.54% (0.2690 => 0.2812, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.52% (0.5577 => 0.5829, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.49% (0.2628 => 0.2746, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.48% (0.2966 => 0.3099, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.44% (0.3899 => 0.4072, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 4.43% (0.2937 => 0.3067, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3489 => 0.3642, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.37% (1.2193 => 1.2726, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 4.35% (0.2761 => 0.2881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.31% (0.3107 => 0.3241, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.31% (0.2760 => 0.2879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2765 => 0.2884, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.27% (1.9828 => 2.0675, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.27% (0.2696 => 0.2811, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.25% (0.3580 => 0.3732, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.21% (0.2925 => 0.3048, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.19% (0.3149 => 0.3281, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.05% (0.3485 => 0.3626, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.98% (0.3293 => 0.3424, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.97% (1.3245 => 1.3771, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary2: 3.95% (0.3192 => 0.3318, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.94% (0.3246 => 0.3374, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.90% (0.5637 => 0.5857, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.88% (1.1364 => 1.1805, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.86% (0.7506 => 0.7796, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.86% (0.4016 => 0.4171, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.86% (1.4563 => 1.5125, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sieve: 3.85% (0.3453 => 0.3586, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (3.8646 => 4.0121, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.79% (0.4379 => 0.4545, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.75% (1.1061 => 1.1476, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.74% (0.2914 => 0.3023, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.71% (0.2988 => 0.3099, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.71% (0.4390 => 0.4553, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 3.71% (1.0594 => 1.0987, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 3.68% (0.3534 => 0.3664, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.65% (0.3756 => 0.3893, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.59% (1.9270 => 1.9962, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.52% (7.2180 => 7.4718, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 3.46% (0.3868 => 0.4002, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.45% (0.4113 => 0.4255, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 3.36% (0.8310 => 0.8589, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.29% (1.3813 => 1.4268, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.27% (0.7460 => 0.7704, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.25% (3.6692 => 3.7885, std. dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 3.18% (14.8535 => 15.3261, std. dev.: 0.0149) MultiSource/Applications/JM/ldecod/ldecod: 3.15% (6.5754 => 6.7828, std. dev.: 0.0102) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.12% (4.9865 => 5.1419, std. dev.: 0.0135) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.10% (1.3819 => 1.4248, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.92% (0.4791 => 0.4931, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.89% (2.1791 => 2.2421, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.84% (0.6135 => 0.6309, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.83% (1.2292 => 1.2640, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.80% (4.3801 => 4.5027, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3755 => 0.3858, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (4.4433 => 4.5630, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 2.56% (1.2749 => 1.3075, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.40% (1.1333 => 1.1605, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.35% (16.2614 => 16.6438, std. dev.: 0.0055) MultiSource/Applications/d/make_dparser: 2.35% (3.1889 => 3.2637, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.21% (0.6283 => 0.6422, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.14% (0.8698 => 0.8884, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.05% (14.5298 => 14.8276, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.88% (2.1007 => 2.1401, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.29% (3.2742 => 3.3165, std. dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 1.22% (8.4961 => 8.5997, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.08% (1.5188 => 1.5352, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2704, std. dev.: 0.0514) SingleSource/Benchmarks/Misc/mandel-2: 8.44% (1.2998 => 1.4095, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.29% (2.0200 => 2.1874, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.06% (0.9996 => 1.0802, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.92% (7.4271 => 7.7184, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9220, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.87% (1.4298 => 1.4565, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.57% (3.6469 => 3.7040, std. dev.: 0.0068) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.28% (1.9290 => 1.9536, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.44% (22.5627 => 21.1098, std. dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.13% (0.8818 => 0.8718, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.54% (0.0997 => 0.0852, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.72% (1.2308 => 1.0988, std. dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.83% (20.3410 => 18.5452, std. dev.: 0.0304) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3053, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.5998, std. dev.: 0.0169) SingleSource/Benchmarks/Dhrystone/dry: -2.51% (2.5089 => 2.4460, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5062, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7462, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2533, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8602, std. dev.: 0.0037) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1324, std. dev.: 0.0150) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9827, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2187, std. dev.: 0.0105) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2543, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8465, std. dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: -1.00% (7.3305 => 7.2571, std. dev.: 0.0114) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 05:34:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 07:34:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120707123401.8BCD82A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1862?compare_to=1858&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1862, Order: 159896, Start Time: 2012-07-07 09:49:45, End Time: 2012-07-07 12:34:03 To: 1858, Order: 159892, Start Time: 2012-07-07 06:35:50, End Time: 2012-07-07 09:21:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (42 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (851 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 23.36% (0.4059 => 0.5007, std. dev.: 0.0240) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.41% (0.2163 => 0.2280, std. dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 32.04% (0.3792 => 0.5007, std. dev.: 0.0240) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3496 => 0.3809, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.95% (0.3465 => 0.3775, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.94% (0.3446 => 0.3754, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.89% (0.3442 => 0.3748, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.87% (0.3460 => 0.3767, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3469 => 0.3776, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.83% (0.3488 => 0.3796, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 8.59% (0.3643 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.52% (0.3650 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.22% (0.3724 => 0.4030, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 4.12% (0.5826 => 0.6066, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.05% (0.5900 => 0.6139, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 3.75% (0.5889 => 0.6110, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.65% (1.6211 => 1.6803, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.62% (0.4029 => 0.4175, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.53% (3.5627 => 3.6886, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.52% (0.5026 => 0.5203, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (0.3930 => 0.4063, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.24% (4.2109 => 4.3472, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.20% (0.4994 => 0.5154, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (0.4361 => 0.4496, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.07% (1.3152 => 1.3556, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 3.07% (0.7171 => 0.7391, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.96% (0.5000 => 0.5148, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.54% (2.7292 => 2.7986, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.50% (1.0781 => 1.1051, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.44% (0.9909 => 1.0151, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.39% (4.4195 => 4.5252, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.36% (1.9694 => 2.0158, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.24% (1.9966 => 2.0413, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 1.98% (5.5417 => 5.6515, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 1.93% (1.8794 => 1.9156, std. dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 1.92% (2.1013 => 2.1417, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.90% (2.0673 => 2.1065, std. dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 1.77% (2.1653 => 2.2036, std. dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 1.73% (4.6177 => 4.6976, std. dev.: 0.0134) MultiSource/Benchmarks/Bullet/bullet: 1.64% (23.5202 => 23.9050, std. dev.: 0.0139) MultiSource/Applications/lua/lua: 1.53% (1.4269 => 1.4488, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.51% (0.7875 => 0.7994, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 1.37% (0.9697 => 0.9830, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.46% (0.2162 => 0.2280, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.59% (11.9555 => 11.6462, std. dev.: 0.0123) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 05:41:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 07:41:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120707124151.B03292A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1863?compare_to=1860&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1863, Order: 159898, Start Time: 2012-07-07 11:23:33, End Time: 2012-07-07 12:41:53 To: 1860, Order: 159896, Start Time: 2012-07-07 09:37:33, End Time: 2012-07-07 10:55:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (63 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (792 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.23% (10.9068 => 11.0411, std. dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.49% (10.3673 => 13.1141, std. dev.: 0.0161) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.78% (1.1194 => 1.2513, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.23% (0.3473 => 0.3759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.13% (0.3516 => 0.3802, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.10% (0.3543 => 0.3830, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.09% (0.3497 => 0.3780, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.06% (0.3561 => 0.3848, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.04% (0.3543 => 0.3828, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 7.85% (0.3694 => 0.3984, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.69% (1.7609 => 1.8964, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.69% (0.3886 => 0.4185, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.58% (0.3828 => 0.4118, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.56% (0.3927 => 0.4224, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.34% (2.2022 => 2.3638, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.80% (10.4361 => 11.0411, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.2065 => 0.2169, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.97% (0.3177 => 0.3335, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.61% (0.4879 => 0.5104, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 4.12% (0.7433 => 0.7739, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.06% (7.0540 => 7.3402, std. dev.: 0.0162) SingleSource/UnitTests/ObjC++/property-reference-object: 3.76% (0.6030 => 0.6257, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.62% (0.3092 => 0.3204, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 3.61% (0.5925 => 0.6139, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 3.56% (0.3282 => 0.3399, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.5569 => 0.5737, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.95% (0.4615 => 0.4751, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 2.88% (0.7326 => 0.7537, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.77% (0.8172 => 0.8398, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (4.9449 => 5.0806, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (14.3668 => 14.7608, std. dev.: 0.0206) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.67% (5.0018 => 5.1353, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.41% (0.5860 => 0.6001, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.37% (0.7835 => 0.8021, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 2.34% (9.4845 => 9.7062, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.32% (8.1363 => 8.3253, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.28% (2.0273 => 2.0736, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.25% (4.2646 => 4.3604, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.02% (1.1861 => 1.2100, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 2.01% (3.3354 => 3.4025, std. dev.: 0.0095) MultiSource/Applications/Burg/burg: 1.95% (1.1642 => 1.1869, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 1.88% (1.5603 => 1.5897, std. dev.: 0.0051) MultiSource/Applications/lua/lua: 1.83% (3.8723 => 3.9430, std. dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: 1.75% (17.1811 => 17.4817, std. dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.69% (0.6450 => 0.6559, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.66% (1.3050 => 1.3267, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.66% (0.8067 => 0.8201, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.65% (1.5415 => 1.5669, std. dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 1.56% (5.7591 => 5.8489, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.53% (0.9765 => 0.9914, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.40% (1.4186 => 1.4385, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.22% (2.2024 => 2.2292, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7554, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.04% (26.0924 => 26.6249, std. dev.: 0.0195) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.5086 => 1.5376, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.37% (2.6546 => 2.6911, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2412, std. dev.: 0.0069) MultiSource/Applications/spiff/spiff: 1.16% (2.9346 => 2.9687, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.88% (5.2763 => 3.1719, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.33% (5.3855 => 3.6981, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.76% (5.3526 => 3.7064, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.05% (2.9384 => 2.5550, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: -10.42% (22.1758 => 19.8640, std. dev.: 0.0183) SingleSource/UnitTests/Vector/constpool: -5.12% (54.1659 => 51.3947, std. dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.21% (3.8922 => 3.8060, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2373 => 1.1040, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.01% (19.9488 => 18.5509, std. dev.: 0.0547) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.91% (8.1563 => 7.9186, std. dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6907, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0837, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.11% (1.3677 => 1.3525, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 06:42:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 08:42:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120707134233.1CA5E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1864?compare_to=1861&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1864, Order: 159898, Start Time: 2012-07-07 12:28:54, End Time: 2012-07-07 13:42:33 To: 1861, Order: 159897, Start Time: 2012-07-07 10:47:24, End Time: 2012-07-07 12:01:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (131 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.34% (1.0988 => 1.1135, std. dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.76% (2.0176 => 2.3154, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.28% (0.3130 => 0.3358, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.91% (0.5818 => 0.6220, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.66% (0.5748 => 0.6131, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.24% (0.7038 => 0.7477, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.19% (0.1986 => 0.2109, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.10% (0.7061 => 0.7492, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.04% (0.7710 => 0.8176, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 5.97% (1.3693 => 1.4510, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.68% (0.5265 => 0.5564, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.64% (3.9660 => 4.1898, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.2721 => 0.2872, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.55% (0.2596 => 0.2740, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.31% (0.4328 => 0.4558, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 5.10% (0.4003 => 0.4207, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.07% (0.3789 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.06% (0.3914 => 0.4112, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.05% (0.3940 => 0.4139, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.05% (0.4062 => 0.4267, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 5.05% (0.3646 => 0.3830, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.03% (0.3601 => 0.3782, std. dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 5.00% (0.2781 => 0.2920, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 5.00% (0.3663 => 0.3846, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 4.97% (0.3623 => 0.3803, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.93% (0.3650 => 0.3830, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.82% (0.2782 => 0.2916, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.77% (0.6959 => 0.7291, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.74% (13.2842 => 13.9140, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.60% (0.3022 => 0.3161, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.56% (0.2607 => 0.2726, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.54% (0.2690 => 0.2812, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.53% (16.6129 => 17.3660, std. dev.: 0.0178) MultiSource/Applications/SPASS/SPASS: 4.53% (13.8202 => 14.4457, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.52% (0.2655 => 0.2775, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.43% (0.2937 => 0.3067, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.40% (0.9199 => 0.9604, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 4.40% (0.2726 => 0.2846, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3489 => 0.3642, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.38% (0.2966 => 0.3096, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.38% (0.2628 => 0.2743, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.2193 => 1.2724, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.31% (0.3899 => 0.4067, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.28% (0.2760 => 0.2878, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.27% (0.2696 => 0.2811, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.22% (0.3580 => 0.3731, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.20% (1.9828 => 2.0661, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 4.17% (0.2761 => 0.2876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.15% (0.3107 => 0.3236, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.14% (0.2925 => 0.3046, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.12% (0.2765 => 0.2879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.10% (0.3149 => 0.3278, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.05% (0.5577 => 0.5803, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary2: 4.04% (0.3192 => 0.3321, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.02% (0.3485 => 0.3625, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.01% (0.3293 => 0.3425, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.91% (1.4563 => 1.5133, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.89% (0.5637 => 0.5856, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.88% (0.4016 => 0.4172, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.81% (1.1364 => 1.1797, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 3.79% (0.3453 => 0.3584, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.76% (0.3534 => 0.3667, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.74% (3.8646 => 4.0091, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.74% (0.4390 => 0.4554, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.72% (1.0594 => 1.0988, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.70% (0.3756 => 0.3895, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.66% (1.3245 => 1.3730, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.62% (0.7506 => 0.7778, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 3.61% (0.2988 => 0.3096, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.61% (1.9270 => 1.9966, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.60% (0.3246 => 0.3363, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.54% (0.4379 => 0.4534, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.53% (1.1061 => 1.1451, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 3.48% (0.4113 => 0.4256, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.44% (7.2180 => 7.4662, std. dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.2914 => 0.3014, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 3.39% (0.3868 => 0.3999, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.24% (0.8310 => 0.8579, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.17% (3.6692 => 3.7856, std. dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: 3.15% (14.8535 => 15.3209, std. dev.: 0.0156) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.14% (1.3819 => 1.4253, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.13% (1.3813 => 1.4245, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.11% (0.7460 => 0.7692, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.09% (4.9865 => 5.1406, std. dev.: 0.0249) MultiSource/Applications/JM/ldecod/ldecod: 2.99% (6.5754 => 6.7717, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.78% (0.4791 => 0.4924, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.75% (1.2292 => 1.2630, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.73% (4.3801 => 4.4996, std. dev.: 0.0043) MultiSource/Applications/siod/siod: 2.60% (2.1791 => 2.2357, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.57% (4.4433 => 4.5575, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.43% (0.6135 => 0.6284, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.36% (1.1333 => 1.1600, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.30% (16.2614 => 16.6353, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 2.28% (3.1889 => 3.2615, std. dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 2.26% (1.2749 => 1.3037, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.08% (0.6283 => 0.6414, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.08% (14.5298 => 14.8325, std. dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.05% (0.8698 => 0.8876, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (2.1007 => 2.1380, std. dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: 1.17% (8.4961 => 8.5951, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 25.14% (1.8175 => 2.2744, std. dev.: 0.0418) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1911, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9996 => 1.0772, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.12% (1.2998 => 1.3924, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.84% (7.4271 => 7.7124, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9227, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6785, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.56% (1.7688 => 1.8317, std. dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4802, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0310 => 1.0567, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1907, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5334, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.43% (3.6469 => 3.6992, std. dev.: 0.0085) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.48% (22.5627 => 21.1014, std. dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.44% (0.8818 => 0.8691, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.65% (0.0997 => 0.0841, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.53% (1.2308 => 1.1135, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.12% (20.3410 => 18.4858, std. dev.: 0.0930) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.73% (1.3780 => 1.3128, std. dev.: 0.0064) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5848, std. dev.: 0.0132) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5101, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7467, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2531, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1308, std. dev.: 0.0224) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9826, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0140) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (0.9692 => 0.9564, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2496, std. dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 08:45:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 10:45:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120707154526.6F4292A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1865?compare_to=1862&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1865, Order: 159898, Start Time: 2012-07-07 13:01:50, End Time: 2012-07-07 15:45:26 To: 1862, Order: 159896, Start Time: 2012-07-07 09:49:45, End Time: 2012-07-07 12:34:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (43 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 949 (850 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 7.06% (0.2252 => 0.2411, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.01% (2.0701 => 2.1117, std. dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.29% (17.3556 => 17.1317, std. dev.: 0.0739) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 17.51% (0.3792 => 0.4456, std. dev.: 0.0240) SingleSource/UnitTests/ObjC/for-in: 9.55% (0.3496 => 0.3830, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.52% (0.3446 => 0.3774, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 9.49% (0.3465 => 0.3794, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-3: 9.48% (0.3460 => 0.3788, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.40% (0.3469 => 0.3795, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3442 => 0.3763, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.23% (0.3488 => 0.3810, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 9.21% (0.3650 => 0.3986, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.09% (0.3643 => 0.3974, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: 8.65% (0.3724 => 0.4046, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.48% (0.5826 => 0.6087, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 4.08% (0.5889 => 0.6129, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.82% (0.4029 => 0.4183, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.73% (3.5627 => 3.6955, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.73% (1.6211 => 1.6815, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.69% (0.3930 => 0.4075, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.60% (0.4361 => 0.4518, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 3.54% (0.7171 => 0.7425, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.42% (0.4994 => 0.5165, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 3.40% (4.2109 => 4.3540, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.32% (0.5026 => 0.5193, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.27% (0.5900 => 0.6093, std. dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.06% (2.7292 => 2.8126, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (1.3152 => 1.3549, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.83% (1.9694 => 2.0252, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.70% (1.9966 => 2.0506, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.61% (0.9909 => 1.0168, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.60% (0.5000 => 0.5130, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.54% (4.4195 => 4.5316, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.50% (2.0673 => 2.1189, std. dev.: 0.0101) MultiSource/Applications/d/make_dparser: 2.37% (1.0781 => 1.1037, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.30% (0.4658 => 0.4765, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 2.29% (2.1013 => 2.1494, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (2.1653 => 2.2148, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (1.8794 => 1.9207, std. dev.: 0.0051) MultiSource/Applications/hbd/hbd: 2.17% (0.9697 => 0.9907, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.13% (4.6177 => 4.7162, std. dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 2.10% (5.5417 => 5.6582, std. dev.: 0.0062) MultiSource/Applications/treecc/treecc: 2.08% (0.7875 => 0.8039, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.60% (1.4269 => 1.4497, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 1.25% (23.5202 => 23.8145, std. dev.: 0.0359) MultiSource/Applications/oggenc/oggenc: 1.02% (1.5932 => 1.6094, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.31% (11.9555 => 11.6789, std. dev.: 0.0094) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 17:34:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 19:34:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120708003402.11A1D2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1866?compare_to=1864&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1866, Order: 159904, Start Time: 2012-07-07 23:20:15, End Time: 2012-07-08 00:34:02 To: 1864, Order: 159898, Start Time: 2012-07-07 12:28:54, End Time: 2012-07-07 13:42:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (134 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (719 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.27% (2.0661 => 2.0924, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 1.01% (1.2630 => 1.2758, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.23% (54.6224 => 55.8428, std. dev.: 0.3586) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.35% (2.0176 => 2.3071, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.35% (0.3130 => 0.3360, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.22% (0.5818 => 0.6238, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.96% (0.5748 => 0.6148, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 6.65% (0.7038 => 0.7506, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 6.62% (1.3693 => 1.4599, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 6.60% (0.7061 => 0.7527, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.45% (0.1986 => 0.2114, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.18% (0.2782 => 0.2954, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.11% (0.2781 => 0.2951, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.06% (0.2607 => 0.2765, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2655 => 0.2814, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.95% (0.2690 => 0.2850, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.91% (0.4062 => 0.4302, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.89% (0.2937 => 0.3110, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.84% (0.7710 => 0.8160, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.82% (0.2596 => 0.2747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.79% (0.3578 => 0.3785, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2726 => 0.2883, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 5.73% (0.3663 => 0.3873, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.71% (3.9660 => 4.1923, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.64% (0.3899 => 0.4119, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.64% (0.5265 => 0.5562, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.64% (0.2696 => 0.2848, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 5.64% (0.3601 => 0.3804, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.62% (0.3646 => 0.3851, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.62% (0.3914 => 0.4134, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.60% (0.3107 => 0.3281, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.60% (0.3789 => 0.4001, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.56% (0.3650 => 0.3853, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.56% (0.3580 => 0.3779, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.53% (0.2765 => 0.2918, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.53% (1.9828 => 2.0924, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 5.53% (0.3149 => 0.3323, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.52% (0.4003 => 0.4224, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.51% (0.2721 => 0.2871, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.47% (0.3623 => 0.3821, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.38% (0.3940 => 0.4152, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.26% (0.3192 => 0.3360, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.18% (0.3453 => 0.3632, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.99% (0.6959 => 0.7306, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: 4.98% (0.3293 => 0.3457, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.98% (0.4016 => 0.4216, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.89% (0.2988 => 0.3134, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.75% (0.3534 => 0.3702, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.75% (13.8202 => 14.4768, std. dev.: 0.0111) MultiSource/Applications/kimwitu++/kc: 4.74% (16.6129 => 17.4007, std. dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.62% (0.4390 => 0.4593, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.54% (0.9199 => 0.9617, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 4.45% (0.3868 => 0.4040, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.43% (13.2842 => 13.8729, std. dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/objinst: 4.35% (0.2945 => 0.3073, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.27% (0.2925 => 0.3050, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.22% (1.2193 => 1.2708, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.10% (0.3246 => 0.3379, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.09% (0.5577 => 0.5805, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.93% (3.8646 => 4.0165, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.89% (0.5637 => 0.5856, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.83% (1.4563 => 1.5121, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.82% (1.3245 => 1.3751, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.81% (0.3755 => 0.3898, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.79% (1.2292 => 1.2758, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.78% (0.7506 => 0.7790, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.73% (1.1364 => 1.1788, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 3.71% (1.1061 => 1.1471, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.67% (1.9270 => 1.9978, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.67% (1.0594 => 1.0983, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.65% (0.4379 => 0.4539, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.64% (0.2914 => 0.3020, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.45% (4.9865 => 5.1583, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.43% (7.2180 => 7.4655, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 3.31% (0.4113 => 0.4249, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 3.30% (0.8310 => 0.8584, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.19% (3.6692 => 3.7863, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.03% (1.3813 => 1.4231, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 3.01% (2.1791 => 2.2446, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.00% (0.7460 => 0.7684, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.97% (1.3819 => 1.4230, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 2.93% (14.8535 => 15.2885, std. dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.92% (0.4791 => 0.4931, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.84% (6.5754 => 6.7619, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (4.3801 => 4.5033, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.72% (0.8698 => 0.8935, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.71% (0.6135 => 0.6301, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.64% (4.4433 => 4.5604, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.47% (1.1333 => 1.1613, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.22% (3.1889 => 3.2598, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.19% (16.2614 => 16.6173, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.10% (0.6283 => 0.6415, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.09% (1.2749 => 1.3015, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 1.99% (14.5298 => 14.8188, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.29% (3.2742 => 3.3164, std. dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 1.19% (8.4961 => 8.5975, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (1.5188 => 1.5363, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.70% (1.8175 => 2.2664, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1891, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: 7.85% (1.2998 => 1.4018, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.91% (7.4271 => 7.7177, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9192, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6802, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0183) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.55% (1.5089 => 1.5323, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.54% (3.6469 => 3.7029, std. dev.: 0.0065) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1943, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.47% (0.4657 => 0.3890, std. dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.5627 => 21.1483, std. dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.08% (0.3511 => 0.3403, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.78% (0.8818 => 0.8661, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2308 => 1.1042, std. dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.18% (20.3410 => 18.4737, std. dev.: 0.0624) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3159, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.68% (2.6470 => 2.5496, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5868, std. dev.: 0.0119) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4867 => 0.4748, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.05% (6.6320 => 6.4960, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7455, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2546, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.58% (0.6589 => 0.6485, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1284, std. dev.: 0.0313) MultiSource/Applications/spiff/spiff: -1.43% (3.0263 => 2.9830, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8645, std. dev.: 0.0070) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2228, std. dev.: 0.0292) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2527, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 17:38:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 19:38:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120708003841.97FE72A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1867?compare_to=1863&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1867, Order: 159904, Start Time: 2012-07-07 23:20:24, End Time: 2012-07-08 00:38:43 To: 1863, Order: 159898, Start Time: 2012-07-07 11:23:33, End Time: 2012-07-07 12:41:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (63 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (792 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.02% (13.1141 => 13.6409, std. dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.58% (10.3673 => 13.6409, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.88% (1.1194 => 1.2524, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.49% (0.3473 => 0.3768, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 8.45% (0.1432 => 0.1553, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.24% (0.3497 => 0.3785, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.16% (0.3543 => 0.3832, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.09% (0.3561 => 0.3849, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 8.04% (0.3543 => 0.3828, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.02% (0.3516 => 0.3798, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.82% (0.3694 => 0.3983, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.77% (0.1622 => 0.1748, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.3927 => 0.4232, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.76% (0.3828 => 0.4125, std. dev.: 0.0090) SingleSource/UnitTests/ObjC/property: 7.72% (0.3886 => 0.4186, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.69% (1.7609 => 1.8964, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.27% (2.2022 => 2.3623, std. dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 6.14% (10.4361 => 11.0770, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.2065 => 0.2169, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.78% (0.3177 => 0.3329, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 4.39% (0.7433 => 0.7759, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.31% (7.0540 => 7.3582, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 3.58% (0.6030 => 0.6246, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.51% (0.5925 => 0.6133, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 3.49% (0.3092 => 0.3200, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: 3.41% (0.3282 => 0.3394, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.38% (0.5569 => 0.5757, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.13% (0.8172 => 0.8428, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.06% (0.4615 => 0.4756, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 2.85% (0.7326 => 0.7535, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.79% (14.3668 => 14.7675, std. dev.: 0.0180) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.68% (5.0018 => 5.1357, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.66% (4.9449 => 5.0763, std. dev.: 0.0063) MultiSource/Applications/spiff/spiff: 2.64% (0.7835 => 0.8042, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.41% (2.0273 => 2.0762, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.39% (4.2646 => 4.3667, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.32% (8.1363 => 8.3251, std. dev.: 0.0103) MultiSource/Applications/Burg/burg: 2.29% (1.1642 => 1.1909, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 2.28% (9.4845 => 9.7008, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.12% (0.8067 => 0.8238, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 2.07% (3.3354 => 3.4046, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.05% (1.1861 => 1.2104, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.85% (3.8723 => 3.9441, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.78% (17.1811 => 17.4866, std. dev.: 0.0200) MultiSource/Applications/oggenc/oggenc: 1.76% (5.7591 => 5.8605, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 1.71% (1.5603 => 1.5870, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.70% (1.4186 => 1.4427, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.63% (0.6450 => 0.6555, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.58% (0.9765 => 0.9919, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.48% (2.2024 => 2.2351, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.12% (2.0665 => 2.0897, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.09% (1.5859 => 1.6032, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.09% (2.2969 => 2.3219, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.81% (1.1145 => 1.1904, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7524, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.23% (1.0313 => 1.0543, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.19% (26.0924 => 26.6630, std. dev.: 0.0314) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.02% (1.5086 => 1.5390, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.35% (2.6546 => 2.6905, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2391, std. dev.: 0.0161) MultiSource/Applications/spiff/spiff: 1.06% (2.9346 => 2.9658, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.82% (5.2763 => 3.1754, std. dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.36% (5.3855 => 3.6964, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.83% (5.3526 => 3.7025, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.04% (2.9384 => 2.5553, std. dev.: 0.0071) MultiSource/Applications/ClamAV/clamscan: -10.44% (22.1758 => 19.8609, std. dev.: 0.0079) SingleSource/UnitTests/Vector/constpool: -5.05% (54.1659 => 51.4314, std. dev.: 0.0404) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.13% (3.8922 => 3.8093, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.35% (1.2373 => 1.1092, std. dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.88% (19.9488 => 18.5769, std. dev.: 0.0360) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (8.1563 => 7.9245, std. dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6829, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0844, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 19:03:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 21:03:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120708020325.190622A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1868?compare_to=1865&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1868, Order: 159904, Start Time: 2012-07-07 23:20:19, End Time: 2012-07-08 02:03:27 To: 1865, Order: 159898, Start Time: 2012-07-07 13:01:50, End Time: 2012-07-07 15:45:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (43 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (850 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.03% (2.2883 => 2.3119, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.82% (2.1117 => 2.0521, std. dev.: 0.0197) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.90% (0.3465 => 0.3808, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.84% (0.3446 => 0.3785, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.80% (0.3460 => 0.3799, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.78% (0.3496 => 0.3838, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.77% (0.3469 => 0.3808, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/trivial-interface: 9.76% (0.3442 => 0.3778, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.72% (0.3488 => 0.3827, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 9.44% (0.3643 => 0.3987, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 9.40% (0.3650 => 0.3993, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 9.00% (0.3724 => 0.4059, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.40% (0.5026 => 0.5247, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 4.31% (0.5826 => 0.6077, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.91% (0.5889 => 0.6119, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.90% (0.4994 => 0.5189, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.88% (1.6211 => 1.6840, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.86% (3.5627 => 3.7003, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.83% (0.5900 => 0.6126, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 3.70% (0.4029 => 0.4178, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.69% (0.4361 => 0.4522, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.44% (1.3152 => 1.3604, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 3.31% (4.2109 => 4.3501, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.21% (0.3930 => 0.4056, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 2.98% (0.7171 => 0.7385, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.94% (1.9694 => 2.0273, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.93% (2.7292 => 2.8092, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.82% (0.5000 => 0.5141, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.75% (1.0781 => 1.1077, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.54% (4.4195 => 4.5318, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 2.51% (0.9909 => 1.0158, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.49% (1.9966 => 2.0464, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.42% (2.0673 => 2.1173, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.41% (1.8794 => 1.9246, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.38% (0.4658 => 0.4769, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (2.1653 => 2.2149, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.25% (5.5417 => 5.6663, std. dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 2.23% (2.1013 => 2.1481, std. dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 2.20% (4.6177 => 4.7194, std. dev.: 0.0074) MultiSource/Applications/treecc/treecc: 2.12% (0.7875 => 0.8042, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.89% (23.5202 => 23.9652, std. dev.: 0.0165) MultiSource/Applications/lua/lua: 1.84% (1.4269 => 1.4532, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.64% (0.6634 => 0.6743, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 1.61% (1.5932 => 1.6189, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 1.51% (0.9697 => 0.9843, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.06% (11.9555 => 11.7096, std. dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 19:15:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 21:15:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120708021514.C8DA42A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1869?compare_to=1866&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1869, Order: 159906, Start Time: 2012-07-08 01:01:34, End Time: 2012-07-08 02:15:16 To: 1866, Order: 159904, Start Time: 2012-07-07 23:20:15, End Time: 2012-07-08 00:34:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (135 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (718 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.40% (2.0176 => 2.3082, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.22% (0.5818 => 0.6238, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.03% (0.5748 => 0.6152, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.87% (0.7061 => 0.7546, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 6.76% (0.7038 => 0.7514, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 6.59% (1.3693 => 1.4596, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.33% (0.2655 => 0.2823, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.31% (0.4328 => 0.4601, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.29% (0.1986 => 0.2111, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.29% (0.2782 => 0.2957, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.21% (0.2607 => 0.2769, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.08% (0.2781 => 0.2950, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.2937 => 0.3115, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: 6.05% (0.2628 => 0.2787, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.99% (0.2690 => 0.2851, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.98% (0.3578 => 0.3792, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.89% (0.3022 => 0.3200, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.86% (0.4062 => 0.4300, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.83% (0.2726 => 0.2885, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.82% (0.2596 => 0.2747, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.76% (0.2761 => 0.2920, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.71% (0.2696 => 0.2850, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.70% (0.3489 => 0.3688, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.70% (0.2966 => 0.3135, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.68% (0.7710 => 0.8148, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.68% (0.5265 => 0.5564, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-4: 5.68% (0.3646 => 0.3853, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.64% (0.3601 => 0.3804, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.63% (3.9660 => 4.1892, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: 5.62% (0.3789 => 0.4002, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.62% (0.3914 => 0.4134, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.62% (0.3650 => 0.3855, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.60% (1.9828 => 2.0938, std. dev.: 0.0191) SingleSource/UnitTests/ObjC/synchronized: 5.60% (0.3663 => 0.3868, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.60% (0.4003 => 0.4227, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.59% (0.2721 => 0.2873, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.58% (0.2760 => 0.2914, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 5.51% (0.3940 => 0.4157, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 5.49% (0.3149 => 0.3322, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.49% (0.3899 => 0.4113, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 5.44% (0.3623 => 0.3820, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.34% (0.3580 => 0.3771, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.29% (0.3192 => 0.3361, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.14% (0.3485 => 0.3664, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3453 => 0.3630, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.98% (0.3293 => 0.3457, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.98% (0.4016 => 0.4216, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.96% (0.6959 => 0.7304, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 4.92% (0.3534 => 0.3708, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.89% (0.2988 => 0.3134, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.81% (0.4390 => 0.4601, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 4.66% (16.6129 => 17.3873, std. dev.: 0.0242) MultiSource/Applications/SPASS/SPASS: 4.64% (13.8202 => 14.4621, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/moments: 4.60% (0.3868 => 0.4046, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.49% (0.9199 => 0.9612, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.48% (0.2945 => 0.3077, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.41% (13.2842 => 13.8703, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.18% (1.2193 => 1.2703, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.05% (0.5577 => 0.5803, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.91% (1.4563 => 1.5132, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.90% (0.5637 => 0.5857, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.88% (0.3246 => 0.3372, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (1.3245 => 1.3754, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.81% (0.3755 => 0.3898, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.77% (1.2292 => 1.2756, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.77% (0.4379 => 0.4544, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.76% (3.8646 => 4.0101, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.76% (1.1364 => 1.1791, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.74% (0.7506 => 0.7787, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.73% (0.7460 => 0.7738, std. dev.: 0.0047) MultiSource/Applications/treecc/treecc: 3.62% (1.9270 => 1.9967, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 3.62% (1.1061 => 1.1461, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.0594 => 1.0976, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.57% (0.2914 => 0.3018, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.48% (7.2180 => 7.4695, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.34% (4.9865 => 5.1531, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/05-eks/eks: 3.31% (0.4113 => 0.4249, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.19% (0.8310 => 0.8575, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (3.6692 => 3.7859, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.13% (2.1791 => 2.2472, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.06% (1.3813 => 1.4236, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.97% (1.3819 => 1.4229, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.96% (14.8535 => 15.2931, std. dev.: 0.0107) MultiSource/Applications/JM/ldecod/ldecod: 2.78% (6.5754 => 6.7582, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.78% (0.4791 => 0.4924, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (4.3801 => 4.5000, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.68% (0.8698 => 0.8931, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.62% (4.4433 => 4.5596, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.53% (0.6135 => 0.6290, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.41% (1.1333 => 1.1606, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.24% (16.2614 => 16.6259, std. dev.: 0.0332) MultiSource/Applications/d/make_dparser: 2.17% (3.1889 => 3.2580, std. dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 2.09% (1.2749 => 1.3015, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.04% (0.6283 => 0.6411, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (2.1007 => 2.1424, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.88% (14.5298 => 14.8031, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.14% (3.2742 => 3.3114, std. dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 1.09% (8.4961 => 8.5884, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 26.67% (1.8175 => 2.3022, std. dev.: 0.0333) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1903, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.65% (1.2998 => 1.3863, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7334, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9219, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6781, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0310 => 1.0561, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.95% (4.1080 => 4.1880, std. dev.: 0.0027) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5340, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.48% (3.6469 => 3.7010, std. dev.: 0.0067) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.25% (1.9290 => 1.9532, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.5627 => 21.1304, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.08% (0.3511 => 0.3403, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.85% (0.8818 => 0.8655, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.24% (1.2308 => 1.1048, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.78% (20.3410 => 18.5547, std. dev.: 0.0700) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3086, std. dev.: 0.0089) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9062, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5881, std. dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7457, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.57% (26.5159 => 26.1000, std. dev.: 0.0290) SingleSource/Benchmarks/Shootout/lists: -1.49% (6.3560 => 6.2616, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8619, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.39% (9.3358 => 9.2064, std. dev.: 0.0182) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4904, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -1.38% (3.0263 => 2.9844, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2546, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.01% (7.3305 => 7.2564, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 19:24:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 21:24:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120708022447.16B5A2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1870?compare_to=1867&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1870, Order: 159906, Start Time: 2012-07-08 01:06:24, End Time: 2012-07-08 02:24:49 To: 1867, Order: 159904, Start Time: 2012-07-07 23:20:24, End Time: 2012-07-08 00:38:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (65 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (790 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.15% (54.8427 => 56.0231, std. dev.: 0.3953) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.02% (1.3323 => 1.3187, std. dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.43% (10.3673 => 13.6260, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.77% (1.1194 => 1.2511, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 8.45% (0.1432 => 0.1553, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.29% (0.3473 => 0.3761, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.10% (0.3543 => 0.3830, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.09% (0.3497 => 0.3780, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.08% (0.3516 => 0.3800, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.04% (0.3543 => 0.3828, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.03% (0.3561 => 0.3847, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.88% (0.3694 => 0.3985, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.83% (0.1622 => 0.1749, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.3927 => 0.4231, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.72% (1.7609 => 1.8969, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 7.64% (0.3886 => 0.4183, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions: 7.60% (0.3828 => 0.4119, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.25% (2.2022 => 2.3619, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 6.16% (10.4361 => 11.0789, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.08% (0.2065 => 0.2170, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.78% (0.3177 => 0.3329, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 4.32% (0.7433 => 0.7754, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (7.0540 => 7.3548, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 3.52% (0.6030 => 0.6242, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.49% (0.5925 => 0.6132, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.49% (0.3092 => 0.3200, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 3.29% (0.3282 => 0.3390, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.09% (0.5569 => 0.5741, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.97% (14.3668 => 14.7939, std. dev.: 0.0171) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.92% (0.8172 => 0.8411, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.92% (0.5860 => 0.6031, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.88% (0.4615 => 0.4748, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 2.83% (0.7326 => 0.7533, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 2.77% (0.7835 => 0.8052, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.76% (4.9449 => 5.0815, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.63% (5.0018 => 5.1335, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.43% (0.8067 => 0.8263, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.41% (4.2646 => 4.3673, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.33% (8.1363 => 8.3259, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 2.33% (2.0273 => 2.0745, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 2.26% (9.4845 => 9.6989, std. dev.: 0.0046) MultiSource/Applications/Burg/burg: 2.18% (1.1642 => 1.1896, std. dev.: 0.0058) MultiSource/Applications/d/make_dparser: 2.16% (3.3354 => 3.4073, std. dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.07% (1.1861 => 1.2107, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.02% (1.5415 => 1.5726, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 1.91% (3.8723 => 3.9462, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.87% (17.1811 => 17.5021, std. dev.: 0.0074) MultiSource/Applications/oggenc/oggenc: 1.75% (5.7591 => 5.8599, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.69% (0.6450 => 0.6559, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.69% (1.5603 => 1.5866, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.61% (0.9765 => 0.9922, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.59% (1.3050 => 1.3258, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.54% (1.4186 => 1.4405, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.48% (2.2024 => 2.2351, std. dev.: 0.0072) MultiSource/Applications/siod/siod: 1.07% (2.2969 => 2.3215, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.02% (1.5859 => 1.6021, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9749, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.81% (1.1145 => 1.1904, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7589, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.38% (1.0313 => 1.0558, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.18% (26.0924 => 26.6608, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.5086 => 1.5375, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.31% (9.1159 => 9.2351, std. dev.: 0.0144) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6886, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.17% (2.9346 => 2.9690, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1259, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.85% (5.2763 => 3.1738, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.36% (5.3855 => 3.6965, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.79% (5.3526 => 3.7046, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.92% (2.9384 => 2.5587, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -10.46% (22.1758 => 19.8556, std. dev.: 0.0055) SingleSource/UnitTests/Vector/constpool: -5.07% (54.1659 => 51.4197, std. dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.08% (3.8922 => 3.8114, std. dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.23% (0.0998 => 0.0846, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.84% (1.2373 => 1.1032, std. dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.74% (19.9488 => 18.6048, std. dev.: 0.0262) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9149, std. dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6918, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0822, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 21:24:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 23:24:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120708042426.B584C2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1871?compare_to=1869&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1871, Order: 159907, Start Time: 2012-07-08 03:10:33, End Time: 2012-07-08 04:24:28 To: 1869, Order: 159906, Start Time: 2012-07-08 01:01:34, End Time: 2012-07-08 02:15:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (135 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (717 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.43% (27.6971 => 29.7549, std. dev.: 0.0606) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.68% (54.9945 => 56.4672, std. dev.: 0.0935) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.46% (2.0176 => 2.3093, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.35% (0.3130 => 0.3360, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.17% (0.5818 => 0.6235, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.85% (0.5748 => 0.6142, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.67% (1.3693 => 1.4607, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 6.45% (0.7038 => 0.7492, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 6.43% (0.7061 => 0.7515, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4328 => 0.4596, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.09% (0.1986 => 0.2107, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.97% (0.2782 => 0.2948, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2655 => 0.2812, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.90% (0.2781 => 0.2945, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.86% (0.3022 => 0.3199, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.83% (0.2607 => 0.2759, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.80% (0.2690 => 0.2846, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.74% (0.4062 => 0.4295, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.72% (0.2726 => 0.2882, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 5.65% (0.3578 => 0.3780, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.64% (0.7710 => 0.8145, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.58% (0.2760 => 0.2914, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.57% (0.5265 => 0.5558, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.56% (0.3650 => 0.3853, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.2721 => 0.2872, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (3.9660 => 4.1851, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.51% (0.2596 => 0.2739, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.49% (0.2696 => 0.2844, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.44% (0.3789 => 0.3995, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.43% (0.2761 => 0.2911, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.41% (0.3899 => 0.4110, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.3107 => 0.3275, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.40% (0.4003 => 0.4219, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.39% (0.3914 => 0.4125, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.39% (0.3489 => 0.3677, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.39% (0.3601 => 0.3795, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.36% (0.3940 => 0.4151, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.35% (1.9828 => 2.0889, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 5.34% (0.3149 => 0.3317, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 5.32% (0.3663 => 0.3858, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.32% (0.3646 => 0.3840, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 5.30% (0.3623 => 0.3815, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.17% (0.3580 => 0.3765, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.05% (0.3485 => 0.3661, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.01% (0.3293 => 0.3458, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.73% (0.6959 => 0.7288, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 4.69% (0.2988 => 0.3128, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.68% (13.8202 => 14.4669, std. dev.: 0.0132) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.65% (0.4390 => 0.4594, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 4.64% (0.3534 => 0.3698, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3756 => 0.3929, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.59% (16.6129 => 17.3756, std. dev.: 0.0313) SingleSource/Benchmarks/Shootout-C++/moments: 4.47% (0.3868 => 0.4041, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.44% (1.2193 => 1.2734, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.42% (0.9199 => 0.9606, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.38% (0.2925 => 0.3053, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.36% (13.2842 => 13.8629, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.02% (1.4563 => 1.5149, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.94% (0.5577 => 0.5797, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.76% (1.1061 => 1.1477, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.75% (1.0594 => 1.0991, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (1.3245 => 1.3741, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.74% (1.2292 => 1.2752, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.73% (0.3246 => 0.3367, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.71% (0.5637 => 0.5846, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.63% (3.8646 => 4.0050, std. dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.57% (1.1364 => 1.1770, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 3.54% (0.7506 => 0.7772, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3755 => 0.3888, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.52% (0.4379 => 0.4533, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.49% (1.9270 => 1.9943, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.2914 => 0.3014, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 3.40% (0.4113 => 0.4253, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.38% (0.7460 => 0.7712, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.34% (7.2180 => 7.4588, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.27% (4.9865 => 5.1494, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/football/football: 3.23% (0.8310 => 0.8578, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (3.6692 => 3.7857, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.10% (1.3813 => 1.4241, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.08% (1.3819 => 1.4244, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.96% (14.8535 => 15.2936, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.84% (0.4791 => 0.4927, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (6.5754 => 6.7597, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 2.79% (2.1791 => 2.2398, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.64% (0.8698 => 0.8928, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.61% (4.3801 => 4.4944, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.59% (0.6135 => 0.6294, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.44% (4.4433 => 4.5517, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.29% (1.1333 => 1.1592, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.23% (16.2614 => 16.6239, std. dev.: 0.0246) MultiSource/Applications/SIBsim4/SIBsim4: 2.21% (1.2749 => 1.3031, std. dev.: 0.0069) MultiSource/Applications/d/make_dparser: 2.20% (3.1889 => 3.2591, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.10% (0.6283 => 0.6415, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (2.1007 => 2.1418, std. dev.: 0.0129) MultiSource/Applications/ClamAV/clamscan: 1.89% (14.5298 => 14.8047, std. dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.23% (3.2742 => 3.3146, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.12% (8.4961 => 8.5911, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2705, std. dev.: 0.0333) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.49% (2.0200 => 2.1915, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.99% (0.9996 => 1.0795, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.89% (1.2998 => 1.3894, std. dev.: 0.0287) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.21% (7.4271 => 7.7399, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9215, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6789, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8312, std. dev.: 0.0163) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.79% (1.4298 => 1.4554, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5334, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.57% (3.6469 => 3.7040, std. dev.: 0.0086) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5079, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.34% (22.5627 => 21.1323, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.16% (0.3511 => 0.3400, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.69% (0.8818 => 0.8669, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.63% (1.2308 => 1.1123, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.76% (20.3410 => 18.5596, std. dev.: 0.0672) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.79% (1.3780 => 1.3120, std. dev.: 0.0083) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6036, std. dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: -2.51% (2.5089 => 2.4460, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7456, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2547, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: -1.46% (3.0263 => 2.9820, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1296, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8650, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2235, std. dev.: 0.0334) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2538, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.14% (3.8887 => 3.8443, std. dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: -1.02% (7.3305 => 7.2557, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 21:28:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 7 Jul 2012 23:28:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120708042855.58FA02A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1872?compare_to=1870&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1872, Order: 159907, Start Time: 2012-07-08 03:10:33, End Time: 2012-07-08 04:28:57 To: 1870, Order: 159906, Start Time: 2012-07-08 01:06:24, End Time: 2012-07-08 02:24:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (66 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (789 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.89% (3.7622 => 3.8334, std. dev.: 0.0076) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.08% (10.3673 => 13.5891, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.43% (1.1194 => 1.2474, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 8.61% (0.3473 => 0.3772, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3543 => 0.3840, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.38% (0.1432 => 0.1552, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.32% (0.3497 => 0.3788, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3516 => 0.3807, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.27% (0.3543 => 0.3836, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.20% (0.3561 => 0.3853, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.09% (0.3694 => 0.3993, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.03% (1.7609 => 1.9023, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.90% (0.3886 => 0.4193, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.3927 => 0.4236, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.84% (0.3828 => 0.4128, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.64% (0.1622 => 0.1746, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.29% (2.2022 => 2.3628, std. dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: 6.20% (10.4361 => 11.0829, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.33% (0.2065 => 0.2175, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.88% (0.3177 => 0.3332, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.73% (0.4879 => 0.5110, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.49% (0.7433 => 0.7767, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.35% (7.0540 => 7.3609, std. dev.: 0.0162) SingleSource/UnitTests/ObjC++/property-reference-object: 3.76% (0.6030 => 0.6257, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 3.62% (0.3092 => 0.3204, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 3.61% (0.5925 => 0.6139, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5569 => 0.5749, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/oourafft: 3.14% (0.3282 => 0.3385, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.06% (0.7326 => 0.7550, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.01% (0.4615 => 0.4754, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.97% (0.8172 => 0.8415, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (14.3668 => 14.7707, std. dev.: 0.0141) MultiSource/Applications/spiff/spiff: 2.78% (0.7835 => 0.8053, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.76% (5.0018 => 5.1398, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.68% (4.9449 => 5.0774, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.59% (0.5860 => 0.6012, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.56% (4.2646 => 4.3739, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.55% (2.0273 => 2.0790, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.43% (8.1363 => 8.3341, std. dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 2.37% (9.4845 => 9.7097, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 2.34% (1.1642 => 1.1914, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.27% (3.3354 => 3.4111, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.24% (0.8067 => 0.8248, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.15% (1.1861 => 1.2116, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.13% (1.5415 => 1.5744, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.00% (3.8723 => 3.9497, std. dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 1.98% (17.1811 => 17.5211, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.78% (1.5603 => 1.5881, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.69% (1.3050 => 1.3271, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.69% (0.6450 => 0.6559, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.69% (0.9765 => 0.9930, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.65% (5.7591 => 5.8544, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.53% (1.4186 => 1.4403, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.48% (2.2024 => 2.2351, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: 1.45% (0.7115 => 0.7218, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 1.25% (2.2969 => 2.3255, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (1.5859 => 1.6025, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.81% (1.1145 => 1.1904, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.13% (3.6395 => 3.7533, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0313 => 1.0566, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.13% (26.0924 => 26.6476, std. dev.: 0.0248) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (1.5086 => 1.5365, std. dev.: 0.0008) MultiSource/Benchmarks/llubenchmark/llu: 1.46% (3.7781 => 3.8334, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.43% (2.6546 => 2.6926, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4460, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 1.17% (2.9346 => 2.9689, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1261, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.12% (5.2763 => 3.1596, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6989, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7032, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.65% (2.9384 => 2.5374, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.38% (22.1758 => 19.8731, std. dev.: 0.0094) SingleSource/UnitTests/Vector/constpool: -5.31% (54.1659 => 51.2912, std. dev.: 0.0697) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.15% (3.8922 => 3.8087, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.57% (1.2373 => 1.1065, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.99% (19.9488 => 18.5543, std. dev.: 0.0703) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (8.1563 => 7.9173, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6874, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0844, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 22:14:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 00:14:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120708051433.823732A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1873?compare_to=1868&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1873, Order: 159906, Start Time: 2012-07-08 02:31:12, End Time: 2012-07-08 05:14:36 To: 1868, Order: 159904, Start Time: 2012-07-07 23:20:19, End Time: 2012-07-08 02:03:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (42 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (851 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.38% (124.6717 => 127.6340, std. dev.: 0.6746) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.66% (2.0521 => 2.0862, std. dev.: 0.0107) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.87% (0.3465 => 0.3807, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 9.87% (0.3446 => 0.3786, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.80% (0.3460 => 0.3799, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.78% (0.3496 => 0.3838, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.77% (0.3469 => 0.3808, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3442 => 0.3776, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.66% (0.3488 => 0.3825, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.47% (0.3643 => 0.3988, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.40% (0.3650 => 0.3993, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.05% (0.3724 => 0.4061, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.34% (0.5826 => 0.6079, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 3.96% (0.5889 => 0.6122, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.82% (1.6211 => 1.6830, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.81% (0.4361 => 0.4527, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.79% (3.5627 => 3.6976, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.76% (0.5900 => 0.6122, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.76% (0.5026 => 0.5215, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 3.75% (0.4029 => 0.4180, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.66% (0.2866 => 0.2971, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.42% (0.4994 => 0.5165, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (0.3930 => 0.4063, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.36% (0.5000 => 0.5168, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.35% (1.3152 => 1.3592, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 3.29% (4.2109 => 4.3494, std. dev.: 0.0109) SingleSource/UnitTests/ObjC++/property-reference: 2.98% (0.7171 => 0.7385, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.78% (2.7292 => 2.8050, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (1.9966 => 2.0504, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 2.62% (1.0781 => 1.1064, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.62% (1.9694 => 2.0210, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.58% (0.4658 => 0.4778, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (4.4195 => 4.5302, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.33% (2.0673 => 2.1155, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.19% (5.5417 => 5.6628, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 2.10% (1.8794 => 1.9188, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 2.04% (4.6177 => 4.7119, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 2.04% (2.1013 => 2.1441, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 1.96% (23.5202 => 23.9820, std. dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 1.96% (2.1653 => 2.2078, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 1.85% (0.7875 => 0.8021, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 1.84% (1.4269 => 1.4531, std. dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: 1.55% (1.5932 => 1.6179, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.2122 => 0.2232, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.15% (11.9555 => 11.6982, std. dev.: 0.0115) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 23:05:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 01:05:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120708060554.9B30E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1874?compare_to=1871&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1874, Order: 159908, Start Time: 2012-07-08 04:52:06, End Time: 2012-07-08 06:05:54 To: 1871, Order: 159907, Start Time: 2012-07-08 03:10:33, End Time: 2012-07-08 04:24:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (129 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.04% (78.9565 => 80.5681, std. dev.: 0.1497) SingleSource/Benchmarks/Misc/mandel-2: 1.04% (1.3894 => 1.4039, std. dev.: 0.0055) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.98% (2.0176 => 2.2997, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.48% (1.3693 => 1.4580, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.46% (0.7061 => 0.7517, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.43% (0.5818 => 0.6192, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.24% (0.7038 => 0.7477, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.14% (0.1986 => 0.2108, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.14% (0.5748 => 0.6101, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.98% (0.4328 => 0.4587, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.58% (0.7710 => 0.8140, std. dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 5.57% (0.2781 => 0.2936, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2782 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.52% (0.2607 => 0.2751, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2690 => 0.2838, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.49% (0.3022 => 0.3188, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.48% (0.2721 => 0.2870, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.46% (0.2655 => 0.2800, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 5.39% (0.4062 => 0.4281, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 5.38% (0.2937 => 0.3095, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.37% (0.3578 => 0.3770, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.37% (0.2628 => 0.2769, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.35% (0.2596 => 0.2735, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.34% (0.5265 => 0.5546, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.28% (3.9660 => 4.1755, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.17% (0.3789 => 0.3985, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 5.17% (0.2726 => 0.2867, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.17% (0.2765 => 0.2908, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.16% (0.2696 => 0.2835, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.14% (0.2760 => 0.2902, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.14% (0.2761 => 0.2903, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions-2: 5.14% (0.3601 => 0.3786, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.14% (0.3914 => 0.4115, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 5.13% (0.3646 => 0.3833, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.11% (0.3663 => 0.3850, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.07% (1.9828 => 2.0833, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.05% (0.3107 => 0.3264, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 5.05% (0.4003 => 0.4205, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.04% (0.3489 => 0.3665, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.04% (0.3650 => 0.3834, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.02% (0.3623 => 0.3805, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.99% (0.3149 => 0.3306, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.98% (0.3899 => 0.4093, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 4.97% (0.3940 => 0.4136, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.87% (0.4390 => 0.4604, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.86% (0.3580 => 0.3754, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.73% (0.3192 => 0.3343, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.62% (0.3485 => 0.3646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.61% (0.4016 => 0.4201, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.53% (0.6959 => 0.7274, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 4.49% (0.3293 => 0.3441, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.38% (0.2988 => 0.3119, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.36% (0.3534 => 0.3688, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.34% (13.8202 => 14.4195, std. dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.31% (0.3756 => 0.3918, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.31% (16.6129 => 17.3293, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.21% (0.9199 => 0.9586, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.15% (13.2842 => 13.8355, std. dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/moments: 4.08% (0.3868 => 0.4026, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.97% (0.2945 => 0.3062, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.97% (1.2193 => 1.2677, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.86% (0.2925 => 0.3038, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 3.72% (1.1061 => 1.1473, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.68% (0.5577 => 0.5782, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.67% (0.5637 => 0.5844, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (1.3245 => 1.3729, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.51% (0.3246 => 0.3360, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.48% (1.4563 => 1.5070, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.47% (1.0594 => 1.0962, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.44% (0.7506 => 0.7764, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.43% (0.4379 => 0.4529, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 3.40% (3.8646 => 3.9960, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.40% (1.1364 => 1.1750, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.27% (1.2292 => 1.2694, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.25% (0.3755 => 0.3877, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.17% (7.2180 => 7.4469, std. dev.: 0.0060) MultiSource/Applications/treecc/treecc: 3.15% (1.9270 => 1.9877, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.02% (1.3819 => 1.4237, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.02% (0.7460 => 0.7685, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.8310 => 0.8555, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.95% (4.9865 => 5.1335, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.90% (1.3813 => 1.4213, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.88% (3.6692 => 3.7750, std. dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 2.75% (14.8535 => 15.2621, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 2.60% (2.1791 => 2.2358, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.56% (6.5754 => 6.7440, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.48% (0.4791 => 0.4910, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.41% (4.3801 => 4.4856, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.8698 => 0.8896, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.24% (4.4433 => 4.5427, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.13% (1.1333 => 1.1574, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 2.11% (3.1889 => 3.2562, std. dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 2.05% (16.2614 => 16.5949, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.96% (0.6283 => 0.6406, std. dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 1.75% (14.5298 => 14.7844, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.1007 => 2.1362, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.83% (1.8175 => 2.2687, std. dev.: 0.0508) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1909, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 8.01% (1.2998 => 1.4039, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.97% (0.9996 => 1.0793, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.86% (7.4271 => 7.7141, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9197, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6782, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.37% (1.7688 => 1.8284, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4801, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1896, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.93% (3.6469 => 3.7172, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4553, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5333, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9583, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.58% (22.5627 => 21.0788, std. dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.79% (0.2670 => 0.2542, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.42% (0.3511 => 0.3391, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.83% (0.8818 => 0.8657, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.65% (0.0997 => 0.0841, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.59% (1.2308 => 1.1128, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (20.3410 => 18.6206, std. dev.: 0.0189) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.05% (1.3780 => 1.3084, std. dev.: 0.0111) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5990, std. dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4477, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5078, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7466, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2522, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.56% (0.6589 => 0.6486, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1152, std. dev.: 0.0209) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8608, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -1.42% (3.0263 => 2.9832, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2195, std. dev.: 0.0294) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2513, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 7 23:14:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 01:14:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120708061451.183432A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1875?compare_to=1872&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1875, Order: 159908, Start Time: 2012-07-08 04:56:31, End Time: 2012-07-08 06:14:53 To: 1872, Order: 159907, Start Time: 2012-07-08 03:10:33, End Time: 2012-07-08 04:28:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (64 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (791 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.60% (13.5891 => 13.8062, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.20% (3.1596 => 3.1974, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.17% (2.5374 => 2.5671, std. dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.17% (10.3673 => 13.8062, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.09% (1.1194 => 1.2547, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 9.57% (0.1432 => 0.1569, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.64% (1.7609 => 1.9130, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 8.00% (0.3473 => 0.3751, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.96% (0.3543 => 0.3825, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.92% (0.3497 => 0.3774, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.83% (0.3561 => 0.3840, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.76% (2.2022 => 2.3732, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3516 => 0.3789, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.71% (0.3543 => 0.3816, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.69% (0.3694 => 0.3978, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.52% (0.1622 => 0.1744, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.36% (0.3886 => 0.4172, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.36% (0.3927 => 0.4216, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.29% (0.3828 => 0.4107, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.74% (10.4361 => 11.1393, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.72% (0.4879 => 0.5158, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.26% (0.3177 => 0.3344, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.70% (7.0540 => 7.3855, std. dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: 4.37% (0.7433 => 0.7758, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 3.87% (0.3282 => 0.3409, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.59% (0.3092 => 0.3203, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.99% (0.4615 => 0.4753, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.98% (0.5569 => 0.5735, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.90% (14.3668 => 14.7833, std. dev.: 0.0191) SingleSource/UnitTests/ObjC++/property-reference-object: 2.87% (0.6030 => 0.6203, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.77% (9.4845 => 9.7474, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.76% (5.0018 => 5.1397, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (4.9449 => 5.0804, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.73% (0.8172 => 0.8395, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 2.63% (0.5925 => 0.6081, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.62% (0.7835 => 0.8040, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.51% (0.5860 => 0.6007, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.45% (4.2646 => 4.3691, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.42% (8.1363 => 8.3335, std. dev.: 0.0114) MultiSource/Applications/treecc/treecc: 2.40% (2.0273 => 2.0760, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.24% (0.8067 => 0.8248, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.21% (3.3354 => 3.4092, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.17% (1.1861 => 1.2118, std. dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 2.14% (17.1811 => 17.5483, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.13% (1.5415 => 1.5744, std. dev.: 0.0063) MultiSource/Applications/Burg/burg: 2.11% (1.1642 => 1.1888, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 2.07% (0.7326 => 0.7478, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 2.03% (5.7591 => 5.8760, std. dev.: 0.0048) MultiSource/Applications/lua/lua: 1.97% (3.8723 => 3.9486, std. dev.: 0.0074) MultiSource/Applications/hbd/hbd: 1.94% (1.5603 => 1.5906, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.79% (1.3050 => 1.3283, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.78% (0.6450 => 0.6565, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.60% (0.9765 => 0.9921, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.59% (1.4186 => 1.4412, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.54% (2.2024 => 2.2363, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.21% (2.2969 => 2.3247, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 1.13% (1.1840 => 1.1974, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.11% (1.5859 => 1.6035, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7530, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0561, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.18% (26.0924 => 26.6624, std. dev.: 0.0395) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6900, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2362, std. dev.: 0.0096) MultiSource/Applications/spiff/spiff: 1.13% (2.9346 => 2.9678, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.40% (5.2763 => 3.1974, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.07% (5.3855 => 3.7122, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.69% (5.3526 => 3.7101, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.64% (2.9384 => 2.5671, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -10.39% (22.1758 => 19.8709, std. dev.: 0.0079) SingleSource/UnitTests/Vector/constpool: -5.16% (54.1659 => 51.3721, std. dev.: 0.0617) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.76% (3.8922 => 3.8236, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.56% (1.2373 => 1.1066, std. dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.52% (19.9488 => 18.6477, std. dev.: 0.0118) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (8.1563 => 7.9195, std. dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6882, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0831, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 00:49:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 02:49:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120708074906.2BCCC2A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/1876?compare_to=1874&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1876, Order: 159909, Start Time: 2012-07-08 06:33:33, End Time: 2012-07-08 07:49:07 To: 1874, Order: 159908, Start Time: 2012-07-08 04:52:06, End Time: 2012-07-08 06:05:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (751 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.29% (2.0176 => 2.3060, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference-object: 6.98% (0.5818 => 0.6224, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 6.89% (0.5748 => 0.6144, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.24% (0.1986 => 0.2110, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 6.23% (0.7061 => 0.7501, std. dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 6.22% (0.7038 => 0.7476, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.10% (0.7710 => 0.8180, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 6.09% (1.3693 => 1.4527, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.98% (0.3578 => 0.3792, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.85% (0.5265 => 0.5573, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.84% (0.3650 => 0.3863, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 5.75% (0.4328 => 0.4577, std. dev.: 0.0085) SingleSource/UnitTests/ObjC/exceptions-2: 5.67% (0.3601 => 0.3805, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 5.62% (0.3914 => 0.4134, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.62% (0.4003 => 0.4228, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.60% (0.3646 => 0.3850, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.60% (0.3789 => 0.4001, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 5.57% (0.3663 => 0.3867, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.55% (0.3623 => 0.3824, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.48% (0.3940 => 0.4156, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.41% (3.9660 => 4.1807, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.36% (0.2782 => 0.2931, std. dev.: 0.0047) SingleSource/Regression/C++/ofstream_ctor: 5.25% (0.2781 => 0.2927, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.23% (0.3022 => 0.3180, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: 5.14% (0.2761 => 0.2903, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2628 => 0.2761, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.05% (0.3899 => 0.4096, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.99% (0.2966 => 0.3114, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.97% (0.2696 => 0.2830, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.84% (0.3489 => 0.3658, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.82% (1.9828 => 2.0784, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/except: 4.82% (0.2760 => 0.2893, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary2: 4.67% (0.3192 => 0.3341, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.66% (0.6959 => 0.7283, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.53% (0.3580 => 0.3742, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 4.50% (16.6129 => 17.3605, std. dev.: 0.0164) MultiSource/Applications/SPASS/SPASS: 4.46% (13.8202 => 14.4370, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.34% (0.9199 => 0.9598, std. dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.30% (13.2842 => 13.8549, std. dev.: 0.0232) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.15% (0.4390 => 0.4572, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.04% (1.2193 => 1.2686, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: 4.00% (0.7506 => 0.7806, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 3.97% (0.2925 => 0.3041, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.83% (0.5637 => 0.5853, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.82% (1.4563 => 1.5120, std. dev.: 0.0058) MultiSource/Benchmarks/nbench/nbench: 3.77% (1.0594 => 1.0993, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.76% (1.3245 => 1.3743, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.73% (0.3246 => 0.3367, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.60% (1.1364 => 1.1773, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 3.58% (1.9270 => 1.9959, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 3.56% (1.1061 => 1.1455, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (3.8646 => 4.0000, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.49% (0.4379 => 0.4532, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.28% (7.2180 => 7.4545, std. dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.22% (0.7460 => 0.7700, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.11% (1.2292 => 1.2674, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.97% (1.3819 => 1.4230, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.97% (0.8310 => 0.8557, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.91% (3.6692 => 3.7760, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.90% (1.3813 => 1.4214, std. dev.: 0.0068) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 2.86% (14.8535 => 15.2786, std. dev.: 0.0039) MultiSource/Applications/siod/siod: 2.74% (2.1791 => 2.2388, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.58% (4.3801 => 4.4929, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 2.57% (6.5754 => 6.7445, std. dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.54% (0.6135 => 0.6291, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.34% (16.2614 => 16.6419, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.24% (4.4433 => 4.5427, std. dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.18% (0.8698 => 0.8888, std. dev.: 0.0073) MultiSource/Applications/d/make_dparser: 2.12% (3.1889 => 3.2565, std. dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.10% (1.1333 => 1.1571, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 2.00% (1.2749 => 1.3004, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 1.81% (14.5298 => 14.7934, std. dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/fbench: 24.48% (1.8175 => 2.2624, std. dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.68% (2.0200 => 2.1954, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 5.98% (1.2998 => 1.3775, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 4.22% (7.4271 => 7.7402, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0595) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6793, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1895, std. dev.: 0.0298) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.96% (3.6469 => 3.7185, std. dev.: 0.0147) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1966, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0132) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.59% (22.5627 => 21.0758, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.62% (0.3511 => 0.3384, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.02% (0.8818 => 0.8640, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.15% (0.0997 => 0.0836, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -9.86% (1.2308 => 1.1095, std. dev.: 0.0340) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.45% (20.3410 => 18.6232, std. dev.: 0.0310) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6004, std. dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.06% (6.6320 => 6.4956, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.68% (28.2225 => 27.7474, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2554, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4887, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1340, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -1.32% (3.0263 => 2.9863, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2163, std. dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2591, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 01:03:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 03:03:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120708080357.EA2382A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1877?compare_to=1875&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1877, Order: 159909, Start Time: 2012-07-08 06:42:30, End Time: 2012-07-08 08:03:58 To: 1875, Order: 159908, Start Time: 2012-07-08 04:56:31, End Time: 2012-07-08 06:14:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (44 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (811 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.34% (0.7478 => 0.7578, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.05% (42.0421 => 42.4845, std. dev.: 0.1314) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.01% (10.3673 => 13.6857, std. dev.: 0.1404) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.90% (1.1194 => 1.2526, std. dev.: 0.0237) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.47% (0.3473 => 0.3767, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.27% (0.3543 => 0.3836, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.12% (0.3497 => 0.3781, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.12% (0.3561 => 0.3850, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.10% (0.3543 => 0.3830, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-3: 8.08% (0.3516 => 0.3800, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.07% (0.3694 => 0.3992, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.04% (1.7609 => 1.9025, std. dev.: 0.0319) SingleSource/Benchmarks/Misc/richards_benchmark: 7.89% (0.1622 => 0.1750, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.85% (2.2022 => 2.3750, std. dev.: 0.0428) SingleSource/UnitTests/ObjC/exceptions: 7.71% (0.3828 => 0.4123, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.69% (0.3886 => 0.4185, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.3927 => 0.4227, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.31% (10.4361 => 11.0946, std. dev.: 0.0166) MultiSource/Applications/lambda-0_1_3/lambda: 4.26% (0.7433 => 0.7750, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 3.78% (0.3282 => 0.3406, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.62% (0.3092 => 0.3204, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 3.53% (0.6030 => 0.6243, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 3.46% (0.5925 => 0.6130, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.44% (0.7326 => 0.7578, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 3.18% (0.7835 => 0.8084, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 2.83% (2.0273 => 2.0846, std. dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 2.59% (9.4845 => 9.7304, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 2.46% (1.1642 => 1.1928, std. dev.: 0.0074) MultiSource/Applications/d/make_dparser: 2.16% (3.3354 => 3.4074, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.12% (1.1861 => 1.2113, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.94% (3.8723 => 3.9474, std. dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 1.86% (5.7591 => 5.8661, std. dev.: 0.0086) MultiSource/Applications/hbd/hbd: 1.77% (1.5603 => 1.5879, std. dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: 1.65% (17.1811 => 17.4644, std. dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.27% (2.2024 => 2.2303, std. dev.: 0.0090) MultiSource/Applications/siod/siod: 1.01% (2.2969 => 2.3200, std. dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.81% (1.1145 => 1.1904, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7511, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.24% (26.0924 => 26.6781, std. dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6895, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2314, std. dev.: 0.0213) MultiSource/Applications/spiff/spiff: 1.17% (2.9346 => 2.9689, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1259, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.86% (5.2763 => 3.1734, std. dev.: 0.0635) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.19% (5.3855 => 3.7055, std. dev.: 0.0484) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.65% (5.3526 => 3.7122, std. dev.: 0.0535) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.01% (2.9384 => 2.5560, std. dev.: 0.0674) MultiSource/Applications/ClamAV/clamscan: -10.51% (22.1758 => 19.8453, std. dev.: 0.0528) SingleSource/UnitTests/Vector/constpool: -5.18% (54.1659 => 51.3612, std. dev.: 0.0279) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.05% (3.8922 => 3.8124, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.02% (1.2373 => 1.1133, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.64% (19.9488 => 18.6250, std. dev.: 0.0437) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.76% (8.1563 => 7.9315, std. dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6872, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0848, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 01:28:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 03:28:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120708082828.ADB6E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1878?compare_to=1873&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1878, Order: 159909, Start Time: 2012-07-08 05:42:12, End Time: 2012-07-08 08:28:29 To: 1873, Order: 159906, Start Time: 2012-07-08 02:31:12, End Time: 2012-07-08 05:14:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (45 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (848 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.76% (0.2163 => 0.2266, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3446 => 0.3781, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.67% (0.3465 => 0.3800, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3496 => 0.3833, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.62% (0.3460 => 0.3793, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.59% (0.3442 => 0.3772, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.51% (0.3469 => 0.3799, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.46% (0.3488 => 0.3818, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions: 9.36% (0.3643 => 0.3984, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.23% (0.3650 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.94% (0.3724 => 0.4057, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 4.60% (0.5826 => 0.6094, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 4.30% (0.5889 => 0.6142, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.13% (1.6211 => 1.6881, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.06% (0.5026 => 0.5230, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.88% (3.5627 => 3.7011, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.78% (0.4361 => 0.4526, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 3.75% (0.4029 => 0.4180, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.73% (0.5900 => 0.6120, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.60% (0.4994 => 0.5174, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 3.47% (4.2109 => 4.3569, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.42% (1.3152 => 1.3602, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.28% (0.3930 => 0.4059, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 3.18% (0.7171 => 0.7399, std. dev.: 0.0065) MultiSource/Applications/d/make_dparser: 3.03% (1.0781 => 1.1108, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.90% (4.4195 => 4.5475, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 2.88% (0.9909 => 1.0194, std. dev.: 0.0092) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.87% (2.7292 => 2.8074, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.76% (0.5000 => 0.5138, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.75% (0.4658 => 0.4786, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (1.9694 => 2.0219, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.65% (0.3845 => 0.3947, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.56% (2.0673 => 2.1202, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.53% (5.5417 => 5.6818, std. dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.52% (1.9966 => 2.0470, std. dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: 2.43% (4.6177 => 4.7299, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 2.40% (23.5202 => 24.0851, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (2.1653 => 2.2159, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 2.23% (2.1013 => 2.1482, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.22% (0.7875 => 0.8050, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.19% (1.8794 => 1.9206, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 2.12% (0.9697 => 0.9903, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.00% (1.4269 => 1.4555, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 1.99% (1.5932 => 1.6249, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.14% (2.0346 => 2.0577, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.81% (0.2162 => 0.2266, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.06% (11.9555 => 11.7093, std. dev.: 0.0162) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 04:00:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 06:00:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120708110022.B27812A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1879?compare_to=1876&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1879, Order: 159910, Start Time: 2012-07-08 09:46:38, End Time: 2012-07-08 11:00:24 To: 1876, Order: 159909, Start Time: 2012-07-08 06:33:33, End Time: 2012-07-08 07:49:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (132 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (721 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.65% (28.6434 => 29.6883, std. dev.: 0.0321) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.97% (1.3325 => 1.3062, std. dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.24% (2.0176 => 2.3049, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.28% (0.3130 => 0.3358, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.06% (0.5818 => 0.6229, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.73% (0.5748 => 0.6135, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.43% (0.7061 => 0.7515, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 6.28% (0.7038 => 0.7480, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.24% (0.1986 => 0.2110, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 6.00% (1.3693 => 1.4514, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/trivial-interface: 5.87% (0.3578 => 0.3788, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 5.75% (0.4003 => 0.4233, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.71% (0.4328 => 0.4575, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.64% (0.3601 => 0.3804, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.63% (0.7710 => 0.8144, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: 5.62% (0.3646 => 0.3851, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.62% (0.3914 => 0.4134, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.60% (0.3663 => 0.3868, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.60% (0.3789 => 0.4001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.59% (0.3650 => 0.3854, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.55% (0.2596 => 0.2740, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.53% (0.5265 => 0.5556, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 5.51% (0.3940 => 0.4157, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.47% (0.3623 => 0.3821, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.36% (0.2782 => 0.2931, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.34% (3.9660 => 4.1778, std. dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 5.29% (0.2781 => 0.2928, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.22% (0.2607 => 0.2743, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.18% (0.2721 => 0.2862, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.17% (0.2726 => 0.2867, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.16% (0.2655 => 0.2792, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.13% (0.2690 => 0.2828, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 5.12% (0.4062 => 0.4270, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 5.04% (0.2937 => 0.3085, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.02% (0.2628 => 0.2760, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.96% (0.2966 => 0.3113, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.84% (0.3489 => 0.3658, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.80% (0.3580 => 0.3752, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.78% (0.2760 => 0.2892, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.78% (1.9828 => 2.0775, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.77% (0.2765 => 0.2897, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.72% (0.3899 => 0.4083, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.70% (0.6959 => 0.7286, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 4.67% (0.2761 => 0.2890, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3107 => 0.3252, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.60% (0.3149 => 0.3294, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.50% (13.8202 => 14.4424, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ary2: 4.42% (0.3192 => 0.3333, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.41% (16.6129 => 17.3461, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.39% (13.2842 => 13.8680, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.39% (0.9199 => 0.9603, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.30% (0.5577 => 0.5817, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.19% (0.3293 => 0.3431, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.16% (0.4016 => 0.4183, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/matrix: 4.15% (0.2988 => 0.3112, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 4.14% (0.3453 => 0.3596, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.13% (0.3534 => 0.3680, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.10% (0.4390 => 0.4570, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.07% (0.2925 => 0.3044, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.05% (0.3756 => 0.3908, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.95% (1.2193 => 1.2675, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.85% (1.4563 => 1.5124, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3246 => 0.3369, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3868 => 0.4012, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.67% (0.2945 => 0.3053, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.61% (0.7506 => 0.7777, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.60% (0.5637 => 0.5840, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.57% (1.1061 => 1.1456, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.56% (1.3245 => 1.3717, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.52% (3.8646 => 4.0008, std. dev.: 0.0070) MultiSource/Applications/treecc/treecc: 3.52% (1.9270 => 1.9948, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.47% (1.1364 => 1.1758, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.47% (0.2914 => 0.3015, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.46% (1.0594 => 1.0961, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.45% (0.4379 => 0.4530, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.28% (7.2180 => 7.4551, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.15% (1.3819 => 1.4254, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.06% (1.3813 => 1.4236, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.06% (1.2292 => 1.2668, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.01% (0.3755 => 0.3868, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 3.01% (0.8310 => 0.8560, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.97% (4.9865 => 5.1347, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.95% (0.7460 => 0.7680, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4113 => 0.4230, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.77% (3.6692 => 3.7708, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 2.63% (14.8535 => 15.2444, std. dev.: 0.0165) MultiSource/Applications/JM/ldecod/ldecod: 2.58% (6.5754 => 6.7453, std. dev.: 0.0048) MultiSource/Applications/siod/siod: 2.58% (2.1791 => 2.2354, std. dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.48% (4.3801 => 4.4887, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.42% (0.4791 => 0.4907, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.31% (4.4433 => 4.5458, std. dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.15% (0.6135 => 0.6267, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.14% (1.1333 => 1.1575, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.12% (16.2614 => 16.6056, std. dev.: 0.0209) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.8698 => 0.8878, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.05% (3.1889 => 3.2542, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.82% (2.1007 => 2.1390, std. dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 1.78% (1.2749 => 1.2976, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 1.77% (14.5298 => 14.7873, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (0.6283 => 0.6391, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 25.07% (1.8175 => 2.2731, std. dev.: 0.0462) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.57% (2.0200 => 2.1932, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.89% (0.9996 => 1.0785, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 6.99% (1.2998 => 1.3907, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.02% (7.4271 => 7.7260, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6782, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8292, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4798, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.75% (3.6469 => 3.7107, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5089 => 1.5316, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5106, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.59% (22.5627 => 21.0752, std. dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.65% (0.3511 => 0.3383, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.03% (0.8818 => 0.8639, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.44% (1.2308 => 1.1023, std. dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.12% (20.3410 => 18.6899, std. dev.: 0.0127) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.21% (1.3780 => 1.3062, std. dev.: 0.0073) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5865, std. dev.: 0.0108) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4461, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4867 => 0.4748, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.03% (6.6320 => 6.4977, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7448, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2552, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.48% (2.5254 => 2.4880, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8595, std. dev.: 0.0036) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1343, std. dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -1.35% (3.0263 => 2.9853, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2143, std. dev.: 0.0330) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2509, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.12% (3.8887 => 3.8450, std. dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 04:05:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 06:05:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120708110527.7E74F2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1880?compare_to=1877&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1880, Order: 159910, Start Time: 2012-07-08 09:46:45, End Time: 2012-07-08 11:05:29 To: 1877, Order: 159909, Start Time: 2012-07-08 06:42:30, End Time: 2012-07-08 08:03:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (64 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (791 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.10% (10.3673 => 13.6957, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.00% (1.1194 => 1.2537, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.47% (0.3473 => 0.3767, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 8.38% (0.3543 => 0.3840, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 8.20% (0.3561 => 0.3853, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.18% (0.3497 => 0.3783, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.13% (0.3543 => 0.3831, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 8.08% (0.3516 => 0.3800, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.93% (0.3694 => 0.3987, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.92% (1.7609 => 1.9003, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/richards_benchmark: 7.89% (0.1622 => 0.1750, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.85% (2.2022 => 2.3750, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.77% (0.3886 => 0.4188, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.69% (0.3927 => 0.4229, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.63% (0.3828 => 0.4120, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.28% (10.4361 => 11.0913, std. dev.: 0.0167) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.4879 => 0.5120, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.85% (0.3177 => 0.3331, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.84% (0.2065 => 0.2165, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.61% (7.0540 => 7.3795, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.31% (0.8172 => 0.8524, std. dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 4.28% (0.7433 => 0.7751, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 3.87% (0.3282 => 0.3409, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.60% (0.4615 => 0.4781, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3092 => 0.3201, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 3.52% (0.6030 => 0.6242, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 3.36% (0.5925 => 0.6124, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.91% (0.5569 => 0.5731, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 2.81% (0.7326 => 0.7532, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.72% (14.3668 => 14.7580, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.66% (5.0018 => 5.1348, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.61% (4.9449 => 5.0741, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 2.54% (9.4845 => 9.7257, std. dev.: 0.0171) MultiSource/Applications/spiff/spiff: 2.53% (0.7835 => 0.8033, std. dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.42% (4.2646 => 4.3678, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.37% (0.5860 => 0.5999, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.26% (8.1363 => 8.3205, std. dev.: 0.0056) MultiSource/Applications/treecc/treecc: 2.26% (2.0273 => 2.0731, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.25% (1.1861 => 1.2128, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 2.16% (1.1642 => 1.1894, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.08% (0.8067 => 0.8235, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 2.04% (3.3354 => 3.4035, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.89% (0.9765 => 0.9950, std. dev.: 0.0052) MultiSource/Applications/lua/lua: 1.89% (3.8723 => 3.9455, std. dev.: 0.0117) MultiSource/Applications/oggenc/oggenc: 1.85% (5.7591 => 5.8659, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.81% (1.5415 => 1.5694, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.79% (1.5603 => 1.5883, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.69% (1.3050 => 1.3271, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.63% (0.6450 => 0.6555, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.59% (17.1811 => 17.4550, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.47% (1.4186 => 1.4394, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.34% (2.2024 => 2.2319, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 1.31% (2.2969 => 2.3270, std. dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9743, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.77% (1.1145 => 1.1900, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7540, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0560, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.34% (26.0924 => 26.7038, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (1.5086 => 1.5350, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.31% (9.1159 => 9.2354, std. dev.: 0.0424) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6882, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 1.18% (2.9346 => 2.9693, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.86% (5.2763 => 3.1730, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.23% (5.3855 => 3.7037, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.63% (5.3526 => 3.7130, std. dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.11% (2.9384 => 2.5532, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -10.53% (22.1758 => 19.8400, std. dev.: 0.0454) SingleSource/UnitTests/Vector/constpool: -5.19% (54.1659 => 51.3557, std. dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.09% (3.8922 => 3.8107, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.33% (0.0998 => 0.0855, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2373 => 1.1156, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.47% (19.9488 => 18.4586, std. dev.: 0.0880) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9146, std. dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6839, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0863, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.06% (1.3677 => 1.3532, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 05:29:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 07:29:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120708122955.BB3192A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1881?compare_to=1878&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1881, Order: 159910, Start Time: 2012-07-08 09:46:30, End Time: 2012-07-08 12:29:58 To: 1878, Order: 159909, Start Time: 2012-07-08 05:42:12, End Time: 2012-07-08 08:28:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (47 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (846 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 25.46% (0.4026 => 0.5051, std. dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2158 => 0.2278, std. dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 33.20% (0.3792 => 0.5051, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/exceptions-2: 9.78% (0.3446 => 0.3783, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.67% (0.3465 => 0.3800, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/for-in: 9.61% (0.3496 => 0.3832, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.60% (0.3460 => 0.3792, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.54% (0.3469 => 0.3800, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.53% (0.3442 => 0.3770, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.43% (0.3488 => 0.3817, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 9.31% (0.3643 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.23% (0.3650 => 0.3987, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 8.83% (0.3724 => 0.4053, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.55% (0.5826 => 0.6091, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 4.16% (0.5889 => 0.6134, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.10% (1.6211 => 1.6876, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.79% (3.5627 => 3.6978, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.78% (0.5026 => 0.5216, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.76% (0.4361 => 0.4525, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.64% (0.5900 => 0.6115, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 3.39% (4.2109 => 4.3538, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 3.30% (0.4029 => 0.4162, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 3.25% (0.7171 => 0.7404, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.16% (0.3930 => 0.4054, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.13% (1.3152 => 1.3564, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.12% (0.4994 => 0.5150, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.83% (2.7292 => 2.8065, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 2.79% (1.0781 => 1.1082, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.76% (0.5000 => 0.5138, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.3845 => 0.3951, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (4.4195 => 4.5408, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.69% (2.0673 => 2.1230, std. dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 2.61% (0.9909 => 1.0168, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (1.9694 => 2.0192, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.45% (0.4658 => 0.4772, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.41% (1.9966 => 2.0448, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 2.33% (5.5417 => 5.6708, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 2.29% (23.5202 => 24.0597, std. dev.: 0.0133) MultiSource/Applications/JM/lencod/lencod: 2.29% (4.6177 => 4.7235, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 2.28% (2.1653 => 2.2146, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 2.13% (2.1013 => 2.1461, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 2.12% (1.8794 => 1.9192, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 1.98% (0.7875 => 0.8031, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 1.98% (1.5932 => 1.6247, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.97% (1.4269 => 1.4550, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.87% (0.9697 => 0.9878, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.57% (0.6634 => 0.6738, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.14% (2.0346 => 2.0577, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.35% (0.2122 => 0.2278, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.97% (11.9555 => 11.7199, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 05:41:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 07:41:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120708124134.4F9DB2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1882?compare_to=1879&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1882, Order: 159913, Start Time: 2012-07-08 11:27:57, End Time: 2012-07-08 12:41:35 To: 1879, Order: 159910, Start Time: 2012-07-08 09:46:38, End Time: 2012-07-08 11:00:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (133 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (720 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.18% (3.7654 => 3.8100, std. dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -1.04% (18.6899 => 18.4961, std. dev.: 0.0591) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.72% (2.0176 => 2.3145, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.82% (0.5818 => 0.6215, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.52% (0.5748 => 0.6123, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.34% (0.7038 => 0.7484, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.22% (0.7061 => 0.7500, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 5.89% (1.3693 => 1.4499, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 5.82% (0.4328 => 0.4580, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.79% (0.1986 => 0.2101, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.73% (0.3578 => 0.3783, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.57% (3.9660 => 4.1870, std. dev.: 0.0111) SingleSource/UnitTests/ObjC/exceptions: 5.57% (0.3914 => 0.4132, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions-2: 5.55% (0.3601 => 0.3801, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.53% (0.5265 => 0.5556, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.51% (0.3646 => 0.3847, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.50% (0.2781 => 0.2934, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 5.49% (0.3789 => 0.3997, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.49% (0.3663 => 0.3864, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.47% (0.4003 => 0.4222, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2596 => 0.2738, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.44% (0.3623 => 0.3820, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.42% (0.3650 => 0.3848, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.41% (0.7710 => 0.8127, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.39% (0.2782 => 0.2932, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3022 => 0.3184, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.33% (0.2721 => 0.2866, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.31% (0.2655 => 0.2796, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 5.27% (0.4062 => 0.4276, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.25% (0.3940 => 0.4147, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.24% (0.2690 => 0.2831, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.18% (0.2628 => 0.2764, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.2937 => 0.3088, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.13% (0.3899 => 0.4099, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.09% (0.2966 => 0.3117, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.03% (0.2726 => 0.2863, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.00% (0.2760 => 0.2898, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.97% (0.2696 => 0.2830, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.96% (0.3489 => 0.3662, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.91% (0.6959 => 0.7301, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.89% (0.3580 => 0.3755, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.86% (0.3107 => 0.3258, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (1.9828 => 2.0789, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.82% (0.2761 => 0.2894, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.76% (0.3149 => 0.3299, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.57% (0.3192 => 0.3338, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.54% (16.6129 => 17.3670, std. dev.: 0.0127) MultiSource/Applications/SPASS/SPASS: 4.53% (13.8202 => 14.4461, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (0.3485 => 0.3642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.37% (0.3453 => 0.3604, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.36% (0.4016 => 0.4191, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.34% (0.3293 => 0.3436, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.34% (0.9199 => 0.9598, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.33% (0.4390 => 0.4580, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.31% (13.2842 => 13.8562, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2988 => 0.3116, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.27% (0.3534 => 0.3685, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.18% (0.3756 => 0.3913, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.14% (1.2193 => 1.2698, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.10% (0.2925 => 0.3045, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.5577 => 0.5799, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.88% (0.3868 => 0.4018, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.85% (1.4563 => 1.5124, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3246 => 0.3369, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.78% (0.5637 => 0.5850, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (1.3245 => 1.3740, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.2945 => 0.3054, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (1.1364 => 1.1782, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.67% (1.0594 => 1.0983, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.54% (1.1061 => 1.1453, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.48% (1.9270 => 1.9941, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 3.48% (3.8646 => 3.9990, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 3.46% (0.7506 => 0.7766, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.43% (0.4379 => 0.4529, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.33% (1.3819 => 1.4279, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.27% (1.3813 => 1.4265, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.23% (1.2292 => 1.2689, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.22% (7.2180 => 7.4505, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.12% (0.3755 => 0.3872, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.04% (4.9865 => 5.1383, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.94% (0.7460 => 0.7679, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.89% (3.6692 => 3.7753, std. dev.: 0.0116) MultiSource/Applications/JM/lencod/lencod: 2.75% (14.8535 => 15.2614, std. dev.: 0.0117) MultiSource/Applications/siod/siod: 2.74% (2.1791 => 2.2389, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 2.73% (6.5754 => 6.7551, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.65% (0.4791 => 0.4918, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 2.55% (0.4113 => 0.4218, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.54% (4.3801 => 4.4915, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.35% (4.4433 => 4.5476, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.33% (1.1333 => 1.1597, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.31% (0.6135 => 0.6277, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.30% (16.2614 => 16.6350, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.29% (0.8698 => 0.8897, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.22% (3.1889 => 3.2598, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.01% (2.1007 => 2.1430, std. dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 1.97% (1.2749 => 1.3000, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.94% (14.5298 => 14.8117, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.88% (0.6283 => 0.6401, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.09% (4.6629 => 4.7138, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (3.2742 => 3.3090, std. dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.78% (1.8175 => 2.2679, std. dev.: 0.0419) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1930, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: 7.55% (1.2998 => 1.3979, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7299, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6785, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4807, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5089 => 1.5325, std. dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.40% (3.6469 => 3.6979, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.01% (0.4657 => 0.3865, std. dev.: 0.0185) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.49% (22.5627 => 21.0991, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.3511 => 0.3397, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.98% (0.8818 => 0.8643, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.23% (1.2308 => 1.1049, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.07% (20.3410 => 18.4961, std. dev.: 0.0591) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std. dev.: 0.0042) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9054, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6017, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4475, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5070, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7462, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2510, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8618, std. dev.: 0.0041) MultiSource/Applications/spiff/spiff: -1.34% (3.0263 => 2.9856, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (0.9692 => 0.9564, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1796, std. dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2509, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2213, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 05:51:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 07:51:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120708125120.B80052A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1883?compare_to=1880&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1883, Order: 159913, Start Time: 2012-07-08 11:33:08, End Time: 2012-07-08 12:51:23 To: 1880, Order: 159910, Start Time: 2012-07-08 09:46:45, End Time: 2012-07-08 11:05:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (59 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (796 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.36% (13.6957 => 13.2350, std. dev.: 0.0203) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.64% (0.8524 => 0.8384, std. dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.66% (10.3673 => 13.2350, std. dev.: 0.0203) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.62% (1.1194 => 1.2495, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 9.01% (0.3473 => 0.3786, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.65% (0.3561 => 0.3869, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.64% (0.3543 => 0.3849, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.64% (0.3497 => 0.3799, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.61% (0.3543 => 0.3848, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.53% (0.3516 => 0.3816, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 8.36% (0.3694 => 0.4003, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.19% (1.7609 => 1.9051, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.10% (2.2022 => 2.3805, std. dev.: 0.0144) SingleSource/UnitTests/ObjC/exceptions: 8.05% (0.3828 => 0.4136, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.03% (0.3886 => 0.4198, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.00% (0.3927 => 0.4241, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 7.15% (0.1622 => 0.1738, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.03% (10.4361 => 11.0651, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.08% (0.4879 => 0.5127, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.54% (7.0540 => 7.3741, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.50% (0.3177 => 0.3320, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.85% (0.7433 => 0.7719, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 3.81% (0.3282 => 0.3407, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 3.53% (0.5925 => 0.6134, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 3.47% (0.6030 => 0.6239, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.83% (0.7326 => 0.7533, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.62% (0.4615 => 0.4736, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.59% (0.8172 => 0.8384, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.57% (0.5569 => 0.5712, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (4.9449 => 5.0672, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.44% (5.0018 => 5.1237, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (14.3668 => 14.7109, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: 2.34% (0.7835 => 0.8018, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 2.30% (9.4845 => 9.7022, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.17% (8.1363 => 8.3126, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.12% (4.2646 => 4.3550, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5860 => 0.5983, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 2.03% (2.0273 => 2.0684, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.92% (1.1861 => 1.2089, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 1.83% (3.3354 => 3.3966, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 1.82% (1.1642 => 1.1854, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.76% (0.8067 => 0.8209, std. dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 1.56% (5.7591 => 5.8491, std. dev.: 0.0177) MultiSource/Applications/lua/lua: 1.52% (3.8723 => 3.9312, std. dev.: 0.0040) MultiSource/Applications/hbd/hbd: 1.51% (1.5603 => 1.5839, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.51% (17.1811 => 17.4408, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.47% (1.5415 => 1.5642, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.29% (1.3050 => 1.3218, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.25% (1.4186 => 1.4363, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.21% (0.9765 => 0.9883, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7551, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.02% (26.0924 => 26.6193, std. dev.: 0.0534) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.94% (1.5086 => 1.5379, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4474, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2345, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6883, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.14% (2.9346 => 2.9682, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1259, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.99% (5.2763 => 3.1665, std. dev.: 0.0153) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.20% (5.3855 => 3.7051, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.62% (5.3526 => 3.7138, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.23% (2.9384 => 2.5497, std. dev.: 0.0191) MultiSource/Applications/ClamAV/clamscan: -10.59% (22.1758 => 19.8279, std. dev.: 0.0120) SingleSource/UnitTests/Vector/constpool: -5.21% (54.1659 => 51.3422, std. dev.: 0.0282) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.39% (3.8922 => 3.7993, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2373 => 1.1155, std. dev.: 0.0343) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.26% (19.9488 => 18.5012, std. dev.: 0.0545) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.85% (8.1563 => 7.9235, std. dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6907, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 07:22:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 09:22:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120708142255.C6AFE2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1884?compare_to=1882&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1884, Order: 159914, Start Time: 2012-07-08 13:09:10, End Time: 2012-07-08 14:22:57 To: 1882, Order: 159913, Start Time: 2012-07-08 11:27:57, End Time: 2012-07-08 12:41:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (133 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (720 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.67% (2.0176 => 2.3135, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.89% (0.5818 => 0.6219, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.84% (0.7061 => 0.7544, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.59% (0.5748 => 0.6127, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.41% (0.7038 => 0.7489, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 5.89% (1.3693 => 1.4500, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.84% (0.1986 => 0.2102, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.78% (0.4328 => 0.4578, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.76% (0.7710 => 0.8154, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 5.73% (0.3578 => 0.3783, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.72% (0.2782 => 0.2941, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.64% (0.5265 => 0.5562, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: 5.57% (0.3914 => 0.4132, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.54% (3.9660 => 4.1858, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 5.53% (0.3601 => 0.3800, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.51% (0.3663 => 0.3865, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.51% (0.3646 => 0.3847, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.51% (0.2596 => 0.2739, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.50% (0.4003 => 0.4223, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.49% (0.3789 => 0.3997, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.45% (0.3650 => 0.3849, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.44% (0.2721 => 0.2869, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.42% (0.4062 => 0.4282, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-3: 5.41% (0.3623 => 0.3819, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.39% (0.2781 => 0.2931, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.37% (0.2607 => 0.2747, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 5.33% (0.3940 => 0.4150, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.27% (0.2655 => 0.2795, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.26% (0.3022 => 0.3181, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.24% (0.2690 => 0.2831, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.22% (0.2760 => 0.2904, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wc: 5.18% (0.2937 => 0.3089, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.14% (0.2628 => 0.2763, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.09% (0.2966 => 0.3117, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.04% (0.3489 => 0.3665, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.01% (0.2696 => 0.2831, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.3899 => 0.4094, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.86% (1.9828 => 2.0792, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 4.85% (0.2761 => 0.2895, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.85% (0.2765 => 0.2899, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.83% (0.6959 => 0.7295, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 4.83% (0.3107 => 0.3257, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.83% (0.3149 => 0.3301, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.75% (0.3580 => 0.3750, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 4.70% (13.8202 => 14.4695, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/sieve: 4.69% (0.3453 => 0.3615, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.67% (0.3192 => 0.3341, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.65% (0.3485 => 0.3647, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.55% (16.6129 => 17.3685, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.53% (0.4016 => 0.4198, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.52% (0.3293 => 0.3442, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.39% (0.9199 => 0.9603, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.34% (13.2842 => 13.8609, std. dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.34% (0.3756 => 0.3919, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2988 => 0.3116, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.24% (0.3534 => 0.3684, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.11% (1.2193 => 1.2694, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.07% (0.2925 => 0.3044, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.05% (0.4390 => 0.4568, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 3.96% (0.3868 => 0.4021, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.85% (0.3246 => 0.3371, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.77% (1.1061 => 1.1478, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.76% (1.3245 => 1.3743, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.75% (1.4563 => 1.5109, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.74% (0.5637 => 0.5848, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.2945 => 0.3054, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.66% (1.0594 => 1.0982, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.58% (1.1364 => 1.1771, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.57% (1.9270 => 1.9958, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 3.54% (3.8646 => 4.0016, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.52% (0.4379 => 0.4533, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.47% (1.2292 => 1.2719, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.46% (0.7506 => 0.7766, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.40% (1.3819 => 1.4289, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.25% (1.3813 => 1.4262, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.23% (7.2180 => 7.4513, std. dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.18% (0.7460 => 0.7697, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 3.15% (0.8310 => 0.8572, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3755 => 0.3873, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.12% (4.9865 => 5.1419, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (3.6692 => 3.7770, std. dev.: 0.0036) MultiSource/Applications/siod/siod: 2.89% (2.1791 => 2.2421, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.82% (0.4791 => 0.4926, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.81% (14.8535 => 15.2707, std. dev.: 0.0107) MultiSource/Applications/JM/ldecod/ldecod: 2.71% (6.5754 => 6.7535, std. dev.: 0.0109) MultiSource/Benchmarks/McCat/05-eks/eks: 2.58% (0.4113 => 0.4219, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.51% (4.3801 => 4.4901, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.41% (4.4433 => 4.5504, std. dev.: 0.0033) MultiSource/Applications/d/make_dparser: 2.30% (3.1889 => 3.2623, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.30% (0.6135 => 0.6276, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.28% (1.1333 => 1.1591, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.8698 => 0.8896, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.26% (16.2614 => 16.6281, std. dev.: 0.0112) MultiSource/Applications/SIBsim4/SIBsim4: 2.06% (1.2749 => 1.3012, std. dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 2.01% (14.5298 => 14.8214, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.94% (2.1007 => 2.1415, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.91% (0.6283 => 0.6403, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.10% (4.6629 => 4.7144, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (3.2742 => 3.3090, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.86% (1.8175 => 2.2694, std. dev.: 0.0191) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1918, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.12% (1.2998 => 1.3924, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7303, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6772, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4787, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (1.5089 => 1.5365, std. dev.: 0.0100) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.67% (3.6469 => 3.7079, std. dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9588, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.54% (22.5627 => 21.0882, std. dev.: 0.0210) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.3511 => 0.3397, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.98% (0.8818 => 0.8643, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1126, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.21% (20.3410 => 18.4680, std. dev.: 0.0334) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.08% (1.3780 => 1.3218, std. dev.: 0.0087) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9059, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5859, std. dev.: 0.0131) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5101, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7447, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2538, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1225, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8621, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: -1.40% (3.0263 => 2.9838, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2154, std. dev.: 0.0266) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2604, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8488, std. dev.: 0.0083) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 07:37:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 09:37:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120708143718.6C98D2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1885?compare_to=1883&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1885, Order: 159914, Start Time: 2012-07-08 13:19:05, End Time: 2012-07-08 14:37:21 To: 1883, Order: 159913, Start Time: 2012-07-08 11:33:08, End Time: 2012-07-08 12:51:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (59 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (796 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.01% (55.5016 => 56.6173, std. dev.: 0.0349) SingleSource/Benchmarks/Misc/lowercase: 1.19% (7.9485 => 8.0431, std. dev.: 0.0072) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.73% (10.3673 => 13.2424, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.55% (1.1194 => 1.2487, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 8.90% (0.3473 => 0.3782, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 8.66% (0.3543 => 0.3850, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.66% (0.3497 => 0.3800, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 8.65% (0.3516 => 0.3820, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.58% (0.3543 => 0.3847, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 8.54% (0.3561 => 0.3865, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 8.34% (0.3694 => 0.4002, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.16% (1.7609 => 1.9046, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.10% (0.1432 => 0.1548, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.08% (0.3886 => 0.4200, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3828 => 0.4137, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 8.02% (0.3927 => 0.4242, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.02% (2.2022 => 2.3788, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 7.15% (0.1622 => 0.1738, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.02% (10.4361 => 11.0642, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.06% (0.4879 => 0.5126, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.52% (7.0540 => 7.3727, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.47% (0.3177 => 0.3319, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 3.81% (0.3282 => 0.3407, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.61% (0.7433 => 0.7701, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 3.56% (0.5925 => 0.6136, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 3.47% (0.6030 => 0.6239, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.83% (0.7326 => 0.7533, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.64% (0.5569 => 0.5716, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.55% (0.8172 => 0.8380, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.51% (0.4615 => 0.4731, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (14.3668 => 14.7146, std. dev.: 0.0096) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.38% (5.0018 => 5.1209, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.38% (4.9449 => 5.0626, std. dev.: 0.0074) MultiSource/Applications/spiff/spiff: 2.20% (0.7835 => 0.8007, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 2.16% (9.4845 => 9.6889, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.13% (8.1363 => 8.3094, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5860 => 0.5979, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.00% (4.2646 => 4.3498, std. dev.: 0.0056) MultiSource/Applications/treecc/treecc: 1.95% (2.0273 => 2.0669, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 1.81% (3.3354 => 3.3958, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.74% (1.1861 => 1.2067, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.64% (0.8067 => 0.8199, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.63% (1.1642 => 1.1832, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.53% (17.1811 => 17.4441, std. dev.: 0.0085) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7591 => 5.8468, std. dev.: 0.0105) MultiSource/Applications/hbd/hbd: 1.48% (1.5603 => 1.5834, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.45% (3.8723 => 3.9285, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.43% (1.5415 => 1.5635, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.28% (1.3050 => 1.3217, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.22% (0.9765 => 0.9884, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.10% (1.4186 => 1.4342, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.80% (1.1145 => 1.1903, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7511, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.35% (1.0313 => 1.0555, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.15% (26.0924 => 26.6538, std. dev.: 0.0089) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (1.5086 => 1.5364, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2377, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6894, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: 1.19% (2.9346 => 2.9696, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.95% (5.2763 => 3.1685, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.21% (5.3855 => 3.7049, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.66% (5.3526 => 3.7114, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.29% (2.9384 => 2.5480, std. dev.: 0.0152) MultiSource/Applications/ClamAV/clamscan: -10.50% (22.1758 => 19.8464, std. dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -5.25% (54.1659 => 51.3231, std. dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.39% (3.8922 => 3.7993, std. dev.: 0.0156) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.13% (0.0998 => 0.0837, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.43% (1.2373 => 1.1082, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.19% (19.9488 => 18.5141, std. dev.: 0.0832) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.87% (8.1563 => 7.9224, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6837, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0830, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 08:41:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 10:41:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120708154102.7E0DE2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1886?compare_to=1881&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1886, Order: 159914, Start Time: 2012-07-08 12:57:31, End Time: 2012-07-08 15:41:05 To: 1881, Order: 159910, Start Time: 2012-07-08 09:46:30, End Time: 2012-07-08 12:29:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (47 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (846 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.84% (125.0473 => 129.8494, std. dev.: 0.7854) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 24.08% (0.3792 => 0.4705, std. dev.: 0.0213) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3465 => 0.3816, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.07% (0.3446 => 0.3793, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.01% (0.3496 => 0.3846, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.97% (0.3460 => 0.3805, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.91% (0.3442 => 0.3783, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.86% (0.3469 => 0.3811, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.83% (0.3488 => 0.3831, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 9.66% (0.3643 => 0.3995, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.59% (0.3650 => 0.4000, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.18% (0.3724 => 0.4066, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 4.89% (0.5826 => 0.6111, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 4.53% (0.5889 => 0.6156, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.93% (1.6211 => 1.6848, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.58% (3.5627 => 3.6904, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.42% (0.4361 => 0.4510, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 3.39% (0.7171 => 0.7414, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.22% (0.9909 => 1.0228, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 3.19% (4.2109 => 4.3453, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 3.15% (0.3267 => 0.3370, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.14% (0.4994 => 0.5151, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (1.3152 => 1.3560, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.10% (0.5900 => 0.6083, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.09% (2.0673 => 2.1311, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.05% (0.3930 => 0.4050, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 3.05% (23.5202 => 24.2376, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (0.5026 => 0.5179, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 2.98% (0.4029 => 0.4149, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.79% (1.0781 => 1.1082, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4146 => 0.4260, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.75% (0.4658 => 0.4786, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.3845 => 0.3949, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.56% (0.5000 => 0.5128, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (4.4195 => 4.5290, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.41% (1.9966 => 2.0447, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.33% (2.7292 => 2.7927, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.32% (1.9694 => 2.0151, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 2.13% (5.5417 => 5.6600, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 2.05% (1.8794 => 1.9180, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 2.05% (0.9697 => 0.9896, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 1.96% (2.1653 => 2.2078, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 1.93% (4.6177 => 4.7068, std. dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 1.84% (2.1013 => 2.1399, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.72% (0.6435 => 0.6546, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.67% (1.4269 => 1.4508, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 1.61% (0.7875 => 0.8002, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 1.38% (1.5932 => 1.6152, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.87% (11.9555 => 11.7319, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 14:36:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 16:36:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120708213605.DDE182A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1887?compare_to=1884&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1887, Order: 159916, Start Time: 2012-07-08 20:22:12, End Time: 2012-07-08 21:36:08 To: 1884, Order: 159914, Start Time: 2012-07-08 13:09:10, End Time: 2012-07-08 14:22:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (130 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 948 (723 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.49% (55.1741 => 56.5458, std. dev.: 0.0986) SingleSource/Benchmarks/Misc/mandel-2: 1.64% (1.3924 => 1.4153, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.33% (79.0776 => 80.1313, std. dev.: 0.2294) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.10% (1.3218 => 1.3072, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.70% (2.0176 => 2.2940, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference: 7.58% (0.7061 => 0.7596, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.24% (0.5818 => 0.6239, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.06% (0.5748 => 0.6154, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.81% (0.3130 => 0.3343, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.01% (0.7038 => 0.7461, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.82% (0.2596 => 0.2747, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.73% (1.3693 => 1.4478, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.71% (0.4328 => 0.4575, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.60% (0.7710 => 0.8142, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.59% (0.1986 => 0.2097, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2781 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.47% (0.4062 => 0.4284, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.21% (0.2782 => 0.2927, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.17% (0.5265 => 0.5537, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.08% (3.9660 => 4.1676, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.05% (0.2655 => 0.2789, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.00% (0.3022 => 0.3173, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.99% (0.2726 => 0.2862, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.2721 => 0.2856, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 4.91% (0.2690 => 0.2822, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 4.90% (0.2937 => 0.3081, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.87% (0.2628 => 0.2756, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.86% (0.2760 => 0.2894, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.86% (0.2966 => 0.3110, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.85% (0.2761 => 0.2895, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.85% (0.2765 => 0.2899, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.82% (0.3489 => 0.3657, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 4.78% (0.3578 => 0.3749, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.74% (0.3899 => 0.4084, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3107 => 0.3254, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.71% (1.9828 => 2.0761, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.67% (0.2696 => 0.2822, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 4.65% (0.3914 => 0.4096, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.64% (0.3149 => 0.3295, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.60% (0.4003 => 0.4187, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.53% (0.3601 => 0.3764, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.53% (0.3646 => 0.3811, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.53% (0.3580 => 0.3742, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 4.52% (0.3940 => 0.4118, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-3: 4.50% (0.3623 => 0.3786, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.49% (0.9199 => 0.9612, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 4.49% (0.3789 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.44% (0.3650 => 0.3812, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 4.39% (0.3192 => 0.3332, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.38% (0.6959 => 0.7264, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 4.37% (0.3663 => 0.3823, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.34% (0.3453 => 0.3603, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.33% (0.3485 => 0.3636, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.28% (0.4390 => 0.4578, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.23% (0.4016 => 0.4186, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.19% (0.3293 => 0.3431, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.15% (13.8202 => 14.3937, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/lists1: 4.13% (0.3534 => 0.3680, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.12% (16.6129 => 17.2976, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/matrix: 4.05% (0.2988 => 0.3109, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.03% (13.2842 => 13.8193, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.02% (0.3756 => 0.3907, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.99% (1.2193 => 1.2679, std. dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.77% (0.2914 => 0.3024, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.3868 => 0.4011, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.69% (1.4563 => 1.5100, std. dev.: 0.0094) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.2925 => 0.3031, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.59% (0.5577 => 0.5777, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.51% (0.5637 => 0.5835, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 3.50% (0.7506 => 0.7769, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.37% (1.1364 => 1.1747, std. dev.: 0.0085) MultiSource/Benchmarks/nbench/nbench: 3.33% (1.0594 => 1.0947, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.32% (1.3245 => 1.3685, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: 3.21% (3.8646 => 3.9886, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.15% (0.4379 => 0.4517, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.11% (1.3819 => 1.4249, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 3.09% (1.1061 => 1.1403, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 3.05% (1.9270 => 1.9858, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 3.04% (1.2292 => 1.2666, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.00% (7.2180 => 7.4348, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.96% (1.3813 => 1.4222, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.96% (0.3755 => 0.3866, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.94% (4.9865 => 5.1331, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.75% (0.7460 => 0.7665, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 2.74% (0.8310 => 0.8538, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (3.6692 => 3.7622, std. dev.: 0.0106) MultiSource/Applications/siod/siod: 2.39% (2.1791 => 2.2311, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.30% (0.4791 => 0.4901, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.27% (14.8535 => 15.1909, std. dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 2.25% (6.5754 => 6.7233, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.8698 => 0.8890, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.10% (4.3801 => 4.4722, std. dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: 2.07% (16.2614 => 16.5985, std. dev.: 0.0148) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.03% (4.4433 => 4.5334, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (2.1007 => 2.1425, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.97% (0.6135 => 0.6256, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.88% (1.1333 => 1.1546, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.77% (3.1889 => 3.2455, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.73% (14.5298 => 14.7816, std. dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: 1.53% (1.2749 => 1.2944, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.94% (1.8175 => 2.2708, std. dev.: 0.0260) SingleSource/Benchmarks/Misc/mandel-2: 8.89% (1.2998 => 1.4153, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.36% (2.0200 => 2.1888, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.92% (7.4271 => 7.7186, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9200, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6786, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4798, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1898, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6469 => 3.7090, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5089 => 1.5324, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9572, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.91% (22.5627 => 21.0027, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.52% (0.8818 => 0.8596, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.60% (0.6576 => 0.6471, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.36% (1.2308 => 1.1033, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.87% (20.3410 => 18.5374, std. dev.: 0.0458) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.14% (1.3780 => 1.3072, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5904, std. dev.: 0.0137) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4462, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5061, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7463, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2547, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.52% (2.5254 => 2.4870, std. dev.: 0.0015) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1382, std. dev.: 0.0066) MultiSource/Applications/spiff/spiff: -1.39% (3.0263 => 2.9842, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.34% (9.3358 => 9.2111, std. dev.: 0.0192) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8666, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2545, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 14:40:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 16:40:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120708214035.328D22A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1888?compare_to=1885&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1888, Order: 159916, Start Time: 2012-07-08 20:22:20, End Time: 2012-07-08 21:40:38 To: 1885, Order: 159914, Start Time: 2012-07-08 13:19:05, End Time: 2012-07-08 14:37:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (53 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (801 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.93% (10.3673 => 13.2632, std. dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.23% (1.1194 => 1.2451, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.47% (0.3473 => 0.3767, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-2: 8.21% (0.3497 => 0.3784, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.19% (0.3543 => 0.3833, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.13% (0.3516 => 0.3802, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.04% (0.3543 => 0.3828, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.00% (0.3561 => 0.3846, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/for-in: 7.80% (0.3694 => 0.3982, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.69% (1.7609 => 1.8963, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 7.68% (0.3828 => 0.4122, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: 7.54% (0.3927 => 0.4223, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.31% (0.3886 => 0.4170, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.23% (2.2022 => 2.3615, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 5.66% (10.4361 => 11.0266, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.31% (0.3177 => 0.3314, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.14% (0.4879 => 0.5081, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.89% (7.0540 => 7.3284, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/Hello: 3.70% (0.5925 => 0.6144, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.63% (0.6030 => 0.6249, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 3.26% (0.3282 => 0.3389, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 3.23% (0.7433 => 0.7673, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.23% (0.4615 => 0.4764, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 2.96% (0.7326 => 0.7543, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.42% (0.8172 => 0.8370, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.37% (14.3668 => 14.7069, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.32% (0.5569 => 0.5698, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.21% (4.9449 => 5.0542, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.20% (5.0018 => 5.1119, std. dev.: 0.0136) MultiSource/Applications/spiff/spiff: 1.97% (0.7835 => 0.7989, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 1.89% (9.4845 => 9.6640, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.83% (8.1363 => 8.2850, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.71% (4.2646 => 4.3375, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (1.1861 => 1.2045, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.51% (2.0273 => 2.0579, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.48% (3.3354 => 3.3847, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.39% (1.5415 => 1.5629, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 1.31% (1.5603 => 1.5808, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.15% (17.1811 => 17.3787, std. dev.: 0.0389) MultiSource/Applications/lua/lua: 1.13% (3.8723 => 3.9160, std. dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 1.12% (5.7591 => 5.8236, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.12% (1.1642 => 1.1772, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7559, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.33% (1.0313 => 1.0553, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.20% (26.0924 => 26.6660, std. dev.: 0.0150) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.93% (1.5086 => 1.5377, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2340, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6877, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 1.01% (2.9346 => 2.9642, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.14% (5.2763 => 3.1586, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.70% (5.3855 => 3.6785, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.29% (5.3526 => 3.6779, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.21% (2.9384 => 2.5503, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.83% (22.1758 => 19.7737, std. dev.: 0.0162) SingleSource/UnitTests/Vector/constpool: -5.07% (54.1659 => 51.4199, std. dev.: 0.0237) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.56% (3.8922 => 3.7924, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.38% (0.8101 => 0.7989, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.44% (1.2373 => 1.1081, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.55% (19.9488 => 18.4427, std. dev.: 0.0901) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.88% (8.1563 => 7.9216, std. dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6935, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0840, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 16:05:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 18:05:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120708230507.D7BB72A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1889?compare_to=1886&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1889, Order: 159916, Start Time: 2012-07-08 20:22:11, End Time: 2012-07-08 23:05:11 To: 1886, Order: 159914, Start Time: 2012-07-08 12:57:31, End Time: 2012-07-08 15:41:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (38 on baseline) Performance Improvements: 6 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 946 (854 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.37% (0.4705 => 0.3935, std. dev.: 0.0292) MultiSource/Benchmarks/Bullet/bullet: -1.86% (24.2376 => 23.7856, std. dev.: 0.0142) MultiSource/Applications/hexxagon/hexxagon: -1.66% (1.0228 => 1.0058, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.59% (2.1311 => 2.0973, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: -1.10% (0.9896 => 0.9787, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -1.07% (2.4525 => 2.4263, std. dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 8.35% (0.3460 => 0.3749, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.24% (0.3496 => 0.3784, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-2: 8.18% (0.3446 => 0.3728, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.17% (0.3465 => 0.3748, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.08% (0.3442 => 0.3720, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.04% (0.3469 => 0.3748, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.00% (0.3488 => 0.3767, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.93% (0.3643 => 0.3932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.81% (0.3650 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.44% (0.3724 => 0.4001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.78% (0.5826 => 0.6046, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.53% (0.4361 => 0.4515, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 3.29% (0.5889 => 0.6083, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.21% (1.6211 => 1.6732, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 3.13% (0.4029 => 0.4155, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.08% (0.5026 => 0.5181, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.07% (3.5627 => 3.6722, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.85% (0.5900 => 0.6068, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.71% (1.3152 => 1.3508, std. dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 2.66% (4.2109 => 4.3227, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.62% (0.3930 => 0.4033, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.60% (0.4994 => 0.5124, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.40% (0.5000 => 0.5120, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 2.40% (0.7171 => 0.7343, std. dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (2.7292 => 2.7833, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.87% (1.9694 => 2.0062, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.71% (1.9966 => 2.0308, std. dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 1.53% (5.5417 => 5.6264, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 1.50% (0.9909 => 1.0058, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.47% (4.4195 => 4.4843, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.45% (2.0673 => 2.0973, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.44% (4.6177 => 4.6843, std. dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (2.1013 => 2.1316, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: 1.43% (1.8794 => 1.9063, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 1.36% (0.7875 => 0.7982, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 1.28% (2.1653 => 2.1931, std. dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 1.13% (23.5202 => 23.7856, std. dev.: 0.0142) MultiSource/Applications/oggenc/oggenc: 1.12% (1.5932 => 1.6110, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.66% (11.9555 => 11.6373, std. dev.: 0.0166) SingleSource/UnitTests/Vector/constpool: -2.02% (2.4764 => 2.4263, std. dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 16:17:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 18:17:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120708231729.0BB8C2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1890?compare_to=1887&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1890, Order: 159917, Start Time: 2012-07-08 22:03:46, End Time: 2012-07-08 23:17:29 To: 1887, Order: 159916, Start Time: 2012-07-08 20:22:12, End Time: 2012-07-08 21:36:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (129 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (723 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.64% (2.0176 => 2.2928, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference-object: 7.15% (0.5818 => 0.6234, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.98% (0.5748 => 0.6149, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 6.91% (0.7061 => 0.7549, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.81% (0.3130 => 0.3343, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.73% (1.3693 => 1.4478, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 5.66% (0.7038 => 0.7436, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.59% (0.1986 => 0.2097, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 5.57% (0.4328 => 0.4569, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2781 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.28% (0.2782 => 0.2929, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.7710 => 0.8111, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.16% (0.2596 => 0.2730, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.16% (0.2655 => 0.2792, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.15% (0.5265 => 0.5536, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 5.14% (0.2628 => 0.2763, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.12% (0.4062 => 0.4270, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.10% (0.2726 => 0.2865, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.09% (0.2966 => 0.3117, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.02% (0.2690 => 0.2825, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.01% (3.9660 => 4.1645, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.00% (0.3022 => 0.3173, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 4.97% (0.2937 => 0.3083, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.93% (0.2760 => 0.2896, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.2721 => 0.2855, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.85% (0.3899 => 0.4088, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 4.83% (0.3107 => 0.3257, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.82% (0.2696 => 0.2826, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 4.78% (0.3578 => 0.3749, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 4.74% (0.2761 => 0.2892, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.71% (1.9828 => 2.0762, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.68% (0.3650 => 0.3821, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.67% (0.3489 => 0.3652, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.65% (0.3914 => 0.4096, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.65% (0.4003 => 0.4189, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.64% (0.3149 => 0.3295, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.58% (0.3601 => 0.3766, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 4.55% (0.3646 => 0.3812, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.54% (0.3789 => 0.3961, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.53% (0.3580 => 0.3742, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 4.50% (0.3663 => 0.3828, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 4.42% (0.3623 => 0.3783, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 4.40% (0.3453 => 0.3605, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.37% (0.3940 => 0.4112, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.6959 => 0.7262, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 4.32% (0.3192 => 0.3330, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.30% (0.3485 => 0.3635, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.28% (0.4016 => 0.4188, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.16% (0.3534 => 0.3681, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.13% (0.3293 => 0.3429, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.07% (0.9199 => 0.9573, std. dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 4.03% (13.8202 => 14.3774, std. dev.: 0.0184) MultiSource/Applications/kimwitu++/kc: 4.00% (16.6129 => 17.2780, std. dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.94% (0.4390 => 0.4563, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.94% (0.3756 => 0.3904, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.91% (13.2842 => 13.8040, std. dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.78% (1.2193 => 1.2654, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3868 => 0.4013, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 3.66% (0.2925 => 0.3032, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.66% (0.5577 => 0.5781, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 3.46% (0.2945 => 0.3047, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.39% (0.5637 => 0.5828, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.30% (0.3246 => 0.3353, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.30% (1.4563 => 1.5043, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (1.3245 => 1.3680, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.21% (1.1364 => 1.1729, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (3.8646 => 3.9872, std. dev.: 0.0096) MultiSource/Applications/spiff/spiff: 3.16% (0.7506 => 0.7743, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.15% (0.4379 => 0.4517, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.14% (1.0594 => 1.0927, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.12% (1.2292 => 1.2675, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.07% (1.1061 => 1.1401, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3755 => 0.3867, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.96% (1.3819 => 1.4228, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.96% (1.9270 => 1.9840, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.93% (7.2180 => 7.4295, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.91% (1.3813 => 1.4215, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.84% (0.7460 => 0.7672, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.81% (4.9865 => 5.1267, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.55% (3.6692 => 3.7626, std. dev.: 0.0136) MultiSource/Applications/siod/siod: 2.40% (2.1791 => 2.2313, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.34% (0.4791 => 0.4903, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.21% (6.5754 => 6.7210, std. dev.: 0.0168) MultiSource/Applications/JM/lencod/lencod: 2.19% (14.8535 => 15.1789, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.11% (4.3801 => 4.4725, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.08% (0.8698 => 0.8879, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6135 => 0.6261, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.98% (16.2614 => 16.5838, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.89% (1.1333 => 1.1547, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.88% (4.4433 => 4.5267, std. dev.: 0.0030) MultiSource/Applications/d/make_dparser: 1.68% (3.1889 => 3.2425, std. dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: 1.68% (14.5298 => 14.7739, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.64% (0.6283 => 0.6386, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.63% (2.1007 => 2.1350, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2937, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 23.87% (1.8175 => 2.2513, std. dev.: 0.0572) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1903, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9996 => 1.0772, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.23% (1.2998 => 1.3938, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.04% (7.4271 => 7.7275, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6795, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8314, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4785, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.88% (1.4298 => 1.4567, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.58% (3.6469 => 3.7045, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.48% (0.4657 => 0.3843, std. dev.: 0.0302) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.01% (22.5627 => 20.9817, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.56% (0.8818 => 0.8592, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.58% (0.6576 => 0.6472, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.64% (1.2308 => 1.1121, std. dev.: 0.0293) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (20.3410 => 18.6495, std. dev.: 0.0436) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.87% (1.3780 => 1.3109, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5831, std. dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.57% (0.4867 => 0.4742, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5027, std. dev.: 0.0077) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7467, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2515, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -1.45% (3.0263 => 2.9824, std. dev.: 0.0019) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1329, std. dev.: 0.0446) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.29% (0.9692 => 0.9567, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8675, std. dev.: 0.0102) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2220, std. dev.: 0.0322) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2545, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 16:26:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 18:26:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120708232632.50E7E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1891?compare_to=1888&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1891, Order: 159917, Start Time: 2012-07-08 22:08:24, End Time: 2012-07-08 23:26:35 To: 1888, Order: 159916, Start Time: 2012-07-08 20:22:20, End Time: 2012-07-08 21:40:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (56 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (798 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.12% (1.5249 => 1.5420, std. dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.85% (10.3673 => 13.2549, std. dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.26% (1.1194 => 1.2454, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.41% (0.3473 => 0.3765, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.21% (0.3543 => 0.3834, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-2: 8.21% (0.3497 => 0.3784, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.13% (0.3516 => 0.3802, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.13% (0.3543 => 0.3831, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.00% (0.3561 => 0.3846, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.82% (0.3694 => 0.3983, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.68% (1.7609 => 1.8962, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 7.52% (0.3828 => 0.4116, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.44% (0.3886 => 0.4175, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.44% (0.3927 => 0.4219, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.23% (2.2022 => 2.3615, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.66% (10.4361 => 11.0266, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.25% (0.3177 => 0.3312, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.20% (0.4879 => 0.5084, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.94% (7.0540 => 7.3317, std. dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 3.70% (0.6030 => 0.6253, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.68% (0.5925 => 0.6143, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 3.23% (0.3282 => 0.3388, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.13% (0.7433 => 0.7666, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 2.96% (0.7326 => 0.7543, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.50% (0.5569 => 0.5708, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.39% (14.3668 => 14.7103, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.36% (0.4615 => 0.4724, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.30% (0.8172 => 0.8360, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.21% (4.9449 => 5.0541, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.16% (5.0018 => 5.1100, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 2.00% (0.7835 => 0.7992, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 1.85% (9.4845 => 9.6596, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.83% (8.1363 => 8.2853, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 1.82% (2.0273 => 2.0642, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.79% (0.5860 => 0.5965, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.67% (4.2646 => 4.3358, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.51% (1.5415 => 1.5647, std. dev.: 0.0033) MultiSource/Applications/d/make_dparser: 1.45% (3.3354 => 3.3839, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 1.30% (1.5603 => 1.5806, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 1.15% (3.8723 => 3.9167, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 1.14% (17.1811 => 17.3770, std. dev.: 0.0204) MultiSource/Applications/Burg/burg: 1.13% (1.1642 => 1.1773, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.12% (1.3050 => 1.3196, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 1.08% (5.7591 => 5.8212, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.06% (2.0665 => 2.0884, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7596, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0560, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.26% (26.0924 => 26.6822, std. dev.: 0.0376) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5086 => 1.5354, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2377, std. dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.20% (2.6546 => 2.6864, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.02% (1.3045 => 1.3178, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: 1.02% (2.9346 => 2.9644, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1250, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.17% (5.2763 => 3.1570, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.73% (5.3855 => 3.6766, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.27% (5.3526 => 3.6786, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.18% (2.9384 => 2.5511, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -10.78% (22.1758 => 19.7863, std. dev.: 0.0158) SingleSource/UnitTests/Vector/constpool: -5.06% (54.1659 => 51.4263, std. dev.: 0.0414) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.60% (3.8922 => 3.7909, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.44% (0.8101 => 0.7984, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.62% (1.2373 => 1.1183, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.38% (19.9488 => 18.4766, std. dev.: 0.0982) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (8.1563 => 7.9106, std. dev.: 0.0105) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6888, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0814, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 19:16:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 21:16:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120709021602.031A02A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1892?compare_to=1889&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1892, Order: 159917, Start Time: 2012-07-08 23:32:45, End Time: 2012-07-09 02:16:05 To: 1889, Order: 159916, Start Time: 2012-07-08 20:22:11, End Time: 2012-07-08 23:05:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (38 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (855 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.57% (109.0914 => 118.4428, std. dev.: 0.0248) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 8.36% (0.3446 => 0.3734, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.20% (0.3465 => 0.3749, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.15% (0.3496 => 0.3781, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.15% (0.3460 => 0.3742, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/synchronized: 8.13% (0.3469 => 0.3751, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.11% (0.3442 => 0.3721, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.94% (0.3488 => 0.3765, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 7.85% (0.3643 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.67% (0.3650 => 0.3930, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.44% (0.3724 => 0.4001, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.71% (0.5826 => 0.6042, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.60% (0.5026 => 0.5207, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.38% (1.6211 => 1.6759, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.35% (0.4361 => 0.4507, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.34% (0.5900 => 0.6097, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.15% (3.5627 => 3.6750, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.08% (0.4029 => 0.4153, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.88% (0.4994 => 0.5138, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.84% (1.3152 => 1.3525, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.72% (0.3930 => 0.4037, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.61% (4.2109 => 4.3206, std. dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.44% (0.5000 => 0.5122, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 2.36% (0.7171 => 0.7340, std. dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.11% (2.7292 => 2.7867, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.88% (1.9694 => 2.0065, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.88% (1.9966 => 2.0342, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 1.86% (1.0781 => 1.0982, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (2.1013 => 2.1367, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 1.49% (1.8794 => 1.9074, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 1.48% (0.9909 => 1.0056, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 1.48% (5.5417 => 5.6239, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.45% (2.0673 => 2.0973, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.37% (4.6177 => 4.6811, std. dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: 1.37% (2.1653 => 2.1949, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.35% (4.4195 => 4.4792, std. dev.: 0.0150) MultiSource/Benchmarks/Bullet/bullet: 1.15% (23.5202 => 23.7916, std. dev.: 0.0157) MultiSource/Applications/lua/lua: 1.09% (1.4269 => 1.4424, std. dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 1.02% (1.5932 => 1.6095, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.71% (11.9555 => 11.6312, std. dev.: 0.0142) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 21:53:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 23:53:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120709045350.8C6AB2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1893?compare_to=1890&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1893, Order: 159922, Start Time: 2012-07-09 03:40:16, End Time: 2012-07-09 04:53:52 To: 1890, Order: 159917, Start Time: 2012-07-08 22:03:46, End Time: 2012-07-08 23:17:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (129 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (723 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.49% (2.0176 => 2.2898, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 6.87% (0.7061 => 0.7546, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.69% (0.5818 => 0.6207, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.52% (0.5748 => 0.6123, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.74% (0.1986 => 0.2100, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 5.71% (0.7038 => 0.7440, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 5.52% (1.3693 => 1.4449, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 5.43% (0.4328 => 0.4563, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.30% (0.5265 => 0.5544, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 5.29% (0.2781 => 0.2928, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.20% (0.2596 => 0.2731, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.18% (0.2782 => 0.2926, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.10% (0.4062 => 0.4269, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.05% (0.7710 => 0.8099, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 5.02% (0.2607 => 0.2738, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.98% (0.2690 => 0.2824, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.97% (0.2655 => 0.2787, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.96% (0.3650 => 0.3831, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2726 => 0.2861, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.95% (0.2628 => 0.2758, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.90% (0.3022 => 0.3170, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 4.89% (0.2761 => 0.2896, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.88% (3.9660 => 4.1597, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.85% (0.2765 => 0.2899, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.83% (0.2937 => 0.3079, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.82% (0.2760 => 0.2893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 4.81% (0.3578 => 0.3750, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.75% (0.2966 => 0.3107, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.72% (0.3646 => 0.3818, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.70% (0.3914 => 0.4098, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.70% (0.3789 => 0.3967, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.67% (0.2696 => 0.2822, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 4.67% (0.3601 => 0.3769, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 4.64% (0.3663 => 0.3833, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.59% (0.3899 => 0.4078, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.57% (0.4003 => 0.4186, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.54% (0.3107 => 0.3248, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.53% (1.9828 => 2.0726, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 4.52% (0.3940 => 0.4118, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 4.47% (0.3623 => 0.3785, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.47% (0.3580 => 0.3740, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.45% (0.3149 => 0.3289, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.44% (0.3489 => 0.3644, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.34% (0.6959 => 0.7261, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 4.32% (0.3192 => 0.3330, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.26% (0.3453 => 0.3600, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.16% (0.3485 => 0.3630, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.08% (0.2988 => 0.3110, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.07% (0.3293 => 0.3427, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.07% (13.8202 => 14.3823, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.06% (0.4016 => 0.4179, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.03% (0.5577 => 0.5802, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.97% (0.9199 => 0.9564, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists1: 3.96% (0.3534 => 0.3674, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.3756 => 0.3901, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.80% (0.4390 => 0.4557, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.3868 => 0.4015, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.80% (16.6129 => 17.2442, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.73% (1.2193 => 1.2648, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.71% (13.2842 => 13.7769, std. dev.: 0.0140) MultiSource/Benchmarks/McCat/09-vor/vor: 3.45% (0.2925 => 0.3026, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.43% (1.4563 => 1.5063, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.30% (0.5637 => 0.5823, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 3.23% (1.1061 => 1.1418, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.21% (1.3245 => 1.3670, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.19% (1.1364 => 1.1727, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.14% (0.3220 => 0.3321, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.12% (1.0594 => 1.0925, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 3.12% (3.8646 => 3.9853, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.11% (0.3246 => 0.3347, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.08% (0.4379 => 0.4514, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 3.00% (0.7506 => 0.7731, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3755 => 0.3864, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.87% (1.9270 => 1.9824, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 2.87% (1.2292 => 1.2645, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.87% (1.3813 => 1.4209, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.87% (7.2180 => 7.4249, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.79% (1.3819 => 1.4205, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.77% (0.7460 => 0.7667, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.61% (4.9865 => 5.1165, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (0.8310 => 0.8522, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (3.6692 => 3.7619, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.21% (4.3801 => 4.4769, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 2.19% (14.8535 => 15.1795, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 2.18% (6.5754 => 6.7187, std. dev.: 0.0141) MultiSource/Applications/siod/siod: 2.17% (2.1791 => 2.2263, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.07% (0.6135 => 0.6262, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (0.8698 => 0.8873, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.98% (16.2614 => 16.5839, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.90% (4.4433 => 4.5279, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.82% (1.1333 => 1.1539, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.66% (3.1889 => 3.2417, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 1.60% (14.5298 => 14.7621, std. dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 1.59% (1.2749 => 1.2952, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.44% (2.1007 => 2.1310, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.75% (1.8175 => 2.2674, std. dev.: 0.0474) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1907, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.98% (0.9996 => 1.0794, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.75% (1.2998 => 1.3875, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.04% (7.4271 => 7.7272, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6774, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.39% (1.7688 => 1.8288, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.02% (1.9199 => 1.9779, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0310 => 1.0568, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1909, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.74% (3.6469 => 3.7105, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5346, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.28% (1.9290 => 1.9536, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.64% (0.4657 => 0.3882, std. dev.: 0.0091) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.05% (22.5627 => 20.9724, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.34% (0.8818 => 0.8612, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.10% (0.9108 => 0.9008, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.62% (1.0460 => 0.8617, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.45% (0.0997 => 0.0843, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.16% (1.2308 => 1.1057, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.17% (20.3410 => 18.4754, std. dev.: 0.0880) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3162, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5502, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5883, std. dev.: 0.0170) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5089, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7462, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2573, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.5254 => 2.4886, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1416, std. dev.: 0.0359) MultiSource/Applications/spiff/spiff: -1.36% (3.0263 => 2.9852, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.28% (0.9692 => 0.9568, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2554, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2298, std. dev.: 0.0396) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 21:58:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 8 Jul 2012 23:58:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120709045844.425562A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1894?compare_to=1891&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1894, Order: 159922, Start Time: 2012-07-09 03:40:24, End Time: 2012-07-09 04:58:45 To: 1891, Order: 159917, Start Time: 2012-07-08 22:08:24, End Time: 2012-07-08 23:26:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (55 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (799 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.00% (13.2549 => 13.5203, std. dev.: 0.0125) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.40% (19.7863 => 19.3120, std. dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: -2.23% (11.0266 => 10.7806, std. dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.41% (10.3673 => 13.5203, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.56% (1.1194 => 1.2488, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.72% (0.3473 => 0.3776, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.50% (0.3543 => 0.3844, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3497 => 0.3791, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.39% (0.3516 => 0.3811, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.35% (0.3543 => 0.3839, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.28% (0.3561 => 0.3856, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.12% (0.3694 => 0.3994, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 7.84% (0.3828 => 0.4128, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.80% (0.3886 => 0.4189, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.3927 => 0.4232, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.56% (1.7609 => 1.8941, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.22% (2.2022 => 2.3611, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.69% (0.3177 => 0.3326, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.32% (0.4879 => 0.5090, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.95% (7.0540 => 7.3326, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/oourafft: 3.60% (0.3282 => 0.3400, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.53% (0.5925 => 0.6134, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.50% (0.6030 => 0.6241, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.31% (0.7433 => 0.7679, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.30% (10.4361 => 10.7806, std. dev.: 0.0068) SingleSource/UnitTests/ObjC++/property-reference: 2.77% (0.7326 => 0.7529, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.53% (0.8172 => 0.8379, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.51% (0.5569 => 0.5709, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.48% (4.9449 => 5.0673, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.47% (0.4615 => 0.4729, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.37% (0.7835 => 0.8021, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (14.3668 => 14.7023, std. dev.: 0.0118) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.20% (5.0018 => 5.1118, std. dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: 1.93% (9.4845 => 9.6675, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.82% (4.2646 => 4.3421, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5860 => 0.5966, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.80% (8.1363 => 8.2828, std. dev.: 0.0083) MultiSource/Applications/treecc/treecc: 1.68% (2.0273 => 2.0613, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.60% (0.8067 => 0.8196, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 1.53% (1.1642 => 1.1820, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 1.42% (3.3354 => 3.3827, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.29% (1.5415 => 1.5614, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 1.25% (5.7591 => 5.8310, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 1.22% (1.5603 => 1.5794, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.22% (3.8723 => 3.9195, std. dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 1.18% (17.1811 => 17.3830, std. dev.: 0.0371) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.14% (1.3050 => 1.3199, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.10% (2.6778 => 2.9750, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.77% (1.1145 => 1.1899, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7555, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.21% (26.0924 => 26.6696, std. dev.: 0.0192) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (1.5086 => 1.5372, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4474, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2460, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.29% (2.6546 => 2.6888, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.19% (2.9346 => 2.9696, std. dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.05% (5.2763 => 3.1633, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.76% (5.3855 => 3.6751, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.36% (5.3526 => 3.6738, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.30% (2.9384 => 2.5476, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -12.91% (22.1758 => 19.3120, std. dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -4.89% (54.1659 => 51.5145, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.58% (3.8922 => 3.7919, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.27% (0.8101 => 0.7998, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.16% (1.2373 => 1.1116, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.12% (19.9488 => 18.5279, std. dev.: 0.0308) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (8.1563 => 7.9089, std. dev.: 0.0121) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6881, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0853, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 8 23:23:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 01:23:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120709062334.C79372A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1895?compare_to=1892&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1895, Order: 159922, Start Time: 2012-07-09 03:40:20, End Time: 2012-07-09 06:23:37 To: 1892, Order: 159917, Start Time: 2012-07-08 23:32:45, End Time: 2012-07-09 02:16:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (38 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (854 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.16% (2.2765 => 2.3028, std. dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 8.42% (0.3446 => 0.3736, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.37% (0.3465 => 0.3755, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.32% (0.3460 => 0.3748, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 8.30% (0.3496 => 0.3786, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.25% (0.3442 => 0.3726, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.24% (0.3469 => 0.3755, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3488 => 0.3772, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.99% (0.3643 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.97% (0.3650 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.60% (0.3724 => 0.4007, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.80% (0.5026 => 0.5217, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.67% (0.4361 => 0.4521, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.47% (0.5826 => 0.6028, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.18% (0.4994 => 0.5153, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.16% (1.6211 => 1.6724, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 3.07% (0.5889 => 0.6070, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.07% (3.5627 => 3.6721, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.03% (0.5900 => 0.6079, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.93% (1.3152 => 1.3537, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: 2.90% (0.4029 => 0.4146, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.64% (4.2109 => 4.3220, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.54% (0.5000 => 0.5127, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 2.22% (0.7171 => 0.7330, std. dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.17% (2.7292 => 2.7885, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.84% (1.9694 => 2.0057, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 1.82% (1.0781 => 1.0977, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.76% (0.9909 => 1.0083, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.76% (2.0673 => 2.1036, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.64% (4.4195 => 4.4920, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (2.1013 => 2.1350, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.56% (1.9966 => 2.0278, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 1.46% (4.6177 => 4.6852, std. dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 1.37% (2.1653 => 2.1949, std. dev.: 0.0080) MultiSource/Benchmarks/MallocBench/gs/gs: 1.34% (1.8794 => 1.9046, std. dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 1.30% (23.5202 => 23.8268, std. dev.: 0.0134) MultiSource/Applications/lua/lua: 1.26% (1.4269 => 1.4449, std. dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 1.26% (5.5417 => 5.6114, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.19% (2.8036 => 2.8371, std. dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.76% (2.4764 => 2.4080, std. dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: -2.59% (11.9555 => 11.6454, std. dev.: 0.0078) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 00:05:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 02:05:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120709070537.EEF942A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1896?compare_to=1893&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1896, Order: 159923, Start Time: 2012-07-09 05:50:24, End Time: 2012-07-09 07:05:39 To: 1893, Order: 159922, Start Time: 2012-07-09 03:40:16, End Time: 2012-07-09 04:53:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (736 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.48% (2.0176 => 2.2896, std. dev.: 0.0285) SingleSource/UnitTests/ObjC++/property-reference: 6.74% (0.7061 => 0.7537, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.65% (0.3130 => 0.3338, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.63% (0.5818 => 0.6204, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.58% (0.5748 => 0.6126, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.71% (0.4062 => 0.4294, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.69% (0.1986 => 0.2099, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.58% (1.3693 => 1.4457, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 5.48% (0.4328 => 0.4565, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.47% (0.7710 => 0.8132, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 5.47% (0.7038 => 0.7423, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.25% (0.2781 => 0.2927, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.24% (0.2655 => 0.2794, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.13% (0.5265 => 0.5535, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 5.06% (0.3578 => 0.3759, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.05% (0.2596 => 0.2727, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 5.02% (0.2628 => 0.2760, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.98% (0.2690 => 0.2824, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.98% (3.9660 => 4.1635, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.2721 => 0.2856, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 4.89% (0.3601 => 0.3777, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 4.86% (0.3789 => 0.3973, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.83% (0.2937 => 0.3079, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.82% (0.2760 => 0.2893, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.81% (0.2765 => 0.2898, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.81% (0.2726 => 0.2857, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 4.77% (0.3646 => 0.3820, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.75% (0.2696 => 0.2824, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3107 => 0.3254, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.70% (0.3914 => 0.4098, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 4.70% (0.3663 => 0.3835, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.68% (0.3650 => 0.3821, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 4.64% (0.3623 => 0.3791, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.60% (0.4003 => 0.4187, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.58% (0.4390 => 0.4591, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.57% (0.3940 => 0.4120, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/methcall: 4.49% (0.2761 => 0.2885, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.48% (0.3149 => 0.3290, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.36% (0.3580 => 0.3736, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.28% (0.6959 => 0.7257, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 4.23% (0.3453 => 0.3599, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.22% (0.3485 => 0.3632, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.3192 => 0.3325, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.12% (0.2988 => 0.3111, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.11% (0.4016 => 0.4181, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.02% (0.3534 => 0.3676, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.99% (0.9199 => 0.9566, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.98% (13.8202 => 14.3697, std. dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.81% (0.3756 => 0.3899, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.79% (1.2193 => 1.2655, std. dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 3.75% (16.6129 => 17.2362, std. dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.73% (13.2842 => 13.7802, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.3868 => 0.4011, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 3.56% (0.2925 => 0.3029, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.50% (0.5577 => 0.5772, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.46% (0.5637 => 0.5832, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.35% (1.4563 => 1.5051, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.20% (1.1364 => 1.1728, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.19% (1.3245 => 1.3668, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.0594 => 1.0929, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.13% (0.7506 => 0.7741, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 3.07% (3.8646 => 3.9831, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.00% (1.3819 => 1.4234, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 2.96% (1.9270 => 1.9841, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 2.95% (1.1061 => 1.1387, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.95% (1.2292 => 1.2654, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.91% (7.2180 => 7.4284, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3755 => 0.3864, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.87% (1.3813 => 1.4209, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.63% (0.7460 => 0.7656, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.58% (4.9865 => 5.1153, std. dev.: 0.0131) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.48% (3.6692 => 3.7601, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 2.29% (14.8535 => 15.1942, std. dev.: 0.0077) MultiSource/Applications/siod/siod: 2.26% (2.1791 => 2.2284, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (6.5754 => 6.7225, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.13% (0.4791 => 0.4893, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.08% (1.1333 => 1.1569, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.04% (4.3801 => 4.4696, std. dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (0.8698 => 0.8872, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.95% (16.2614 => 16.5781, std. dev.: 0.0180) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.92% (4.4433 => 4.5284, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.86% (0.6135 => 0.6249, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.79% (2.1007 => 2.1383, std. dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: 1.74% (14.5298 => 14.7826, std. dev.: 0.0139) MultiSource/Applications/d/make_dparser: 1.63% (3.1889 => 3.2410, std. dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2937, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.93% (1.8175 => 2.2706, std. dev.: 0.0451) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.29% (2.0200 => 2.1875, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4041, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7319, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6795, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.38% (1.0310 => 1.0555, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.80% (3.6469 => 3.7124, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5089 => 1.5360, std. dev.: 0.0104) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4546, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9586, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.79% (0.4657 => 0.3968, std. dev.: 0.0089) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.09% (22.5627 => 20.9631, std. dev.: 0.4525) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.32% (0.8818 => 0.8613, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.45% (0.0997 => 0.0843, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.07% (1.2308 => 1.1068, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.55% (20.3410 => 18.6009, std. dev.: 0.0404) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3075, std. dev.: 0.0078) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5502, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4464, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5082, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7450, std. dev.: 0.0988) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2552, std. dev.: 0.0034) MultiSource/Applications/lua/lua: -1.58% (26.5159 => 26.0968, std. dev.: 0.0504) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8618, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: -1.35% (3.0263 => 2.9855, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.21% (0.9692 => 0.9575, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2296, std. dev.: 0.0126) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2581, std. dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 00:11:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 02:11:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120709071104.642762A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1897?compare_to=1894&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1897, Order: 159923, Start Time: 2012-07-09 05:50:25, End Time: 2012-07-09 07:11:07 To: 1894, Order: 159922, Start Time: 2012-07-09 03:40:24, End Time: 2012-07-09 04:58:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (39 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (816 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.47% (10.3673 => 13.5267, std. dev.: 0.1467) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.75% (1.1194 => 1.2509, std. dev.: 0.0251) SingleSource/UnitTests/ObjC/trivial-interface: 8.67% (0.3473 => 0.3774, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.46% (0.3497 => 0.3793, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.41% (0.3543 => 0.3841, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3543 => 0.3840, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3516 => 0.3810, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/synchronized: 8.31% (0.3561 => 0.3857, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.18% (0.3694 => 0.3996, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.81% (0.3828 => 0.4127, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.66% (0.3927 => 0.4228, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.64% (0.3886 => 0.4183, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.56% (1.7609 => 1.8941, std. dev.: 0.0219) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.22% (2.2022 => 2.3612, std. dev.: 0.0349) SingleSource/Benchmarks/Misc/oourafft: 3.66% (0.3282 => 0.3402, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 3.57% (0.6030 => 0.6245, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.51% (0.5925 => 0.6133, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.31% (0.7433 => 0.7679, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 3.25% (10.4361 => 10.7752, std. dev.: 0.0089) SingleSource/UnitTests/ObjC++/property-reference: 2.78% (0.7326 => 0.7530, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.22% (0.7835 => 0.8009, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 2.13% (9.4845 => 9.6861, std. dev.: 0.0044) MultiSource/Applications/treecc/treecc: 1.73% (2.0273 => 2.0624, std. dev.: 0.0074) MultiSource/Applications/d/make_dparser: 1.48% (3.3354 => 3.3849, std. dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 1.28% (17.1811 => 17.4004, std. dev.: 0.0094) MultiSource/Applications/lua/lua: 1.24% (3.8723 => 3.9202, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 1.23% (1.1642 => 1.1785, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 1.23% (5.7591 => 5.8298, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.21% (1.5603 => 1.5792, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.80% (1.1145 => 1.1903, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.26% (3.6395 => 3.7581, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.35% (1.0313 => 1.0555, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.20% (26.0924 => 26.6656, std. dev.: 0.0346) SingleSource/Benchmarks/Dhrystone/dry: 1.42% (2.4116 => 2.4459, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2389, std. dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6883, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.17% (2.9346 => 2.9689, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.95% (5.2763 => 3.1686, std. dev.: 0.0618) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.73% (5.3855 => 3.6766, std. dev.: 0.0513) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.35% (5.3526 => 3.6747, std. dev.: 0.0549) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.25% (2.9384 => 2.5491, std. dev.: 0.0673) MultiSource/Applications/ClamAV/clamscan: -12.91% (22.1758 => 19.3133, std. dev.: 0.0090) SingleSource/UnitTests/Vector/constpool: -4.85% (54.1659 => 51.5400, std. dev.: 0.0292) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.51% (3.8922 => 3.7944, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2373 => 1.1155, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.90% (19.9488 => 18.5714, std. dev.: 0.0415) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.79% (8.1563 => 7.9287, std. dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6898, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0842, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 02:36:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 04:36:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120709093651.4E7142A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1898?compare_to=1895&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1898, Order: 159923, Start Time: 2012-07-09 06:51:16, End Time: 2012-07-09 09:36:52 To: 1895, Order: 159922, Start Time: 2012-07-09 03:40:20, End Time: 2012-07-09 06:23:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (39 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (854 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 8.69% (0.3488 => 0.3791, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.37% (0.3465 => 0.3755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.36% (0.3446 => 0.3734, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.25% (0.3442 => 0.3726, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.24% (0.3469 => 0.3755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.24% (0.3460 => 0.3745, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.21% (0.3496 => 0.3783, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.99% (0.3643 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.92% (0.3650 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.57% (0.3724 => 0.4006, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.42% (0.5826 => 0.6025, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 3.12% (0.5889 => 0.6073, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.10% (1.6211 => 1.6714, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (0.5026 => 0.5180, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.03% (0.4361 => 0.4493, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.99% (3.5627 => 3.6691, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.76% (0.5900 => 0.6063, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 2.73% (0.7171 => 0.7367, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.62% (1.3152 => 1.3497, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.56% (0.4029 => 0.4132, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.51% (4.2109 => 4.3164, std. dev.: 0.0147) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.50% (0.4994 => 0.5119, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.18% (0.9909 => 1.0125, std. dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.09% (2.7292 => 2.7863, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.07% (1.0781 => 1.1004, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 1.75% (0.7875 => 0.8013, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (2.1013 => 2.1361, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.65% (2.0673 => 2.1015, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.63% (1.9694 => 2.0015, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.61% (1.9966 => 2.0288, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.54% (4.6177 => 4.6886, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 1.46% (1.8794 => 1.9069, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.45% (4.4195 => 4.4834, std. dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: 1.38% (2.1653 => 2.1951, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 1.35% (5.5417 => 5.6166, std. dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: 1.26% (23.5202 => 23.8161, std. dev.: 0.0128) MultiSource/Applications/hbd/hbd: 1.09% (0.9697 => 0.9803, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.04% (1.4269 => 1.4418, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 2.04% (2.8036 => 2.8608, std. dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.63% (11.9555 => 11.6411, std. dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 04:50:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 06:50:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120709115034.C709F2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1899?compare_to=1896&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1899, Order: 159925, Start Time: 2012-07-09 10:36:49, End Time: 2012-07-09 11:50:38 To: 1896, Order: 159923, Start Time: 2012-07-09 05:50:24, End Time: 2012-07-09 07:05:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (129 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (728 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.36% (2.0176 => 2.2872, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.43% (0.5818 => 0.6250, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5748 => 0.6167, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.93% (0.7061 => 0.7550, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.1986 => 0.2113, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: 5.98% (0.3578 => 0.3792, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.94% (0.4328 => 0.4585, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.80% (1.3693 => 1.4487, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 5.79% (0.2781 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.75% (0.2782 => 0.2942, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.64% (0.3650 => 0.3856, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 5.63% (0.7038 => 0.7434, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 5.62% (0.3914 => 0.4134, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2607 => 0.2753, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.59% (0.7710 => 0.8141, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-2: 5.58% (0.3601 => 0.3802, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 5.57% (0.3789 => 0.4000, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 5.55% (0.4003 => 0.4225, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 5.54% (0.3646 => 0.3848, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3022 => 0.3189, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.52% (0.3623 => 0.3823, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 5.51% (0.3663 => 0.3865, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2690 => 0.2838, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.50% (0.2655 => 0.2801, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.49% (0.4062 => 0.4285, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.43% (0.5265 => 0.5551, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.40% (0.2628 => 0.2770, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.39% (0.2596 => 0.2736, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/property: 5.38% (0.3940 => 0.4152, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.32% (0.2765 => 0.2912, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2966 => 0.3123, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.28% (0.2937 => 0.3092, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.22% (0.2761 => 0.2905, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.3107 => 0.3268, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.12% (3.9660 => 4.1691, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.09% (1.9828 => 2.0837, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.07% (0.2721 => 0.2859, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.99% (0.3489 => 0.3663, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.89% (0.3580 => 0.3755, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.73% (0.3192 => 0.3343, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.71% (0.3485 => 0.3649, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.66% (0.3453 => 0.3614, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.60% (0.6959 => 0.7279, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 4.59% (0.2988 => 0.3125, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3293 => 0.3443, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.53% (0.4016 => 0.4198, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3534 => 0.3691, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.24% (0.4390 => 0.4576, std. dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 4.17% (13.8202 => 14.3966, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.16% (0.9199 => 0.9582, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.05% (13.2842 => 13.8227, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.05% (0.5577 => 0.5803, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.04% (1.2193 => 1.2685, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 4.01% (16.6129 => 17.2786, std. dev.: 0.0195) MultiSource/Benchmarks/McCat/09-vor/vor: 3.97% (0.2925 => 0.3041, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.84% (0.2945 => 0.3058, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.65% (0.5637 => 0.5843, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 3.49% (0.7506 => 0.7768, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.48% (1.3245 => 1.3706, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.47% (1.2292 => 1.2718, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.45% (1.4563 => 1.5065, std. dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.2914 => 0.3014, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.40% (0.4379 => 0.4528, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.37% (1.1364 => 1.1747, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.36% (0.3246 => 0.3355, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.0594 => 1.0942, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 3.23% (3.8646 => 3.9895, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.23% (7.2180 => 7.4509, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.22% (0.3755 => 0.3876, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.20% (1.9270 => 1.9886, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.16% (1.1061 => 1.1411, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.08% (1.3813 => 1.4238, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.05% (1.3819 => 1.4241, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.89% (4.9865 => 5.1308, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.87% (0.7460 => 0.7674, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.73% (0.8310 => 0.8537, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.64% (3.6692 => 3.7659, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 2.51% (2.1791 => 2.2337, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.36% (0.4791 => 0.4904, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.35% (14.8535 => 15.2023, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.34% (4.3801 => 4.4828, std. dev.: 0.0110) MultiSource/Applications/JM/ldecod/ldecod: 2.31% (6.5754 => 6.7272, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.25% (0.8698 => 0.8894, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.18% (0.6135 => 0.6269, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.13% (4.4433 => 4.5380, std. dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 1.98% (16.2614 => 16.5839, std. dev.: 0.0159) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.93% (1.1333 => 1.1552, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 1.88% (3.1889 => 3.2489, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (2.1007 => 2.1380, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 1.77% (14.5298 => 14.7875, std. dev.: 0.0219) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.70% (0.6283 => 0.6390, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 1.61% (1.2749 => 1.2954, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 26.13% (1.8175 => 2.2925, std. dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.19% (2.0200 => 2.1854, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: 7.92% (1.2998 => 1.4028, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6988, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7267, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9215, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1917, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9586, std. dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5120, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.44% (3.6469 => 3.6995, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.86% (22.5627 => 21.0142, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.55% (0.8818 => 0.8593, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.16% (1.2308 => 1.1058, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.53% (20.3410 => 18.6055, std. dev.: 0.0470) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3162, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9830, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9060, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5979, std. dev.: 0.0108) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5049, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7468, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2521, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.48% (0.9692 => 0.9549, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1309, std. dev.: 0.0266) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0170) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -1.41% (3.0263 => 2.9835, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.31% (9.3358 => 9.2133, std. dev.: 0.0231) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2547, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 04:55:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 06:55:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120709115540.5565E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1900?compare_to=1897&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1900, Order: 159925, Start Time: 2012-07-09 10:37:05, End Time: 2012-07-09 11:55:43 To: 1897, Order: 159923, Start Time: 2012-07-09 05:50:25, End Time: 2012-07-09 07:11:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (54 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (801 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 2.52% (19.3133 => 19.8003, std. dev.: 0.0485) MultiSource/Applications/JM/ldecod/ldecod: 2.51% (10.7752 => 11.0454, std. dev.: 0.0190) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.38% (13.5267 => 13.0699, std. dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.07% (10.3673 => 13.0699, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.53% (1.1194 => 1.2485, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.81% (0.3473 => 0.3779, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.64% (0.3543 => 0.3849, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 8.64% (0.3497 => 0.3799, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.59% (0.3516 => 0.3818, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.55% (0.3543 => 0.3846, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.45% (0.3561 => 0.3862, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3694 => 0.4001, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.10% (0.3828 => 0.4138, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.97% (0.3927 => 0.4240, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/property: 7.82% (0.3886 => 0.4190, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.64% (1.7609 => 1.8955, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.92% (2.2022 => 2.3547, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 5.84% (10.4361 => 11.0454, std. dev.: 0.0190) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.99% (0.2065 => 0.2168, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.66% (0.3177 => 0.3325, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.4879 => 0.5087, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 3.90% (0.5925 => 0.6156, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.88% (7.0540 => 7.3275, std. dev.: 0.0148) SingleSource/UnitTests/ObjC++/property-reference-object: 3.86% (0.6030 => 0.6263, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.54% (0.8172 => 0.8461, std. dev.: 0.0072) MultiSource/Applications/lambda-0_1_3/lambda: 3.30% (0.7433 => 0.7678, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 3.06% (0.7326 => 0.7550, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 3.05% (0.3282 => 0.3382, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.91% (0.5569 => 0.5731, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.69% (0.4615 => 0.4739, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.63% (14.3668 => 14.7453, std. dev.: 0.0099) MultiSource/Applications/spiff/spiff: 2.35% (0.7835 => 0.8019, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.32% (4.9449 => 5.0597, std. dev.: 0.0124) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.32% (5.0018 => 5.1178, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.20% (8.1363 => 8.3157, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 2.03% (9.4845 => 9.6771, std. dev.: 0.0099) MultiSource/Applications/lua/lua: 1.92% (3.8723 => 3.9468, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.87% (4.2646 => 4.3444, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.68% (1.1861 => 1.2060, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 1.64% (3.3354 => 3.3901, std. dev.: 0.0127) MultiSource/Applications/treecc/treecc: 1.59% (2.0273 => 2.0595, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.51% (1.3050 => 1.3247, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.33% (1.5415 => 1.5620, std. dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 1.29% (17.1811 => 17.4034, std. dev.: 0.0194) MultiSource/Applications/oggenc/oggenc: 1.20% (5.7591 => 5.8282, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.16% (1.4186 => 1.4351, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7510, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.31% (26.0924 => 26.6959, std. dev.: 0.0186) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (1.5086 => 1.5374, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.36% (2.6546 => 2.6907, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2391, std. dev.: 0.0074) MultiSource/Applications/spiff/spiff: 1.17% (2.9346 => 2.9689, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -80.38% (0.8651 => 0.1697, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.96% (5.2763 => 3.1677, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.76% (5.3855 => 3.6750, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.35% (5.3526 => 3.6748, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.08% (2.9384 => 2.5542, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -10.71% (22.1758 => 19.8003, std. dev.: 0.0485) SingleSource/UnitTests/Vector/constpool: -4.91% (54.1659 => 51.5064, std. dev.: 0.0493) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.67% (3.8922 => 3.7881, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.35% (1.2373 => 1.1093, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.81% (19.9488 => 18.5903, std. dev.: 0.0410) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9132, std. dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6864, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0835, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 06:20:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 08:20:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120709132007.B5BDF2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1901?compare_to=1898&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1901, Order: 159925, Start Time: 2012-07-09 10:36:39, End Time: 2012-07-09 13:20:10 To: 1898, Order: 159923, Start Time: 2012-07-09 06:51:16, End Time: 2012-07-09 09:36:52 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (43 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 948 (849 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.38% (0.7367 => 0.7469, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.08% (4.4834 => 4.5319, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.05% (2.1015 => 2.1235, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.11% (0.2172 => 0.2283, std. dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 9.74% (0.3460 => 0.3797, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.69% (0.3446 => 0.3780, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.67% (0.3465 => 0.3800, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.61% (0.3496 => 0.3832, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.59% (0.3442 => 0.3772, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.52% (0.3488 => 0.3820, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/synchronized: 9.46% (0.3469 => 0.3797, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.29% (0.3650 => 0.3989, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.28% (0.3643 => 0.3981, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.81% (0.3724 => 0.4052, std. dev.: 0.0058) SingleSource/UnitTests/ObjC++/Hello: 4.74% (0.5826 => 0.6102, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.31% (0.5889 => 0.6143, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.16% (0.7171 => 0.7469, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.99% (0.4361 => 0.4535, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.93% (3.5627 => 3.7026, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.81% (1.6211 => 1.6828, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.58% (0.5900 => 0.6111, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 3.31% (4.2109 => 4.3503, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.30% (0.5026 => 0.5192, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.28% (0.4994 => 0.5158, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.23% (0.4029 => 0.4159, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (1.3152 => 1.3570, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.08% (0.5000 => 0.5154, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.00% (0.3930 => 0.4048, std. dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.84% (2.7292 => 2.8067, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 2.83% (0.9909 => 1.0189, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.72% (2.0673 => 2.1235, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.66% (1.0781 => 1.1068, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.54% (4.4195 => 4.5319, std. dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: 2.33% (2.1013 => 2.1503, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.28% (1.9694 => 2.0144, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.22% (1.9966 => 2.0409, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 2.02% (1.8794 => 1.9173, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 1.98% (2.1653 => 2.2082, std. dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 1.92% (4.6177 => 4.7064, std. dev.: 0.0114) MultiSource/Applications/SPASS/SPASS: 1.90% (5.5417 => 5.6468, std. dev.: 0.0058) MultiSource/Applications/hbd/hbd: 1.81% (0.9697 => 0.9873, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 1.81% (23.5202 => 23.9450, std. dev.: 0.0483) MultiSource/Applications/treecc/treecc: 1.77% (0.7875 => 0.8014, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.62% (1.4269 => 1.4500, std. dev.: 0.0059) MultiSource/Applications/siod/siod: 1.54% (0.6634 => 0.6736, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 1.29% (1.5932 => 1.6137, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.59% (0.2122 => 0.2283, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.19% (2.4764 => 2.4221, std. dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: -2.12% (11.9555 => 11.7026, std. dev.: 0.0211) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 06:43:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 08:43:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120709134356.DECC52A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1902?compare_to=1899&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1902, Order: 159926, Start Time: 2012-07-09 12:30:10, End Time: 2012-07-09 13:44:00 To: 1899, Order: 159925, Start Time: 2012-07-09 10:36:49, End Time: 2012-07-09 11:50:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (129 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (723 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.63% (1.4028 => 1.4257, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.37% (2.0176 => 2.2873, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.55% (0.5818 => 0.6257, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.43% (0.5748 => 0.6175, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.11% (0.7061 => 0.7563, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.55% (0.1986 => 0.2116, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.11% (0.2782 => 0.2952, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.10% (0.4328 => 0.4592, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.93% (0.2781 => 0.2946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.93% (0.3578 => 0.3790, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.90% (1.3693 => 1.4501, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.79% (0.2607 => 0.2758, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 5.74% (0.7038 => 0.7442, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.69% (0.2760 => 0.2917, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.66% (0.4062 => 0.4292, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.65% (0.3646 => 0.3852, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 5.65% (0.2726 => 0.2880, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 5.65% (0.3789 => 0.4003, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 5.64% (0.3601 => 0.3804, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.60% (0.3623 => 0.3826, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2966 => 0.3132, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.60% (0.3663 => 0.3868, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.59% (0.3022 => 0.3191, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.56% (0.3650 => 0.3853, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.54% (0.3914 => 0.4131, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.50% (0.7710 => 0.8134, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2765 => 0.2917, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.49% (0.5265 => 0.5554, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.47% (0.4003 => 0.4222, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.43% (0.2761 => 0.2911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.41% (0.3940 => 0.4153, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.38% (0.2696 => 0.2841, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.32% (0.2596 => 0.2734, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.30% (0.3149 => 0.3316, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.22% (1.9828 => 2.0863, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.11% (0.3580 => 0.3763, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.11% (3.9660 => 4.1687, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.07% (0.3489 => 0.3666, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.05% (0.3899 => 0.4096, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.86% (0.4016 => 0.4211, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.85% (0.3485 => 0.3654, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.73% (0.3192 => 0.3343, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3293 => 0.3447, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.65% (0.2988 => 0.3127, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.53% (0.3534 => 0.3694, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.40% (0.6959 => 0.7265, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.39% (0.3756 => 0.3921, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.34% (0.3868 => 0.4036, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.33% (0.4390 => 0.4580, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.19% (13.8202 => 14.3996, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.08% (0.9199 => 0.9574, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.06% (13.2842 => 13.8235, std. dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.04% (1.2193 => 1.2686, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 3.94% (16.6129 => 17.2679, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/objinst: 3.94% (0.2945 => 0.3061, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.90% (0.2925 => 0.3039, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.77% (0.5577 => 0.5787, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.53% (0.5637 => 0.5836, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.48% (0.7506 => 0.7767, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 3.45% (1.2292 => 1.2716, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.38% (1.4563 => 1.5055, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.37% (1.3245 => 1.3692, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.34% (1.1364 => 1.1744, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.33% (0.4379 => 0.4525, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.30% (0.3755 => 0.3879, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.28% (7.2180 => 7.4547, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: 3.23% (3.8646 => 3.9895, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 3.21% (1.0594 => 1.0934, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.11% (1.9270 => 1.9870, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.11% (1.1061 => 1.1405, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.11% (1.3813 => 1.4242, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.97% (1.3819 => 1.4229, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.90% (4.9865 => 5.1310, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.86% (0.7460 => 0.7673, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.64% (3.6692 => 3.7662, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.35% (2.1791 => 2.2303, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.35% (0.8698 => 0.8902, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (6.5754 => 6.7295, std. dev.: 0.0200) MultiSource/Applications/JM/lencod/lencod: 2.31% (14.8535 => 15.1969, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.30% (0.4791 => 0.4901, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.25% (4.3801 => 4.4786, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.15% (4.4433 => 4.5388, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.07% (0.6135 => 0.6262, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.97% (16.2614 => 16.5819, std. dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.97% (1.1333 => 1.1556, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.77% (3.1889 => 3.2453, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.72% (14.5298 => 14.7795, std. dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 1.59% (1.2749 => 1.2952, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.48% (2.1007 => 2.1318, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2669, std. dev.: 0.0449) SingleSource/Benchmarks/Misc/mandel-2: 9.69% (1.2998 => 1.4257, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.67% (2.0200 => 2.1952, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.17% (0.9996 => 1.0813, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7263, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9215, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6793, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4785, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.53% (1.5089 => 1.5320, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.48% (3.6469 => 3.7008, std. dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (1.9290 => 1.9562, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.86% (0.4657 => 0.3872, std. dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.88% (22.5627 => 21.0114, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.49% (0.8818 => 0.8598, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.40% (1.2308 => 1.1028, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.68% (20.3410 => 18.5754, std. dev.: 0.0292) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3130, std. dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5887, std. dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.59% (0.4867 => 0.4741, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7457, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.52% (6.3560 => 6.2592, std. dev.: 0.0008) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1254, std. dev.: 0.0285) MultiSource/Applications/spiff/spiff: -1.47% (3.0263 => 2.9818, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4904, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2417, std. dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std. dev.: 0.0037) MultiSource/Applications/minisat/minisat: -1.12% (9.3358 => 9.2316, std. dev.: 0.0069) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 06:48:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 08:48:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120709134821.684E42A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1903?compare_to=1900&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1903, Order: 159926, Start Time: 2012-07-09 12:30:21, End Time: 2012-07-09 13:48:25 To: 1900, Order: 159925, Start Time: 2012-07-09 10:37:05, End Time: 2012-07-09 11:55:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (799 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.13% (10.3673 => 13.0758, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.51% (1.1194 => 1.2482, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 8.93% (0.3473 => 0.3783, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.78% (0.3497 => 0.3804, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.70% (0.3516 => 0.3822, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.64% (0.3543 => 0.3849, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/synchronized: 8.59% (0.3561 => 0.3867, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.58% (0.3543 => 0.3847, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.36% (0.3694 => 0.4003, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.99% (0.3828 => 0.4134, std. dev.: 0.0091) SingleSource/UnitTests/ObjC/property: 7.95% (0.3886 => 0.4195, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.3927 => 0.4236, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.56% (1.7609 => 1.8941, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.89% (2.2022 => 2.3540, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.82% (10.4361 => 11.0431, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.99% (0.2065 => 0.2168, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.3177 => 0.3333, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.35% (0.4879 => 0.5091, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.03% (0.5925 => 0.6164, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference-object: 3.93% (0.6030 => 0.6267, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.86% (7.0540 => 7.3262, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 3.27% (0.7433 => 0.7676, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 3.19% (0.7326 => 0.7560, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.74% (0.8172 => 0.8396, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.64% (0.5569 => 0.5716, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.51% (0.4615 => 0.4731, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.49% (14.3668 => 14.7251, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.32% (4.9449 => 5.0596, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.30% (5.0018 => 5.1168, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.20% (0.7835 => 0.8007, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.03% (8.1363 => 8.3014, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 2.00% (9.4845 => 9.6740, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.89% (4.2646 => 4.3453, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.64% (1.1861 => 1.2056, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.61% (2.0273 => 2.0600, std. dev.: 0.0037) MultiSource/Applications/hbd/hbd: 1.55% (1.5603 => 1.5845, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 1.55% (3.3354 => 3.3870, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.43% (1.3050 => 1.3236, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.34% (1.1642 => 1.1798, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 1.23% (3.8723 => 3.9199, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.22% (17.1811 => 17.3915, std. dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7591 => 5.8267, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.16% (0.9765 => 0.9878, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.08% (2.0665 => 2.0888, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.03% (1.4186 => 1.4332, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.10% (2.6778 => 2.9751, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (3.6395 => 3.7477, std. dev.: 0.0051) MultiSource/Applications/lua/lua: 2.30% (26.0924 => 26.6915, std. dev.: 0.0273) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.10% (1.0313 => 1.0530, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (1.5086 => 1.5356, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4474, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2376, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6894, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 1.04% (2.9346 => 2.9650, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.01% (5.2763 => 3.1652, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.79% (5.3855 => 3.6734, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.34% (5.3526 => 3.6752, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.19% (2.9384 => 2.5507, std. dev.: 0.0110) MultiSource/Applications/ClamAV/clamscan: -10.76% (22.1758 => 19.7905, std. dev.: 0.0109) SingleSource/UnitTests/Vector/constpool: -4.96% (54.1659 => 51.4809, std. dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.66% (3.8922 => 3.7887, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.73% (1.2373 => 1.1169, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.59% (19.9488 => 18.6350, std. dev.: 0.0225) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9136, std. dev.: 0.0101) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6819, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0851, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 08:59:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 10:59:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120709155949.D7BB42A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1904?compare_to=1902&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1904, Order: 159931, Start Time: 2012-07-09 14:46:09, End Time: 2012-07-09 15:59:52 To: 1902, Order: 159926, Start Time: 2012-07-09 12:30:10, End Time: 2012-07-09 13:44:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.78% (55.0671 => 56.5998, std. dev.: 0.0433) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.30% (2.0176 => 2.2860, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.51% (0.5818 => 0.6255, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.32% (0.5748 => 0.6169, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.91% (0.7061 => 0.7549, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.61% (0.3130 => 0.3337, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.24% (0.1986 => 0.2110, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.04% (0.3578 => 0.3794, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.01% (0.4328 => 0.4588, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 5.93% (0.2781 => 0.2946, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.90% (1.3693 => 1.4501, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.68% (0.2782 => 0.2940, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 5.67% (0.3914 => 0.4136, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.67% (0.3650 => 0.3857, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 5.67% (0.3601 => 0.3805, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.63% (0.7038 => 0.7434, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.61% (0.2726 => 0.2879, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.60% (0.3623 => 0.3826, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2607 => 0.2753, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.57% (0.3646 => 0.3849, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.54% (0.3789 => 0.3999, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.52% (0.4003 => 0.4224, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.52% (0.2628 => 0.2773, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.46% (0.3663 => 0.3863, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.46% (0.3022 => 0.3187, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.43% (0.5265 => 0.5551, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 5.41% (0.2937 => 0.3096, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.40% (0.7710 => 0.8126, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 5.36% (0.3940 => 0.4151, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.32% (0.2761 => 0.2908, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.3107 => 0.3271, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.28% (0.2596 => 0.2733, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.17% (1.9828 => 2.0854, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.12% (3.9660 => 4.1690, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.03% (0.3580 => 0.3760, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.2721 => 0.2857, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.98% (0.3899 => 0.4093, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.96% (0.3489 => 0.3662, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2988 => 0.3130, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.75% (0.3453 => 0.3617, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.73% (0.3485 => 0.3650, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.70% (0.3192 => 0.3342, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3293 => 0.3447, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.61% (0.4016 => 0.4201, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.51% (0.4390 => 0.4588, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3534 => 0.3691, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.41% (0.6959 => 0.7266, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.37% (0.3756 => 0.3920, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.21% (13.8202 => 14.4014, std. dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.11% (0.9199 => 0.9577, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/moments: 4.08% (0.3868 => 0.4026, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.07% (16.6129 => 17.2890, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.07% (1.2193 => 1.2689, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.06% (13.2842 => 13.8232, std. dev.: 0.0169) MultiSource/Benchmarks/McCat/09-vor/vor: 3.83% (0.2925 => 0.3037, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.77% (0.5577 => 0.5787, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.46% (0.5637 => 0.5832, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.42% (0.3246 => 0.3357, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.40% (1.2292 => 1.2710, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.40% (1.3245 => 1.3695, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.40% (0.7506 => 0.7761, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (1.4563 => 1.5057, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.29% (1.0594 => 1.0943, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.29% (0.4379 => 0.4523, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.28% (7.2180 => 7.4550, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.25% (1.1364 => 1.1733, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 3.23% (3.8646 => 3.9896, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 3.20% (1.1061 => 1.1415, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.19% (1.9270 => 1.9884, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.08% (1.3813 => 1.4239, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.08% (1.3819 => 1.4245, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.89% (4.9865 => 5.1305, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.83% (0.7460 => 0.7671, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.70% (0.8310 => 0.8534, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (3.6692 => 3.7648, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.46% (2.1791 => 2.2328, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.36% (6.5754 => 6.7308, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.35% (4.3801 => 4.4832, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.32% (0.8698 => 0.8900, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 2.29% (14.8535 => 15.1936, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.16% (4.4433 => 4.5392, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 2.02% (16.2614 => 16.5906, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.02% (1.1333 => 1.1562, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.83% (3.1889 => 3.2472, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.77% (2.1007 => 2.1379, std. dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: 1.72% (14.5298 => 14.7798, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.64% (0.6283 => 0.6386, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.58% (1.2749 => 1.2950, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.78% (1.8175 => 2.2678, std. dev.: 0.0281) SingleSource/Benchmarks/Misc/mandel-2: 8.73% (1.2998 => 1.4133, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1911, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.48% (1.0895 => 1.1710, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7170, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6778, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8294, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0560, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1892, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.86% (3.6469 => 3.7146, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (1.5089 => 1.5353, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.83% (22.5627 => 21.0212, std. dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.52% (0.8818 => 0.8596, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.12% (1.2308 => 1.1063, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.08% (20.3410 => 18.4945, std. dev.: 0.0997) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.25% (1.3780 => 1.3057, std. dev.: 0.0070) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.8259 => 8.5683, std. dev.: 0.0225) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.55% (0.4867 => 0.4743, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -2.51% (2.5089 => 2.4459, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5099, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.68% (28.2225 => 27.7470, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2559, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.56% (0.6589 => 0.6486, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1253, std. dev.: 0.0248) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: -1.46% (3.0263 => 2.9821, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4903, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2253, std. dev.: 0.0288) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2540, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8491, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 09:04:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 11:04:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120709160419.89E4F2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1905?compare_to=1903&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1905, Order: 159931, Start Time: 2012-07-09 14:46:18, End Time: 2012-07-09 16:04:23 To: 1903, Order: 159926, Start Time: 2012-07-09 12:30:21, End Time: 2012-07-09 13:48:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (55 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (800 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.29% (78.0784 => 79.8666, std. dev.: 0.4404) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.12% (10.3673 => 13.0752, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.49% (1.1194 => 1.2480, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.90% (0.3473 => 0.3782, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.72% (0.3543 => 0.3852, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.66% (0.3497 => 0.3800, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.61% (0.3543 => 0.3848, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.57% (0.3561 => 0.3866, std. dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions-3: 8.56% (0.3516 => 0.3817, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3694 => 0.4001, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.02% (0.3828 => 0.4135, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.95% (0.3886 => 0.4195, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/parameter-passing: 7.92% (0.3927 => 0.4238, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.62% (1.7609 => 1.8951, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.87% (2.2022 => 2.3536, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.80% (10.4361 => 11.0417, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.94% (0.2065 => 0.2167, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.3177 => 0.3327, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.28% (0.4879 => 0.5088, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 3.85% (0.6030 => 0.6262, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (7.0540 => 7.3248, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 3.80% (0.5925 => 0.6150, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.18% (0.7433 => 0.7669, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 3.14% (0.3282 => 0.3385, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 3.07% (0.7326 => 0.7551, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.97% (0.8172 => 0.8415, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.62% (0.5569 => 0.5715, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.47% (14.3668 => 14.7212, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.45% (0.4615 => 0.4728, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.33% (5.0018 => 5.1184, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (4.9449 => 5.0601, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 2.26% (0.7835 => 0.8012, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (9.4845 => 9.6764, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.02% (8.1363 => 8.3009, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.91% (4.2646 => 4.3459, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.65% (1.1861 => 1.2057, std. dev.: 0.0053) MultiSource/Applications/treecc/treecc: 1.59% (2.0273 => 2.0596, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 1.53% (3.3354 => 3.3864, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.43% (1.5603 => 1.5826, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.43% (1.3050 => 1.3236, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 1.35% (1.1642 => 1.1799, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.30% (3.8723 => 3.9225, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 1.21% (17.1811 => 17.3888, std. dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7591 => 5.8264, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.04% (1.4186 => 1.4334, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9749, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7523, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 2.17% (26.0924 => 26.6587, std. dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.09% (1.0313 => 1.0529, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.5086 => 1.5375, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6901, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2316, std. dev.: 0.0105) MultiSource/Applications/spiff/spiff: 1.21% (2.9346 => 2.9701, std. dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.97% (5.2763 => 3.1671, std. dev.: 0.0130) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.75% (5.3855 => 3.6758, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.25% (5.3526 => 3.6799, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.17% (2.9384 => 2.5514, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.75% (22.1758 => 19.7920, std. dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -4.94% (54.1659 => 51.4915, std. dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.59% (3.8922 => 3.7912, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -9.91% (1.2373 => 1.1147, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.36% (19.9488 => 18.4811, std. dev.: 0.0947) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.78% (8.1563 => 7.9296, std. dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6865, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0856, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.06% (1.3677 => 1.3532, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 09:31:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 11:31:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120709163114.AD3E72A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1906?compare_to=1901&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1906, Order: 159926, Start Time: 2012-07-09 13:47:45, End Time: 2012-07-09 16:31:18 To: 1901, Order: 159925, Start Time: 2012-07-09 10:36:39, End Time: 2012-07-09 13:20:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (43 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (849 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 14.96% (0.4004 => 0.4603, std. dev.: 0.0170) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.48% (125.5745 => 129.9415, std. dev.: 0.8494) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 21.39% (0.3792 => 0.4603, std. dev.: 0.0170) SingleSource/UnitTests/ObjC/exceptions-4: 9.67% (0.3465 => 0.3800, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.66% (0.3446 => 0.3779, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.65% (0.3460 => 0.3794, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.56% (0.3442 => 0.3771, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.52% (0.3488 => 0.3820, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 9.51% (0.3469 => 0.3799, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.50% (0.3496 => 0.3828, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.31% (0.3643 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.21% (0.3650 => 0.3986, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.92% (0.3724 => 0.4056, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.67% (0.5826 => 0.6098, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.42% (0.5889 => 0.6149, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.10% (0.4361 => 0.4540, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.92% (3.5627 => 3.7024, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.91% (1.6211 => 1.6845, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.85% (0.5900 => 0.6127, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.34% (0.4994 => 0.5161, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.34% (1.3152 => 1.3591, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 3.32% (0.7171 => 0.7409, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.27% (4.2109 => 4.3486, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (0.5026 => 0.5190, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 3.23% (0.4029 => 0.4159, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.18% (0.5000 => 0.5159, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.14% (0.9909 => 1.0220, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.08% (0.3930 => 0.4051, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.82% (2.0673 => 2.1257, std. dev.: 0.0114) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.81% (2.7292 => 2.8060, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.75% (0.4658 => 0.4786, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.60% (2.1013 => 2.1559, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.51% (4.4195 => 4.5303, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 2.50% (1.0781 => 1.1051, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.44% (1.9694 => 2.0174, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 2.31% (1.8794 => 1.9228, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.18% (1.9966 => 2.0401, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 2.06% (5.5417 => 5.6556, std. dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 1.92% (4.6177 => 4.7064, std. dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (2.1653 => 2.2060, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 1.83% (0.7875 => 0.8019, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.81% (23.5202 => 23.9464, std. dev.: 0.0211) MultiSource/Applications/hbd/hbd: 1.74% (0.9697 => 0.9866, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.52% (0.6634 => 0.6735, std. dev.: 0.0038) MultiSource/Applications/lua/lua: 1.49% (1.4269 => 1.4481, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.00% (2.4764 => 2.4022, std. dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: -2.10% (11.9555 => 11.7044, std. dev.: 0.0149) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 11:01:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 13:01:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120709180156.0A9082A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1907?compare_to=1904&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1907, Order: 159936, Start Time: 2012-07-09 16:48:19, End Time: 2012-07-09 18:01:59 To: 1904, Order: 159931, Start Time: 2012-07-09 14:46:09, End Time: 2012-07-09 15:59:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (130 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.93% (2.0176 => 2.2987, std. dev.: 0.0129) SingleSource/UnitTests/ObjC++/property-reference-object: 6.98% (0.5818 => 0.6224, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.70% (0.5748 => 0.6133, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.46% (0.7061 => 0.7517, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.04% (0.1986 => 0.2106, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.69% (1.3693 => 1.4472, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.68% (0.7038 => 0.7438, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.55% (0.4328 => 0.4568, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.51% (0.7710 => 0.8135, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.43% (0.5265 => 0.5551, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.35% (0.2596 => 0.2735, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.18% (3.9660 => 4.1714, std. dev.: 0.0153) SingleSource/UnitTests/ObjC/trivial-interface: 5.17% (0.3578 => 0.3763, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.14% (0.2781 => 0.2924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.09% (0.3789 => 0.3982, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-4: 5.07% (0.3646 => 0.3831, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.07% (0.2760 => 0.2900, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.07% (0.2782 => 0.2923, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 5.03% (0.3601 => 0.3782, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.02% (0.3663 => 0.3847, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.97% (0.4062 => 0.4264, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.96% (0.3914 => 0.4108, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 4.95% (0.2607 => 0.2736, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.93% (0.3022 => 0.3171, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.90% (0.3650 => 0.3829, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.86% (0.2655 => 0.2784, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2726 => 0.2858, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.83% (0.2690 => 0.2820, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 4.82% (0.4003 => 0.4196, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 4.80% (0.3623 => 0.3797, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.77% (0.3940 => 0.4128, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.76% (0.2628 => 0.2753, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.74% (0.2765 => 0.2896, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.70% (0.2937 => 0.3075, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.67% (0.3489 => 0.3652, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.65% (0.2966 => 0.3104, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.60% (0.3107 => 0.3250, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.60% (0.2761 => 0.2888, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.60% (0.2696 => 0.2820, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.57% (0.3899 => 0.4077, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.53% (1.9828 => 2.0727, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.50% (0.6959 => 0.7272, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: 4.48% (0.3149 => 0.3290, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.44% (0.3580 => 0.3739, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.33% (0.3485 => 0.3636, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.33% (0.4016 => 0.4190, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.32% (13.8202 => 14.4174, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sieve: 4.32% (0.3453 => 0.3602, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.24% (0.9199 => 0.9589, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.16% (13.2842 => 13.8368, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: 4.10% (0.3293 => 0.3428, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.08% (0.2988 => 0.3110, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.04% (0.3192 => 0.3321, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.99% (1.2193 => 1.2679, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 3.96% (0.3534 => 0.3674, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 3.95% (16.6129 => 17.2694, std. dev.: 0.0147) MultiSource/Benchmarks/McCat/09-vor/vor: 3.93% (0.2925 => 0.3040, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.89% (0.3756 => 0.3902, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.83% (0.4390 => 0.4558, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.3868 => 0.4016, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.77% (0.5577 => 0.5787, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.73% (0.5637 => 0.5847, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.54% (0.4379 => 0.4534, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.51% (1.4563 => 1.5074, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: 3.50% (0.7506 => 0.7769, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.50% (1.3245 => 1.3708, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.44% (1.0594 => 1.0958, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 3.40% (0.2945 => 0.3045, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.33% (1.1364 => 1.1742, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.21% (3.8646 => 3.9888, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.21% (7.2180 => 7.4499, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.19% (1.9270 => 1.9885, std. dev.: 0.0115) MultiSource/Applications/Burg/burg: 3.15% (1.1061 => 1.1409, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.06% (1.3813 => 1.4235, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.92% (1.2292 => 1.2651, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.90% (0.8310 => 0.8551, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.90% (4.9865 => 5.1310, std. dev.: 0.0158) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.88% (0.7460 => 0.7675, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.88% (1.3819 => 1.4217, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3755 => 0.3861, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.74% (3.6692 => 3.7699, std. dev.: 0.0096) MultiSource/Benchmarks/McCat/05-eks/eks: 2.72% (0.4113 => 0.4225, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.49% (2.1791 => 2.2334, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.46% (0.4791 => 0.4909, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.42% (6.5754 => 6.7343, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 2.40% (14.8535 => 15.2101, std. dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.28% (4.3801 => 4.4801, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.11% (4.4433 => 4.5372, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6135 => 0.6263, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.8698 => 0.8878, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.05% (16.2614 => 16.5944, std. dev.: 0.0247) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.97% (1.1333 => 1.1556, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 1.90% (3.1889 => 3.2494, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.76% (14.5298 => 14.7857, std. dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.74% (2.1007 => 2.1373, std. dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 1.67% (1.2749 => 1.2962, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.66% (0.6283 => 0.6387, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.83% (0.4846 => 0.6970, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 25.03% (1.8175 => 2.2724, std. dev.: 0.0501) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1902, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.97% (0.9996 => 1.0793, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.48% (1.0895 => 1.1710, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.11% (1.2998 => 1.3922, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.05% (7.4271 => 7.7277, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6787, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8314, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1891, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.67% (3.6469 => 3.7078, std. dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5089 => 1.5332, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.86% (22.5627 => 21.0144, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.47% (0.8818 => 0.8600, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.05% (0.0997 => 0.0847, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1126, std. dev.: 0.0324) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.06% (20.3410 => 18.4978, std. dev.: 0.0740) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.33% (1.3780 => 1.3183, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.79% (8.8259 => 8.5798, std. dev.: 0.0153) SingleSource/Benchmarks/Dhrystone/dry: -2.51% (2.5089 => 2.4459, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5083, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7462, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2522, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4883, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -1.40% (3.0263 => 2.9840, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1532, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8665, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2231, std. dev.: 0.0194) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2622, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 11:06:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 13:06:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120709180632.4C70D2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1908?compare_to=1905&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1908, Order: 159936, Start Time: 2012-07-09 16:48:16, End Time: 2012-07-09 18:06:36 To: 1905, Order: 159931, Start Time: 2012-07-09 14:46:18, End Time: 2012-07-09 16:04:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (57 on baseline) Performance Improvements: 3 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 927 (798 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.31% (13.0752 => 13.3773, std. dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.76% (54.6080 => 56.1148, std. dev.: 0.3500) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -2.42% (11.0417 => 10.7742, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -2.35% (19.7920 => 19.3277, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.06% (1.1147 => 1.1029, std. dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.03% (10.3673 => 13.3773, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.64% (1.1194 => 1.2497, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.84% (0.3473 => 0.3780, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.75% (0.3543 => 0.3853, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.61% (0.3497 => 0.3798, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.58% (0.3543 => 0.3847, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.56% (0.3516 => 0.3817, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 8.54% (0.3561 => 0.3865, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.47% (0.3694 => 0.4007, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.02% (1.7609 => 1.9022, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 7.94% (0.3828 => 0.4132, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 7.87% (0.3886 => 0.4192, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.82% (0.3927 => 0.4234, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.01% (2.2022 => 2.3566, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.94% (0.2065 => 0.2167, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.69% (0.3177 => 0.3326, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.55% (0.4879 => 0.5101, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.96% (7.0540 => 7.3331, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 3.83% (0.5925 => 0.6152, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference-object: 3.83% (0.6030 => 0.6261, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 3.29% (0.3282 => 0.3390, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.24% (10.4361 => 10.7742, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 3.21% (0.7326 => 0.7561, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.20% (0.7433 => 0.7671, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.78% (0.8172 => 0.8399, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.64% (0.4615 => 0.4737, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.64% (14.3668 => 14.7455, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.62% (0.5569 => 0.5715, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.45% (4.9449 => 5.0660, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.39% (5.0018 => 5.1213, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: 2.26% (0.7835 => 0.8012, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.15% (8.1363 => 8.3114, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 2.15% (9.4845 => 9.6883, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (4.2646 => 4.3471, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.93% (0.5860 => 0.5973, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.71% (2.0273 => 2.0620, std. dev.: 0.0086) MultiSource/Applications/d/make_dparser: 1.54% (3.3354 => 3.3866, std. dev.: 0.0035) MultiSource/Applications/hbd/hbd: 1.49% (1.5603 => 1.5835, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.41% (1.3050 => 1.3234, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.38% (2.0665 => 2.0950, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.36% (3.8723 => 3.9249, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.32% (1.5415 => 1.5619, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.31% (0.8067 => 0.8173, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 1.26% (5.7591 => 5.8319, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.18% (17.1811 => 17.3843, std. dev.: 0.0390) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.14% (0.9765 => 0.9876, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7558, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.23% (1.0313 => 1.0543, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.18% (26.0924 => 26.6600, std. dev.: 0.0106) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.05% (1.5086 => 1.5395, std. dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4462, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2430, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6899, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 1.03% (2.9346 => 2.9647, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.73% (5.2763 => 3.1800, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.70% (5.3855 => 3.6781, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.32% (5.3526 => 3.6762, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.98% (2.9384 => 2.5570, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -12.84% (22.1758 => 19.3277, std. dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -4.92% (54.1659 => 51.4996, std. dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.53% (3.8922 => 3.7937, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.86% (1.2373 => 1.1029, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.11% (19.9488 => 18.5307, std. dev.: 0.0548) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.85% (8.1563 => 7.9242, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6849, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0827, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 12:42:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 14:42:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120709194205.CDB282A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1909?compare_to=1906&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1909, Order: 159936, Start Time: 2012-07-09 16:58:55, End Time: 2012-07-09 19:42:09 To: 1906, Order: 159926, Start Time: 2012-07-09 13:47:45, End Time: 2012-07-09 16:31:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (48 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (844 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 9.66% (0.3446 => 0.3779, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.58% (0.3465 => 0.3797, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.51% (0.3460 => 0.3789, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.50% (0.3496 => 0.3828, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.49% (0.3488 => 0.3819, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 9.41% (0.3442 => 0.3766, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.40% (0.3469 => 0.3795, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.25% (0.3643 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.18% (0.3650 => 0.3985, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.81% (0.3724 => 0.4052, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.94% (0.5826 => 0.6114, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.57% (0.5889 => 0.6158, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.11% (1.6211 => 1.6877, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.01% (0.4361 => 0.4536, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.94% (0.5026 => 0.5224, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.90% (3.5627 => 3.7016, std. dev.: 0.0090) MultiSource/Applications/spiff/spiff: 3.90% (0.4029 => 0.4186, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.64% (0.7171 => 0.7432, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.59% (0.5900 => 0.6112, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.46% (0.3930 => 0.4066, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.46% (4.2109 => 4.3564, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.36% (1.3152 => 1.3594, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.19% (2.0673 => 2.1333, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.18% (0.4994 => 0.5153, std. dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.06% (2.7292 => 2.8127, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.05% (0.9909 => 1.0211, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.03% (0.3362 => 0.3464, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 2.80% (0.3678 => 0.3781, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.76% (0.5000 => 0.5138, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 2.75% (1.0781 => 1.1077, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.65% (1.9694 => 2.0215, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.64% (0.4658 => 0.4781, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.3845 => 0.3946, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (4.4195 => 4.5329, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4146 => 0.4252, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.53% (1.9966 => 2.0471, std. dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: 2.41% (1.8794 => 1.9246, std. dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 2.37% (2.1013 => 2.1510, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 2.30% (5.5417 => 5.6692, std. dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: 2.29% (23.5202 => 24.0586, std. dev.: 0.0147) MultiSource/Applications/treecc/treecc: 2.20% (0.7875 => 0.8048, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (2.1653 => 2.2127, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.11% (4.6177 => 4.7153, std. dev.: 0.0047) MultiSource/Applications/hbd/hbd: 2.02% (0.9697 => 0.9893, std. dev.: 0.0032) MultiSource/Applications/lua/lua: 1.59% (1.4269 => 1.4496, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.57% (0.6435 => 0.6536, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.54% (0.6634 => 0.6736, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 1.32% (1.5932 => 1.6142, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.10% (2.4764 => 2.4243, std. dev.: 0.0117) MultiSource/Applications/kimwitu++/kc: -1.81% (11.9555 => 11.7392, std. dev.: 0.0151) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 12:43:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 14:43:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120709194314.C2A012A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1910?compare_to=1907&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1910, Order: 159943, Start Time: 2012-07-09 18:29:36, End Time: 2012-07-09 19:43:18 To: 1907, Order: 159936, Start Time: 2012-07-09 16:48:19, End Time: 2012-07-09 18:01:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (129 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.18% (2.0176 => 2.3037, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.20% (0.5818 => 0.6237, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.06% (0.5748 => 0.6154, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.77% (0.7061 => 0.7539, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.14% (0.1986 => 0.2108, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.94% (0.7038 => 0.7456, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.84% (1.3693 => 1.4493, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 5.73% (0.3578 => 0.3783, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.64% (0.3650 => 0.3856, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.54% (0.7710 => 0.8137, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.54% (0.2782 => 0.2936, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 5.53% (0.3601 => 0.3800, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.50% (0.2781 => 0.2934, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.49% (0.3914 => 0.4129, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.46% (0.3646 => 0.3845, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.45% (0.4003 => 0.4221, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.44% (0.3789 => 0.3995, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.43% (0.5265 => 0.5551, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 5.41% (0.3623 => 0.3819, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.41% (0.2607 => 0.2748, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.41% (0.3663 => 0.3861, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.36% (0.3940 => 0.4151, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.35% (0.2596 => 0.2735, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2690 => 0.2833, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.27% (0.4062 => 0.4276, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.26% (3.9660 => 4.1748, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2628 => 0.2766, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.21% (0.2726 => 0.2868, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.11% (0.2937 => 0.3087, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.03% (0.2765 => 0.2904, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.00% (0.2760 => 0.2898, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.99% (0.2966 => 0.3114, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.96% (0.3107 => 0.3261, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.94% (1.9828 => 2.0808, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.93% (0.2696 => 0.2829, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.93% (0.3489 => 0.3661, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.93% (0.2761 => 0.2897, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.92% (0.3899 => 0.4091, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 4.89% (0.3149 => 0.3303, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.83% (0.3580 => 0.3753, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 4.64% (0.3192 => 0.3340, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.59% (0.3485 => 0.3645, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.56% (0.6959 => 0.7276, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 4.43% (0.3453 => 0.3606, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.37% (0.3293 => 0.3437, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.34% (16.6129 => 17.3346, std. dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 4.30% (13.8202 => 14.4151, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.28% (0.4016 => 0.4188, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3756 => 0.3916, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 4.25% (0.2988 => 0.3115, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.22% (0.3534 => 0.3683, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.17% (0.9199 => 0.9583, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.11% (13.2842 => 13.8298, std. dev.: 0.0134) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.10% (0.4390 => 0.4570, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 4.00% (0.2925 => 0.3042, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.96% (1.2193 => 1.2676, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 3.96% (0.3868 => 0.4021, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.82% (0.5577 => 0.5790, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 3.67% (0.2945 => 0.3053, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.65% (0.5637 => 0.5843, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.54% (0.3246 => 0.3361, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.50% (1.4563 => 1.5072, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.44% (1.3245 => 1.3701, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 3.43% (3.8646 => 3.9972, std. dev.: 0.0067) MultiSource/Applications/treecc/treecc: 3.41% (1.9270 => 1.9927, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.40% (0.7506 => 0.7761, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.40% (1.1364 => 1.1750, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.31% (0.4379 => 0.4524, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.28% (1.1061 => 1.1424, std. dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.0594 => 1.0941, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.26% (7.2180 => 7.4534, std. dev.: 0.0148) MultiSource/Applications/hexxagon/hexxagon: 3.21% (1.2292 => 1.2687, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3755 => 0.3870, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.06% (1.3813 => 1.4235, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.97% (4.9865 => 5.1348, std. dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.96% (0.7460 => 0.7681, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.91% (1.3819 => 1.4221, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8310 => 0.8536, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.71% (3.6692 => 3.7685, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.61% (2.1791 => 2.2359, std. dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: 2.50% (6.5754 => 6.7398, std. dev.: 0.0149) MultiSource/Applications/JM/lencod/lencod: 2.48% (14.8535 => 15.2212, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.41% (4.3801 => 4.4855, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.26% (4.4433 => 4.5439, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (0.4791 => 0.4898, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.13% (1.1333 => 1.1574, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.10% (0.6135 => 0.6264, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.03% (16.2614 => 16.5920, std. dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.02% (0.8698 => 0.8874, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.98% (3.1889 => 3.2521, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.76% (1.2749 => 1.2974, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.73% (14.5298 => 14.7810, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.61% (2.1007 => 2.1346, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2649, std. dev.: 0.0536) SingleSource/Benchmarks/Misc/mandel-2: 8.66% (1.2998 => 1.4123, std. dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.49% (2.0200 => 2.1914, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.22% (7.4271 => 7.7405, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4788, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.34% (1.0310 => 1.0551, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9591, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.56% (3.6469 => 3.7037, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5089 => 1.5324, std. dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.88% (22.5627 => 21.0097, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.16% (0.3511 => 0.3400, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.47% (0.8818 => 0.8600, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.65% (0.0997 => 0.0841, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2308 => 1.1050, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.08% (20.3410 => 18.4936, std. dev.: 0.0778) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.96% (1.3780 => 1.3235, std. dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9762 => 1.9055, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5961, std. dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4476, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5092, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7463, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2523, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.48% (3.0263 => 2.9816, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4889, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std. dev.: 0.0017) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1764, std. dev.: 0.0193) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2579, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2348, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 12:52:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 14:52:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120709195225.7B2902A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1911?compare_to=1908&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1911, Order: 159943, Start Time: 2012-07-09 18:34:21, End Time: 2012-07-09 19:52:28 To: 1908, Order: 159936, Start Time: 2012-07-09 16:48:16, End Time: 2012-07-09 18:06:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (56 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (798 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.15% (13.3773 => 13.7985, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.23% (78.6682 => 80.4199, std. dev.: 0.6151) SingleSource/Benchmarks/McGill/chomp: 1.07% (1.1029 => 1.1147, std. dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.10% (10.3673 => 13.7985, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.40% (1.1194 => 1.2470, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.87% (0.3473 => 0.3781, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3543 => 0.3849, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3497 => 0.3796, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-3: 8.53% (0.3516 => 0.3816, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.50% (0.3543 => 0.3844, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.48% (0.3561 => 0.3863, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: 8.20% (0.3694 => 0.3997, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.06% (1.7609 => 1.9029, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions: 7.94% (0.3828 => 0.4132, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.82% (0.3886 => 0.4190, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/parameter-passing: 7.79% (0.3927 => 0.4233, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.07% (2.2022 => 2.3579, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.63% (0.3177 => 0.3324, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.47% (0.4879 => 0.5097, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.00% (7.0540 => 7.3364, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 3.98% (0.6030 => 0.6270, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.95% (0.5925 => 0.6159, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 3.32% (0.3282 => 0.3391, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.27% (10.4361 => 10.7775, std. dev.: 0.0088) SingleSource/UnitTests/ObjC++/property-reference: 3.19% (0.7326 => 0.7560, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 3.09% (0.7433 => 0.7663, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.29% (0.8172 => 0.8359, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.25% (4.9449 => 5.0564, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.25% (0.4615 => 0.4719, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.24% (0.5569 => 0.5694, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.19% (5.0018 => 5.1111, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.12% (14.3668 => 14.6707, std. dev.: 0.0192) MultiSource/Applications/spiff/spiff: 1.86% (0.7835 => 0.7981, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 1.83% (9.4845 => 9.6583, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.82% (8.1363 => 8.2844, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.79% (4.2646 => 4.3409, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.71% (0.5860 => 0.5960, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.52% (2.0273 => 2.0581, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.44% (1.1861 => 1.2032, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 1.40% (3.3354 => 3.3822, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 1.33% (1.5603 => 1.5811, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.21% (2.0665 => 2.0915, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.15% (1.5415 => 1.5593, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 1.15% (1.1642 => 1.1776, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.13% (1.3050 => 1.3197, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.10% (3.8723 => 3.9149, std. dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 1.04% (17.1811 => 17.3598, std. dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 1.03% (5.7591 => 5.8184, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.77% (1.1145 => 1.1900, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7506, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.36% (1.0313 => 1.0556, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.19% (26.0924 => 26.6643, std. dev.: 0.0232) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.95% (1.5086 => 1.5380, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2395, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.35% (2.6546 => 2.6905, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.12% (2.9346 => 2.9676, std. dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.97% (5.2763 => 3.1675, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.57% (5.3855 => 3.6855, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.18% (5.3526 => 3.6834, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.46% (2.9384 => 2.5430, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -12.89% (22.1758 => 19.3176, std. dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -5.04% (54.1659 => 51.4382, std. dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.64% (3.8922 => 3.7894, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.43% (0.8101 => 0.7985, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.93% (0.0998 => 0.0839, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.91% (1.2373 => 1.1147, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.30% (19.9488 => 18.4934, std. dev.: 0.0761) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.83% (8.1563 => 7.9258, std. dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6936, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0841, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 14:24:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 16:24:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120709212440.6CB262A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1912?compare_to=1910&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1912, Order: 159955, Start Time: 2012-07-09 20:11:01, End Time: 2012-07-09 21:24:43 To: 1910, Order: 159943, Start Time: 2012-07-09 18:29:36, End Time: 2012-07-09 19:43:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (129 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.98% (54.8060 => 56.4373, std. dev.: 0.0737) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.93% (2.0176 => 2.2987, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 7.15% (0.5818 => 0.6234, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.85% (0.5748 => 0.6142, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.65% (0.3130 => 0.3338, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.40% (0.7061 => 0.7513, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.94% (0.1986 => 0.2104, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 5.79% (1.3693 => 1.4486, std. dev.: 0.0076) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.56% (0.7710 => 0.8139, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 5.56% (0.7038 => 0.7429, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 5.37% (0.3578 => 0.3770, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.37% (0.2721 => 0.2867, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.34% (0.3650 => 0.3845, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 5.29% (0.4328 => 0.4557, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.24% (0.4062 => 0.4275, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.24% (0.2596 => 0.2732, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.20% (0.2655 => 0.2793, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.18% (0.2781 => 0.2925, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.17% (0.5265 => 0.5537, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: 5.15% (0.3789 => 0.3984, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 5.14% (0.3601 => 0.3786, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.08% (0.3663 => 0.3849, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.07% (0.3646 => 0.3831, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.07% (0.4003 => 0.4206, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.07% (0.2782 => 0.2923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.06% (0.3914 => 0.4112, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.05% (3.9660 => 4.1662, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 5.02% (0.2607 => 0.2738, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.00% (0.3940 => 0.4137, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 5.00% (0.3623 => 0.3804, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.98% (0.2690 => 0.2824, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.87% (0.2628 => 0.2756, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.86% (0.3022 => 0.3169, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2726 => 0.2858, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.79% (0.2966 => 0.3108, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.77% (0.3899 => 0.4085, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.73% (0.2937 => 0.3076, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.73% (0.6959 => 0.7288, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 4.64% (0.2760 => 0.2888, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.64% (0.2761 => 0.2889, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.61% (0.3489 => 0.3650, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.59% (0.2765 => 0.2892, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.56% (0.2696 => 0.2819, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.51% (1.9828 => 2.0723, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 4.51% (0.3149 => 0.3291, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.47% (0.3107 => 0.3246, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.44% (0.3580 => 0.3739, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.28% (0.3485 => 0.3634, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.14% (0.3453 => 0.3596, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.10% (0.9199 => 0.9576, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.09% (13.8202 => 14.3851, std. dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.06% (0.4016 => 0.4179, std. dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 4.03% (16.6129 => 17.2824, std. dev.: 0.0228) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.99% (0.4390 => 0.4565, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 3.98% (0.3192 => 0.3319, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.91% (0.3756 => 0.3903, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 3.89% (0.3293 => 0.3421, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2988 => 0.3104, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.88% (0.3534 => 0.3671, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.85% (13.2842 => 13.7954, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.81% (1.2193 => 1.2658, std. dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.77% (0.2914 => 0.3024, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3868 => 0.4012, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.69% (0.2925 => 0.3033, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.59% (0.5577 => 0.5777, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.58% (0.5637 => 0.5839, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 3.50% (0.7506 => 0.7769, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.47% (1.4563 => 1.5068, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.42% (0.3246 => 0.3357, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.27% (1.3245 => 1.3678, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.24% (1.1364 => 1.1732, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (3.8646 => 3.9878, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 3.17% (1.9270 => 1.9880, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.15% (0.4379 => 0.4517, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.0594 => 1.0924, std. dev.: 0.0067) MultiSource/Applications/Burg/burg: 3.02% (1.1061 => 1.1395, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.00% (7.2180 => 7.4347, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.97% (1.3813 => 1.4223, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.94% (0.8310 => 0.8554, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.90% (1.2292 => 1.2648, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.76% (0.7460 => 0.7666, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3755 => 0.3858, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.74% (1.3819 => 1.4197, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.72% (4.9865 => 5.1220, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (3.6692 => 3.7650, std. dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 2.45% (6.5754 => 6.7364, std. dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 2.35% (14.8535 => 15.2028, std. dev.: 0.0050) MultiSource/Applications/siod/siod: 2.22% (2.1791 => 2.2275, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.18% (4.3801 => 4.4757, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.10% (0.6135 => 0.6264, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.06% (4.4433 => 4.5349, std. dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 2.00% (16.2614 => 16.5874, std. dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.89% (1.1333 => 1.1547, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.88% (3.1889 => 3.2488, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.8698 => 0.8857, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.61% (14.5298 => 14.7636, std. dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 1.61% (1.2749 => 1.2954, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.44% (2.1007 => 2.1310, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.23% (1.8175 => 2.2760, std. dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1912, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: 8.09% (1.2998 => 1.4050, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.75% (0.9996 => 1.0771, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.20% (7.4271 => 7.7393, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9199, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6790, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.39% (1.7688 => 1.8287, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4798, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0310 => 1.0561, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5339, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.63% (3.6469 => 3.7062, std. dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (1.9290 => 1.9565, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.99% (22.5627 => 20.9852, std. dev.: 0.0225) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.45% (0.8818 => 0.8602, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.11% (0.9108 => 0.9007, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.63% (1.2308 => 1.1123, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.94% (20.3410 => 18.5234, std. dev.: 0.0800) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.23% (1.3780 => 1.3197, std. dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5502, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.18% (1.9762 => 1.9134, std. dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5947, std. dev.: 0.0094) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5039, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: -1.70% (28.2225 => 27.7432, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9984, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2565, std. dev.: 0.0039) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1094, std. dev.: 0.0234) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -1.40% (3.0263 => 2.9838, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.31% (9.3358 => 9.2138, std. dev.: 0.0096) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2362, std. dev.: 0.0109) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2573, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 14:38:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 16:38:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120709213806.0BD792A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1913?compare_to=1911&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1913, Order: 159955, Start Time: 2012-07-09 20:20:05, End Time: 2012-07-09 21:38:10 To: 1911, Order: 159943, Start Time: 2012-07-09 18:34:21, End Time: 2012-07-09 19:52:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (54 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (801 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.02% (13.7985 => 13.3819, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.02% (1.1147 => 1.1033, std. dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.08% (10.3673 => 13.3819, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (1.1194 => 1.2441, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.87% (0.3473 => 0.3781, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.61% (0.3497 => 0.3798, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.55% (0.3543 => 0.3846, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.50% (0.3543 => 0.3844, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.48% (0.3561 => 0.3863, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.48% (0.3516 => 0.3814, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.18% (0.3694 => 0.3996, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.92% (0.3828 => 0.4131, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.80% (0.3886 => 0.4189, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.72% (0.3927 => 0.4230, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.45% (1.7609 => 1.8920, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.78% (2.2022 => 2.3515, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.4879 => 0.5094, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.31% (0.3177 => 0.3314, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (7.0540 => 7.3249, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 3.83% (10.4361 => 10.8353, std. dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: 3.71% (0.5925 => 0.6145, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 3.70% (0.6030 => 0.6253, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.28% (0.7433 => 0.7677, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 3.14% (0.3282 => 0.3385, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.92% (0.7326 => 0.7540, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.38% (0.4615 => 0.4725, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.36% (0.8172 => 0.8365, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.33% (0.5569 => 0.5699, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.24% (4.9449 => 5.0557, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.20% (5.0018 => 5.1117, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.09% (14.3668 => 14.6671, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.90% (8.1363 => 8.2911, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 1.90% (9.4845 => 9.6648, std. dev.: 0.0158) MultiSource/Applications/spiff/spiff: 1.89% (0.7835 => 0.7983, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.71% (4.2646 => 4.3377, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 1.51% (3.3354 => 3.3857, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.49% (1.1861 => 1.2038, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.47% (2.0273 => 2.0570, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7591 => 5.8388, std. dev.: 0.0061) MultiSource/Applications/hbd/hbd: 1.29% (1.5603 => 1.5805, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.18% (3.8723 => 3.9179, std. dev.: 0.0048) MultiSource/Applications/Burg/burg: 1.16% (1.1642 => 1.1777, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.16% (1.3050 => 1.3201, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.14% (1.5415 => 1.5591, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.14% (17.1811 => 17.3763, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.02% (2.0665 => 2.0876, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.24% (3.6395 => 3.7575, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.16% (26.0924 => 26.6555, std. dev.: 0.0298) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (1.5086 => 1.5362, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6898, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2321, std. dev.: 0.0116) MultiSource/Applications/spiff/spiff: 1.10% (2.9346 => 2.9670, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1250, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.30% (0.8651 => 0.1704, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.21% (5.2763 => 3.1549, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.78% (5.3855 => 3.6740, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.37% (5.3526 => 3.6735, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.63% (2.9384 => 2.5378, std. dev.: 0.0177) MultiSource/Applications/ClamAV/clamscan: -12.80% (22.1758 => 19.3379, std. dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: -5.06% (54.1659 => 51.4239, std. dev.: 0.0291) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.76% (3.8922 => 3.7847, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.13% (0.0998 => 0.0837, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -10.83% (1.2373 => 1.1033, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.57% (19.9488 => 18.6384, std. dev.: 0.0475) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.87% (8.1563 => 7.9226, std. dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6875, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 15:53:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 17:53:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120709225302.D27432A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1914?compare_to=1909&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1914, Order: 159955, Start Time: 2012-07-09 20:09:50, End Time: 2012-07-09 22:53:06 To: 1909, Order: 159936, Start Time: 2012-07-09 16:58:55, End Time: 2012-07-09 19:42:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (45 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (847 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.37% (124.7102 => 130.1554, std. dev.: 0.6146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.36% (54.1435 => 54.8785, std. dev.: 0.1154) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 10.24% (0.3496 => 0.3854, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.22% (0.3465 => 0.3819, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-2: 10.16% (0.3446 => 0.3796, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.14% (0.3442 => 0.3791, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.06% (0.3460 => 0.3808, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.03% (0.3469 => 0.3817, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.01% (0.3488 => 0.3837, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.84% (0.3650 => 0.4009, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.72% (0.3643 => 0.3997, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 9.34% (0.3724 => 0.4072, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.30% (0.5826 => 0.6135, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.98% (0.5889 => 0.6182, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.97% (1.6211 => 1.6854, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.88% (3.5627 => 3.7010, std. dev.: 0.0058) MultiSource/Applications/spiff/spiff: 3.85% (0.4029 => 0.4184, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.81% (0.4361 => 0.4527, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.75% (0.5900 => 0.6121, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 3.72% (0.7171 => 0.7438, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.52% (0.4994 => 0.5170, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.41% (2.7292 => 2.8223, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (0.3845 => 0.3976, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.29% (4.2109 => 4.3494, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.28% (0.5026 => 0.5191, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.26% (0.5000 => 0.5163, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.25% (1.3152 => 1.3579, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.23% (0.3930 => 0.4057, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.02% (2.0673 => 2.1298, std. dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 2.89% (0.9909 => 1.0195, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (1.9694 => 2.0261, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.81% (0.4658 => 0.4789, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.76% (1.0781 => 1.1079, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.53% (4.4195 => 4.5315, std. dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: 2.52% (5.5417 => 5.6811, std. dev.: 0.0100) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.51% (1.9966 => 2.0468, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.37% (2.1653 => 2.2167, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 2.36% (23.5202 => 24.0759, std. dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: 2.26% (2.1013 => 2.1488, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 2.25% (4.6177 => 4.7214, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 2.18% (1.8794 => 1.9204, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 2.05% (0.9697 => 0.9896, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.02% (0.7875 => 0.8034, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.81% (1.4269 => 1.4527, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.78% (0.6634 => 0.6752, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.77% (0.6435 => 0.6549, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 1.74% (1.5932 => 1.6209, std. dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.59% (2.4764 => 2.4122, std. dev.: 0.0061) MultiSource/Applications/kimwitu++/kc: -1.88% (11.9555 => 11.7302, std. dev.: 0.0181) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 16:05:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 18:05:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120709230558.B00E32A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1915?compare_to=1912&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1915, Order: 159961, Start Time: 2012-07-09 21:52:22, End Time: 2012-07-09 23:06:02 To: 1912, Order: 159955, Start Time: 2012-07-09 20:11:01, End Time: 2012-07-09 21:24:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 207.89% (2.9471 => 9.0737, std. dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.46% (2.0176 => 2.2892, std. dev.: 0.0064) SingleSource/UnitTests/ObjC++/property-reference-object: 6.91% (0.5818 => 0.6220, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.85% (0.7061 => 0.7545, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.68% (0.5748 => 0.6132, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.19% (1.3693 => 1.4541, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 5.87% (0.7038 => 0.7451, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.59% (0.1986 => 0.2097, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.36% (0.4328 => 0.4560, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.26% (0.5265 => 0.5542, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.11% (0.7710 => 0.8104, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.05% (0.2596 => 0.2727, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 5.03% (0.2781 => 0.2921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.02% (0.4062 => 0.4266, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.2721 => 0.2855, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.86% (0.3022 => 0.3169, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.86% (3.9660 => 4.1588, std. dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.78% (0.2782 => 0.2915, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.71% (0.2760 => 0.2890, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.68% (0.2607 => 0.2729, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.67% (0.2765 => 0.2894, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.66% (0.2726 => 0.2853, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.65% (0.2690 => 0.2815, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.64% (0.2628 => 0.2750, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.63% (0.2655 => 0.2778, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.61% (0.3489 => 0.3650, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: 4.61% (0.3578 => 0.3743, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.55% (0.2966 => 0.3101, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.53% (0.2937 => 0.3070, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.3899 => 0.4073, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.43% (1.9828 => 2.0707, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4390 => 0.4584, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 4.42% (0.2761 => 0.2883, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.41% (0.3650 => 0.3811, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 4.41% (0.3107 => 0.3244, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.39% (0.3580 => 0.3737, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.37% (0.6959 => 0.7263, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.34% (0.2696 => 0.2813, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.32% (0.3149 => 0.3285, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 4.32% (0.3914 => 0.4083, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.22% (0.4003 => 0.4172, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.19% (0.3485 => 0.3631, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.18% (0.3663 => 0.3816, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 4.17% (0.3789 => 0.3947, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.17% (0.3646 => 0.3798, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 4.17% (0.3601 => 0.3751, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 4.11% (0.3453 => 0.3595, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/property: 4.11% (0.3940 => 0.4102, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.08% (13.8202 => 14.3834, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.07% (0.9199 => 0.9573, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.01% (0.3192 => 0.3320, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.96% (0.4016 => 0.4175, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 3.94% (16.6129 => 17.2670, std. dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/lists1: 3.88% (0.3534 => 0.3671, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.85% (13.2842 => 13.7957, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.85% (0.5637 => 0.5854, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 3.85% (0.2988 => 0.3103, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.83% (0.3293 => 0.3419, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.82% (1.2193 => 1.2659, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.73% (0.3756 => 0.3896, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3868 => 0.4012, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.2925 => 0.3031, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.60% (0.5577 => 0.5778, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.45% (0.7506 => 0.7765, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.34% (1.4563 => 1.5050, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.27% (0.3246 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.13% (1.1364 => 1.1720, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.13% (1.1061 => 1.1407, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.12% (1.3245 => 1.3658, std. dev.: 0.0077) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.0594 => 1.0922, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 3.07% (1.9270 => 1.9862, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 3.07% (3.8646 => 3.9833, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.06% (0.4379 => 0.4513, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.88% (1.3813 => 1.4211, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 2.88% (1.2292 => 1.2646, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.85% (7.2180 => 7.4234, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.77% (1.3819 => 1.4202, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.76% (0.7460 => 0.7666, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.61% (4.9865 => 5.1167, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (0.8310 => 0.8522, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.41% (2.1791 => 2.2317, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.38% (0.4791 => 0.4905, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.28% (3.6692 => 3.7530, std. dev.: 0.0148) MultiSource/Applications/JM/lencod/lencod: 2.18% (14.8535 => 15.1771, std. dev.: 0.0172) MultiSource/Applications/JM/ldecod/ldecod: 2.17% (6.5754 => 6.7182, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.08% (4.3801 => 4.4712, std. dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 1.97% (16.2614 => 16.5824, std. dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.88% (1.1333 => 1.1546, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.82% (4.4433 => 4.5241, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.81% (0.6135 => 0.6246, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.75% (0.8698 => 0.8850, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.64% (14.5298 => 14.7676, std. dev.: 0.0095) MultiSource/Applications/d/make_dparser: 1.63% (3.1889 => 3.2408, std. dev.: 0.0139) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2937, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.39% (2.1007 => 2.1298, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 26.91% (1.8175 => 2.3066, std. dev.: 0.0322) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.44% (2.0200 => 2.1904, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.02% (0.9996 => 1.0798, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 6.85% (1.2998 => 1.3888, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.84% (7.4271 => 7.7124, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6772, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.96% (4.1080 => 4.1887, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.92% (1.4298 => 1.4573, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (1.5089 => 1.5353, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.57% (3.6469 => 3.7040, std. dev.: 0.0052) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5109, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.02% (22.5627 => 20.9788, std. dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.33% (0.3511 => 0.3394, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.54% (0.8818 => 0.8594, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.38% (0.9108 => 0.8982, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -9.64% (1.2308 => 1.1121, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.06% (20.3410 => 18.4979, std. dev.: 0.0804) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3114, std. dev.: 0.0070) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.24% (1.9762 => 1.9121, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5913, std. dev.: 0.0235) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4464, std. dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5043, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2530, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7951, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.48% (0.9692 => 0.9549, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1291, std. dev.: 0.0343) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8631, std. dev.: 0.0079) MultiSource/Applications/spiff/spiff: -1.36% (3.0263 => 2.9851, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2514, std. dev.: 0.0051) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2222, std. dev.: 0.0114) MultiSource/Benchmarks/Bullet/bullet: -1.13% (7.3305 => 7.2479, std. dev.: 0.0197) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 16:24:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 18:24:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120709232420.B78E22A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/1916?compare_to=1913&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1916, Order: 159963, Start Time: 2012-07-09 22:06:21, End Time: 2012-07-09 23:24:22 To: 1913, Order: 159955, Start Time: 2012-07-09 20:20:05, End Time: 2012-07-09 21:38:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (45 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (809 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 2.16% (19.3379 => 19.7551, std. dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.79% (13.3819 => 12.8750, std. dev.: 0.0103) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.19% (10.3673 => 12.8750, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.01% (1.1194 => 1.2426, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.35% (0.3473 => 0.3763, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.99% (0.3543 => 0.3826, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.89% (0.3497 => 0.3773, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.85% (0.3543 => 0.3821, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.82% (0.3516 => 0.3791, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.81% (0.3561 => 0.3839, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/for-in: 7.58% (0.3694 => 0.3974, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.38% (0.3927 => 0.4217, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: 7.31% (0.3828 => 0.4108, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.30% (1.7609 => 1.8894, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.21% (0.3886 => 0.4166, std. dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.69% (2.2022 => 2.3496, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.06% (0.3177 => 0.3306, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.91% (0.4879 => 0.5070, std. dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: 3.79% (10.4361 => 10.8312, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.39% (7.0540 => 7.2932, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 3.08% (0.6030 => 0.6216, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.04% (0.7433 => 0.7659, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 3.00% (0.5925 => 0.6103, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.40% (0.8172 => 0.8368, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 2.22% (0.7326 => 0.7489, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.15% (0.5569 => 0.5689, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.87% (4.9449 => 5.0376, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (14.3668 => 14.6331, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.84% (5.0018 => 5.0940, std. dev.: 0.0072) MultiSource/Applications/spiff/spiff: 1.71% (0.7835 => 0.7969, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.61% (8.1363 => 8.2673, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 1.47% (9.4845 => 9.6236, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 1.39% (1.5603 => 1.5820, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.35% (4.2646 => 4.3221, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.27% (2.0273 => 2.0530, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.16% (1.1861 => 1.1999, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 1.16% (3.3354 => 3.3742, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7594, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.23% (1.0313 => 1.0543, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.06% (26.0924 => 26.6298, std. dev.: 0.0294) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5367, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.52% (9.1159 => 9.2545, std. dev.: 0.0103) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.40% (2.6546 => 2.6918, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 1.15% (2.9346 => 2.9684, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.27% (5.2763 => 3.1515, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.92% (5.3855 => 3.6663, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.44% (5.3526 => 3.6697, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.63% (2.9384 => 2.5378, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -10.92% (22.1758 => 19.7551, std. dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: -5.07% (54.1659 => 51.4212, std. dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.94% (3.8922 => 3.7777, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.46% (0.8101 => 0.7983, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1073, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.02% (19.9488 => 18.5479, std. dev.: 0.0506) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.91% (8.1563 => 7.9191, std. dev.: 0.0145) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6864, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0825, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 17:47:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 19:47:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120710004731.D8E922A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1917?compare_to=1915&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1917, Order: 159966, Start Time: 2012-07-09 23:33:51, End Time: 2012-07-10 00:47:35 To: 1915, Order: 159961, Start Time: 2012-07-09 21:52:22, End Time: 2012-07-09 23:06:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (124 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (727 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.77% (79.4004 => 81.5998, std. dev.: 0.7199) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.56% (2.0176 => 2.2912, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 8.32% (0.5818 => 0.6302, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.88% (0.5748 => 0.6201, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.42% (0.7061 => 0.7585, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.4062 => 0.4303, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.91% (1.3693 => 1.4502, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.78% (0.4328 => 0.4578, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 5.67% (0.7038 => 0.7437, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 5.65% (0.2781 => 0.2938, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.64% (0.1986 => 0.2098, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.53% (0.2765 => 0.2918, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.52% (0.2607 => 0.2751, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.50% (0.2782 => 0.2935, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.48% (0.3578 => 0.3774, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.42% (0.2655 => 0.2799, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 5.30% (0.3601 => 0.3792, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.28% (0.5265 => 0.5543, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 5.28% (0.2690 => 0.2832, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.28% (0.2596 => 0.2733, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.25% (0.2760 => 0.2905, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.24% (0.2937 => 0.3091, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 5.24% (0.3646 => 0.3837, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.23% (0.3650 => 0.3841, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.23% (0.3789 => 0.3987, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.21% (1.9828 => 2.0862, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: 5.21% (0.2628 => 0.2765, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/parameter-passing: 5.20% (0.4003 => 0.4211, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.19% (0.3663 => 0.3853, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.16% (0.3914 => 0.4116, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.15% (0.7710 => 0.8107, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.12% (0.3107 => 0.3266, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2761 => 0.2902, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.09% (0.2966 => 0.3117, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.04% (3.9660 => 4.1660, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.02% (0.3489 => 0.3664, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.01% (0.2696 => 0.2831, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 4.97% (0.3940 => 0.4136, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.92% (0.3149 => 0.3304, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.87% (0.3899 => 0.4089, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.62% (0.3485 => 0.3646, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.58% (0.6959 => 0.7278, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 4.54% (0.3192 => 0.3337, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.38% (0.2988 => 0.3119, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.34% (0.3293 => 0.3436, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.30% (0.3534 => 0.3686, std. dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: 4.21% (16.6129 => 17.3121, std. dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.15% (0.3756 => 0.3912, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.12% (0.4390 => 0.4571, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.04% (0.9199 => 0.9571, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 4.01% (13.8202 => 14.3747, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/moments: 4.01% (0.3868 => 0.4023, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.80% (0.2945 => 0.3057, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.76% (1.2193 => 1.2651, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.73% (13.2842 => 13.7793, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 3.59% (0.2925 => 0.3030, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.44% (0.5577 => 0.5769, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.41% (1.3245 => 1.3696, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.32% (0.5637 => 0.5824, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.27% (1.4563 => 1.5039, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.25% (1.2292 => 1.2692, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3246 => 0.3351, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.18% (0.7506 => 0.7745, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 3.18% (1.1061 => 1.1413, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.16% (3.8646 => 3.9866, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.14% (1.1364 => 1.1721, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 3.10% (1.9270 => 1.9867, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.0594 => 1.0922, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3755 => 0.3870, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.01% (0.4379 => 0.4511, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.91% (7.2180 => 7.4283, std. dev.: 0.0105) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.82% (1.3813 => 1.4203, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.76% (0.7460 => 0.7666, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.74% (1.3819 => 1.4198, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.61% (4.9865 => 5.1164, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 2.45% (0.8310 => 0.8514, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.41% (3.6692 => 3.7575, std. dev.: 0.0083) MultiSource/Applications/siod/siod: 2.34% (2.1791 => 2.2300, std. dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 2.15% (6.5754 => 6.7170, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.12% (0.8698 => 0.8882, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 2.08% (14.8535 => 15.1618, std. dev.: 0.0180) MultiSource/Applications/sqlite3/sqlite3: 2.02% (16.2614 => 16.5891, std. dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.94% (4.3801 => 4.4652, std. dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.85% (1.1333 => 1.1543, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.80% (4.4433 => 4.5231, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.78% (3.1889 => 3.2458, std. dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.73% (0.6135 => 0.6241, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.64% (1.2749 => 1.2958, std. dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 1.62% (14.5298 => 14.7652, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (2.1007 => 2.1324, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.65% (1.8175 => 2.2655, std. dev.: 0.0464) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1887, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.34% (1.5824 => 1.6986, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 7.14% (1.2998 => 1.3926, std. dev.: 0.0176) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.17% (7.4271 => 7.7370, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6770, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8292, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.23% (12.0921 => 12.4823, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.35% (1.0310 => 1.0552, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1917, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4553, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (1.5089 => 1.5353, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.62% (3.6469 => 3.7060, std. dev.: 0.0088) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9586, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.97% (0.4657 => 0.4053, std. dev.: 0.0085) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.02% (22.5627 => 20.9777, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.08% (0.3511 => 0.3403, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.88% (0.8818 => 0.8564, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.43% (0.9108 => 0.8978, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.25% (0.0997 => 0.0835, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -10.48% (1.2308 => 1.1018, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.96% (20.3410 => 18.5192, std. dev.: 0.0576) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3068, std. dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5513, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.19% (1.9762 => 1.9131, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5850, std. dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5109, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9982, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7952, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: -1.48% (3.0263 => 2.9815, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.47% (6.3560 => 6.2624, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1451, std. dev.: 0.0179) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2435, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2567, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2363, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 18:10:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 20:10:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120710011005.C611C2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1918?compare_to=1916&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1918, Order: 159968, Start Time: 2012-07-09 23:52:04, End Time: 2012-07-10 01:10:09 To: 1916, Order: 159963, Start Time: 2012-07-09 22:06:21, End Time: 2012-07-09 23:24:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (54 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (800 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.17% (12.8750 => 13.1548, std. dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.89% (10.3673 => 13.1548, std. dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.20% (1.1194 => 1.2448, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.70% (1.7609 => 1.8965, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.43% (0.3473 => 0.3731, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.23% (0.3543 => 0.3799, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 7.15% (0.3497 => 0.3747, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.11% (0.3516 => 0.3766, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.08% (0.3543 => 0.3794, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.02% (0.3561 => 0.3811, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.97% (2.2022 => 2.3556, std. dev.: 0.0087) SingleSource/UnitTests/ObjC/for-in: 6.88% (0.3694 => 0.3948, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 6.72% (0.3927 => 0.4191, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.66% (0.3828 => 0.4083, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.64% (0.3886 => 0.4144, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.4879 => 0.5080, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.09% (0.3177 => 0.3307, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.77% (10.4361 => 10.8298, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.73% (7.0540 => 7.3172, std. dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 3.62% (0.7433 => 0.7702, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 3.47% (0.6030 => 0.6239, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.43% (0.5925 => 0.6128, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.78% (0.7326 => 0.7530, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.30% (0.5569 => 0.5697, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.23% (0.4615 => 0.4718, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.17% (0.8172 => 0.8349, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.00% (4.9449 => 5.0440, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.98% (5.0018 => 5.1008, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 1.94% (0.7835 => 0.7987, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (14.3668 => 14.6303, std. dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 1.80% (9.4845 => 9.6552, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.72% (0.5860 => 0.5961, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 1.64% (5.7591 => 5.8538, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.63% (4.2646 => 4.3341, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.57% (8.1363 => 8.2640, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 1.51% (2.0273 => 2.0580, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.37% (1.1861 => 1.2023, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: 1.36% (3.3354 => 3.3807, std. dev.: 0.0055) MultiSource/Applications/hbd/hbd: 1.31% (1.5603 => 1.5808, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.25% (1.1642 => 1.1788, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.21% (3.8723 => 3.9193, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.14% (1.5415 => 1.5591, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.14% (17.1811 => 17.3772, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.04% (1.3050 => 1.3186, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.03% (2.0665 => 2.0878, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.81% (1.1145 => 1.1904, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.32% (3.6395 => 3.7605, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.94% (26.0924 => 26.5985, std. dev.: 0.0357) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5366, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.41% (9.1159 => 9.2448, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.39% (2.6546 => 2.6916, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 1.14% (2.9346 => 2.9680, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.18% (5.2763 => 3.1564, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.77% (5.3855 => 3.6743, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.21% (5.3526 => 3.6821, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.80% (2.9384 => 2.5623, std. dev.: 0.0104) MultiSource/Applications/ClamAV/clamscan: -10.74% (22.1758 => 19.7949, std. dev.: 0.0071) SingleSource/UnitTests/Vector/constpool: -5.01% (54.1659 => 51.4528, std. dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.62% (3.8922 => 3.7904, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.36% (0.8101 => 0.7991, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.13% (1.2373 => 1.0996, std. dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.05% (19.9488 => 18.5425, std. dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.65% (8.1563 => 7.9405, std. dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6839, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0859, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 19:04:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 21:04:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120710020422.2E8A62A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1919?compare_to=1914&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1919, Order: 159965, Start Time: 2012-07-09 23:20:59, End Time: 2012-07-10 02:04:25 To: 1914, Order: 159955, Start Time: 2012-07-09 20:09:50, End Time: 2012-07-09 22:53:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (39 on baseline) Performance Improvements: 12 (3 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 940 (852 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.56% (2.8223 => 2.7784, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -1.39% (5.6811 => 5.6020, std. dev.: 0.0087) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.25% (11.6833 => 11.5371, std. dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.23% (4.6923 => 4.6344, std. dev.: 0.0110) MultiSource/Benchmarks/Bullet/bullet: -1.20% (24.0759 => 23.7871, std. dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (2.1488 => 2.1244, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.12% (2.0261 => 2.0034, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -1.06% (4.7214 => 4.6714, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: -1.06% (1.1079 => 1.0962, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.04% (2.0468 => 2.0256, std. dev.: 0.0060) MultiSource/Applications/lua/lua: -1.02% (1.4527 => 1.4379, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -1.01% (2.2167 => 2.1943, std. dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 8.47% (0.3496 => 0.3792, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.44% (0.3446 => 0.3737, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 8.40% (0.3465 => 0.3756, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.32% (0.3460 => 0.3748, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.31% (0.3442 => 0.3728, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.29% (0.3488 => 0.3777, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.27% (0.3469 => 0.3756, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.97% (0.3650 => 0.3941, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.88% (0.3643 => 0.3930, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.63% (0.3724 => 0.4008, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.36% (0.5826 => 0.6080, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 4.09% (0.5889 => 0.6130, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.14% (1.6211 => 1.6720, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.08% (3.5627 => 3.6726, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.00% (0.5026 => 0.5177, std. dev.: 0.0057) MultiSource/Applications/spiff/spiff: 2.95% (0.4029 => 0.4148, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 2.91% (0.7171 => 0.7380, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.91% (0.4361 => 0.4488, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.75% (0.5900 => 0.6062, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 2.56% (4.2109 => 4.3186, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.43% (2.0673 => 2.1175, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.40% (0.5000 => 0.5120, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.40% (1.3152 => 1.3467, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.36% (0.4994 => 0.5112, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.24% (0.9909 => 1.0131, std. dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.80% (2.7292 => 2.7784, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.73% (1.9694 => 2.0034, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 1.68% (1.0781 => 1.0962, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (4.4195 => 4.4885, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 1.47% (1.8794 => 1.9070, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.45% (1.9966 => 2.0256, std. dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 1.34% (2.1653 => 2.1943, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 1.26% (1.5932 => 1.6133, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.24% (0.9697 => 0.9817, std. dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 1.16% (4.6177 => 4.6714, std. dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 1.13% (23.5202 => 23.7871, std. dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (2.1013 => 2.1244, std. dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 1.09% (5.5417 => 5.6020, std. dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.2122 => 0.2232, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.80% (11.9555 => 11.6207, std. dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -1.85% (2.4764 => 2.4307, std. dev.: 0.0165) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.24% (4.6926 => 4.6344, std. dev.: 0.0110) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 19:29:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 21:29:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120710022916.033032A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1920?compare_to=1917&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1920, Order: 159972, Start Time: 2012-07-10 01:15:23, End Time: 2012-07-10 02:29:19 To: 1917, Order: 159966, Start Time: 2012-07-09 23:33:51, End Time: 2012-07-10 00:47:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (127 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.79% (81.5998 => 78.5059, std. dev.: 1.1440) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.37% (2.0176 => 2.2873, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 7.99% (0.5818 => 0.6283, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.86% (0.7061 => 0.7616, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 7.81% (0.5748 => 0.6197, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.83% (0.4062 => 0.4299, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.65% (1.3693 => 1.4467, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.54% (0.1986 => 0.2096, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.52% (0.4328 => 0.4567, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.36% (0.7038 => 0.7415, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.25% (0.2781 => 0.2927, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.18% (0.2782 => 0.2926, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2690 => 0.2829, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.14% (0.3578 => 0.3762, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.06% (0.3022 => 0.3175, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.03% (0.2765 => 0.2904, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.02% (0.2628 => 0.2760, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.01% (0.2655 => 0.2788, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.00% (0.2760 => 0.2898, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.99% (0.3789 => 0.3978, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.2721 => 0.2855, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.90% (0.3650 => 0.3829, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 4.90% (0.2937 => 0.3081, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.90% (1.9828 => 2.0800, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.90% (0.5265 => 0.5523, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.89% (0.2596 => 0.2723, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-2: 4.89% (0.3601 => 0.3777, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 4.85% (0.3646 => 0.3823, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.85% (0.2761 => 0.2895, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.82% (0.2966 => 0.3109, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 4.80% (0.3663 => 0.3839, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.79% (0.3489 => 0.3656, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3107 => 0.3255, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.76% (0.7710 => 0.8077, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.75% (0.2696 => 0.2824, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.75% (0.4003 => 0.4193, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.73% (0.3914 => 0.4099, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: 4.70% (0.3149 => 0.3297, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 4.66% (0.3623 => 0.3792, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.65% (0.3485 => 0.3647, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.62% (3.9660 => 4.1491, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.62% (0.3899 => 0.4079, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.58% (0.3580 => 0.3744, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 4.54% (0.3940 => 0.4119, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4390 => 0.4584, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 4.39% (0.3192 => 0.3332, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.34% (0.3453 => 0.3603, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.23% (0.4016 => 0.4186, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.19% (0.3293 => 0.3431, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 4.16% (0.3534 => 0.3681, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.12% (0.2988 => 0.3111, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.02% (0.6959 => 0.7239, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.99% (0.3756 => 0.3906, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.80% (16.6129 => 17.2437, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.78% (0.9199 => 0.9547, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.3868 => 0.4011, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.61% (13.8202 => 14.3192, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.49% (13.2842 => 13.7476, std. dev.: 0.0095) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.2925 => 0.3027, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.46% (0.2945 => 0.3047, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.46% (1.2193 => 1.2615, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.32% (0.5577 => 0.5762, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (1.4563 => 1.5014, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.06% (1.3819 => 1.4242, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.05% (0.5637 => 0.5809, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.05% (1.2292 => 1.2667, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (3.8646 => 3.9779, std. dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.89% (1.1364 => 1.1692, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.86% (1.3813 => 1.4208, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 2.84% (0.7506 => 0.7719, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.83% (1.3245 => 1.3620, std. dev.: 0.0117) MultiSource/Benchmarks/nbench/nbench: 2.80% (1.0594 => 1.0891, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.80% (0.3755 => 0.3860, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.79% (4.9865 => 5.1256, std. dev.: 0.0062) MultiSource/Applications/Burg/burg: 2.77% (1.1061 => 1.1367, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.65% (0.4379 => 0.4495, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.62% (7.2180 => 7.4069, std. dev.: 0.0109) MultiSource/Applications/treecc/treecc: 2.58% (1.9270 => 1.9767, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.48% (0.7460 => 0.7645, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.25% (3.6692 => 3.7518, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.18% (0.8310 => 0.8491, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 2.04% (2.1791 => 2.2236, std. dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 1.93% (14.8535 => 15.1398, std. dev.: 0.0192) MultiSource/Applications/JM/ldecod/ldecod: 1.91% (6.5754 => 6.7008, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.87% (0.8698 => 0.8861, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.77% (16.2614 => 16.5500, std. dev.: 0.0526) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.64% (4.3801 => 4.4518, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.53% (1.1333 => 1.1506, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.51% (4.4433 => 4.5102, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.51% (3.1889 => 3.2369, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: 1.33% (14.5298 => 14.7236, std. dev.: 0.0146) MultiSource/Applications/SIBsim4/SIBsim4: 1.19% (1.2749 => 1.2901, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.1007 => 2.1232, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.58% (1.8175 => 2.2642, std. dev.: 0.0456) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.42% (2.0200 => 2.1901, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: 7.59% (1.2998 => 1.3985, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.04% (7.4271 => 7.7269, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6797, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.42% (1.7688 => 1.8293, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4801, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.38% (1.0310 => 1.0555, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1895, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.82% (1.4298 => 1.4558, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5089 => 1.5357, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6469 => 3.7089, std. dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.20% (1.9290 => 1.9521, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.51% (0.4657 => 0.4121, std. dev.: 0.0121) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.13% (22.5627 => 20.9542, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.05% (0.8818 => 0.8549, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.05% (0.3511 => 0.3404, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.77% (0.9108 => 0.8947, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.54% (1.2308 => 1.1011, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.61% (20.3410 => 18.5902, std. dev.: 0.0564) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.36% (1.3780 => 1.3041, std. dev.: 0.0089) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.61% (2.6470 => 2.5515, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.28% (1.9762 => 1.9114, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5891, std. dev.: 0.0235) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.09% (6.6320 => 6.4935, std. dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2472, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7934, std. dev.: 0.0019) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1200, std. dev.: 0.0357) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4889, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8633, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: -1.34% (3.0263 => 2.9856, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.3167 => 5.2466, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.21% (0.9692 => 0.9575, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2235, std. dev.: 0.0290) MultiSource/Benchmarks/Bullet/bullet: -1.13% (7.3305 => 7.2474, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 19:55:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 21:55:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120710025545.132AB2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1921?compare_to=1918&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1921, Order: 159974, Start Time: 2012-07-10 01:37:48, End Time: 2012-07-10 02:55:48 To: 1918, Order: 159968, Start Time: 2012-07-09 23:52:04, End Time: 2012-07-10 01:10:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (55 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (799 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.26% (13.1548 => 13.5843, std. dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.00% (54.4970 => 56.6795, std. dev.: 0.0567) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.03% (10.3673 => 13.5843, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.44% (1.1194 => 1.2475, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 8.41% (0.3473 => 0.3765, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.04% (0.3543 => 0.3828, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.98% (0.3497 => 0.3776, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.96% (0.3516 => 0.3796, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.96% (0.3543 => 0.3825, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.95% (0.3561 => 0.3844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.79% (1.7609 => 1.8980, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.69% (0.3694 => 0.3978, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.61% (2.2022 => 2.3697, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions: 7.55% (0.3828 => 0.4117, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.54% (0.3927 => 0.4223, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.41% (0.3886 => 0.4174, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 6.98% (0.1432 => 0.1532, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.69% (7.0540 => 7.3849, std. dev.: 0.0072) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.25% (0.3177 => 0.3312, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.18% (0.4879 => 0.5083, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 3.93% (0.5925 => 0.6158, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.88% (0.6030 => 0.6264, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.67% (10.4361 => 10.8191, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 3.35% (0.3282 => 0.3392, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.31% (0.7433 => 0.7679, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.08% (0.7326 => 0.7552, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.32% (0.5569 => 0.5698, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.28% (0.4615 => 0.4720, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (0.8172 => 0.8346, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.98% (0.7835 => 0.7990, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.97% (5.0018 => 5.1003, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.94% (4.9449 => 5.0409, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (14.3668 => 14.6399, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.79% (8.1363 => 8.2819, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.69% (4.2646 => 4.3365, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.64% (9.4845 => 9.6401, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 1.43% (2.0273 => 2.0563, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 1.37% (1.5603 => 1.5817, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.31% (2.0665 => 2.0936, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.30% (1.1861 => 1.2015, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.26% (1.5415 => 1.5609, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 1.25% (1.1642 => 1.1788, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 1.21% (3.3354 => 3.3757, std. dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7591 => 5.8265, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.13% (1.3050 => 1.3197, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 1.08% (3.8723 => 3.9142, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9742, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7466, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 2.25% (9.1159 => 9.3213, std. dev.: 0.0069) MultiSource/Applications/lua/lua: 1.91% (26.0924 => 26.5915, std. dev.: 0.0504) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5357, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4461, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.29% (2.6546 => 2.6888, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: 1.26% (3.8526 => 3.9012, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 1.16% (2.9346 => 2.9686, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.24% (5.2763 => 3.1533, std. dev.: 0.0075) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.53% (5.3855 => 3.6872, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.03% (5.3526 => 3.6917, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.27% (2.9384 => 2.5486, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.78% (22.1758 => 19.7855, std. dev.: 0.0165) SingleSource/UnitTests/Vector/constpool: -4.86% (54.1659 => 51.5318, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.84% (3.8922 => 3.7817, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (0.8101 => 0.7978, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2373 => 1.1020, std. dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.61% (19.9488 => 18.6302, std. dev.: 0.0370) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9160, std. dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6869, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0839, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.11% (1.3677 => 1.3525, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 21:10:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 23:10:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120710041047.64CDF2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1922?compare_to=1920&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1922, Order: 159976, Start Time: 2012-07-10 02:56:57, End Time: 2012-07-10 04:10:50 To: 1920, Order: 159972, Start Time: 2012-07-10 01:15:23, End Time: 2012-07-10 02:29:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (123 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (729 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.58% (54.7192 => 56.1311, std. dev.: 0.2146) SingleSource/Benchmarks/McGill/chomp: 1.04% (1.1011 => 1.1125, std. dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.42% (2.0176 => 2.2884, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.45% (0.7061 => 0.7658, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.10% (0.5818 => 0.6289, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.95% (0.5748 => 0.6205, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.26% (0.3130 => 0.3326, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.09% (0.1986 => 0.2107, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 6.01% (1.3693 => 1.4516, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 5.96% (0.4062 => 0.4304, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 5.71% (0.4328 => 0.4575, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 5.57% (0.2781 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.46% (0.2782 => 0.2934, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.41% (0.7038 => 0.7419, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.35% (0.2765 => 0.2913, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.32% (0.2726 => 0.2871, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.26% (0.3022 => 0.3181, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.26% (0.2607 => 0.2744, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2628 => 0.2766, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: 5.24% (0.2690 => 0.2831, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.21% (0.2937 => 0.3090, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.20% (0.3578 => 0.3764, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.18% (0.3650 => 0.3839, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.16% (0.7710 => 0.8108, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.12% (1.9828 => 2.0844, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.3107 => 0.3265, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.07% (0.2760 => 0.2900, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 5.07% (0.2761 => 0.2901, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.97% (0.2596 => 0.2725, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 4.96% (0.3646 => 0.3827, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.96% (0.2966 => 0.3113, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 4.94% (0.3623 => 0.3802, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.94% (0.5265 => 0.5525, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: 4.94% (0.3789 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.92% (0.3601 => 0.3778, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.90% (0.2696 => 0.2828, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 4.89% (0.3663 => 0.3842, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 4.88% (0.3914 => 0.4105, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.85% (0.4390 => 0.4603, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.84% (0.3489 => 0.3658, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.83% (0.3149 => 0.3301, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 4.80% (0.4003 => 0.4195, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.70% (0.3940 => 0.4125, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.69% (3.9660 => 4.1520, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.66% (0.3580 => 0.3747, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.62% (0.3899 => 0.4079, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.56% (0.3485 => 0.3644, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.49% (0.3453 => 0.3608, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.48% (0.3192 => 0.3335, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.47% (0.3534 => 0.3692, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.41% (0.4016 => 0.4193, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.37% (0.3293 => 0.3437, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.31% (0.3756 => 0.3918, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2988 => 0.3116, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.25% (0.6959 => 0.7255, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.90% (0.3868 => 0.4019, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 3.76% (16.6129 => 17.2376, std. dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.74% (0.9199 => 0.9543, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.71% (13.8202 => 14.3335, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.2945 => 0.3054, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.64% (13.2842 => 13.7680, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.50% (1.2193 => 1.2620, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.34% (0.5577 => 0.5763, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.29% (1.2292 => 1.2696, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (1.4563 => 1.5037, std. dev.: 0.0045) MultiSource/Applications/spiff/spiff: 3.18% (0.7506 => 0.7745, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.18% (0.5637 => 0.5816, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3755 => 0.3870, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.04% (1.3819 => 1.4239, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.03% (1.3813 => 1.4232, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.97% (1.1364 => 1.1701, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.86% (3.8646 => 3.9751, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.84% (1.3245 => 1.3621, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.81% (7.2180 => 7.4211, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 2.77% (1.0594 => 1.0887, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.71% (4.9865 => 5.1218, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.69% (0.4379 => 0.4497, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.69% (1.1061 => 1.1358, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 2.67% (1.9270 => 1.9785, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.18% (3.6692 => 3.7491, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.17% (0.8310 => 0.8490, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 2.01% (6.5754 => 6.7076, std. dev.: 0.0170) MultiSource/Applications/JM/lencod/lencod: 1.93% (14.8535 => 15.1408, std. dev.: 0.0063) MultiSource/Applications/siod/siod: 1.85% (2.1791 => 2.2194, std. dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 1.81% (16.2614 => 16.5550, std. dev.: 0.0166) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.70% (4.3801 => 4.4545, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.59% (1.1333 => 1.1513, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.57% (4.4433 => 4.5131, std. dev.: 0.0084) MultiSource/Applications/d/make_dparser: 1.49% (3.1889 => 3.2365, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.37% (14.5298 => 14.7291, std. dev.: 0.0097) MultiSource/Applications/SIBsim4/SIBsim4: 1.24% (1.2749 => 1.2907, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.1007 => 2.1232, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.58% (1.8175 => 2.2824, std. dev.: 0.0460) SingleSource/Benchmarks/Misc/mandel-2: 8.81% (1.2998 => 1.4143, std. dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1902, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.00% (0.9996 => 1.0796, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.92% (7.4271 => 7.7186, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0310 => 1.0562, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1895, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5340, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.59% (3.6469 => 3.7049, std. dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.11% (22.5627 => 20.9586, std. dev.: 0.0195) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.06% (0.8818 => 0.8548, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.70% (0.9108 => 0.8953, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.62% (1.0460 => 0.8617, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -9.61% (1.2308 => 1.1125, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.00% (20.3410 => 18.5101, std. dev.: 0.0727) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std. dev.: 0.0066) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.26% (1.9762 => 1.9117, std. dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5906, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5054, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9980, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2565, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7944, std. dev.: 0.0020) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1149, std. dev.: 0.0275) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4902, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -1.37% (3.0263 => 2.9847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2191, std. dev.: 0.0148) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2425, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2572, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 21:42:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 9 Jul 2012 23:42:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120710044201.C53832A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1923?compare_to=1921&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1923, Order: 159976, Start Time: 2012-07-10 03:23:48, End Time: 2012-07-10 04:42:05 To: 1921, Order: 159974, Start Time: 2012-07-10 01:37:48, End Time: 2012-07-10 02:55:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (52 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (802 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.69% (10.3673 => 13.5492, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.57% (1.1194 => 1.2489, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 8.29% (0.3473 => 0.3761, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.99% (0.3543 => 0.3826, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.98% (0.3561 => 0.3845, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.96% (0.3543 => 0.3825, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 7.95% (0.3497 => 0.3775, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.94% (0.3516 => 0.3795, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.72% (1.7609 => 1.8969, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/for-in: 7.72% (0.3694 => 0.3979, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.53% (2.2022 => 2.3680, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 7.42% (0.3828 => 0.4112, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.36% (0.3927 => 0.4216, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.31% (0.3886 => 0.4170, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.35% (7.0540 => 7.3612, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.22% (0.4879 => 0.5085, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.22% (0.3177 => 0.3311, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.98% (0.6030 => 0.6270, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.92% (10.4361 => 10.8457, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 3.83% (0.5925 => 0.6152, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.28% (0.7433 => 0.7677, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/oourafft: 3.23% (0.3282 => 0.3388, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 3.17% (0.7326 => 0.7558, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.64% (0.5569 => 0.5716, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.30% (0.8172 => 0.8360, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.90% (5.0018 => 5.0968, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (14.3668 => 14.6374, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.87% (4.9449 => 5.0373, std. dev.: 0.0162) MultiSource/Applications/spiff/spiff: 1.76% (0.7835 => 0.7973, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.74% (8.1363 => 8.2779, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.71% (4.2646 => 4.3377, std. dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (9.4845 => 9.6312, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.39% (1.5415 => 1.5629, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.37% (2.0665 => 2.0948, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.35% (1.1861 => 1.2021, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.32% (2.0273 => 2.0540, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 1.29% (1.5603 => 1.5804, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 1.23% (5.7591 => 5.8300, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 1.23% (3.3354 => 3.3763, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.17% (1.3050 => 1.3203, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7523, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.07% (26.0924 => 26.6320, std. dev.: 0.0284) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.97% (1.5086 => 1.5383, std. dev.: 0.0091) MultiSource/Applications/minisat/minisat: 1.46% (9.1159 => 9.2488, std. dev.: 0.0251) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6886, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.10% (2.9346 => 2.9668, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.05% (1.3045 => 1.3182, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.16% (5.2763 => 3.1573, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.55% (5.3855 => 3.6865, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.05% (5.3526 => 3.6908, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.18% (2.9384 => 2.5511, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: -10.72% (22.1758 => 19.7994, std. dev.: 0.0129) SingleSource/UnitTests/Vector/constpool: -4.86% (54.1659 => 51.5338, std. dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.88% (3.8922 => 3.7800, std. dev.: 0.0165) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.32% (0.8101 => 0.7994, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.35% (1.2373 => 1.1093, std. dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.84% (19.9488 => 18.5837, std. dev.: 0.0486) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.91% (8.1563 => 7.9189, std. dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.58% (32.5116 => 31.6724, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0851, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 22:15:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 00:15:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120710051518.077BB2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1924?compare_to=1919&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1924, Order: 159976, Start Time: 2012-07-10 02:32:10, End Time: 2012-07-10 05:15:22 To: 1919, Order: 159965, Start Time: 2012-07-09 23:20:59, End Time: 2012-07-10 02:04:25 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (42 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (851 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.03% (1.0131 => 1.0235, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.55% (0.2270 => 0.2396, std. dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 9.61% (0.3496 => 0.3832, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.34% (0.3446 => 0.3768, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.32% (0.3465 => 0.3788, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.31% (0.3460 => 0.3782, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.28% (0.3469 => 0.3791, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.24% (0.3442 => 0.3760, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.17% (0.3488 => 0.3808, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.96% (0.3650 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.81% (0.3643 => 0.3964, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.49% (0.3724 => 0.4040, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.41% (0.5826 => 0.6141, std. dev.: 0.0077) SingleSource/UnitTests/ObjC++/property-reference-object: 5.11% (0.5889 => 0.6190, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 3.96% (0.7171 => 0.7455, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.83% (0.2738 => 0.2843, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.68% (1.6211 => 1.6808, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.38% (3.5627 => 3.6832, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 3.30% (0.4029 => 0.4162, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.29% (0.9909 => 1.0235, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.28% (0.4361 => 0.4504, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.16% (0.5026 => 0.5185, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.16% (2.0673 => 2.1327, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.12% (0.5900 => 0.6084, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (0.3625 => 0.3737, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.87% (1.3152 => 1.3529, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 2.79% (4.2109 => 4.3282, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.78% (0.4994 => 0.5133, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.54% (0.3930 => 0.4030, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.44% (0.5000 => 0.5122, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.31% (2.7292 => 2.7923, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.14% (1.9694 => 2.0115, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.00% (1.9966 => 2.0366, std. dev.: 0.0057) MultiSource/Applications/d/make_dparser: 1.98% (1.0781 => 1.0995, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.70% (0.9697 => 0.9862, std. dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 1.66% (23.5202 => 23.9102, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 1.52% (5.5417 => 5.6258, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.51% (4.4195 => 4.4861, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 1.50% (1.8794 => 1.9076, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 1.49% (2.1013 => 2.1327, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.49% (2.1653 => 2.1975, std. dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 1.39% (4.6177 => 4.6818, std. dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 1.34% (1.5932 => 1.6145, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (1.4269 => 1.4419, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.24% (11.9555 => 11.6874, std. dev.: 0.0163) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 22:52:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 00:52:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120710055230.F3E6A2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1925?compare_to=1922&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1925, Order: 159979, Start Time: 2012-07-10 04:38:42, End Time: 2012-07-10 05:52:33 To: 1922, Order: 159976, Start Time: 2012-07-10 02:56:57, End Time: 2012-07-10 04:10:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (126 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (727 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.99% (2.0176 => 2.2998, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 7.80% (0.5818 => 0.6272, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.73% (0.7061 => 0.7607, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.13% (0.5748 => 0.6158, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.81% (1.3693 => 1.4488, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.68% (0.7038 => 0.7438, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.55% (0.4328 => 0.4568, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.39% (0.1986 => 0.2093, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 5.32% (0.2781 => 0.2929, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.15% (0.5265 => 0.5536, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.10% (0.2782 => 0.2924, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.10% (0.3489 => 0.3667, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/random: 5.06% (0.2690 => 0.2826, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.05% (0.7710 => 0.8099, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 4.99% (0.2607 => 0.2737, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.97% (0.4062 => 0.4264, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.96% (0.3022 => 0.3172, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.93% (0.2655 => 0.2786, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.89% (0.2596 => 0.2723, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.87% (0.2628 => 0.2756, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.86% (0.2760 => 0.2894, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.84% (3.9660 => 4.1581, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2726 => 0.2858, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.79% (0.2966 => 0.3108, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.77% (0.2765 => 0.2897, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.77% (1.9828 => 2.0774, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wc: 4.77% (0.2937 => 0.3077, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.73% (0.3149 => 0.3298, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 4.72% (0.3578 => 0.3747, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 4.71% (0.2761 => 0.2891, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.67% (0.2696 => 0.2822, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.64% (0.3580 => 0.3746, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.58% (0.3650 => 0.3817, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 4.55% (0.3646 => 0.3812, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.54% (0.3107 => 0.3248, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 4.53% (0.3601 => 0.3764, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.51% (0.3789 => 0.3960, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 4.47% (0.3914 => 0.4089, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.45% (0.3663 => 0.3826, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 4.42% (0.4003 => 0.4180, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 4.42% (0.3623 => 0.3783, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.39% (0.3485 => 0.3638, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 4.34% (0.3940 => 0.4111, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.26% (0.3192 => 0.3328, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.23% (0.3453 => 0.3599, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.21% (0.6959 => 0.7252, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.18% (0.4016 => 0.4184, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (0.3756 => 0.3911, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.10% (0.3293 => 0.3428, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.07% (0.3534 => 0.3678, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 4.05% (0.2988 => 0.3109, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.99% (0.4390 => 0.4565, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 3.91% (16.6129 => 17.2626, std. dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.83% (0.9199 => 0.9551, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.80% (13.8202 => 14.3459, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3868 => 0.4013, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.67% (13.2842 => 13.7722, std. dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.63% (1.2193 => 1.2635, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.57% (0.2945 => 0.3050, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.37% (0.5577 => 0.5765, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.4563 => 1.5038, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.18% (0.5637 => 0.5816, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.13% (1.3819 => 1.4252, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.08% (1.2292 => 1.2670, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.03% (1.3813 => 1.4231, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.02% (1.3245 => 1.3645, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.98% (1.1061 => 1.1391, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 2.97% (3.8646 => 3.9793, std. dev.: 0.0101) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0906, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.94% (1.1364 => 1.1698, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 2.88% (0.7506 => 0.7722, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.81% (0.4379 => 0.4502, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.80% (1.9270 => 1.9809, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3755 => 0.3859, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.76% (7.2180 => 7.4172, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.62% (4.9865 => 5.1173, std. dev.: 0.0143) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.51% (0.7460 => 0.7647, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.27% (3.6692 => 3.7524, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.24% (0.8310 => 0.8496, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.12% (2.1791 => 2.2252, std. dev.: 0.0069) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (6.5754 => 6.7131, std. dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 2.06% (14.8535 => 15.1595, std. dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.92% (0.8698 => 0.8865, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.92% (16.2614 => 16.5734, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.90% (4.3801 => 4.4633, std. dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.81% (0.6135 => 0.6246, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.76% (4.4433 => 4.5216, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (1.1333 => 1.1526, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.62% (3.1889 => 3.2406, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (1.2749 => 1.2942, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 1.39% (14.5298 => 14.7323, std. dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.31% (2.1007 => 2.1282, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 25.79% (1.8175 => 2.2863, std. dev.: 0.0373) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.18% (2.0200 => 2.1853, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: 8.08% (1.2998 => 1.4048, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7315, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.72% (11.2619 => 11.6810, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4803, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.35% (1.0310 => 1.0552, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.90% (1.4298 => 1.4570, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5342, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.44% (3.6469 => 3.6993, std. dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (1.9290 => 1.9560, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.08% (22.5627 => 20.9648, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.30% (0.8818 => 0.8615, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.59% (0.9108 => 0.8963, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.59% (1.2308 => 1.1128, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.57% (20.3410 => 18.5974, std. dev.: 0.0713) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3151, std. dev.: 0.0110) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.18% (1.9762 => 1.9133, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.82% (8.8259 => 8.5769, std. dev.: 0.0155) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5059, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2570, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.52% (2.5254 => 2.4869, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7953, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1240, std. dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3305 => 7.2245, std. dev.: 0.0238) MultiSource/Applications/spiff/spiff: -1.43% (3.0263 => 2.9831, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2223, std. dev.: 0.0369) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2524, std. dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 9 23:28:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 01:28:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120710062805.826F22A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1926?compare_to=1923&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1926, Order: 159979, Start Time: 2012-07-10 05:09:46, End Time: 2012-07-10 06:28:08 To: 1923, Order: 159976, Start Time: 2012-07-10 03:23:48, End Time: 2012-07-10 04:42:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (794 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.38% (10.3673 => 13.5174, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.98% (1.1194 => 1.2535, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 8.18% (0.3473 => 0.3757, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.08% (1.7609 => 1.9031, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3543 => 0.3823, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.89% (0.3497 => 0.3773, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.87% (0.3543 => 0.3822, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.82% (0.3516 => 0.3791, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 7.75% (0.3561 => 0.3837, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.66% (0.3694 => 0.3977, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.43% (2.2022 => 2.3659, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 7.39% (0.3828 => 0.4111, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.36% (0.3927 => 0.4216, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.28% (0.3886 => 0.4169, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.75% (0.3177 => 0.3328, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.35% (7.0540 => 7.3610, std. dev.: 0.0075) SingleSource/UnitTests/ObjC++/property-reference-object: 4.23% (0.6030 => 0.6285, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.17% (10.4361 => 10.8708, std. dev.: 0.0077) SingleSource/UnitTests/ObjC++/Hello: 4.03% (0.5925 => 0.6164, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 3.82% (0.7433 => 0.7717, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/oourafft: 3.72% (0.3282 => 0.3404, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.26% (0.7326 => 0.7565, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.91% (0.8172 => 0.8410, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 2.77% (0.4289 => 0.4408, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.69% (0.5569 => 0.5719, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.59% (4.9449 => 5.0728, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.51% (5.0018 => 5.1271, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.41% (14.3668 => 14.7124, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 2.30% (0.7835 => 0.8015, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.15% (8.1363 => 8.3114, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5860 => 0.5985, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.06% (9.4845 => 9.6799, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.02% (2.0665 => 2.1082, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.00% (4.2646 => 4.3497, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 1.85% (1.5603 => 1.5891, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.77% (1.1861 => 1.2071, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 1.72% (2.0273 => 2.0622, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 1.68% (3.3354 => 3.3913, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.66% (1.1642 => 1.1835, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 1.64% (5.7591 => 5.8537, std. dev.: 0.0133) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.59% (1.5415 => 1.5660, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.56% (1.3050 => 1.3254, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.47% (3.8723 => 3.9294, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.44% (0.8067 => 0.8183, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.33% (0.9765 => 0.9895, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.33% (17.1811 => 17.4091, std. dev.: 0.0184) MultiSource/Applications/hexxagon/hexxagon: 1.23% (1.2842 => 1.3000, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.19% (1.4186 => 1.4355, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.2024 => 2.2259, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7589, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.22% (26.0924 => 26.6715, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.98% (1.5086 => 1.5385, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 1.41% (2.4116 => 2.4455, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2424, std. dev.: 0.0301) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6902, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 1.14% (2.9346 => 2.9681, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1257, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.02% (5.2763 => 3.1649, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.12% (5.3855 => 3.7095, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.64% (5.3526 => 3.7127, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.10% (2.9384 => 2.5535, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -10.49% (22.1758 => 19.8498, std. dev.: 0.0094) SingleSource/UnitTests/Vector/constpool: -4.92% (54.1659 => 51.5013, std. dev.: 0.0262) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.31% (3.8922 => 3.8021, std. dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.73% (0.0998 => 0.0841, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.74% (1.2373 => 1.1168, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.23% (19.9488 => 18.5063, std. dev.: 0.1076) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (8.1563 => 7.9172, std. dev.: 0.0126) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6839, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: -1.99% (10.2830 => 10.0782, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 00:37:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 02:37:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120710073719.222E82A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1927?compare_to=1925&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1927, Order: 159982, Start Time: 2012-07-10 06:20:08, End Time: 2012-07-10 07:37:22 To: 1925, Order: 159979, Start Time: 2012-07-10 04:38:42, End Time: 2012-07-10 05:52:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (92 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (769 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.25% (2.0176 => 2.3051, std. dev.: 0.0234) SingleSource/UnitTests/ObjC++/property-reference: 8.23% (0.7061 => 0.7642, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.91% (0.5818 => 0.6278, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.69% (0.5748 => 0.6190, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.87% (0.3130 => 0.3345, std. dev.: 0.0083) MultiSource/Applications/lambda-0_1_3/lambda: 6.07% (0.7038 => 0.7465, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 6.00% (1.3693 => 1.4515, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 5.66% (0.4328 => 0.4573, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.54% (0.2781 => 0.2935, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.29% (0.4062 => 0.4277, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.26% (0.2966 => 0.3122, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.18% (0.2782 => 0.2926, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2655 => 0.2790, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 5.07% (0.2760 => 0.2900, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.06% (0.2607 => 0.2739, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.06% (0.2726 => 0.2864, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/trivial-interface: 5.00% (0.3578 => 0.3757, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.98% (0.2690 => 0.2824, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.90% (0.3650 => 0.3829, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: 4.87% (0.4003 => 0.4198, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.86% (0.3580 => 0.3754, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 4.85% (0.3646 => 0.3823, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 4.85% (0.3940 => 0.4131, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 4.83% (0.2937 => 0.3079, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 4.83% (0.3601 => 0.3775, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.83% (0.3789 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.80% (0.3914 => 0.4102, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.78% (0.3663 => 0.3838, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 4.72% (0.3623 => 0.3794, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.71% (0.2761 => 0.2891, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.70% (0.3107 => 0.3253, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.67% (0.2696 => 0.2822, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.57% (0.3192 => 0.3338, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.53% (0.3485 => 0.3643, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.43% (0.4016 => 0.4194, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.43% (0.3453 => 0.3606, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.41% (16.6129 => 17.3451, std. dev.: 0.2787) SingleSource/Benchmarks/Shootout-C++/matrix: 4.32% (0.2988 => 0.3117, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 4.31% (0.3293 => 0.3435, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 4.26% (13.8202 => 14.4089, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/lists1: 4.10% (0.3534 => 0.3679, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.94% (0.4390 => 0.4563, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.3868 => 0.4015, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.53% (0.2945 => 0.3049, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.18% (0.7506 => 0.7745, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 3.18% (1.1061 => 1.1413, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.11% (1.2292 => 1.2674, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.08% (1.9270 => 1.9864, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.95% (4.9865 => 5.1335, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.93% (0.3755 => 0.3865, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.55% (2.1791 => 2.2347, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (6.5754 => 6.7389, std. dev.: 0.0121) MultiSource/Applications/JM/lencod/lencod: 2.36% (14.8535 => 15.2034, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.09% (0.8698 => 0.8880, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 2.02% (16.2614 => 16.5893, std. dev.: 0.0176) MultiSource/Applications/d/make_dparser: 1.88% (3.1889 => 3.2490, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.79% (14.5298 => 14.7906, std. dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 1.63% (1.2749 => 1.2957, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.6283 => 0.6384, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 95.34% (0.1824 => 0.3563, std. dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.96% (1.8175 => 2.2712, std. dev.: 0.0203) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1906, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: 8.36% (1.2998 => 1.4085, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.90% (0.9996 => 1.0786, std. dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0079) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.89% (7.4271 => 7.7163, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6796, std. dev.: 0.0312) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4788, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.05% (1.0310 => 1.0521, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1919, std. dev.: 0.0049) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4559, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.68% (3.6469 => 3.7082, std. dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: 1.52% (8.3908 => 8.5183, std. dev.: 0.0242) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (1.9290 => 1.9568, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.57% (22.5627 => 21.0810, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0184) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.05% (0.0997 => 0.0847, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2308 => 1.1019, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.27% (20.3410 => 18.4558, std. dev.: 0.0684) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.34% (1.3780 => 1.3044, std. dev.: 0.0066) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.69% (2.6470 => 2.5492, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5078, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2555, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9982, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7949, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: -1.46% (3.0263 => 2.9820, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2385, std. dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2578, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 01:17:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 03:17:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120710081708.4FAA82A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1928?compare_to=1926&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1928, Order: 159982, Start Time: 2012-07-10 06:55:49, End Time: 2012-07-10 08:17:11 To: 1926, Order: 159979, Start Time: 2012-07-10 05:09:46, End Time: 2012-07-10 06:28:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (57 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (799 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 22.71% (0.3937 => 0.4831, std. dev.: 0.0330) MultiSource/Benchmarks/PAQ8p/paq8p: 3.92% (13.5174 => 14.0476, std. dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.50% (10.3673 => 14.0476, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: 26.57% (0.3817 => 0.4831, std. dev.: 0.0330) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.66% (1.1194 => 1.2499, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.16% (0.3543 => 0.3832, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.86% (1.7609 => 1.8993, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 7.83% (0.3473 => 0.3745, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.82% (2.2022 => 2.3745, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.62% (0.3543 => 0.3813, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.58% (0.3497 => 0.3762, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3516 => 0.3781, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.47% (0.3561 => 0.3827, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.36% (0.3694 => 0.3966, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.08% (0.3828 => 0.4099, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.03% (0.3886 => 0.4159, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.00% (0.3927 => 0.4202, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.3177 => 0.3342, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.94% (0.2065 => 0.2167, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.82% (0.4879 => 0.5114, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.65% (7.0540 => 7.3821, std. dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: 4.26% (10.4361 => 10.8811, std. dev.: 0.0310) MultiSource/Applications/lambda-0_1_3/lambda: 3.90% (0.7433 => 0.7723, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 3.67% (0.6030 => 0.6251, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.56% (0.5569 => 0.5767, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 3.54% (0.5925 => 0.6135, std. dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 3.36% (0.7326 => 0.7572, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.05% (0.8172 => 0.8421, std. dev.: 0.0091) MultiSource/Applications/spiff/spiff: 2.80% (0.7835 => 0.8054, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.51% (0.4615 => 0.4731, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (14.3668 => 14.7264, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.36% (4.9449 => 5.0617, std. dev.: 0.0085) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.36% (5.0018 => 5.1196, std. dev.: 0.0139) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.17% (4.2646 => 4.3571, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 2.12% (9.4845 => 9.6860, std. dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.11% (8.1363 => 8.3078, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.07% (1.1861 => 1.2106, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.01% (2.0273 => 2.0681, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 1.69% (3.3354 => 3.3917, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 1.60% (1.1840 => 1.2030, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.60% (0.6450 => 0.6553, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 1.51% (5.7591 => 5.8458, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.51% (1.5415 => 1.5647, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.49% (1.3050 => 1.3245, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.46% (2.0665 => 2.0966, std. dev.: 0.0053) MultiSource/Applications/lua/lua: 1.43% (3.8723 => 3.9277, std. dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: 1.25% (17.1811 => 17.3966, std. dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.25% (1.4186 => 1.4363, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.24% (0.9765 => 0.9886, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.89% (1.1145 => 1.1913, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7559, std. dev.: 0.0121) MultiSource/Applications/lua/lua: 2.10% (26.0924 => 26.6408, std. dev.: 0.0330) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.09% (1.5086 => 1.5402, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4463, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2378, std. dev.: 0.0184) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.19% (2.6546 => 2.6863, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 1.03% (2.9346 => 2.9648, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.29% (5.2763 => 3.1505, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.08% (5.3855 => 3.7116, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.62% (5.3526 => 3.7136, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.39% (2.9384 => 2.5450, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -10.36% (22.1758 => 19.8790, std. dev.: 0.0422) SingleSource/UnitTests/Vector/constpool: -5.20% (54.1659 => 51.3509, std. dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.88% (1.2373 => 1.1150, std. dev.: 0.0200) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.70% (19.9488 => 18.6121, std. dev.: 0.0332) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.83% (8.1563 => 7.9256, std. dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6808, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: -1.98% (10.2830 => 10.0794, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 01:28:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 03:28:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120710082845.D6B9B2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1929?compare_to=1924&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1929, Order: 159981, Start Time: 2012-07-10 05:42:58, End Time: 2012-07-10 08:28:49 To: 1924, Order: 159976, Start Time: 2012-07-10 02:32:10, End Time: 2012-07-10 05:15:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (39 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (854 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.23% (2.4171 => 2.4709, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.97% (126.3922 => 130.1508, std. dev.: 1.3246) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 9.01% (0.3496 => 0.3811, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.88% (0.3446 => 0.3752, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.86% (0.3465 => 0.3772, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.79% (0.3460 => 0.3764, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.74% (0.3442 => 0.3743, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.71% (0.3469 => 0.3771, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.69% (0.3488 => 0.3791, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 8.68% (0.3650 => 0.3967, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.26% (0.3643 => 0.3944, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.08% (0.3724 => 0.4025, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.84% (0.5826 => 0.6108, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 4.48% (0.5889 => 0.6153, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.08% (0.5900 => 0.6141, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.41% (1.6211 => 1.6763, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.40% (0.5026 => 0.5197, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 3.33% (0.7171 => 0.7410, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.10% (0.4994 => 0.5149, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.09% (0.3362 => 0.3466, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.06% (3.5627 => 3.6716, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.96% (0.4361 => 0.4490, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 2.93% (0.4029 => 0.4147, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.90% (0.9909 => 1.0196, std. dev.: 0.0075) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.86% (0.5000 => 0.5143, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.83% (1.3152 => 1.3524, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.58% (4.2109 => 4.3194, std. dev.: 0.0102) MultiSource/Applications/d/make_dparser: 2.36% (1.0781 => 1.1035, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.35% (2.0673 => 2.1159, std. dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (2.7292 => 2.7833, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.97% (1.9694 => 2.0081, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.55% (1.9966 => 2.0276, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 1.49% (1.8794 => 1.9074, std. dev.: 0.0088) MultiSource/Applications/hbd/hbd: 1.39% (0.9697 => 0.9832, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.37% (1.5932 => 1.6150, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.26% (4.4195 => 4.4753, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 1.23% (5.5417 => 5.6100, std. dev.: 0.0155) MultiSource/Benchmarks/Bullet/bullet: 1.22% (23.5202 => 23.8081, std. dev.: 0.0278) MultiSource/Applications/lua/lua: 1.20% (1.4269 => 1.4440, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.18% (4.6177 => 4.6722, std. dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 1.17% (2.1653 => 2.1907, std. dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.65% (11.9555 => 11.6389, std. dev.: 0.0135) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 02:19:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 04:19:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120710091917.A2B7B2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1930?compare_to=1927&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1930, Order: 159983, Start Time: 2012-07-10 08:05:35, End Time: 2012-07-10 09:19:21 To: 1927, Order: 159982, Start Time: 2012-07-10 06:20:08, End Time: 2012-07-10 07:37:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (129 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.57% (2.0176 => 2.3116, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 8.51% (0.5818 => 0.6313, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.18% (0.5748 => 0.6218, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.75% (0.7061 => 0.7608, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2781 => 0.2960, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.2966 => 0.3156, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.1986 => 0.2113, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 6.38% (1.3693 => 1.4566, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 6.33% (0.4062 => 0.4319, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 6.31% (0.7038 => 0.7482, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.24% (0.4328 => 0.4598, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.12% (0.3022 => 0.3207, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.05% (0.2760 => 0.2927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.98% (0.2607 => 0.2763, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.98% (0.2726 => 0.2889, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.94% (0.2628 => 0.2784, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.91% (0.2690 => 0.2849, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.77% (0.2721 => 0.2878, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3899 => 0.4123, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 5.73% (0.3578 => 0.3783, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.70% (0.3580 => 0.3784, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.66% (0.2596 => 0.2743, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.65% (1.9828 => 2.0948, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 5.60% (0.4003 => 0.4227, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.59% (0.3650 => 0.3854, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 5.57% (0.3914 => 0.4132, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 5.54% (0.3789 => 0.3999, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 5.54% (0.3663 => 0.3866, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.54% (0.2761 => 0.2914, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.54% (0.7710 => 0.8137, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 5.51% (0.3646 => 0.3847, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.50% (0.3107 => 0.3278, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 5.47% (0.3601 => 0.3798, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.45% (0.2696 => 0.2843, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.45% (0.5265 => 0.5552, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.3489 => 0.3679, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.43% (0.3149 => 0.3320, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.40% (3.9660 => 4.1800, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 5.33% (0.3623 => 0.3816, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 5.28% (0.3940 => 0.4148, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.14% (0.3485 => 0.3664, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.11% (0.3192 => 0.3355, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.08% (0.4016 => 0.4220, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.98% (0.3293 => 0.3457, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (0.3756 => 0.3934, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.74% (0.4390 => 0.4598, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 4.69% (16.6129 => 17.3926, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.63% (0.6959 => 0.7281, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 4.49% (13.8202 => 14.4404, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/moments: 4.47% (0.3868 => 0.4041, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.2945 => 0.3072, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.25% (0.9199 => 0.9590, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.07% (0.2925 => 0.3044, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.04% (1.2193 => 1.2686, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.99% (13.2842 => 13.8136, std. dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.86% (0.5577 => 0.5792, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.73% (1.2292 => 1.2751, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.70% (0.3246 => 0.3366, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.68% (0.3755 => 0.3893, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.62% (0.5637 => 0.5841, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 3.60% (0.7506 => 0.7776, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.58% (1.3245 => 1.3719, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.56% (1.4563 => 1.5081, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 3.46% (3.8646 => 3.9983, std. dev.: 0.0143) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.46% (1.1364 => 1.1757, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.42% (1.1061 => 1.1439, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.39% (1.3813 => 1.4281, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.39% (1.3819 => 1.4287, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.38% (0.4379 => 0.4527, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 3.35% (1.9270 => 1.9915, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.34% (4.9865 => 5.1532, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 3.34% (1.0594 => 1.0948, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.18% (7.2180 => 7.4475, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.08% (0.7460 => 0.7690, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.76% (3.6692 => 3.7703, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.64% (0.8698 => 0.8928, std. dev.: 0.0048) MultiSource/Applications/siod/siod: 2.61% (2.1791 => 2.2359, std. dev.: 0.0088) MultiSource/Applications/JM/ldecod/ldecod: 2.58% (6.5754 => 6.7453, std. dev.: 0.0143) MultiSource/Applications/JM/lencod/lencod: 2.55% (14.8535 => 15.2329, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.45% (4.3801 => 4.4876, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.25% (0.6135 => 0.6273, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.25% (4.4433 => 4.5431, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.17% (1.1333 => 1.1579, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.16% (16.2614 => 16.6124, std. dev.: 0.0137) MultiSource/Applications/d/make_dparser: 2.12% (3.1889 => 3.2566, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.95% (2.1007 => 2.1417, std. dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.93% (0.6283 => 0.6404, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.86% (14.5298 => 14.8002, std. dev.: 0.0154) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2574, std. dev.: 0.0522) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1909, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.90% (0.9996 => 1.0786, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.44% (1.2998 => 1.3965, std. dev.: 0.0080) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.00% (7.4271 => 7.7243, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6780, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.86% (1.4298 => 1.4564, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5343, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.58% (3.6469 => 3.7045, std. dev.: 0.0060) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.5627 => 21.1414, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.05% (0.8818 => 0.8637, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.14% (0.9108 => 0.9004, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.18% (1.2308 => 1.1055, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.52% (20.3410 => 18.6075, std. dev.: 0.0233) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std. dev.: 0.0169) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.18% (1.9762 => 1.9133, std. dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5966, std. dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/dry: -2.53% (2.5089 => 2.4455, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4867 => 0.4748, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5134, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2549, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.55% (26.5159 => 26.1037, std. dev.: 0.0238) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7947, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: -1.43% (3.0263 => 2.9831, std. dev.: 0.0109) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2163, std. dev.: 0.0323) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2418, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2546, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 03:03:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 05:03:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120710100354.13DAD2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1931?compare_to=1928&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1931, Order: 159987, Start Time: 2012-07-10 08:45:13, End Time: 2012-07-10 10:03:55 To: 1928, Order: 159982, Start Time: 2012-07-10 06:55:49, End Time: 2012-07-10 08:17:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.00% (10.3673 => 14.0997, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.75% (1.1194 => 1.2509, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.61% (2.2022 => 2.3918, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 7.98% (0.3473 => 0.3750, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.95% (1.7609 => 1.9009, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3516 => 0.3789, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.75% (0.3497 => 0.3768, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.73% (0.3543 => 0.3817, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.73% (0.3543 => 0.3817, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 7.64% (0.3561 => 0.3833, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.50% (0.3694 => 0.3971, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: 7.41% (0.3927 => 0.4218, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.39% (0.3828 => 0.4111, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.23% (0.3886 => 0.4167, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (0.1622 => 0.1733, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.98% (0.4879 => 0.5122, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.93% (7.0540 => 7.4021, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.82% (0.3177 => 0.3330, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 4.47% (10.4361 => 10.9025, std. dev.: 0.0083) MultiSource/Applications/lambda-0_1_3/lambda: 3.93% (0.7433 => 0.7725, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.84% (0.5569 => 0.5783, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference-object: 3.78% (0.6030 => 0.6258, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.73% (0.2758 => 0.2861, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 3.73% (0.5925 => 0.6146, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.47% (0.7326 => 0.7580, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.89% (0.8172 => 0.8408, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.70% (4.9449 => 5.0783, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.68% (5.0018 => 5.1360, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.64% (14.3668 => 14.7455, std. dev.: 0.0106) MultiSource/Applications/spiff/spiff: 2.60% (0.7835 => 0.8039, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.54% (0.4615 => 0.4732, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.45% (1.1642 => 1.1927, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 2.28% (9.4845 => 9.7011, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.19% (8.1363 => 8.3148, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.19% (4.2646 => 4.3580, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.92% (1.5603 => 1.5902, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.91% (1.1861 => 1.2088, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.91% (2.0273 => 2.0660, std. dev.: 0.0100) MultiSource/Applications/d/make_dparser: 1.86% (3.3354 => 3.3974, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 1.68% (5.7591 => 5.8561, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.65% (1.3050 => 1.3265, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.52% (3.8723 => 3.9311, std. dev.: 0.0089) MultiSource/Applications/minisat/minisat: 1.41% (0.7115 => 0.7215, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.36% (1.4186 => 1.4379, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.32% (2.0665 => 2.0938, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.28% (0.9765 => 0.9890, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.24% (17.1811 => 17.3949, std. dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.19% (2.2024 => 2.2285, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.84% (1.1145 => 1.1907, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7569, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.01% (26.0924 => 26.6161, std. dev.: 0.0175) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (1.5086 => 1.5374, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.66% (9.1159 => 9.2670, std. dev.: 0.0360) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6898, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.13% (2.9346 => 2.9679, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1613, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.87% (5.3855 => 3.7229, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.42% (5.3526 => 3.7242, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.30% (2.9384 => 2.5475, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -10.38% (22.1758 => 19.8734, std. dev.: 0.0110) SingleSource/UnitTests/Vector/constpool: -5.26% (54.1659 => 51.3185, std. dev.: 0.0481) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.18% (3.8922 => 3.8074, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2373 => 1.1109, std. dev.: 0.0331) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.14% (19.9488 => 18.5242, std. dev.: 0.0326) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9178, std. dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6874, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0858, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.05% (1.3677 => 1.3533, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 04:00:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 06:00:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120710110029.427D42A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1932?compare_to=1930&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1932, Order: 159987, Start Time: 2012-07-10 09:46:59, End Time: 2012-07-10 11:00:34 To: 1930, Order: 159983, Start Time: 2012-07-10 08:05:35, End Time: 2012-07-10 09:19:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (130 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (723 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.65% (2.0176 => 2.3132, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.35% (0.5818 => 0.6304, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.09% (0.5748 => 0.6213, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.68% (0.7061 => 0.7603, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.35% (0.4328 => 0.4603, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.27% (1.3693 => 1.4551, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.22% (0.2781 => 0.2954, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.21% (0.7038 => 0.7475, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.09% (0.1986 => 0.2107, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.01% (0.2760 => 0.2926, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.01% (0.4062 => 0.4306, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.99% (0.3022 => 0.3203, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.93% (0.2966 => 0.3142, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.87% (0.2726 => 0.2886, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.86% (0.2782 => 0.2945, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.83% (0.2607 => 0.2759, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.76% (0.2690 => 0.2845, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.73% (0.2721 => 0.2877, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 5.70% (0.3578 => 0.3782, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.59% (0.3650 => 0.3854, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 5.58% (0.2937 => 0.3101, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.57% (1.9828 => 2.0932, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 5.56% (0.3149 => 0.3324, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.53% (0.3601 => 0.3800, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.51% (0.5265 => 0.5555, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2765 => 0.2917, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2596 => 0.2738, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.45% (0.2696 => 0.2843, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.3489 => 0.3679, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 5.43% (0.3646 => 0.3844, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.42% (0.4003 => 0.4220, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.3107 => 0.3275, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.39% (0.3914 => 0.4125, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.38% (0.3789 => 0.3993, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.38% (0.3663 => 0.3860, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.37% (3.9660 => 4.1790, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.36% (0.3580 => 0.3772, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.36% (0.7710 => 0.8123, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 5.24% (0.3623 => 0.3813, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.22% (0.2988 => 0.3144, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.20% (0.3940 => 0.4145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.05% (0.3485 => 0.3661, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.98% (0.3453 => 0.3625, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.88% (0.4016 => 0.4212, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.73% (0.3534 => 0.3701, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.66% (0.6959 => 0.7283, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 4.65% (16.6129 => 17.3848, std. dev.: 0.0166) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.56% (0.4390 => 0.4590, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.45% (0.3868 => 0.4040, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.38% (13.8202 => 14.4253, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.36% (0.9199 => 0.9600, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.2945 => 0.3072, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.5577 => 0.5811, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.04% (1.2193 => 1.2685, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.03% (13.2842 => 13.8199, std. dev.: 0.0125) MultiSource/Benchmarks/McCat/09-vor/vor: 4.00% (0.2925 => 0.3042, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.64% (1.2292 => 1.2739, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.56% (1.4563 => 1.5082, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.51% (0.5637 => 0.5835, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.45% (1.3245 => 1.3702, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.44% (1.1364 => 1.1755, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 3.43% (3.8646 => 3.9971, std. dev.: 0.0054) MultiSource/Applications/spiff/spiff: 3.42% (0.7506 => 0.7763, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.39% (0.3246 => 0.3356, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.38% (1.3819 => 1.4286, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.38% (1.0594 => 1.0952, std. dev.: 0.0107) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.37% (1.3813 => 1.4279, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.36% (1.1061 => 1.1433, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.36% (0.4379 => 0.4526, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.34% (4.9865 => 5.1529, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.32% (1.9270 => 1.9909, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.12% (7.2180 => 7.4431, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.03% (0.7460 => 0.7686, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.73% (4.3801 => 4.4995, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.70% (3.6692 => 3.7684, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8310 => 0.8528, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.58% (6.5754 => 6.7453, std. dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 2.57% (14.8535 => 15.2357, std. dev.: 0.0121) MultiSource/Applications/siod/siod: 2.53% (2.1791 => 2.2342, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.47% (0.8698 => 0.8913, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.40% (0.4791 => 0.4906, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.26% (4.4433 => 4.5439, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.17% (1.1333 => 1.1579, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.12% (16.2614 => 16.6060, std. dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.12% (0.6135 => 0.6265, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.08% (3.1889 => 3.2553, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.89% (0.6283 => 0.6402, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.87% (14.5298 => 14.8022, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (2.1007 => 2.1397, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.2749 => 1.2969, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2704, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.36% (2.0200 => 2.1888, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: 7.55% (1.2998 => 1.3979, std. dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.97% (7.4271 => 7.7218, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9188, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6789, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8291, std. dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0310 => 1.0561, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1893, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4556, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5089 => 1.5357, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.59% (3.6469 => 3.7048, std. dev.: 0.0068) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1961, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.39% (22.5627 => 21.1220, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.12% (0.8818 => 0.8631, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.19% (0.9108 => 0.9000, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.23% (1.2308 => 1.1049, std. dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.76% (20.3410 => 18.5595, std. dev.: 0.0428) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.19% (1.3780 => 1.3065, std. dev.: 0.0181) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.67% (2.6470 => 2.5498, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.27% (1.9762 => 1.9115, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6050, std. dev.: 0.0156) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4463, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5035, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9980, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.52% (6.3560 => 6.2596, std. dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7961, std. dev.: 0.0022) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1360, std. dev.: 0.0288) MultiSource/Applications/spiff/spiff: -1.42% (3.0263 => 2.9832, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: -1.35% (9.3358 => 9.2099, std. dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.26% (0.9692 => 0.9570, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2396, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2512, std. dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 04:39:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 06:39:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120710113941.C7F312A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1933?compare_to=1929&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1933, Order: 159987, Start Time: 2012-07-10 08:56:37, End Time: 2012-07-10 11:39:47 To: 1929, Order: 159981, Start Time: 2012-07-10 05:42:58, End Time: 2012-07-10 08:28:49 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (41 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (852 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 9.21% (0.3496 => 0.3818, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.02% (0.3446 => 0.3757, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.00% (0.3465 => 0.3777, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.96% (0.3460 => 0.3770, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.95% (0.3442 => 0.3750, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.92% (0.3488 => 0.3799, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 8.88% (0.3469 => 0.3777, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.66% (0.3650 => 0.3966, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.48% (0.3643 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.24% (0.3724 => 0.4031, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 5.06% (0.5826 => 0.6121, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.77% (0.5889 => 0.6170, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.67% (0.7171 => 0.7434, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.56% (0.5900 => 0.6110, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (1.6211 => 1.6781, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.26% (3.5627 => 3.6789, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.16% (0.4361 => 0.4499, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 3.03% (0.4029 => 0.4151, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.95% (2.0673 => 2.1282, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.82% (0.4994 => 0.5135, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.81% (0.5026 => 0.5167, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: 2.77% (4.2109 => 4.3274, std. dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.70% (0.3930 => 0.4036, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.62% (1.3152 => 1.3497, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.52% (0.5000 => 0.5126, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 2.20% (1.0781 => 1.1018, std. dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.17% (2.7292 => 2.7883, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.14% (1.9694 => 2.0116, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.93% (1.9966 => 2.0352, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.83% (0.9697 => 0.9874, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.70% (4.4195 => 4.4948, std. dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: 1.55% (1.8794 => 1.9086, std. dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: 1.55% (2.1653 => 2.1989, std. dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 1.46% (4.6177 => 4.6853, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 1.46% (2.1013 => 2.1320, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 1.35% (23.5202 => 23.8369, std. dev.: 0.0203) MultiSource/Applications/treecc/treecc: 1.28% (0.7875 => 0.7976, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.26% (5.5417 => 5.6114, std. dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 1.20% (1.5932 => 1.6123, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.07% (1.4269 => 1.4422, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.42% (0.2122 => 0.2237, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.16% (11.9555 => 11.6973, std. dev.: 0.0224) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 07:41:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 09:41:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120710144138.B21DA2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1934?compare_to=1932&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1934, Order: 159989, Start Time: 2012-07-10 13:28:02, End Time: 2012-07-10 14:41:42 To: 1932, Order: 159987, Start Time: 2012-07-10 09:46:59, End Time: 2012-07-10 11:00:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (131 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (721 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.60% (2.0176 => 2.3121, std. dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference-object: 8.37% (0.5818 => 0.6305, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.21% (0.5748 => 0.6220, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 7.59% (0.7061 => 0.7597, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 6.36% (0.2781 => 0.2958, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 6.30% (1.3693 => 1.4555, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.27% (0.7038 => 0.7479, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.19% (0.1986 => 0.2109, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 6.06% (0.4062 => 0.4308, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.01% (0.2760 => 0.2926, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.99% (0.3022 => 0.3203, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.93% (0.2966 => 0.3142, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.93% (0.2782 => 0.2947, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.76% (0.2655 => 0.2808, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2726 => 0.2883, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.73% (0.2721 => 0.2877, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.70% (0.3578 => 0.3782, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.59% (0.3489 => 0.3684, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.56% (0.3650 => 0.3853, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 5.49% (0.3914 => 0.4129, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.49% (0.3789 => 0.3997, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.49% (0.5265 => 0.5554, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.48% (1.9828 => 2.0915, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.3107 => 0.3277, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2596 => 0.2738, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2761 => 0.2912, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.46% (0.3899 => 0.4112, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 5.46% (0.3646 => 0.3845, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.45% (0.4003 => 0.4221, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 5.44% (0.3601 => 0.3797, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.43% (0.3149 => 0.3320, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.42% (0.3580 => 0.3774, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.38% (0.7710 => 0.8125, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 5.38% (0.3663 => 0.3860, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.33% (0.3623 => 0.3816, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.31% (3.9660 => 4.1765, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/property: 5.28% (0.3940 => 0.4148, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.11% (0.3192 => 0.3355, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.09% (0.2988 => 0.3140, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.98% (0.3453 => 0.3625, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.96% (0.3485 => 0.3658, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.93% (0.4016 => 0.4214, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.77% (0.3293 => 0.3450, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.74% (0.4390 => 0.4598, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.70% (16.6129 => 17.3929, std. dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3756 => 0.3929, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.54% (0.6959 => 0.7275, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.52% (0.2945 => 0.3078, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 4.36% (13.8202 => 14.4223, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/moments: 4.34% (0.3868 => 0.4036, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.14% (0.2925 => 0.3046, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.09% (0.9199 => 0.9575, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.02% (13.2842 => 13.8186, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.98% (1.2193 => 1.2678, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.5577 => 0.5793, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.67% (1.2292 => 1.2743, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.62% (1.4563 => 1.5090, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.58% (0.7506 => 0.7775, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.57% (0.5637 => 0.5838, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.54% (0.3246 => 0.3361, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3755 => 0.3887, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.48% (3.8646 => 3.9990, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.46% (1.3813 => 1.4291, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.45% (0.4379 => 0.4530, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.40% (1.3245 => 1.3695, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.38% (1.1364 => 1.1748, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.0594 => 1.0951, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.35% (1.3819 => 1.4282, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (4.9865 => 5.1506, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 3.25% (1.1061 => 1.1421, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 3.25% (1.9270 => 1.9896, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.15% (7.2180 => 7.4452, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.95% (0.7460 => 0.7680, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.68% (3.6692 => 3.7676, std. dev.: 0.0054) MultiSource/Applications/siod/siod: 2.61% (2.1791 => 2.2360, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 2.52% (6.5754 => 6.7410, std. dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 2.50% (14.8535 => 15.2246, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.41% (4.3801 => 4.4857, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.40% (0.4791 => 0.4906, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.37% (0.8698 => 0.8904, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.27% (4.4433 => 4.5441, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.11% (1.1333 => 1.1572, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.05% (16.2614 => 16.5945, std. dev.: 0.0200) MultiSource/Applications/d/make_dparser: 2.04% (3.1889 => 3.2538, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.96% (0.6135 => 0.6255, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.88% (0.6283 => 0.6401, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.82% (14.5298 => 14.7942, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.75% (2.1007 => 2.1375, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.66% (1.2749 => 1.2961, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/fbench: 25.33% (1.8175 => 2.2778, std. dev.: 0.0447) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1929, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: 6.54% (1.2998 => 1.3848, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7298, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6780, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4787, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1909, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4546, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (3.6469 => 3.7086, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5336, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.39% (1.9290 => 1.9558, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.43% (0.4657 => 0.3892, std. dev.: 0.0112) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.40% (22.5627 => 21.1184, std. dev.: 0.0208) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.06% (0.8818 => 0.8636, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.23% (0.9108 => 0.8996, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.19% (1.2308 => 1.1054, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.84% (20.3410 => 18.5438, std. dev.: 0.0522) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0088) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.19% (1.9762 => 1.9132, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.40% (8.8259 => 8.6139, std. dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5101, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9980, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2571, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7948, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4889, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: -1.38% (3.0263 => 2.9844, std. dev.: 0.0010) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1559, std. dev.: 0.0331) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2226, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2442, std. dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2544, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 07:46:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 09:46:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120710144617.0C1A22A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1935?compare_to=1931&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1935, Order: 159989, Start Time: 2012-07-10 13:27:57, End Time: 2012-07-10 14:46:21 To: 1931, Order: 159987, Start Time: 2012-07-10 08:45:13, End Time: 2012-07-10 10:03:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (63 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (792 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.18% (78.2190 => 79.9207, std. dev.: 0.5514) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.00% (55.4384 => 56.5464, std. dev.: 0.1321) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.04% (10.3673 => 14.1036, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.74% (1.1194 => 1.2508, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 8.59% (0.1432 => 0.1555, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.58% (2.2022 => 2.3911, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.52% (0.3543 => 0.3845, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.12% (0.3473 => 0.3755, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.96% (1.7609 => 1.9011, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.91% (0.3516 => 0.3794, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.81% (0.3497 => 0.3770, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 7.76% (0.3543 => 0.3818, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.72% (0.3561 => 0.3836, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.53% (0.3694 => 0.3972, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.47% (0.3828 => 0.4114, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.38% (0.3927 => 0.4217, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.26% (0.3886 => 0.4168, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (0.1622 => 0.1733, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.45% (0.4879 => 0.5145, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.03% (7.0540 => 7.4086, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.97% (0.3177 => 0.3335, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 4.60% (0.3282 => 0.3433, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.44% (10.4361 => 10.8993, std. dev.: 0.0164) MultiSource/Applications/lambda-0_1_3/lambda: 3.89% (0.7433 => 0.7722, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference-object: 3.80% (0.6030 => 0.6259, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.78% (0.5925 => 0.6149, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.61% (0.8172 => 0.8467, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 3.56% (0.7326 => 0.7587, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.24% (0.3121 => 0.3222, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (4.9449 => 5.0839, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.80% (0.5569 => 0.5725, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.62% (0.4615 => 0.4736, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.62% (14.3668 => 14.7429, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.59% (5.0018 => 5.1314, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 2.48% (9.4845 => 9.7198, std. dev.: 0.0062) MultiSource/Applications/spiff/spiff: 2.32% (0.7835 => 0.8017, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.27% (0.5860 => 0.5993, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.21% (8.1363 => 8.3161, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.17% (4.2646 => 4.3571, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.02% (1.5415 => 1.5727, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.89% (1.1861 => 1.2085, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 1.86% (2.0273 => 2.0650, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.86% (0.8067 => 0.8217, std. dev.: 0.0040) MultiSource/Applications/hbd/hbd: 1.81% (1.5603 => 1.5885, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 1.76% (3.3354 => 3.3942, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 1.75% (1.1642 => 1.1846, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 1.72% (5.7591 => 5.8583, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 1.53% (3.8723 => 3.9317, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.48% (1.3050 => 1.3243, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.36% (2.0665 => 2.0946, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.34% (0.9765 => 0.9896, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.31% (1.4186 => 1.4372, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 1.27% (17.1811 => 17.3990, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.13% (2.2024 => 2.2272, std. dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.10% (2.6778 => 2.9750, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7556, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.28% (26.0924 => 26.6862, std. dev.: 0.0089) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (1.5086 => 1.5362, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4462, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.41% (9.1159 => 9.2441, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6885, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.13% (2.9346 => 2.9678, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.09% (5.2763 => 3.1610, std. dev.: 0.0118) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.83% (5.3855 => 3.7249, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.39% (5.3526 => 3.7260, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.36% (2.9384 => 2.5457, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.53% (22.1758 => 19.8412, std. dev.: 0.0196) SingleSource/UnitTests/Vector/constpool: -5.28% (54.1659 => 51.3065, std. dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.22% (3.8922 => 3.8057, std. dev.: 0.0157) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.33% (0.0998 => 0.0855, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2373 => 1.1057, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.01% (19.9488 => 18.5499, std. dev.: 0.0553) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.85% (8.1563 => 7.9239, std. dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6925, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 09:11:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 11:11:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120710161104.451682A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1936?compare_to=1933&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1936, Order: 159989, Start Time: 2012-07-10 13:27:46, End Time: 2012-07-10 16:11:09 To: 1933, Order: 159987, Start Time: 2012-07-10 08:56:37, End Time: 2012-07-10 11:39:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (40 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (853 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 4.68% (0.2287 => 0.2394, std. dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 9.32% (0.3496 => 0.3822, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.21% (0.3465 => 0.3784, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.08% (0.3446 => 0.3759, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.05% (0.3469 => 0.3783, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.95% (0.3442 => 0.3750, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.90% (0.3460 => 0.3768, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.89% (0.3488 => 0.3798, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.66% (0.3650 => 0.3966, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.48% (0.3643 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.30% (0.3724 => 0.4033, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 5.17% (0.5826 => 0.6127, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 4.86% (0.5889 => 0.6175, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.67% (0.7171 => 0.7434, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.64% (0.5900 => 0.6115, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (1.6211 => 1.6785, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.35% (3.5627 => 3.6820, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (0.4361 => 0.4496, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.01% (2.0673 => 2.1295, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 3.00% (0.4029 => 0.4150, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.98% (0.5026 => 0.5176, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 2.94% (0.9909 => 1.0200, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.88% (0.4994 => 0.5138, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.84% (1.3152 => 1.3526, std. dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 2.83% (4.2109 => 4.3300, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.75% (0.3930 => 0.4038, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.68% (0.5000 => 0.5134, std. dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.29% (2.7292 => 2.7918, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 2.21% (1.0781 => 1.1019, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.14% (1.9694 => 2.0115, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.91% (1.9966 => 2.0348, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 1.90% (0.9697 => 0.9881, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.74% (4.4195 => 4.4965, std. dev.: 0.0110) MultiSource/Benchmarks/MallocBench/gs/gs: 1.66% (1.8794 => 1.9106, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 1.52% (2.1653 => 2.1982, std. dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 1.49% (4.6177 => 4.6865, std. dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: 1.47% (23.5202 => 23.8655, std. dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: 1.45% (2.1013 => 2.1318, std. dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: 1.30% (5.5417 => 5.6139, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 1.22% (1.5932 => 1.6127, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.18% (1.4269 => 1.4437, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.02% (11.9555 => 11.7135, std. dev.: 0.0131) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 09:23:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 11:23:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120710162307.CB1CD2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1937?compare_to=1934&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1937, Order: 159992, Start Time: 2012-07-10 15:09:29, End Time: 2012-07-10 16:23:12 To: 1934, Order: 159989, Start Time: 2012-07-10 13:28:02, End Time: 2012-07-10 14:41:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (130 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (723 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.57% (54.5110 => 56.4546, std. dev.: 0.0974) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.47% (2.0176 => 2.3096, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.60% (0.5818 => 0.6260, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.34% (0.5748 => 0.6170, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.84% (0.7061 => 0.7544, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 6.25% (1.3693 => 1.4549, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 6.07% (0.7038 => 0.7465, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 6.03% (0.4328 => 0.4589, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.89% (0.1986 => 0.2103, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 5.65% (0.2781 => 0.2938, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.62% (0.2596 => 0.2742, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.2721 => 0.2872, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.43% (0.3022 => 0.3186, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.42% (0.4062 => 0.4282, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.5265 => 0.5550, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.33% (0.2607 => 0.2746, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.32% (0.2782 => 0.2930, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.31% (0.2655 => 0.2796, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.30% (0.3489 => 0.3674, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.28% (0.7710 => 0.8117, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 5.24% (0.2690 => 0.2831, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.23% (3.9660 => 4.1734, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/except: 5.22% (0.2760 => 0.2904, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.21% (0.2628 => 0.2765, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.21% (0.2726 => 0.2868, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.15% (1.9828 => 2.0850, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.2937 => 0.3088, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.09% (0.2966 => 0.3117, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.00% (0.3580 => 0.3759, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.00% (0.2761 => 0.2899, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.93% (0.2696 => 0.2829, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.90% (0.4390 => 0.4605, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 4.86% (0.3107 => 0.3258, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.76% (0.3149 => 0.3299, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 4.70% (0.3578 => 0.3746, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.68% (0.3650 => 0.3821, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 4.62% (0.3914 => 0.4095, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.62% (0.3485 => 0.3646, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.60% (0.6959 => 0.7279, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 4.57% (0.4003 => 0.4186, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.3453 => 0.3610, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 4.51% (0.3192 => 0.3336, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.51% (0.4016 => 0.4197, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 4.49% (0.3789 => 0.3959, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 4.47% (0.3601 => 0.3762, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 4.47% (0.3646 => 0.3809, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.42% (0.3663 => 0.3825, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.38% (0.2988 => 0.3119, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.37% (0.3293 => 0.3437, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 4.37% (0.3940 => 0.4112, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.37% (16.6129 => 17.3381, std. dev.: 0.0206) SingleSource/UnitTests/ObjC/exceptions-3: 4.36% (0.3623 => 0.3781, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.33% (0.3534 => 0.3687, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.31% (0.3756 => 0.3918, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.25% (0.9199 => 0.9590, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.20% (13.8202 => 14.4007, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.10% (1.2193 => 1.2693, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.98% (0.3868 => 0.4022, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.94% (13.2842 => 13.8076, std. dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.2945 => 0.3060, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.84% (0.5577 => 0.5791, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.76% (0.2925 => 0.3035, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.69% (0.5637 => 0.5845, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.58% (1.4563 => 1.5085, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.56% (1.3245 => 1.3716, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.51% (0.3246 => 0.3360, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.50% (1.0594 => 1.0965, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.44% (1.1364 => 1.1755, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.36% (3.8646 => 3.9944, std. dev.: 0.0052) MultiSource/Applications/spiff/spiff: 3.34% (0.7506 => 0.7757, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 3.32% (1.2292 => 1.2700, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 3.26% (1.1061 => 1.1422, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 3.22% (1.9270 => 1.9891, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.18% (1.3813 => 1.4252, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3755 => 0.3873, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.10% (4.9865 => 5.1413, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.08% (1.3819 => 1.4244, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.06% (7.2180 => 7.4390, std. dev.: 0.0090) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.99% (0.7460 => 0.7683, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 2.90% (0.8310 => 0.8551, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (3.6692 => 3.7712, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 2.58% (0.4113 => 0.4219, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.57% (14.8535 => 15.2353, std. dev.: 0.0162) MultiSource/Applications/JM/ldecod/ldecod: 2.57% (6.5754 => 6.7444, std. dev.: 0.0112) MultiSource/Applications/siod/siod: 2.49% (2.1791 => 2.2334, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.48% (0.4791 => 0.4910, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.30% (0.8698 => 0.8898, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.28% (4.3801 => 4.4801, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.27% (4.4433 => 4.5442, std. dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.25% (0.6135 => 0.6273, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.17% (16.2614 => 16.6137, std. dev.: 0.0256) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.10% (1.1333 => 1.1571, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.01% (0.6283 => 0.6409, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.88% (3.1889 => 3.2489, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 1.84% (1.2749 => 1.2983, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (2.1007 => 2.1381, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 1.78% (14.5298 => 14.7878, std. dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.44% (1.8175 => 2.2981, std. dev.: 0.0344) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.61% (2.0200 => 2.1940, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: 7.58% (1.2998 => 1.3983, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.17% (7.4271 => 7.7367, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.22% (12.0921 => 12.4810, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5089 => 1.5356, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (3.6469 => 3.7093, std. dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.52% (22.5627 => 21.0909, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.08% (0.3511 => 0.3403, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.92% (0.8818 => 0.8649, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2308 => 1.1003, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.88% (20.3410 => 18.5344, std. dev.: 0.0247) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.44% (1.3780 => 1.3168, std. dev.: 0.0106) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9128, std. dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5935, std. dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/dry: -2.52% (2.5089 => 2.4458, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5059, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2548, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7911, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1419, std. dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -1.36% (3.0263 => 2.9852, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2154, std. dev.: 0.0181) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2433, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2535, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 09:32:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 11:32:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120710163206.E7D612A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1938?compare_to=1935&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1938, Order: 159992, Start Time: 2012-07-10 15:14:00, End Time: 2012-07-10 16:32:12 To: 1935, Order: 159989, Start Time: 2012-07-10 13:27:57, End Time: 2012-07-10 14:46:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (64 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (791 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.33% (10.8993 => 11.0446, std. dev.: 0.0141) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.00% (14.1036 => 13.5392, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.60% (10.3673 => 13.5392, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2484, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.34% (2.2022 => 2.3859, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops: 8.24% (0.1432 => 0.1550, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.91% (1.7609 => 1.9001, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.37% (0.3473 => 0.3729, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.06% (0.3543 => 0.3793, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 7.01% (0.3497 => 0.3742, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.00% (0.3543 => 0.3791, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.99% (0.3561 => 0.3810, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.97% (0.3516 => 0.3761, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.85% (0.3927 => 0.4196, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 6.79% (0.3694 => 0.3945, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.66% (0.3828 => 0.4083, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.61% (0.3886 => 0.4143, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.83% (10.4361 => 11.0446, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/oourafft: 4.75% (0.3282 => 0.3438, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.61% (0.4879 => 0.5104, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.34% (0.3177 => 0.3315, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.28% (7.0540 => 7.3559, std. dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: 4.05% (0.7433 => 0.7734, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 3.70% (0.6030 => 0.6253, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.59% (0.5925 => 0.6138, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 3.51% (0.7326 => 0.7583, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.57% (0.5569 => 0.5712, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.49% (0.4615 => 0.4730, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.43% (4.9449 => 5.0651, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (14.3668 => 14.7094, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.36% (0.8172 => 0.8365, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.36% (5.0018 => 5.1199, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.21% (9.4845 => 9.6938, std. dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.20% (0.4636 => 0.4738, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.17% (0.7835 => 0.8005, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5860 => 0.5982, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 2.02% (1.5603 => 1.5918, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.94% (8.1363 => 8.2944, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.89% (4.2646 => 4.3452, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.80% (2.0273 => 2.0638, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.80% (2.0665 => 2.1037, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.75% (0.8067 => 0.8208, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.73% (1.1861 => 1.2066, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.69% (1.1642 => 1.1839, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 1.62% (5.7591 => 5.8524, std. dev.: 0.0112) MultiSource/Applications/lua/lua: 1.59% (3.8723 => 3.9339, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.58% (1.5415 => 1.5658, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 1.57% (3.3354 => 3.3879, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 1.55% (0.6456 => 0.6556, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.42% (1.3050 => 1.3235, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.29% (17.1811 => 17.4032, std. dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.17% (0.9765 => 0.9879, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.16% (1.4186 => 1.4350, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.06% (1.2842 => 1.2978, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.04% (2.2024 => 2.2253, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7503, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.15% (26.0924 => 26.6541, std. dev.: 0.0192) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (1.5086 => 1.5370, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6893, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2226, std. dev.: 0.0159) MultiSource/Applications/spiff/spiff: 1.12% (2.9346 => 2.9674, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1257, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.18% (5.2763 => 3.1563, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.22% (5.3855 => 3.7043, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.79% (5.3526 => 3.7047, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.29% (2.9384 => 2.5480, std. dev.: 0.0149) MultiSource/Applications/ClamAV/clamscan: -10.64% (22.1758 => 19.8158, std. dev.: 0.0212) SingleSource/UnitTests/Vector/constpool: -5.29% (54.1659 => 51.3024, std. dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.22% (3.8922 => 3.8056, std. dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.70% (1.2373 => 1.1049, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.89% (19.9488 => 18.5740, std. dev.: 0.0264) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9181, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6807, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0839, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 11:04:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 13:04:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120710180434.8FAC12A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1939?compare_to=1937&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1939, Order: 159993, Start Time: 2012-07-10 16:50:52, End Time: 2012-07-10 18:04:38 To: 1937, Order: 159992, Start Time: 2012-07-10 15:09:29, End Time: 2012-07-10 16:23:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (130 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.69% (78.1783 => 80.2783, std. dev.: 0.1966) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.63% (41.8489 => 42.5330, std. dev.: 0.0961) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.27% (2.2981 => 2.2689, std. dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.36% (2.0176 => 2.3073, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 7.73% (0.7061 => 0.7607, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.63% (0.5818 => 0.6262, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 7.41% (0.5748 => 0.6174, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.24% (1.3693 => 1.4548, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 6.11% (0.7038 => 0.7468, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.01% (0.4328 => 0.4588, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.96% (0.4062 => 0.4304, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.86% (0.2596 => 0.2748, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.75% (0.5265 => 0.5568, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.74% (0.1986 => 0.2100, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.66% (0.2721 => 0.2875, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.65% (0.2781 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.46% (0.2782 => 0.2934, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3022 => 0.3184, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.33% (0.2607 => 0.2746, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.33% (0.2760 => 0.2907, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.28% (3.9660 => 4.1755, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/random: 5.28% (0.2690 => 0.2832, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.27% (0.2655 => 0.2795, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.21% (0.7710 => 0.8112, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 5.21% (0.2628 => 0.2765, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.21% (0.3650 => 0.3840, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.17% (0.2726 => 0.2867, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.16% (0.2966 => 0.3119, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.14% (0.2765 => 0.2907, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3489 => 0.3668, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.07% (0.2937 => 0.3086, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.05% (1.9828 => 2.0829, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.03% (0.3899 => 0.4095, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.97% (0.2696 => 0.2830, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.94% (0.3580 => 0.3757, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.93% (0.2761 => 0.2897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.86% (0.3107 => 0.3258, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 4.81% (0.3578 => 0.3750, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.78% (0.4390 => 0.4600, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.67% (0.3789 => 0.3966, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.62% (0.4003 => 0.4188, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.62% (0.3485 => 0.3646, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 4.60% (0.3914 => 0.4094, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.60% (0.6959 => 0.7279, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 4.58% (0.3601 => 0.3766, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.57% (0.3192 => 0.3338, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.55% (0.3646 => 0.3812, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.3453 => 0.3610, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 4.53% (0.3663 => 0.3829, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.51% (0.4016 => 0.4197, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 4.47% (0.3940 => 0.4116, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 4.44% (0.3623 => 0.3784, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.39% (16.6129 => 17.3414, std. dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/matrix: 4.38% (0.2988 => 0.3119, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.33% (0.3534 => 0.3687, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.31% (0.3293 => 0.3435, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.31% (0.2925 => 0.3051, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 4.16% (13.8202 => 14.3949, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.11% (0.5577 => 0.5806, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.10% (0.9199 => 0.9576, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.97% (1.2193 => 1.2677, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.94% (13.2842 => 13.8079, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/moments: 3.90% (0.3868 => 0.4019, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 3.87% (0.2945 => 0.3059, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 3.66% (0.7506 => 0.7781, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.58% (0.5637 => 0.5839, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.51% (1.4563 => 1.5074, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.45% (0.3246 => 0.3358, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.42% (1.0594 => 1.0956, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.40% (1.3245 => 1.3695, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 3.38% (3.8646 => 3.9953, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 3.38% (1.2292 => 1.2707, std. dev.: 0.0095) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.32% (1.1364 => 1.1741, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.31% (1.1061 => 1.1427, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.20% (0.4379 => 0.4519, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.19% (1.9270 => 1.9885, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3755 => 0.3870, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.04% (1.3813 => 1.4233, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.97% (1.3819 => 1.4230, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.93% (4.9865 => 5.1326, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.93% (7.2180 => 7.4294, std. dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.73% (0.7460 => 0.7664, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8310 => 0.8536, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.71% (3.6692 => 3.7686, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 2.58% (0.4113 => 0.4219, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.52% (14.8535 => 15.2276, std. dev.: 0.0119) MultiSource/Applications/siod/siod: 2.49% (2.1791 => 2.2334, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 2.47% (6.5754 => 6.7379, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.30% (0.4791 => 0.4901, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.25% (0.8698 => 0.8894, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.16% (4.3801 => 4.4749, std. dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 2.09% (16.2614 => 16.6012, std. dev.: 0.0180) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6135 => 0.6261, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.03% (1.1333 => 1.1563, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.02% (4.4433 => 4.5330, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 1.92% (3.1889 => 3.2502, std. dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 1.86% (14.5298 => 14.8000, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (2.1007 => 2.1380, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.77% (0.6283 => 0.6394, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2689, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1913, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.7000, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 7.12% (1.2998 => 1.3923, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7326, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9226, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6787, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8292, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4806, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0310 => 1.0557, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1888, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.61% (3.6469 => 3.7055, std. dev.: 0.0082) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9699, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.23% (1.9290 => 1.9527, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.5627 => 21.0505, std. dev.: 0.0242) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.21% (0.8818 => 0.8623, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.17% (1.2308 => 1.1056, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.79% (20.3410 => 18.5539, std. dev.: 0.0574) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3103, std. dev.: 0.0070) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.24% (1.9762 => 1.9122, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5860, std. dev.: 0.0270) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4476, std. dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5086, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2524, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7936, std. dev.: 0.0029) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1137, std. dev.: 0.0171) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.5254 => 2.4882, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -1.45% (3.0263 => 2.9825, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8649, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2200, std. dev.: 0.0185) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2404, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2564, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 11:18:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 13:18:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120710181820.77DC52A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1940?compare_to=1938&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1940, Order: 159996, Start Time: 2012-07-10 17:00:15, End Time: 2012-07-10 18:18:24 To: 1938, Order: 159992, Start Time: 2012-07-10 15:14:00, End Time: 2012-07-10 16:32:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (57 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (797 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.03% (1.1049 => 1.1163, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.50% (10.3673 => 13.5292, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.85% (1.1194 => 1.2520, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.10% (0.1432 => 0.1548, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.03% (2.2022 => 2.3790, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.87% (1.7609 => 1.8994, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: 7.40% (0.3473 => 0.3730, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.20% (0.3543 => 0.3798, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.15% (0.3497 => 0.3747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.11% (0.3543 => 0.3795, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.10% (0.3561 => 0.3814, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.08% (0.3516 => 0.3765, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 6.93% (0.3694 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.64% (0.3828 => 0.4082, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/parameter-passing: 6.62% (0.3927 => 0.4187, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.61% (0.3886 => 0.4143, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.97% (10.4361 => 10.9545, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.53% (0.4879 => 0.5100, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.32% (7.0540 => 7.3586, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.31% (0.3177 => 0.3314, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.01% (0.7433 => 0.7731, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 3.42% (0.6030 => 0.6236, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.39% (0.5925 => 0.6126, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 3.18% (0.7326 => 0.7559, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.55% (0.5569 => 0.5711, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.48% (0.8172 => 0.8375, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.46% (14.3668 => 14.7200, std. dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.41% (0.4615 => 0.4726, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.40% (5.0018 => 5.1220, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.32% (4.9449 => 5.0598, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: 2.14% (0.7835 => 0.8003, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (9.4845 => 9.6753, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.98% (8.1363 => 8.2973, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.92% (2.0273 => 2.0662, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.91% (0.5860 => 0.5972, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.89% (4.2646 => 4.3454, std. dev.: 0.0050) MultiSource/Applications/d/make_dparser: 1.71% (3.3354 => 3.3924, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.69% (1.5415 => 1.5676, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.67% (1.1861 => 1.2059, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 1.64% (5.7591 => 5.8538, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 1.58% (1.5603 => 1.5849, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.45% (2.0665 => 2.0965, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 1.42% (3.8723 => 3.9271, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.38% (17.1811 => 17.4182, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.38% (1.3050 => 1.3230, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.18% (1.4186 => 1.4353, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.17% (0.9765 => 0.9879, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.77% (1.1145 => 1.1900, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7548, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.13% (26.0924 => 26.6474, std. dev.: 0.0347) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (1.5086 => 1.5389, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2377, std. dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6891, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 1.13% (2.9346 => 2.9677, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.12% (5.2763 => 3.1592, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.25% (5.3855 => 3.7024, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.79% (5.3526 => 3.7044, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.00% (2.9384 => 2.5565, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -10.53% (22.1758 => 19.8397, std. dev.: 0.0159) SingleSource/UnitTests/Vector/constpool: -4.97% (54.1659 => 51.4758, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.52% (3.8922 => 3.7942, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.33% (0.8101 => 0.7993, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.93% (0.0998 => 0.0839, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -9.78% (1.2373 => 1.1163, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.75% (19.9488 => 18.6023, std. dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (8.1563 => 7.9201, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6806, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0866, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 12:21:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 14:21:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120710192131.318DA2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1941?compare_to=1936&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1941, Order: 159993, Start Time: 2012-07-10 16:38:42, End Time: 2012-07-10 19:21:36 To: 1936, Order: 159989, Start Time: 2012-07-10 13:27:46, End Time: 2012-07-10 16:11:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (42 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (851 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.38% (2.1189 => 2.0685, std. dev.: 0.0163) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 9.18% (0.3496 => 0.3817, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.06% (0.3465 => 0.3779, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.97% (0.3446 => 0.3755, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.96% (0.3460 => 0.3770, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.92% (0.3442 => 0.3749, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.88% (0.3469 => 0.3777, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.86% (0.3488 => 0.3797, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.71% (0.3650 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.51% (0.3643 => 0.3953, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 8.32% (0.3724 => 0.4034, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.05% (0.5826 => 0.6120, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 4.67% (0.5889 => 0.6164, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.47% (1.6211 => 1.6774, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference: 3.44% (0.7171 => 0.7418, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.44% (0.5900 => 0.6103, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.28% (0.4361 => 0.4504, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.15% (3.5627 => 3.6748, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.90% (0.4994 => 0.5139, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.88% (0.5026 => 0.5171, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 2.85% (4.2109 => 4.3311, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.85% (0.4029 => 0.4144, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.70% (1.3152 => 1.3507, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.67% (0.3930 => 0.4035, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.62% (0.5000 => 0.5131, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.59% (2.0673 => 2.1209, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 2.46% (0.9909 => 1.0153, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.17% (1.0781 => 1.1015, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.17% (2.7292 => 2.7884, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.96% (1.9694 => 2.0080, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 1.78% (1.5932 => 1.6216, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.73% (1.9966 => 2.0311, std. dev.: 0.0039) MultiSource/Applications/hbd/hbd: 1.72% (0.9697 => 0.9864, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 1.70% (1.8794 => 1.9114, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 1.45% (5.5417 => 5.6222, std. dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.44% (4.4195 => 4.4830, std. dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: 1.43% (23.5202 => 23.8566, std. dev.: 0.0196) MultiSource/Applications/lua/lua: 1.37% (1.4269 => 1.4465, std. dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: 1.33% (2.1653 => 2.1940, std. dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 1.32% (2.1013 => 2.1291, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 1.32% (0.7875 => 0.7979, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.21% (4.6177 => 4.6738, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.2122 => 0.2243, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.18% (11.9555 => 11.6946, std. dev.: 0.0112) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 12:46:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 14:46:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120710194613.D5EAE2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1942?compare_to=1939&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1942, Order: 160006, Start Time: 2012-07-10 18:32:23, End Time: 2012-07-10 19:46:18 To: 1939, Order: 159993, Start Time: 2012-07-10 16:50:52, End Time: 2012-07-10 18:04:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (129 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.10% (1.3107 => 1.2963, std. dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.03% (2.0176 => 2.3007, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.36% (0.7061 => 0.7651, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.10% (0.5818 => 0.6289, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.92% (0.5748 => 0.6203, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.72% (0.4062 => 0.4335, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (0.4328 => 0.4607, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.37% (0.3578 => 0.3806, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 6.36% (0.2781 => 0.2958, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.22% (0.3650 => 0.3877, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.21% (1.3693 => 1.4543, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hello: 6.18% (0.2607 => 0.2768, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.12% (0.3646 => 0.3869, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.11% (0.2782 => 0.2952, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 6.11% (0.3601 => 0.3821, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.10% (0.3789 => 0.4020, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.09% (0.1986 => 0.2107, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 6.09% (0.3663 => 0.3886, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.06% (0.2690 => 0.2853, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.06% (0.3022 => 0.3205, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.05% (0.4003 => 0.4245, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-3: 6.04% (0.3623 => 0.3842, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.03% (0.3914 => 0.4150, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.96% (0.3940 => 0.4175, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2655 => 0.2813, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.94% (0.2628 => 0.2784, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.91% (0.2726 => 0.2887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.87% (0.2760 => 0.2922, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.85% (0.7038 => 0.7450, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.83% (0.2966 => 0.3139, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.82% (0.2937 => 0.3108, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.71% (0.2696 => 0.2850, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.66% (1.9828 => 2.0950, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.65% (0.3489 => 0.3686, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.60% (0.3107 => 0.3281, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.53% (0.3580 => 0.3778, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.46% (0.3149 => 0.3321, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.5265 => 0.5550, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.39% (0.3899 => 0.4109, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.37% (0.2721 => 0.2867, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.35% (0.2596 => 0.2735, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.33% (0.7710 => 0.8121, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 5.30% (0.3453 => 0.3636, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.28% (3.9660 => 4.1755, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.28% (0.3485 => 0.3669, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.14% (0.3192 => 0.3356, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.09% (0.2988 => 0.3140, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.95% (0.3534 => 0.3709, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 4.95% (0.3293 => 0.3456, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (0.3756 => 0.3939, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.71% (0.6959 => 0.7287, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.65% (0.4390 => 0.4594, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 4.60% (0.3868 => 0.4046, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.47% (13.8202 => 14.4381, std. dev.: 0.0138) MultiSource/Applications/kimwitu++/kc: 4.47% (16.6129 => 17.3550, std. dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.2945 => 0.3075, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.17% (1.2193 => 1.2702, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.12% (0.9199 => 0.9578, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.04% (13.2842 => 13.8210, std. dev.: 0.0129) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.2292 => 1.2770, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.80% (0.5577 => 0.5789, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.76% (0.2925 => 0.3035, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.70% (0.3755 => 0.3894, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.64% (1.4563 => 1.5093, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.57% (0.3246 => 0.3362, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.57% (1.1364 => 1.1770, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.53% (1.3245 => 1.3712, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.46% (1.3813 => 1.4291, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 3.45% (3.8646 => 3.9978, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.45% (1.0594 => 1.0959, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.42% (0.7506 => 0.7763, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.40% (1.3819 => 1.4289, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.37% (7.2180 => 7.4614, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.35% (0.5637 => 0.5826, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.28% (1.9270 => 1.9902, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 3.26% (1.1061 => 1.1422, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.14% (4.9865 => 5.1433, std. dev.: 0.0115) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.04% (0.7460 => 0.7687, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.93% (3.6692 => 3.7767, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 2.86% (6.5754 => 6.7633, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.72% (0.8698 => 0.8935, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 2.72% (0.4113 => 0.4225, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 2.65% (14.8535 => 15.2470, std. dev.: 0.0134) MultiSource/Applications/siod/siod: 2.50% (2.1791 => 2.2335, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.44% (0.4791 => 0.4908, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.38% (4.3801 => 4.4845, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.35% (4.4433 => 4.5478, std. dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 2.28% (16.2614 => 16.6328, std. dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.19% (1.1333 => 1.1581, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.18% (0.6135 => 0.6269, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.12% (3.1889 => 3.2564, std. dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 2.06% (1.2749 => 1.3012, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.96% (14.5298 => 14.8153, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6283 => 0.6398, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (2.1007 => 2.1391, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2579, std. dev.: 0.0491) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.27% (2.0200 => 2.1871, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 5.92% (1.2998 => 1.3768, std. dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.04% (7.4271 => 7.7273, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9885, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8306, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.90% (1.4298 => 1.4569, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9593, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5089 => 1.5325, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.45% (3.6469 => 3.6998, std. dev.: 0.0081) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.73% (0.4657 => 0.4064, std. dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.49% (22.5627 => 21.0984, std. dev.: 0.0214) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.08% (0.3511 => 0.3403, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.76% (0.8818 => 0.8663, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.55% (0.0997 => 0.0842, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2308 => 1.1097, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.56% (20.3410 => 18.6008, std. dev.: 0.0295) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.06% (1.3780 => 1.3083, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9128, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5133, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2515, std. dev.: 0.0053) MultiSource/Applications/minisat/minisat: -1.64% (9.3358 => 9.1828, std. dev.: 0.0223) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7959, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1394, std. dev.: 0.0225) MultiSource/Applications/spiff/spiff: -1.41% (3.0263 => 2.9836, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8634, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2394, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2528, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 13:04:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 15:04:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120710200425.ED81C2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1943?compare_to=1940&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1943, Order: 160006, Start Time: 2012-07-10 18:46:17, End Time: 2012-07-10 20:04:30 To: 1940, Order: 159996, Start Time: 2012-07-10 17:00:15, End Time: 2012-07-10 18:18:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (58 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (797 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.21% (13.5292 => 13.8280, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.95% (55.3742 => 56.4543, std. dev.: 0.0365) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.38% (10.3673 => 13.8280, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2484, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 8.15% (0.3473 => 0.3756, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.05% (2.2022 => 2.3794, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.92% (0.3497 => 0.3774, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.90% (0.3543 => 0.3823, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.89% (0.3561 => 0.3842, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.87% (0.3543 => 0.3822, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.87% (1.7609 => 1.8994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.80% (0.3694 => 0.3982, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-3: 7.79% (0.3516 => 0.3790, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.46% (0.3927 => 0.4220, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.44% (0.3886 => 0.4175, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: 7.39% (0.3828 => 0.4111, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.78% (10.4361 => 10.9346, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.4879 => 0.5105, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.50% (0.3177 => 0.3320, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.33% (7.0540 => 7.3595, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference-object: 3.93% (0.6030 => 0.6267, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.91% (0.7433 => 0.7724, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 3.73% (0.7326 => 0.7599, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.80% (0.4615 => 0.4744, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.71% (0.5569 => 0.5720, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.45% (0.8172 => 0.8372, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.42% (5.0018 => 5.1229, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (14.3668 => 14.7141, std. dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.42% (4.9449 => 5.0644, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 2.37% (0.7835 => 0.8021, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5860 => 0.5985, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 2.10% (9.4845 => 9.6836, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.07% (4.2646 => 4.3529, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.06% (8.1363 => 8.3037, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.05% (0.8067 => 0.8232, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.02% (2.0273 => 2.0683, std. dev.: 0.0096) MultiSource/Applications/Burg/burg: 1.87% (1.1642 => 1.1860, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 1.87% (3.3354 => 3.3977, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.5415 => 1.5700, std. dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 1.73% (5.7591 => 5.8587, std. dev.: 0.0046) MultiSource/Applications/lua/lua: 1.69% (3.8723 => 3.9379, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.59% (1.3050 => 1.3257, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.57% (1.5603 => 1.5848, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.57% (17.1811 => 17.4501, std. dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.40% (0.9765 => 0.9902, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.21% (2.0665 => 2.0916, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.19% (2.2024 => 2.2285, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9741, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.80% (1.1145 => 1.1903, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7499, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.14% (1.0313 => 1.0534, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.96% (26.0924 => 26.6034, std. dev.: 0.0319) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5357, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2397, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6880, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 1.06% (2.9346 => 2.9656, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.18% (5.2763 => 3.1563, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.21% (5.3855 => 3.7046, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7036, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.35% (2.9384 => 2.5460, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -10.48% (22.1758 => 19.8517, std. dev.: 0.0128) SingleSource/UnitTests/Vector/constpool: -5.34% (54.1659 => 51.2716, std. dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.16% (3.8922 => 3.8082, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.52% (1.2373 => 1.1071, std. dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.98% (19.9488 => 18.5568, std. dev.: 0.0269) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.88% (8.1563 => 7.9215, std. dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6932, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0871, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 14:27:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 16:27:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120710212751.DAF8E2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1944?compare_to=1942&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1944, Order: 160009, Start Time: 2012-07-10 20:14:09, End Time: 2012-07-10 21:27:55 To: 1942, Order: 160006, Start Time: 2012-07-10 18:32:23, End Time: 2012-07-10 19:46:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (131 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (722 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.98% (1.3768 => 1.4040, std. dev.: 0.0103) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.95% (2.0176 => 2.2991, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.33% (0.7061 => 0.7649, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.11% (0.5818 => 0.6290, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 7.88% (0.5748 => 0.6201, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 6.57% (1.3693 => 1.4593, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.47% (0.4328 => 0.4608, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2781 => 0.2960, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.40% (0.2655 => 0.2825, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.33% (0.2607 => 0.2772, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2782 => 0.2958, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 6.31% (0.2726 => 0.2898, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.25% (0.4062 => 0.4316, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2628 => 0.2789, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.11% (0.2765 => 0.2934, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2690 => 0.2854, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.09% (0.2937 => 0.3116, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.06% (0.3578 => 0.3795, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.04% (0.1986 => 0.2106, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.99% (0.3022 => 0.3203, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 5.98% (0.2760 => 0.2925, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 5.97% (0.7038 => 0.7458, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.93% (0.2966 => 0.3142, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.93% (0.2596 => 0.2750, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.92% (0.3650 => 0.3866, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.92% (0.3601 => 0.3814, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.90% (0.2696 => 0.2855, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 5.90% (0.3646 => 0.3861, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.83% (0.2761 => 0.2922, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.83% (0.3107 => 0.3288, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.82% (0.3489 => 0.3692, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.79% (1.9828 => 2.0977, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 5.79% (0.3663 => 0.3875, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.75% (0.3789 => 0.4007, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 5.75% (0.3914 => 0.4139, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.75% (0.4003 => 0.4233, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: 5.72% (0.3149 => 0.3329, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.71% (0.3623 => 0.3830, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.71% (0.7710 => 0.8150, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.62% (0.5265 => 0.5561, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 5.56% (0.3940 => 0.4159, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.47% (0.4390 => 0.4630, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.45% (0.3580 => 0.3775, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.41% (0.3899 => 0.4110, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 5.39% (0.3453 => 0.3639, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.37% (0.2721 => 0.2867, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3192 => 0.3362, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.28% (0.3485 => 0.3669, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.23% (3.9660 => 4.1736, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 5.21% (0.3534 => 0.3718, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.15% (0.2988 => 0.3142, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.07% (0.3293 => 0.3460, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.93% (0.3756 => 0.3941, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.65% (0.3868 => 0.4048, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.54% (0.6959 => 0.7275, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 4.45% (16.6129 => 17.3524, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 4.20% (13.8202 => 14.4010, std. dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.20% (0.9199 => 0.9585, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.03% (1.2292 => 1.2787, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3755 => 0.3902, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.90% (1.2193 => 1.2668, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.78% (0.5577 => 0.5788, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.76% (13.2842 => 13.7834, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.66% (1.4563 => 1.5096, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 3.66% (0.2925 => 0.3032, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.49% (0.5637 => 0.5834, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.38% (0.4379 => 0.4527, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.36% (0.3246 => 0.3355, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.36% (0.7506 => 0.7758, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 3.33% (1.0594 => 1.0947, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (1.3245 => 1.3680, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.27% (1.1364 => 1.1736, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.27% (3.8646 => 3.9909, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.27% (1.3813 => 1.4264, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.22% (1.3819 => 1.4264, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 3.15% (1.1061 => 1.1409, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.14% (7.2180 => 7.4450, std. dev.: 0.0048) MultiSource/Applications/treecc/treecc: 3.11% (1.9270 => 1.9869, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.11% (4.9865 => 5.1414, std. dev.: 0.0133) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.02% (0.7460 => 0.7685, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 2.77% (0.8310 => 0.8540, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.72% (3.6692 => 3.7691, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.63% (0.8698 => 0.8927, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 2.55% (0.4113 => 0.4218, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.53% (6.5754 => 6.7419, std. dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: 2.49% (14.8535 => 15.2229, std. dev.: 0.0165) MultiSource/Applications/siod/siod: 2.39% (2.1791 => 2.2311, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.30% (0.4791 => 0.4901, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (4.3801 => 4.4793, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6135 => 0.6263, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.08% (4.4433 => 4.5358, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 2.08% (16.2614 => 16.5997, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.99% (1.1333 => 1.1558, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 1.90% (14.5298 => 14.8060, std. dev.: 0.0086) MultiSource/Applications/d/make_dparser: 1.88% (3.1889 => 3.2489, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.87% (1.2749 => 1.2987, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6283 => 0.6398, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.54% (2.1007 => 2.1331, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.02% (1.8175 => 2.2723, std. dev.: 0.0455) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.03% (2.0200 => 2.1823, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4040, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6988, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.4271 => 7.7166, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9868, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9194, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6796, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8313, std. dev.: 0.0173) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4801, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.89% (1.4298 => 1.4568, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5352, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6469 => 3.7088, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.51% (22.5627 => 21.0945, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.47% (0.3511 => 0.3389, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.76% (0.8818 => 0.8663, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1105, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.89% (20.3410 => 18.5323, std. dev.: 0.0636) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.27% (1.3780 => 1.3192, std. dev.: 0.0057) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.18% (1.9762 => 1.9133, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.79% (8.8259 => 8.5795, std. dev.: 0.0165) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5067, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2546, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7945, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0107) MultiSource/Applications/spiff/spiff: -1.43% (3.0263 => 2.9829, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1468, std. dev.: 0.0289) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2418, std. dev.: 0.0228) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2231, std. dev.: 0.0265) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2538, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.17% (0.9692 => 0.9579, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 14:50:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 16:50:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120710215036.2D27A2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1945?compare_to=1943&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1945, Order: 160009, Start Time: 2012-07-10 20:32:16, End Time: 2012-07-10 21:50:41 To: 1943, Order: 160006, Start Time: 2012-07-10 18:46:17, End Time: 2012-07-10 20:04:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (79 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (776 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.51% (13.8280 => 14.0370, std. dev.: 0.0094) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.40% (10.3673 => 14.0370, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.95% (1.1194 => 1.2532, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.52% (2.2022 => 2.3899, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 8.38% (0.1432 => 0.1552, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.29% (0.3473 => 0.3761, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.09% (1.7609 => 1.9033, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 7.98% (0.3497 => 0.3776, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.96% (0.3516 => 0.3796, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.96% (0.3543 => 0.3825, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.93% (0.3543 => 0.3824, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.89% (0.3561 => 0.3842, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.77% (0.3886 => 0.4188, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.77% (0.3694 => 0.3981, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.77% (0.1622 => 0.1748, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.72% (0.3927 => 0.4230, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.60% (0.3828 => 0.4119, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.23% (0.2065 => 0.2173, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 5.15% (0.3282 => 0.3451, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.06% (0.4879 => 0.5126, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.02% (7.0540 => 7.4080, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.94% (0.3177 => 0.3334, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.92% (10.4361 => 10.9492, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 4.90% (0.7433 => 0.7797, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.34% (0.6030 => 0.6292, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 4.12% (0.5925 => 0.6169, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: 3.99% (0.7326 => 0.7618, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.85% (0.2700 => 0.2804, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.5569 => 0.5769, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: 3.59% (0.3092 => 0.3203, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.58% (0.4615 => 0.4780, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 3.33% (0.3180 => 0.3286, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.32% (5.0018 => 5.1679, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.15% (14.3668 => 14.8191, std. dev.: 0.0120) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.14% (0.8172 => 0.8429, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.14% (4.9449 => 5.1004, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.14% (0.4103 => 0.4232, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.05% (0.7835 => 0.8074, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.04% (0.3423 => 0.3527, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.88% (9.4845 => 9.7580, std. dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.84% (4.2646 => 4.3856, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.83% (0.5860 => 0.6026, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.80% (2.0273 => 2.0840, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.75% (8.1363 => 8.3598, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.60% (0.8067 => 0.8277, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.59% (1.1861 => 1.2168, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 2.59% (1.1642 => 1.1943, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.55% (3.3354 => 3.4205, std. dev.: 0.0087) MultiSource/Applications/lua/lua: 2.46% (3.8723 => 3.9676, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.37% (0.4636 => 0.4746, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.34% (5.7591 => 5.8941, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.32% (1.3050 => 1.3353, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 2.26% (1.5603 => 1.5955, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.23% (1.5415 => 1.5758, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.19% (2.2024 => 2.2506, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.14% (1.4186 => 1.4489, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 2.09% (17.1811 => 17.5394, std. dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.07% (0.9765 => 0.9967, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.06% (0.6450 => 0.6583, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.04% (0.5105 => 0.5209, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.89% (0.5981 => 0.6094, std. dev.: 0.0041) MultiSource/Applications/minisat/minisat: 1.80% (0.7115 => 0.7243, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.78% (0.6456 => 0.6571, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.72% (2.2969 => 2.3364, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.69% (1.5859 => 1.6127, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.59% (0.6675 => 0.6781, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.52% (2.0665 => 2.0980, std. dev.: 0.0102) MultiSource/Applications/lemon/lemon: 1.30% (1.0722 => 1.0861, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.20% (1.2842 => 1.2996, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 1.19% (0.8921 => 0.9027, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7503, std. dev.: 0.0071) MultiSource/Applications/lua/lua: 2.05% (26.0924 => 26.6264, std. dev.: 0.0236) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.05% (1.0313 => 1.0524, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5367, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6893, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2348, std. dev.: 0.0125) MultiSource/Applications/spiff/spiff: 1.09% (2.9346 => 2.9665, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.12% (5.2763 => 3.1597, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.59% (5.3855 => 3.7379, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.24% (5.3526 => 3.7339, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.26% (2.9384 => 2.5489, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -9.85% (22.1758 => 19.9911, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3295, std. dev.: 0.0360) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.27% (3.8922 => 3.8428, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.53% (0.0998 => 0.0843, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.58% (1.2373 => 1.1064, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.37% (19.9488 => 18.6789, std. dev.: 0.0240) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9206, std. dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6886, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 15:32:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 17:32:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120710223222.091A02A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1946?compare_to=1941&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1946, Order: 160009, Start Time: 2012-07-10 19:49:09, End Time: 2012-07-10 22:32:27 To: 1941, Order: 159993, Start Time: 2012-07-10 16:38:42, End Time: 2012-07-10 19:21:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (40 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (853 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.38% (121.0716 => 128.7996, std. dev.: 1.0710) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.08% (2.0685 => 2.1115, std. dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 8.44% (0.3496 => 0.3791, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.34% (0.3465 => 0.3754, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.24% (0.3446 => 0.3730, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.19% (0.3469 => 0.3753, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.18% (0.3460 => 0.3743, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.11% (0.3442 => 0.3721, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.08% (0.3488 => 0.3770, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.05% (0.3650 => 0.3944, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.82% (0.3643 => 0.3928, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.57% (0.3724 => 0.4006, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.75% (0.5826 => 0.6103, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 4.28% (0.5889 => 0.6141, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.27% (1.6211 => 1.6741, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 3.19% (0.7171 => 0.7400, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (0.5026 => 0.5180, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.05% (3.5627 => 3.6712, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.03% (0.5900 => 0.6079, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.98% (0.4361 => 0.4491, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.78% (2.0673 => 2.1248, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 2.70% (4.2109 => 4.3248, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 2.67% (0.9909 => 1.0174, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 2.63% (0.4029 => 0.4135, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.60% (0.3930 => 0.4032, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.59% (1.3152 => 1.3493, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.48% (0.4994 => 0.5118, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.38% (0.5000 => 0.5119, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.02% (1.0781 => 1.0999, std. dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.85% (2.7292 => 2.7796, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.84% (1.9694 => 2.0057, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.82% (23.5202 => 23.9492, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.67% (1.9966 => 2.0299, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 1.63% (0.9697 => 0.9855, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 1.57% (1.8794 => 1.9090, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 1.48% (5.5417 => 5.6235, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 1.43% (2.1653 => 2.1963, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.29% (4.4195 => 4.4767, std. dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (2.1013 => 2.1280, std. dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 1.25% (4.6177 => 4.6755, std. dev.: 0.0096) MultiSource/Applications/lua/lua: 1.11% (1.4269 => 1.4427, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.42% (2.0820 => 2.1115, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.30% (11.9555 => 11.6808, std. dev.: 0.0104) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 16:09:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 18:09:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120710230921.A0B602A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1947?compare_to=1944&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1947, Order: 160013, Start Time: 2012-07-10 21:55:35, End Time: 2012-07-10 23:09:24 To: 1944, Order: 160009, Start Time: 2012-07-10 20:14:09, End Time: 2012-07-10 21:27:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (132 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (721 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.26% (27.5709 => 29.5724, std. dev.: 0.0952) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.56% (54.5821 => 56.5262, std. dev.: 0.0634) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.08% (2.0176 => 2.3016, std. dev.: 0.0170) SingleSource/UnitTests/ObjC++/property-reference: 8.21% (0.7061 => 0.7641, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 8.10% (0.5818 => 0.6289, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 7.97% (0.5748 => 0.6206, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (0.4328 => 0.4616, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.58% (1.3693 => 1.4594, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.40% (0.2781 => 0.2959, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.29% (0.2607 => 0.2771, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.29% (0.2782 => 0.2957, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.28% (0.4062 => 0.4317, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2690 => 0.2858, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.24% (0.1986 => 0.2110, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.19% (0.3022 => 0.3209, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2628 => 0.2789, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.12% (0.3578 => 0.3797, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.06% (0.2655 => 0.2816, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.2937 => 0.3115, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.04% (0.2765 => 0.2932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.03% (0.3650 => 0.3870, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 6.02% (0.2726 => 0.2890, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.01% (0.2760 => 0.2926, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.99% (0.3107 => 0.3293, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.97% (0.2696 => 0.2857, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.97% (0.7038 => 0.7458, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.93% (0.2966 => 0.3142, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.88% (1.9828 => 2.0994, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 5.87% (0.4003 => 0.4238, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.83% (0.3789 => 0.4010, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 5.83% (0.2761 => 0.2922, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.81% (0.3646 => 0.3858, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.80% (0.3601 => 0.3810, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.79% (0.3489 => 0.3691, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.77% (0.3914 => 0.4140, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.76% (0.3663 => 0.3874, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.69% (0.3623 => 0.3829, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.68% (0.3149 => 0.3328, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.58% (0.3940 => 0.4160, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.54% (0.3899 => 0.4115, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.47% (0.3580 => 0.3776, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.46% (0.7710 => 0.8131, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (0.3485 => 0.3675, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sieve: 5.42% (0.3453 => 0.3640, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.39% (0.5265 => 0.5549, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3192 => 0.3362, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.2721 => 0.2865, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.27% (3.9660 => 4.1750, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 5.25% (0.2988 => 0.3145, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.20% (0.2596 => 0.2731, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 5.13% (0.3293 => 0.3462, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.04% (0.3534 => 0.3712, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.95% (0.3756 => 0.3942, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.85% (0.4390 => 0.4603, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: 4.76% (0.3868 => 0.4052, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 4.50% (16.6129 => 17.3598, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/objinst: 4.48% (0.2945 => 0.3077, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.47% (0.6959 => 0.7270, std. dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 4.37% (13.8202 => 14.4242, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.37% (0.9199 => 0.9601, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.10% (1.2193 => 1.2693, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.95% (1.2292 => 1.2778, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.85% (13.2842 => 13.7954, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.84% (0.5577 => 0.5791, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.79% (0.2925 => 0.3036, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.78% (0.3755 => 0.3897, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.69% (0.7506 => 0.7783, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.64% (1.4563 => 1.5093, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.60% (1.3813 => 1.4310, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.53% (1.1061 => 1.1452, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.53% (1.0594 => 1.0968, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.53% (1.3245 => 1.3712, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.51% (1.3819 => 1.4304, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.49% (1.1364 => 1.1761, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.5637 => 0.5831, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.42% (0.3246 => 0.3357, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.38% (0.4379 => 0.4527, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.35% (1.9270 => 1.9916, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.35% (3.8646 => 3.9941, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.28% (4.9865 => 5.1503, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.21% (7.2180 => 7.4498, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.02% (0.7460 => 0.7685, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.82% (0.8698 => 0.8943, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.82% (3.6692 => 3.7725, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8310 => 0.8543, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 2.71% (6.5754 => 6.7533, std. dev.: 0.0067) MultiSource/Applications/siod/siod: 2.65% (2.1791 => 2.2368, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 2.63% (0.4113 => 0.4221, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 2.57% (14.8535 => 15.2353, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.57% (0.4791 => 0.4914, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.30% (4.3801 => 4.4807, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6135 => 0.6272, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.19% (4.4433 => 4.5405, std. dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.14% (1.1333 => 1.1576, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.08% (16.2614 => 16.5994, std. dev.: 0.0267) MultiSource/Applications/d/make_dparser: 2.02% (3.1889 => 3.2534, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (2.1007 => 2.1425, std. dev.: 0.0113) MultiSource/Applications/ClamAV/clamscan: 1.97% (14.5298 => 14.8166, std. dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.97% (0.6283 => 0.6407, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.93% (1.2749 => 1.2995, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2636, std. dev.: 0.0511) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1886, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.33% (1.2998 => 1.3951, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.22% (7.4271 => 7.7403, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9227, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6799, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4783, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1896, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4553, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5089 => 1.5327, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9590, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.52% (3.6469 => 3.7025, std. dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.26% (0.4657 => 0.4086, std. dev.: 0.0156) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.42% (22.5627 => 21.1152, std. dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.56% (0.3511 => 0.3386, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.00% (0.8818 => 0.8642, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.85% (1.2308 => 1.1096, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.89% (20.3410 => 18.5336, std. dev.: 0.0683) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3103, std. dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.26% (1.9762 => 1.9117, std. dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5894, std. dev.: 0.0170) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5105, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2521, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7939, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8584, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.42% (3.0263 => 2.9834, std. dev.: 0.0015) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1493, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2122, std. dev.: 0.0314) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2395, std. dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2559, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 16:36:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 18:36:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120710233646.B61832A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1948?compare_to=1945&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1948, Order: 160017, Start Time: 2012-07-10 22:18:25, End Time: 2012-07-10 23:36:51 To: 1945, Order: 160009, Start Time: 2012-07-10 20:32:16, End Time: 2012-07-10 21:50:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (77 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (778 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.29% (56.4537 => 54.5980, std. dev.: 0.3420) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.41% (10.3673 => 14.0386, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.02% (1.1194 => 1.2540, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.59% (2.2022 => 2.3914, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.26% (0.3473 => 0.3760, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.04% (1.7609 => 1.9024, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.02% (0.3543 => 0.3827, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.96% (0.3543 => 0.3825, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.92% (0.3497 => 0.3774, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.91% (0.3516 => 0.3794, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.89% (0.3561 => 0.3842, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.79% (0.3927 => 0.4233, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.72% (0.3694 => 0.3979, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 7.71% (0.1622 => 0.1747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.65% (0.3828 => 0.4121, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.62% (0.3886 => 0.4182, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 5.12% (0.3282 => 0.3450, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.06% (0.7433 => 0.7809, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.04% (0.4879 => 0.5125, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.2065 => 0.2169, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.03% (7.0540 => 7.4085, std. dev.: 0.0181) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.97% (0.3177 => 0.3335, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 4.92% (10.4361 => 10.9494, std. dev.: 0.0097) SingleSource/UnitTests/ObjC++/property-reference-object: 4.26% (0.6030 => 0.6287, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.10% (0.7326 => 0.7626, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.03% (0.5925 => 0.6164, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.93% (0.2700 => 0.2806, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3092 => 0.3201, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.48% (0.5569 => 0.5763, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.47% (0.4615 => 0.4775, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.27% (0.3180 => 0.3284, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.18% (4.9449 => 5.1022, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.17% (0.8172 => 0.8431, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.16% (5.0018 => 5.1600, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.96% (14.3668 => 14.7920, std. dev.: 0.0220) MultiSource/Applications/spiff/spiff: 2.92% (0.7835 => 0.8064, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.92% (0.5860 => 0.6031, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 2.89% (9.4845 => 9.7589, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.86% (4.2646 => 4.3865, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.70% (8.1363 => 8.3560, std. dev.: 0.0044) MultiSource/Applications/treecc/treecc: 2.69% (2.0273 => 2.0819, std. dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.55% (1.1861 => 1.2163, std. dev.: 0.0044) MultiSource/Applications/lua/lua: 2.53% (3.8723 => 3.9704, std. dev.: 0.0112) MultiSource/Applications/Burg/burg: 2.53% (1.1642 => 1.1936, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.52% (0.8067 => 0.8270, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.51% (0.4103 => 0.4206, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.47% (3.3354 => 3.4177, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.39% (0.4636 => 0.4747, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.34% (5.7591 => 5.8939, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.33% (1.5603 => 1.5966, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.28% (1.3050 => 1.3348, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.5415 => 1.5757, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.21% (2.2024 => 2.2510, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.12% (0.6450 => 0.6587, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.07% (17.1811 => 17.5362, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.06% (0.5105 => 0.5210, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.04% (1.4186 => 1.4475, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.01% (0.9765 => 0.9961, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.94% (0.5981 => 0.6097, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 1.86% (0.6456 => 0.6576, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.86% (0.7115 => 0.7247, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.72% (1.5859 => 1.6132, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.70% (2.2969 => 2.3359, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.65% (0.6675 => 0.6785, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.51% (2.0665 => 2.0977, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 1.27% (1.2842 => 1.3005, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.22% (1.0722 => 1.0853, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7512, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.18% (26.0924 => 26.6619, std. dev.: 0.0161) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.89% (1.5086 => 1.5371, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6879, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 1.14% (2.9346 => 2.9682, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.13% (5.2763 => 3.1588, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.60% (5.3855 => 3.7377, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.27% (5.3526 => 3.7326, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.18% (2.9384 => 2.5512, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -9.86% (22.1758 => 19.9884, std. dev.: 0.0115) SingleSource/UnitTests/Vector/constpool: -5.31% (54.1659 => 51.2892, std. dev.: 0.0720) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.31% (3.8922 => 3.8411, std. dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.41% (1.2373 => 1.1085, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.58% (19.9488 => 18.6356, std. dev.: 0.0174) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.85% (8.1563 => 7.9235, std. dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6879, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0850, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 17:51:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 19:51:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120711005108.582F02A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1949?compare_to=1947&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1949, Order: 160028, Start Time: 2012-07-10 23:37:21, End Time: 2012-07-11 00:51:13 To: 1947, Order: 160013, Start Time: 2012-07-10 21:55:35, End Time: 2012-07-10 23:09:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (132 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (723 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.35% (1.3951 => 1.4140, std. dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.64% (2.0176 => 2.3129, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference: 6.93% (0.7061 => 0.7550, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.84% (0.5818 => 0.6216, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.51% (0.5748 => 0.6122, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.83% (0.7038 => 0.7448, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.76% (0.4062 => 0.4296, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.73% (1.3693 => 1.4478, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.69% (0.1986 => 0.2099, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.61% (0.4328 => 0.4571, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.2721 => 0.2872, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.51% (0.2596 => 0.2739, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.32% (0.5265 => 0.5545, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.32% (0.3650 => 0.3844, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.25% (3.9660 => 4.1742, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.23% (0.7710 => 0.8113, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 5.21% (0.2726 => 0.2868, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.20% (0.3022 => 0.3179, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.14% (0.2781 => 0.2924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2655 => 0.2790, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.07% (0.2782 => 0.2923, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.04% (0.2760 => 0.2899, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.02% (0.2966 => 0.3115, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.96% (0.3107 => 0.3261, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.94% (0.2937 => 0.3082, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.90% (0.6959 => 0.7300, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.88% (0.2765 => 0.2900, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.87% (0.2690 => 0.2821, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 4.86% (0.3578 => 0.3752, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.85% (0.3899 => 0.4088, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.84% (0.3489 => 0.3658, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.82% (1.9828 => 2.0783, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/fibo: 4.79% (0.2628 => 0.2754, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.76% (0.3149 => 0.3299, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 4.75% (0.3623 => 0.3795, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 4.71% (0.2761 => 0.2891, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.70% (0.3914 => 0.4098, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.69% (0.3580 => 0.3748, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 4.66% (0.3646 => 0.3816, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 4.65% (0.4003 => 0.4189, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.60% (0.2696 => 0.2820, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 4.59% (0.3789 => 0.3963, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 4.58% (0.3601 => 0.3766, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 4.56% (0.3663 => 0.3830, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.52% (0.3940 => 0.4118, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3485 => 0.3641, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.38% (0.2988 => 0.3119, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.37% (0.3453 => 0.3604, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.36% (0.4016 => 0.4191, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.32% (16.6129 => 17.3302, std. dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.21% (0.4390 => 0.4575, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.18% (13.8202 => 14.3981, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.3192 => 0.3325, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.15% (0.3756 => 0.3912, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.14% (0.9199 => 0.9580, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: 4.10% (0.3534 => 0.3679, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.10% (0.3293 => 0.3428, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.06% (1.2193 => 1.2688, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/moments: 3.96% (0.3868 => 0.4021, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.88% (13.2842 => 13.7996, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.77% (0.5577 => 0.5787, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.61% (0.7506 => 0.7777, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 3.59% (0.2925 => 0.3030, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.57% (0.5637 => 0.5838, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.51% (1.4563 => 1.5074, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.49% (1.3245 => 1.3707, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.48% (0.3246 => 0.3359, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.46% (0.2945 => 0.3047, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.46% (1.1364 => 1.1757, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 3.38% (3.8646 => 3.9954, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 3.37% (1.9270 => 1.9920, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 3.36% (1.0594 => 1.0950, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.32% (1.3819 => 1.4278, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.25% (1.3813 => 1.4262, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 3.19% (1.2292 => 1.2684, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.15% (0.4379 => 0.4517, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.15% (1.1061 => 1.1409, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.12% (4.9865 => 5.1421, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.00% (7.2180 => 7.4345, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.96% (0.7460 => 0.7681, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3755 => 0.3864, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.83% (0.8310 => 0.8545, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (3.6692 => 3.7712, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.62% (0.6135 => 0.6296, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.53% (0.4791 => 0.4912, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.50% (14.8535 => 15.2246, std. dev.: 0.0144) MultiSource/Applications/JM/ldecod/ldecod: 2.47% (6.5754 => 6.7375, std. dev.: 0.0134) MultiSource/Applications/siod/siod: 2.39% (2.1791 => 2.2311, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.29% (0.8698 => 0.8897, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (4.3801 => 4.4789, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.14% (1.1333 => 1.1576, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.06% (4.4433 => 4.5350, std. dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 1.92% (16.2614 => 16.5740, std. dev.: 0.0243) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6283 => 0.6398, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.79% (14.5298 => 14.7894, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (2.1007 => 2.1381, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.77% (3.1889 => 3.2455, std. dev.: 0.0149) MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.2749 => 1.2969, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.00% (1.5188 => 1.5340, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.39% (1.8175 => 2.2789, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/mandel-2: 8.79% (1.2998 => 1.4140, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.15% (2.0200 => 2.1846, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.13% (7.4271 => 7.7338, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6792, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8315, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1892, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.75% (1.4298 => 1.4548, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5331, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.57% (3.6469 => 3.7043, std. dev.: 0.0069) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (1.9290 => 1.9554, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.52% (22.5627 => 21.0925, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.05% (0.0997 => 0.0847, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2308 => 1.1097, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.84% (20.3410 => 18.5431, std. dev.: 0.0713) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3086, std. dev.: 0.0124) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.16% (1.9762 => 1.9137, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5909, std. dev.: 0.0147) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4464, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5034, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2525, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7925, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: -1.47% (3.0263 => 2.9817, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0008) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1553, std. dev.: 0.0513) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2198, std. dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2401, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2515, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8701, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 18:22:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 20:22:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120711012257.025002A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1950?compare_to=1948&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1950, Order: 160029, Start Time: 2012-07-11 00:04:40, End Time: 2012-07-11 01:23:00 To: 1948, Order: 160017, Start Time: 2012-07-10 22:18:25, End Time: 2012-07-10 23:36:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (60 on baseline) Performance Improvements: 10 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 921 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.40% (54.5980 => 56.4531, std. dev.: 0.1607) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.49% (14.0386 => 13.5487, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.27% (1.6132 => 1.5927, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.25% (2.3914 => 2.3615, std. dev.: 0.0035) MultiSource/Applications/siod/siod: -1.25% (2.3359 => 2.3067, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.23% (3.7377 => 3.6918, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.13% (3.9704 => 3.9257, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: -1.12% (0.9026 => 0.8925, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (3.8411 => 3.7994, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: -1.06% (1.2036 => 1.1908, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: -1.01% (5.8939 => 5.8342, std. dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.69% (10.3673 => 13.5487, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.51% (1.1194 => 1.2482, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 8.98% (0.3473 => 0.3785, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.65% (0.3516 => 0.3820, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.64% (0.3497 => 0.3799, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.61% (0.3543 => 0.3848, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.61% (0.3543 => 0.3848, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.59% (0.3561 => 0.3867, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.42% (0.3694 => 0.4005, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.05% (0.3828 => 0.4136, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.03% (0.3886 => 0.4198, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.94% (0.3927 => 0.4239, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.72% (1.7609 => 1.8969, std. dev.: 0.0104) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.23% (2.2022 => 2.3615, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.69% (0.3177 => 0.3326, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.57% (0.4879 => 0.5102, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.53% (10.4361 => 10.9089, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference-object: 4.41% (0.6030 => 0.6296, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.30% (0.5925 => 0.6180, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.17% (7.0540 => 7.3478, std. dev.: 0.0117) SingleSource/UnitTests/ObjC++/property-reference: 4.04% (0.7326 => 0.7622, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 3.87% (0.3282 => 0.3409, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.83% (0.7433 => 0.7718, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.60% (0.5569 => 0.5714, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.60% (0.4615 => 0.4735, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.50% (0.8172 => 0.8376, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.44% (5.0018 => 5.1236, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.41% (14.3668 => 14.7131, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.36% (4.9449 => 5.0617, std. dev.: 0.0038) MultiSource/Applications/hbd/hbd: 2.23% (1.5603 => 1.5951, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 2.20% (0.7835 => 0.8007, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.08% (8.1363 => 8.3055, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5860 => 0.5979, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.03% (2.0665 => 2.1084, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 1.89% (2.0273 => 2.0657, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.89% (4.2646 => 4.3453, std. dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 1.89% (9.4845 => 9.6639, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (1.1861 => 1.2065, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.63% (1.1642 => 1.1832, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 1.51% (3.3354 => 3.3859, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.50% (1.3050 => 1.3246, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.49% (0.8067 => 0.8187, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.49% (1.5415 => 1.5644, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.38% (3.8723 => 3.9257, std. dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 1.30% (5.7591 => 5.8342, std. dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 1.30% (1.2842 => 1.3009, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.24% (0.9765 => 0.9886, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.21% (17.1811 => 17.3890, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.07% (1.4186 => 1.4338, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7468, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.31% (26.0924 => 26.6957, std. dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (1.5086 => 1.5364, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6898, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2365, std. dev.: 0.0437) MultiSource/Applications/spiff/spiff: 1.08% (2.9346 => 2.9663, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.87% (5.2763 => 3.1726, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.45% (5.3855 => 3.6918, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.94% (5.3526 => 3.6967, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.24% (2.9384 => 2.5493, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: -10.60% (22.1758 => 19.8252, std. dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -4.92% (54.1659 => 51.4985, std. dev.: 0.0386) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.38% (3.8922 => 3.7994, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.05% (1.2373 => 1.1129, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.58% (19.9488 => 18.6352, std. dev.: 0.0352) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.87% (8.1563 => 7.9223, std. dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6873, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0847, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 18:44:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 20:44:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120711014448.5CEEE2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1951?compare_to=1946&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1951, Order: 160026, Start Time: 2012-07-10 23:01:52, End Time: 2012-07-11 01:44:53 To: 1946, Order: 160009, Start Time: 2012-07-10 19:49:09, End Time: 2012-07-10 22:32:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (38 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (855 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.27% (0.2143 => 0.2256, std. dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 8.12% (0.3496 => 0.3780, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.98% (0.3446 => 0.3721, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.97% (0.3465 => 0.3741, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.95% (0.3460 => 0.3735, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.90% (0.3442 => 0.3714, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.88% (0.3488 => 0.3763, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.84% (0.3469 => 0.3741, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 7.81% (0.3650 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.58% (0.3643 => 0.3919, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.41% (0.3724 => 0.4000, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.24% (0.5826 => 0.6073, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.87% (0.5889 => 0.6117, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.05% (1.6211 => 1.6705, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.96% (0.5026 => 0.5175, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (0.4361 => 0.4489, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.92% (0.4994 => 0.5140, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.82% (3.5627 => 3.6630, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 2.80% (0.7171 => 0.7372, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.63% (0.5900 => 0.6055, std. dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 2.54% (4.2109 => 4.3177, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: 2.51% (0.4029 => 0.4130, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.36% (1.3152 => 1.3463, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.27% (2.0673 => 2.1143, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.22% (0.5000 => 0.5111, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.21% (0.9909 => 1.0128, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 2.01% (23.5202 => 23.9939, std. dev.: 0.0194) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.92% (1.9694 => 2.0073, std. dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.91% (2.7292 => 2.7813, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.78% (1.9966 => 2.0322, std. dev.: 0.0063) MultiSource/Applications/d/make_dparser: 1.78% (1.0781 => 1.0973, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.64% (4.4195 => 4.4922, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.38% (0.9697 => 0.9831, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 1.32% (2.1653 => 2.1939, std. dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 1.32% (5.5417 => 5.6146, std. dev.: 0.0112) MultiSource/Benchmarks/MallocBench/gs/gs: 1.29% (1.8794 => 1.9037, std. dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 1.25% (4.6177 => 4.6752, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 1.17% (2.1013 => 2.1258, std. dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.2122 => 0.2256, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.39% (11.9555 => 11.6698, std. dev.: 0.0069) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 19:32:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 21:32:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120711023251.6C6C82A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1952?compare_to=1949&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1952, Order: 160030, Start Time: 2012-07-11 01:19:04, End Time: 2012-07-11 02:32:54 To: 1949, Order: 160028, Start Time: 2012-07-10 23:37:21, End Time: 2012-07-11 00:51:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (126 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.17% (2.0176 => 2.3035, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.59% (0.7061 => 0.7597, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.32% (0.5818 => 0.6244, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.01% (0.5748 => 0.6151, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.61% (0.3130 => 0.3337, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.38% (0.7038 => 0.7487, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 6.27% (1.3693 => 1.4551, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.79% (0.1986 => 0.2101, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 5.73% (0.4328 => 0.4576, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.2721 => 0.2872, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.50% (0.2782 => 0.2935, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2781 => 0.2933, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.40% (0.7710 => 0.8126, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3022 => 0.3185, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2690 => 0.2835, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.34% (0.5265 => 0.5546, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.24% (0.2655 => 0.2794, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 5.22% (0.2607 => 0.2743, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.21% (0.2726 => 0.2868, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.17% (0.3580 => 0.3765, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.12% (0.2596 => 0.2729, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2761 => 0.2902, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (0.2765 => 0.2906, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.00% (0.2760 => 0.2898, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.98% (3.9660 => 4.1635, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.94% (1.9828 => 2.0807, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.90% (0.3489 => 0.3660, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.89% (0.3107 => 0.3259, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.82% (0.2696 => 0.2826, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.76% (0.3149 => 0.3299, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.74% (0.3899 => 0.4084, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.62% (0.3485 => 0.3646, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.3453 => 0.3610, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.48% (0.3192 => 0.3335, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.44% (0.4390 => 0.4585, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 4.39% (0.3578 => 0.3735, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.38% (0.4016 => 0.4192, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.34% (0.6959 => 0.7261, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2988 => 0.3116, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 4.25% (0.3789 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.24% (0.3914 => 0.4080, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.20% (0.4003 => 0.4171, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.19% (0.3650 => 0.3803, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.19% (0.3293 => 0.3431, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 4.17% (0.3646 => 0.3798, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.17% (0.3601 => 0.3751, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.16% (0.3534 => 0.3681, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.15% (0.3756 => 0.3912, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.14% (0.2925 => 0.3046, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 4.09% (0.3623 => 0.3771, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.05% (0.9199 => 0.9572, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 4.04% (0.3940 => 0.4099, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.00% (13.2842 => 13.8152, std. dev.: 0.0188) MultiSource/Applications/kimwitu++/kc: 3.99% (16.6129 => 17.2761, std. dev.: 0.0162) MultiSource/Applications/SPASS/SPASS: 3.95% (13.8202 => 14.3659, std. dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.94% (0.5577 => 0.5797, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.3868 => 0.4016, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.78% (1.2193 => 1.2654, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.2945 => 0.3055, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.40% (0.7506 => 0.7761, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (1.4563 => 1.5056, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.35% (1.2292 => 1.2704, std. dev.: 0.0110) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (3.8646 => 3.9933, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.26% (0.5637 => 0.5821, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.26% (1.3245 => 1.3677, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.20% (1.3813 => 1.4255, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.13% (1.1364 => 1.1720, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.05% (1.9270 => 1.9857, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.04% (1.3819 => 1.4239, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.01% (0.3755 => 0.3868, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.98% (1.1061 => 1.1391, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.97% (0.4379 => 0.4509, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.91% (4.9865 => 5.1316, std. dev.: 0.0312) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.87% (7.2180 => 7.4252, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.68% (0.7460 => 0.7660, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.49% (3.6692 => 3.7606, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 2.49% (0.8310 => 0.8517, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (6.5754 => 6.7325, std. dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: 2.39% (14.8535 => 15.2081, std. dev.: 0.0079) MultiSource/Applications/siod/siod: 2.31% (2.1791 => 2.2294, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.30% (0.4791 => 0.4901, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.18% (0.8698 => 0.8888, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.13% (4.3801 => 4.4734, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.96% (16.2614 => 16.5803, std. dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.86% (0.6135 => 0.6249, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.85% (4.4433 => 4.5255, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.81% (1.1333 => 1.1538, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 1.67% (3.1889 => 3.2420, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 1.66% (14.5298 => 14.7713, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.48% (2.1007 => 2.1317, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2614, std. dev.: 0.0302) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1922, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: 8.36% (1.2998 => 1.4085, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.34% (1.5824 => 1.6986, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.18% (7.4271 => 7.7372, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6795, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.52% (2.8606 => 2.9614, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8294, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4784, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.96% (4.1080 => 4.1887, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.90% (1.4298 => 1.4570, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.90% (3.6469 => 3.7162, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5333, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9571, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1927, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.11% (1.9433 => 1.9649, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.66% (22.5627 => 21.0591, std. dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.92% (0.8818 => 0.8649, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.13% (0.9108 => 0.9005, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.02% (1.2308 => 1.1075, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.54% (20.3410 => 18.4006, std. dev.: 0.1115) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3101, std. dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.27% (1.9762 => 1.9115, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5879, std. dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5115, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2431, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7950, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1326, std. dev.: 0.0151) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.37% (2.5254 => 2.4908, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.36% (3.0263 => 2.9852, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2499, std. dev.: 0.0067) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2207, std. dev.: 0.0388) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2411, std. dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8489, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 20:09:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 22:09:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120711030900.AF9972A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1953?compare_to=1950&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1953, Order: 160031, Start Time: 2012-07-11 01:50:42, End Time: 2012-07-11 03:09:05 To: 1950, Order: 160029, Start Time: 2012-07-11 00:04:40, End Time: 2012-07-11 01:23:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (60 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.14% (51.4985 => 52.0873, std. dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.63% (13.5487 => 13.3283, std. dev.: 0.0069) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.56% (10.3673 => 13.3283, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.72% (1.1194 => 1.2506, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.55% (0.3473 => 0.3770, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.30% (0.3543 => 0.3837, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3516 => 0.3807, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.24% (0.3543 => 0.3835, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.24% (0.3497 => 0.3785, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.17% (0.3561 => 0.3852, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.96% (0.3694 => 0.3988, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.96% (1.7609 => 1.9010, std. dev.: 0.0099) SingleSource/UnitTests/ObjC/exceptions: 7.86% (0.3828 => 0.4129, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.82% (0.3927 => 0.4234, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.69% (0.3886 => 0.4185, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.20% (2.2022 => 2.3607, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 4.94% (0.6030 => 0.6328, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.86% (0.5925 => 0.6213, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.55% (0.4879 => 0.5101, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.50% (0.7326 => 0.7656, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.50% (0.3177 => 0.3320, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.15% (10.4361 => 10.8691, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.87% (7.0540 => 7.3273, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 3.56% (0.3282 => 0.3399, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.55% (0.7433 => 0.7697, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.64% (0.5569 => 0.5716, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.51% (0.8172 => 0.8377, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.45% (0.4615 => 0.4728, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.35% (0.4636 => 0.4745, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (4.9449 => 5.0601, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.25% (5.0018 => 5.1145, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 2.20% (0.7835 => 0.8007, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.11% (14.3668 => 14.6695, std. dev.: 0.0039) MultiSource/Applications/hbd/hbd: 2.10% (1.5603 => 1.5930, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5860 => 0.5982, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 2.00% (9.4845 => 9.6743, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.00% (8.1363 => 8.2991, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.90% (4.2646 => 4.3457, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.69% (2.0665 => 2.1014, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 1.69% (2.0273 => 2.0615, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.56% (0.8067 => 0.8193, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (1.1861 => 1.2045, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.47% (3.3354 => 3.3843, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 1.45% (1.1642 => 1.1811, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.34% (3.8723 => 3.9240, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.27% (1.5415 => 1.5611, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.25% (1.3050 => 1.3213, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.22% (5.7591 => 5.8295, std. dev.: 0.0138) MultiSource/Applications/sqlite3/sqlite3: 1.15% (17.1811 => 17.3782, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.10% (0.9765 => 0.9872, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (2.2024 => 2.2256, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.01% (1.2842 => 1.2972, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9743, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7539, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.29% (26.0924 => 26.6896, std. dev.: 0.0203) SingleSource/Benchmarks/Dhrystone/dry: 1.42% (2.4116 => 2.4458, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.29% (2.6546 => 2.6888, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.24% (9.1159 => 9.2287, std. dev.: 0.0113) MultiSource/Applications/spiff/spiff: 1.04% (2.9346 => 2.9651, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1255, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.94% (5.2763 => 3.1689, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.55% (5.3855 => 3.6865, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.10% (5.3526 => 3.6880, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.19% (2.9384 => 2.5509, std. dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: -10.64% (22.1758 => 19.8158, std. dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: -3.84% (54.1659 => 52.0873, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.38% (3.8922 => 3.7996, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1072, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.77% (19.9488 => 18.5990, std. dev.: 0.0322) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (8.1563 => 7.9246, std. dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6777, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0855, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 21:14:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 23:14:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120711041439.F1B5B2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1954?compare_to=1952&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1954, Order: 160034, Start Time: 2012-07-11 03:00:48, End Time: 2012-07-11 04:14:44 To: 1952, Order: 160030, Start Time: 2012-07-11 01:19:04, End Time: 2012-07-11 02:32:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (125 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (728 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.72% (78.0886 => 80.2102, std. dev.: 0.5843) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.21% (3.8257 => 3.7796, std. dev.: 0.0138) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.83% (2.0176 => 2.2966, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 7.86% (0.7061 => 0.7616, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.44% (0.5818 => 0.6251, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 7.34% (0.5748 => 0.6170, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.61% (0.3130 => 0.3337, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.11% (1.3693 => 1.4530, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.84% (0.1986 => 0.2102, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.73% (0.7710 => 0.8152, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 5.71% (0.4062 => 0.4294, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.50% (0.4328 => 0.4566, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 5.50% (0.7038 => 0.7425, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 5.43% (0.2781 => 0.2932, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.37% (0.2721 => 0.2867, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.32% (0.2782 => 0.2930, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.20% (0.5265 => 0.5539, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 5.20% (0.3578 => 0.3764, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2690 => 0.2829, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.16% (0.2596 => 0.2730, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.02% (0.2628 => 0.2760, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.02% (0.3489 => 0.3664, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.01% (0.2655 => 0.2788, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.00% (0.2760 => 0.2898, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.99% (0.3646 => 0.3828, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.99% (0.2966 => 0.3114, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.99% (0.2726 => 0.2862, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.99% (0.3650 => 0.3832, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.92% (1.9828 => 2.0804, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.91% (3.9660 => 4.1608, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/for-in: 4.91% (0.3789 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 4.89% (0.3623 => 0.3800, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 4.87% (0.4003 => 0.4198, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.87% (0.2937 => 0.3080, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 4.86% (0.3601 => 0.3776, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 4.86% (0.3663 => 0.3841, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 4.85% (0.3914 => 0.4104, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 4.80% (0.3940 => 0.4129, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.78% (0.2761 => 0.2893, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.76% (0.3149 => 0.3299, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.75% (0.3580 => 0.3750, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.75% (0.2696 => 0.2824, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3107 => 0.3252, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.62% (0.3899 => 0.4079, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (0.3485 => 0.3642, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.29% (0.3192 => 0.3329, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.27% (0.6959 => 0.7256, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4016 => 0.4187, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.26% (0.3453 => 0.3600, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.12% (0.2988 => 0.3111, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.10% (0.3293 => 0.3428, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.07% (0.3534 => 0.3678, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.03% (16.6129 => 17.2820, std. dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.02% (0.3756 => 0.3907, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.90% (13.2842 => 13.8022, std. dev.: 0.0110) MultiSource/Applications/SPASS/SPASS: 3.86% (13.8202 => 14.3530, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.83% (0.9199 => 0.9551, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 3.77% (0.3868 => 0.4014, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.63% (1.2193 => 1.2635, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 3.59% (0.2925 => 0.3030, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 3.46% (0.2945 => 0.3047, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.44% (0.5577 => 0.5769, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.41% (1.4563 => 1.5060, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.30% (0.7506 => 0.7754, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.25% (0.5637 => 0.5820, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.13% (0.4379 => 0.4516, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.12% (1.2292 => 1.2675, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 3.11% (3.8646 => 3.9847, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.10% (1.3245 => 1.3656, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.10% (1.1061 => 1.1404, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.04% (1.3813 => 1.4233, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.03% (1.3819 => 1.4238, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.03% (7.2180 => 7.4365, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (1.1364 => 1.1700, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.94% (1.9270 => 1.9837, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.88% (1.0594 => 1.0899, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3755 => 0.3859, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.76% (0.7460 => 0.7666, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.50% (4.9865 => 5.1112, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.35% (3.6692 => 3.7555, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8310 => 0.8505, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.30% (14.8535 => 15.1958, std. dev.: 0.0111) MultiSource/Applications/JM/ldecod/ldecod: 2.23% (6.5754 => 6.7219, std. dev.: 0.0054) MultiSource/Applications/siod/siod: 2.23% (2.1791 => 2.2276, std. dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.08% (4.3801 => 4.4713, std. dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (0.8698 => 0.8873, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.97% (4.4433 => 4.5308, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.97% (16.2614 => 16.5811, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.78% (1.1333 => 1.1535, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 1.61% (3.1889 => 3.2401, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 1.54% (14.5298 => 14.7529, std. dev.: 0.0172) MultiSource/Applications/SIBsim4/SIBsim4: 1.38% (1.2749 => 1.2925, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.26% (2.1007 => 2.1271, std. dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 26.44% (1.8175 => 2.2980, std. dev.: 0.0402) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.66% (2.0200 => 2.1950, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 8.33% (1.2998 => 1.4081, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.17% (7.4271 => 7.7365, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6781, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.09% (1.0310 => 1.0525, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.80% (3.6469 => 3.7124, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5113, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.42% (1.9433 => 1.9709, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.85% (22.5627 => 21.0174, std. dev.: 0.0200) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.22% (0.8818 => 0.8622, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.47% (0.9108 => 0.8974, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.55% (0.0997 => 0.0842, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.72% (1.2308 => 1.0988, std. dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.69% (20.3410 => 18.5727, std. dev.: 0.0773) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.92% (1.3780 => 1.3102, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9126, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5847, std. dev.: 0.0132) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5088, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2557, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7940, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2320, std. dev.: 0.0059) MultiSource/Applications/spiff/spiff: -1.34% (3.0263 => 2.9857, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2149, std. dev.: 0.0136) MultiSource/Applications/lua/lua: -1.25% (26.5159 => 26.1834, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.12% (3.8887 => 3.8451, std. dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2591, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 21:55:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 23:55:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120711045512.AFB4C2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/1955?compare_to=1953&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1955, Order: 160034, Start Time: 2012-07-11 03:36:54, End Time: 2012-07-11 04:55:17 To: 1953, Order: 160031, Start Time: 2012-07-11 01:50:42, End Time: 2012-07-11 03:09:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (63 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 927 (792 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.30% (13.3283 => 13.6353, std. dev.: 0.0141) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.21% (3.6880 => 3.7326, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.19% (3.6865 => 3.7305, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.01% (1.3132 => 1.3265, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.27% (52.0873 => 51.4280, std. dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.52% (10.3673 => 13.6353, std. dev.: 0.0141) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.44% (1.1194 => 1.2587, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.49% (0.3473 => 0.3768, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.46% (1.7609 => 1.9098, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.21% (0.3543 => 0.3834, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.21% (0.3497 => 0.3784, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.20% (2.2022 => 2.3827, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/exceptions-4: 8.19% (0.3543 => 0.3833, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.14% (0.3561 => 0.3851, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-3: 8.11% (0.3516 => 0.3801, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.90% (0.3694 => 0.3986, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/property: 7.80% (0.3886 => 0.4189, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.76% (0.3828 => 0.4125, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.66% (0.3927 => 0.4228, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.39% (0.4879 => 0.5142, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.07% (0.3177 => 0.3338, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.94% (0.2065 => 0.2167, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 4.84% (10.4361 => 10.9408, std. dev.: 0.0168) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.76% (7.0540 => 7.3901, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/oourafft: 4.63% (0.3282 => 0.3434, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference-object: 4.58% (0.6030 => 0.6306, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.52% (0.5925 => 0.6193, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.19% (0.7326 => 0.7633, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 4.00% (0.7433 => 0.7730, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.02% (0.8172 => 0.8419, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5569 => 0.5736, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.88% (0.5860 => 0.6029, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.79% (5.0018 => 5.1415, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 2.71% (0.7835 => 0.8047, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.69% (4.9449 => 5.0778, std. dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 2.65% (9.4845 => 9.7363, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.62% (14.3668 => 14.7430, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.46% (8.1363 => 8.3364, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.31% (4.2646 => 4.3629, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.15% (2.0273 => 2.0709, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.11% (0.8067 => 0.8237, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 2.08% (1.5603 => 1.5928, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.02% (1.1861 => 1.2101, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.97% (5.7591 => 5.8725, std. dev.: 0.0048) MultiSource/Applications/d/make_dparser: 1.91% (3.3354 => 3.3991, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.82% (1.3050 => 1.3287, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.79% (1.5415 => 1.5691, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 1.79% (3.8723 => 3.9415, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.63% (0.6450 => 0.6555, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.61% (1.4186 => 1.4415, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.61% (0.9765 => 0.9922, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.50% (17.1811 => 17.4395, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.14% (2.0665 => 2.0900, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 1.11% (1.1840 => 1.1972, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.07% (1.5859 => 1.6028, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.01% (2.2969 => 2.3200, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9743, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7492, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.12% (26.0924 => 26.6464, std. dev.: 0.0200) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5358, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.31% (9.1159 => 9.2356, std. dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.29% (2.6546 => 2.6889, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.13% (2.9346 => 2.9677, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.66% (5.2763 => 3.1838, std. dev.: 0.0134) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.73% (5.3855 => 3.7305, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.27% (5.3526 => 3.7326, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.00% (2.9384 => 2.5565, std. dev.: 0.0111) MultiSource/Applications/ClamAV/clamscan: -10.28% (22.1758 => 19.8951, std. dev.: 0.0191) SingleSource/UnitTests/Vector/constpool: -5.05% (54.1659 => 51.4280, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.92% (3.8922 => 3.8173, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.61% (1.2373 => 1.1060, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.96% (19.9488 => 18.5602, std. dev.: 0.0519) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.91% (8.1563 => 7.9190, std. dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6880, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0868, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 10 21:55:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 10 Jul 2012 23:55:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120711045553.2713A2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/1956?compare_to=1951&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1956, Order: 160031, Start Time: 2012-07-11 02:12:41, End Time: 2012-07-11 04:55:57 To: 1951, Order: 160026, Start Time: 2012-07-10 23:01:52, End Time: 2012-07-11 01:44:53 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 5 (60 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 946 (833 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.41% (0.9831 => 0.9970, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.17% (2.1143 => 2.1390, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.05% (1.0128 => 1.0234, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.46% (52.4386 => 54.2534, std. dev.: 0.3039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.33% (125.2270 => 129.4025, std. dev.: 1.2024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: -5.27% (0.2256 => 0.2137, std. dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 9.41% (0.3496 => 0.3825, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.38% (0.3442 => 0.3765, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.32% (0.3488 => 0.3813, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.29% (0.3446 => 0.3766, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.26% (0.3465 => 0.3786, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.25% (0.3460 => 0.3780, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.14% (0.3469 => 0.3786, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.00% (0.3643 => 0.3971, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 8.93% (0.3650 => 0.3976, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.70% (0.3724 => 0.4048, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.37% (0.5826 => 0.6139, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.01% (0.5889 => 0.6184, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.30% (0.5026 => 0.5242, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.20% (0.5900 => 0.6148, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.94% (0.3930 => 0.4085, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 3.81% (0.7171 => 0.7444, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/fibo: 3.78% (0.2725 => 0.2828, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.76% (0.4361 => 0.4525, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.74% (0.2729 => 0.2831, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.73% (1.6211 => 1.6815, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.73% (0.2738 => 0.2840, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.72% (3.5627 => 3.6952, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hello: 3.68% (0.2714 => 0.2814, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2750 => 0.2851, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.62% (0.2875 => 0.2979, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.49% (0.3096 => 0.3204, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.47% (2.0673 => 2.1390, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.40% (0.3060 => 0.3164, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.31% (0.3267 => 0.3375, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.30% (0.4029 => 0.4162, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.28% (0.9909 => 1.0234, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3258 => 0.3363, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.21% (0.3362 => 0.3470, std. dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: 3.21% (4.2109 => 4.3460, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.19% (0.3195 => 0.3297, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.09% (1.3152 => 1.3559, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sieve: 3.09% (0.3726 => 0.3841, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.07% (0.3678 => 0.3791, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.03% (0.3625 => 0.3735, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.89% (2.7292 => 2.8081, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.84% (0.4994 => 0.5136, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 2.82% (0.9697 => 0.9970, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3690 => 0.3793, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.68% (0.5000 => 0.5134, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4146 => 0.4252, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.52% (1.9694 => 2.0191, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.51% (1.0781 => 1.1052, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 2.49% (0.4251 => 0.4357, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.32% (0.4658 => 0.4766, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.28% (1.9966 => 2.0422, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (4.4195 => 4.5177, std. dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (2.1653 => 2.2117, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 2.12% (2.1013 => 2.1459, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 2.09% (23.5202 => 24.0129, std. dev.: 0.0117) MultiSource/Applications/JM/lencod/lencod: 1.88% (4.6177 => 4.7044, std. dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.86% (0.6435 => 0.6555, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 1.80% (1.8794 => 1.9132, std. dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 1.77% (5.5417 => 5.6399, std. dev.: 0.0061) MultiSource/Applications/treecc/treecc: 1.74% (0.7875 => 0.8012, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.66% (1.4269 => 1.4506, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.93% (11.9555 => 11.7246, std. dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 01:09:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 03:09:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120711080920.AF1662A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1957?compare_to=1956&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1957, Order: 160034, Start Time: 2012-07-11 05:23:36, End Time: 2012-07-11 08:09:25 To: 1956, Order: 160031, Start Time: 2012-07-11 02:12:41, End Time: 2012-07-11 04:55:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (31 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (862 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.28% (0.2164 => 0.2300, std. dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 9.29% (0.3465 => 0.3787, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/for-in: 9.27% (0.3496 => 0.3820, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.26% (0.3446 => 0.3765, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.11% (0.3469 => 0.3785, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.02% (0.3460 => 0.3772, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.01% (0.3442 => 0.3752, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.94% (0.3488 => 0.3800, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 8.74% (0.3650 => 0.3969, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.59% (0.3643 => 0.3956, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.35% (0.3724 => 0.4035, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.91% (0.5826 => 0.6112, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.72% (0.5889 => 0.6167, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (1.6211 => 1.6800, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.56% (3.5627 => 3.6894, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 3.50% (0.7171 => 0.7422, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.26% (0.4361 => 0.4503, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 3.23% (0.4029 => 0.4159, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.21% (0.3930 => 0.4056, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.96% (0.9909 => 1.0202, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: 2.82% (4.2109 => 4.3295, std. dev.: 0.0112) MultiSource/Applications/d/make_dparser: 2.37% (1.0781 => 1.1036, std. dev.: 0.0035) MultiSource/Applications/hbd/hbd: 2.28% (0.9697 => 0.9918, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 1.94% (23.5202 => 23.9776, std. dev.: 0.0283) MultiSource/Benchmarks/MallocBench/gs/gs: 1.77% (1.8794 => 1.9126, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 1.71% (2.1013 => 2.1373, std. dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: 1.64% (5.5417 => 5.6325, std. dev.: 0.0144) MultiSource/Applications/JM/ldecod/ldecod: 1.60% (2.1653 => 2.1999, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.59% (4.6177 => 4.6910, std. dev.: 0.0057) MultiSource/Applications/treecc/treecc: 1.35% (0.7875 => 0.7981, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 1.35% (1.4269 => 1.4461, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.38% (0.2162 => 0.2300, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.18% (11.9555 => 11.6943, std. dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 01:30:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 03:30:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120711083049.3E3212A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1958?compare_to=1954&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1958, Order: 160036, Start Time: 2012-07-11 07:16:25, End Time: 2012-07-11 08:30:53 To: 1954, Order: 160034, Start Time: 2012-07-11 03:00:48, End Time: 2012-07-11 04:14:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (130 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (721 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.66% (2.0176 => 2.2932, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 8.16% (0.5818 => 0.6293, std. dev.: 0.0071) SingleSource/UnitTests/ObjC++/Hello: 7.99% (0.5748 => 0.6207, std. dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference: 7.38% (0.7061 => 0.7582, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.1986 => 0.2113, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 6.14% (1.3693 => 1.4534, std. dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 6.04% (0.2781 => 0.2949, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 5.96% (0.4328 => 0.4586, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.95% (0.3578 => 0.3791, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.89% (0.3650 => 0.3865, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 5.85% (0.7038 => 0.7450, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 5.75% (0.3914 => 0.4139, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.73% (0.7710 => 0.8152, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/parameter-passing: 5.72% (0.4003 => 0.4232, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 5.71% (0.3623 => 0.3830, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 5.69% (0.3601 => 0.3806, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3022 => 0.3194, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.69% (0.2760 => 0.2917, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 5.68% (0.3646 => 0.3853, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.64% (0.2782 => 0.2939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.62% (0.3789 => 0.4002, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 5.60% (0.3663 => 0.3868, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash: 5.54% (0.4062 => 0.4287, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.52% (0.2607 => 0.2751, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.50% (0.2655 => 0.2801, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2596 => 0.2738, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.41% (0.3940 => 0.4153, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.39% (0.2765 => 0.2914, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.37% (0.2628 => 0.2769, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.35% (0.2937 => 0.3094, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.34% (0.5265 => 0.5546, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.33% (0.2966 => 0.3124, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.32% (0.2761 => 0.2908, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.29% (1.9828 => 2.0877, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.19% (0.2696 => 0.2836, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.11% (3.9660 => 4.1686, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.3107 => 0.3265, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.03% (0.3580 => 0.3760, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.98% (0.3899 => 0.4093, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.97% (0.4390 => 0.4608, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 4.95% (0.3453 => 0.3624, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.85% (0.3485 => 0.3654, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.73% (0.4016 => 0.4206, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.73% (0.3192 => 0.3343, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.67% (0.6959 => 0.7284, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/matrix: 4.59% (0.2988 => 0.3125, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3293 => 0.3443, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3534 => 0.3691, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.27% (16.6129 => 17.3218, std. dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (0.3756 => 0.3915, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.09% (0.9199 => 0.9575, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 4.05% (13.8202 => 14.3794, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.98% (13.2842 => 13.8131, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/objinst: 3.97% (0.2945 => 0.3062, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.81% (1.2193 => 1.2657, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 3.76% (0.2925 => 0.3035, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.73% (0.5577 => 0.5785, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.60% (1.4563 => 1.5087, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.58% (0.5637 => 0.5839, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.45% (0.3246 => 0.3358, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.41% (0.7506 => 0.7762, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.34% (1.2292 => 1.2703, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (3.8646 => 3.9938, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.34% (1.3245 => 1.3687, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.22% (0.4379 => 0.4520, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.20% (1.1364 => 1.1728, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.20% (0.3755 => 0.3875, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.16% (1.3813 => 1.4249, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.11% (1.3819 => 1.4249, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.10% (1.1061 => 1.1404, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.09% (7.2180 => 7.4407, std. dev.: 0.0118) MultiSource/Applications/treecc/treecc: 3.06% (1.9270 => 1.9859, std. dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.0594 => 1.0913, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.88% (0.7460 => 0.7675, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.77% (4.9865 => 5.1246, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.57% (3.6692 => 3.7636, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 2.48% (0.8310 => 0.8516, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.41% (14.8535 => 15.2116, std. dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.37% (4.3801 => 4.4837, std. dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (6.5754 => 6.7257, std. dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 2.21% (16.2614 => 16.6204, std. dev.: 0.0273) MultiSource/Applications/siod/siod: 2.18% (2.1791 => 2.2267, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.15% (0.8698 => 0.8885, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.15% (0.4791 => 0.4894, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.07% (4.4433 => 4.5351, std. dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.90% (1.1333 => 1.1548, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.87% (0.6135 => 0.6250, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 1.79% (3.1889 => 3.2461, std. dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: 1.72% (14.5298 => 14.7794, std. dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 1.61% (1.2749 => 1.2954, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.57% (2.1007 => 2.1336, std. dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2690, std. dev.: 0.0189) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.59% (2.0200 => 2.1935, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.96% (1.2998 => 1.3903, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (0.2093 => 0.2197, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (4.5947 => 4.8136, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.02% (7.4271 => 7.7260, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6761, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4801, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9773, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1913, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5349, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (3.6469 => 3.7094, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9575, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1928, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.79% (22.5627 => 21.0300, std. dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.13% (0.3511 => 0.3401, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.27% (0.8818 => 0.8618, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.35% (0.9108 => 0.8985, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.74% (1.2308 => 1.1109, std. dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.01% (20.3410 => 18.5082, std. dev.: 0.0895) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.84% (1.3780 => 1.3113, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.29% (1.9762 => 1.9111, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5878, std. dev.: 0.0219) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.32% (0.4867 => 0.4754, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.01% (6.6320 => 6.4988, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2538, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7962, std. dev.: 0.0018) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1286, std. dev.: 0.0191) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: -1.37% (3.0263 => 2.9847, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2147, std. dev.: 0.0160) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8686, std. dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2530, std. dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2439, std. dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8485, std. dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 01:34:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 03:34:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120711083414.6780F2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1959?compare_to=1955&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1959, Order: 160036, Start Time: 2012-07-11 07:15:52, End Time: 2012-07-11 08:34:18 To: 1955, Order: 160034, Start Time: 2012-07-11 03:36:54, End Time: 2012-07-11 04:55:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (58 on baseline) Performance Improvements: 3 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (797 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.12% (13.6353 => 13.3469, std. dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.40% (55.8966 => 54.5559, std. dev.: 0.1900) SingleSource/Benchmarks/Misc/fbench: -1.13% (2.2992 => 2.2732, std. dev.: 0.0091) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.74% (10.3673 => 13.3469, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.77% (1.1194 => 1.2511, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.38% (0.1432 => 0.1552, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.35% (1.7609 => 1.9080, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: 8.32% (0.3473 => 0.3762, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.07% (0.3543 => 0.3829, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-2: 8.06% (0.3497 => 0.3779, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.02% (0.3516 => 0.3798, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.02% (0.3543 => 0.3827, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/synchronized: 7.95% (0.3561 => 0.3844, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.94% (2.2022 => 2.3771, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 7.85% (0.3694 => 0.3984, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.72% (0.3886 => 0.4186, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.65% (0.3828 => 0.4121, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.3927 => 0.4227, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.94% (0.2065 => 0.2167, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.69% (0.3177 => 0.3326, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 4.58% (0.6030 => 0.6306, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.53% (7.0540 => 7.3735, std. dev.: 0.0100) SingleSource/UnitTests/ObjC++/Hello: 4.46% (0.5925 => 0.6189, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.31% (10.4361 => 10.8862, std. dev.: 0.0192) MultiSource/Applications/lambda-0_1_3/lambda: 4.12% (0.7433 => 0.7739, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 3.56% (0.7326 => 0.7587, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.93% (0.5569 => 0.5732, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.84% (0.4615 => 0.4746, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.74% (5.0018 => 5.1386, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.69% (4.9449 => 5.0781, std. dev.: 0.0101) MultiSource/Applications/spiff/spiff: 2.59% (0.7835 => 0.8038, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (14.3668 => 14.7264, std. dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 2.43% (9.4845 => 9.7153, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.27% (8.1363 => 8.3212, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.23% (4.2646 => 4.3599, std. dev.: 0.0058) MultiSource/Applications/treecc/treecc: 2.20% (2.0273 => 2.0720, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.95% (1.1861 => 1.2092, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.92% (1.5603 => 1.5902, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.88% (1.5415 => 1.5705, std. dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 1.88% (5.7591 => 5.8671, std. dev.: 0.0058) MultiSource/Applications/d/make_dparser: 1.83% (3.3354 => 3.3965, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 1.75% (3.8723 => 3.9399, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.69% (1.3050 => 1.3270, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.66% (0.6450 => 0.6557, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.62% (1.4186 => 1.4416, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.56% (0.9765 => 0.9917, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 1.44% (17.1811 => 17.4284, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.42% (2.2024 => 2.2337, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.10% (2.0665 => 2.0892, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9743, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.80% (1.1145 => 1.1903, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7572, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.28% (26.0924 => 26.6874, std. dev.: 0.0183) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.5086 => 1.5375, std. dev.: 0.0112) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2430, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6890, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.07% (2.9346 => 2.9659, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1261, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.96% (5.2763 => 3.1680, std. dev.: 0.0086) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.94% (5.3855 => 3.7191, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.56% (5.3526 => 3.7166, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.54% (2.9384 => 2.5404, std. dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: -10.36% (22.1758 => 19.8785, std. dev.: 0.0672) SingleSource/UnitTests/Vector/constpool: -5.29% (54.1659 => 51.3020, std. dev.: 0.0874) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.95% (3.8922 => 3.8164, std. dev.: 0.0269) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.85% (1.2373 => 1.1154, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.87% (19.9488 => 18.5783, std. dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.79% (8.1563 => 7.9290, std. dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6857, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0820, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 03:41:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 05:41:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120711104146.805C12A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1960?compare_to=1958&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1960, Order: 160037, Start Time: 2012-07-11 09:28:04, End Time: 2012-07-11 10:41:50 To: 1958, Order: 160036, Start Time: 2012-07-11 07:16:25, End Time: 2012-07-11 08:30:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.38% (1.3903 => 1.4095, std. dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.54% (2.0176 => 2.2907, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 8.11% (0.5818 => 0.6290, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.90% (0.5748 => 0.6202, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.48% (0.7061 => 0.7589, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.09% (0.1986 => 0.2107, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 6.00% (1.3693 => 1.4515, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 5.95% (0.3578 => 0.3791, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.86% (0.3650 => 0.3864, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.85% (0.4328 => 0.4581, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 5.78% (0.3601 => 0.3809, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 5.76% (0.3646 => 0.3856, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.75% (0.7038 => 0.7443, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 5.75% (0.2781 => 0.2941, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 5.73% (0.3663 => 0.3873, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.73% (0.3789 => 0.4006, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3022 => 0.3195, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 5.70% (0.3914 => 0.4137, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.66% (0.3623 => 0.3828, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.65% (0.4003 => 0.4229, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.59% (0.4062 => 0.4289, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2782 => 0.2937, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2607 => 0.2752, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.54% (0.2690 => 0.2839, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 5.51% (0.3940 => 0.4157, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.48% (0.2628 => 0.2772, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.43% (0.7710 => 0.8129, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.2966 => 0.3126, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.36% (0.2760 => 0.2908, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.36% (0.2726 => 0.2872, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.35% (0.2765 => 0.2913, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.35% (0.2655 => 0.2797, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 5.35% (0.2937 => 0.3094, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.2721 => 0.2865, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.28% (0.5265 => 0.5543, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.28% (0.2596 => 0.2733, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.27% (0.3489 => 0.3673, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.26% (1.9828 => 2.0870, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.15% (0.3107 => 0.3267, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.14% (0.3580 => 0.3764, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.3899 => 0.4094, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 4.99% (0.3149 => 0.3306, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.96% (3.9660 => 4.1629, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 4.92% (0.3192 => 0.3349, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.79% (0.3485 => 0.3652, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.74% (0.3293 => 0.3449, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 4.55% (0.2988 => 0.3124, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.47% (0.3756 => 0.3924, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 4.47% (0.3534 => 0.3692, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.44% (0.6959 => 0.7268, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.35% (0.4390 => 0.4581, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 4.34% (0.3868 => 0.4036, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.29% (16.6129 => 17.3258, std. dev.: 0.0096) MultiSource/Benchmarks/McCat/09-vor/vor: 4.03% (0.2925 => 0.3043, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.02% (13.8202 => 14.3757, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/objinst: 4.01% (0.2945 => 0.3063, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.97% (0.9199 => 0.9564, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.5577 => 0.5795, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.88% (13.2842 => 13.7993, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.71% (1.2193 => 1.2645, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.45% (0.7506 => 0.7765, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.39% (1.2292 => 1.2709, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.38% (1.4563 => 1.5055, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.36% (0.3246 => 0.3355, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (3.8646 => 3.9901, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.24% (1.3245 => 1.3674, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.22% (1.3819 => 1.4264, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.21% (0.5637 => 0.5818, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.20% (0.3755 => 0.3875, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.17% (0.4379 => 0.4518, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.13% (1.1061 => 1.1407, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.13% (7.2180 => 7.4437, std. dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.07% (1.3813 => 1.4237, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.00% (1.1364 => 1.1705, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.96% (1.9270 => 1.9841, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 2.88% (1.0594 => 1.0899, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.80% (4.9865 => 5.1262, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.68% (0.7460 => 0.7660, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.59% (3.6692 => 3.7644, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8310 => 0.8505, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (6.5754 => 6.7262, std. dev.: 0.0175) MultiSource/Applications/JM/lencod/lencod: 2.29% (14.8535 => 15.1933, std. dev.: 0.0035) MultiSource/Applications/siod/siod: 2.19% (2.1791 => 2.2269, std. dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.08% (0.8698 => 0.8879, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.07% (4.3801 => 4.4708, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.97% (16.2614 => 16.5822, std. dev.: 0.0124) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.89% (4.4433 => 4.5274, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.88% (1.1333 => 1.1546, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 1.67% (3.1889 => 3.2423, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 1.62% (14.5298 => 14.7653, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.1007 => 2.1304, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.93% (1.8175 => 2.2706, std. dev.: 0.0528) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1912, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: 8.44% (1.2998 => 1.4095, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.89% (0.9996 => 1.0785, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.89% (7.4271 => 7.7163, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6790, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4787, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0310 => 1.0561, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5089 => 1.5315, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.48% (3.6469 => 3.7010, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.40% (1.9433 => 1.9705, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1940, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.5627 => 21.0512, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.33% (0.3511 => 0.3394, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.43% (0.8818 => 0.8604, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.46% (0.9108 => 0.8975, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1126, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.74% (20.3410 => 18.5640, std. dev.: 0.0227) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3130, std. dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9830, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.19% (1.9762 => 1.9131, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5802, std. dev.: 0.0164) SingleSource/Benchmarks/Dhrystone/dry: -2.52% (2.5089 => 2.4458, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5070, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7945, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4890, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.44% (6.3560 => 6.2646, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8615, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: -1.38% (3.0263 => 2.9845, std. dev.: 0.0014) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1509, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2232, std. dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2533, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2438, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 03:46:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 05:46:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120711104624.1C53D2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1961?compare_to=1959&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1961, Order: 160037, Start Time: 2012-07-11 09:28:11, End Time: 2012-07-11 10:46:30 To: 1959, Order: 160036, Start Time: 2012-07-11 07:15:52, End Time: 2012-07-11 08:34:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (60 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.74% (54.5559 => 56.5978, std. dev.: 0.0566) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.66% (78.2454 => 81.1129, std. dev.: 0.2679) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.91% (10.3673 => 13.4686, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.92% (1.1194 => 1.2528, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.40% (1.7609 => 1.9089, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.34% (2.2022 => 2.3858, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.26% (0.3473 => 0.3760, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.07% (0.3543 => 0.3829, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.02% (0.3543 => 0.3827, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.95% (0.3497 => 0.3775, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.91% (0.3516 => 0.3794, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.86% (0.3561 => 0.3841, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.74% (0.3694 => 0.3980, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/parameter-passing: 7.44% (0.3927 => 0.4219, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.42% (0.3828 => 0.4112, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 7.39% (0.3886 => 0.4173, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.99% (0.2065 => 0.2168, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.90% (0.4879 => 0.5118, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.63% (10.4361 => 10.9190, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.63% (0.3177 => 0.3324, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.60% (7.0540 => 7.3784, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/oourafft: 4.51% (0.3282 => 0.3430, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 4.08% (0.6030 => 0.6276, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 4.00% (0.5925 => 0.6162, std. dev.: 0.0089) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.7433 => 0.7720, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 3.19% (0.7326 => 0.7560, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.06% (0.4615 => 0.4756, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (0.8172 => 0.8401, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.76% (4.9449 => 5.0814, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.71% (0.5569 => 0.5720, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 2.58% (9.4845 => 9.7296, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.58% (5.0018 => 5.1306, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.39% (14.3668 => 14.7106, std. dev.: 0.0218) MultiSource/Applications/spiff/spiff: 2.35% (0.7835 => 0.8019, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.25% (8.1363 => 8.3194, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.14% (0.8067 => 0.8240, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5860 => 0.5984, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.99% (4.2646 => 4.3494, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 1.92% (1.5603 => 1.5903, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 1.92% (2.0273 => 2.0662, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.77% (1.5415 => 1.5688, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 1.75% (3.3354 => 3.3939, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 1.68% (3.8723 => 3.9375, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7591 => 5.8545, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 1.62% (1.1642 => 1.1831, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.52% (1.3050 => 1.3249, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.49% (1.4186 => 1.4397, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (2.2024 => 2.2345, std. dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 1.43% (17.1811 => 17.4267, std. dev.: 0.0583) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.41% (0.9765 => 0.9903, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.06% (2.0665 => 2.0885, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7527, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.12% (26.0924 => 26.6450, std. dev.: 0.0278) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5086 => 1.5360, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4474, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2429, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.35% (2.6546 => 2.6905, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 1.09% (2.9346 => 2.9665, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.82% (5.2763 => 3.1751, std. dev.: 0.0134) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.76% (5.3855 => 3.7288, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.35% (5.3526 => 3.7279, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.36% (2.9384 => 2.5458, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -10.55% (22.1758 => 19.8371, std. dev.: 0.0299) SingleSource/UnitTests/Vector/constpool: -5.41% (54.1659 => 51.2356, std. dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.07% (3.8922 => 3.8118, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.23% (1.2373 => 1.1107, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.16% (19.9488 => 18.5200, std. dev.: 0.0793) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9160, std. dev.: 0.0112) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6895, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0834, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 04:20:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 06:20:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120711112033.094CD2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1962?compare_to=1957&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1962, Order: 160036, Start Time: 2012-07-11 08:37:19, End Time: 2012-07-11 11:20:39 To: 1957, Order: 160034, Start Time: 2012-07-11 05:23:36, End Time: 2012-07-11 08:09:25 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (40 on baseline) Performance Improvements: 2 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 946 (852 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.26% (110.5372 => 118.5648, std. dev.: 0.0347) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.85% (124.6428 => 130.6894, std. dev.: 0.5529) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.95% (2.0516 => 2.0917, std. dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.09% (54.2542 => 54.8466, std. dev.: 0.0718) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -5.96% (0.2300 => 0.2163, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.71% (0.3797 => 0.3694, std. dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 9.21% (0.3496 => 0.3818, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.06% (0.3465 => 0.3779, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.02% (0.3446 => 0.3757, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.02% (0.3460 => 0.3772, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.00% (0.3488 => 0.3802, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 8.95% (0.3442 => 0.3750, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.94% (0.3469 => 0.3779, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.71% (0.3650 => 0.3968, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.59% (0.3643 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.35% (0.3724 => 0.4035, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.89% (0.5826 => 0.6111, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 4.84% (0.5889 => 0.6174, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.67% (3.5627 => 3.6934, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.65% (1.6211 => 1.6802, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.64% (0.5900 => 0.6115, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.46% (0.4361 => 0.4512, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 3.46% (0.7171 => 0.7419, std. dev.: 0.0041) MultiSource/Applications/spiff/spiff: 3.38% (0.4029 => 0.4165, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.05% (0.3930 => 0.4050, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.04% (0.5000 => 0.5152, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (2.0673 => 2.1301, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.02% (0.5026 => 0.5178, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.99% (1.3152 => 1.3545, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.96% (0.4994 => 0.5142, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.95% (4.2109 => 4.3350, std. dev.: 0.0083) MultiSource/Applications/hexxagon/hexxagon: 2.92% (0.9909 => 1.0198, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.84% (2.7292 => 2.8068, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.52% (1.9694 => 2.0191, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 2.36% (0.9697 => 0.9926, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.36% (1.9966 => 2.0437, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 2.30% (1.0781 => 1.1029, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (4.4195 => 4.5105, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 1.97% (1.8794 => 1.9164, std. dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 1.81% (23.5202 => 23.9467, std. dev.: 0.0319) MultiSource/Applications/JM/ldecod/ldecod: 1.75% (2.1653 => 2.2031, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 1.65% (5.5417 => 5.6332, std. dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 1.65% (4.6177 => 4.6937, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 1.64% (2.1013 => 2.1358, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 1.52% (0.7875 => 0.7995, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.39% (1.4269 => 1.4467, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.17% (11.9555 => 11.6955, std. dev.: 0.0034) SingleSource/UnitTests/Vector/constpool: -1.01% (2.4764 => 2.4515, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 05:23:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 07:23:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120711122316.60A7B2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1963?compare_to=1960&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1963, Order: 160041, Start Time: 2012-07-11 11:09:34, End Time: 2012-07-11 12:23:22 To: 1960, Order: 160037, Start Time: 2012-07-11 09:28:04, End Time: 2012-07-11 10:41:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.68% (55.0370 => 56.5097, std. dev.: 0.0195) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.55% (2.0176 => 2.2910, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.13% (0.5818 => 0.6291, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.99% (0.7061 => 0.7625, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.86% (0.5748 => 0.6200, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.24% (0.1986 => 0.2110, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (0.4328 => 0.4591, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 6.01% (0.3578 => 0.3793, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.92% (1.3693 => 1.4503, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 5.86% (0.3789 => 0.4011, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 5.83% (0.2781 => 0.2943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.81% (0.3663 => 0.3876, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.81% (0.3650 => 0.3862, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.79% (0.2607 => 0.2758, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.75% (0.3601 => 0.3808, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 5.73% (0.3646 => 0.3855, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.65% (0.3914 => 0.4135, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.62% (0.4003 => 0.4228, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.60% (0.3623 => 0.3826, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.56% (0.3022 => 0.3190, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 5.51% (0.3940 => 0.4157, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.50% (0.2782 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.49% (0.4062 => 0.4285, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.43% (0.2690 => 0.2836, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.42% (0.7710 => 0.8128, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 5.36% (0.2726 => 0.2872, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.33% (0.2628 => 0.2768, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.33% (0.2760 => 0.2907, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.32% (0.2596 => 0.2734, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.30% (0.5265 => 0.5544, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.2721 => 0.2865, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.27% (0.2655 => 0.2795, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.24% (0.2765 => 0.2910, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.24% (0.2937 => 0.3091, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.22% (0.3489 => 0.3671, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (1.9828 => 2.0857, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.16% (0.2966 => 0.3119, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2696 => 0.2834, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2761 => 0.2902, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.08% (0.3580 => 0.3762, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.05% (3.9660 => 4.1661, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.99% (0.3107 => 0.3262, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.99% (0.3149 => 0.3306, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.87% (0.3899 => 0.4089, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.71% (0.3485 => 0.3649, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.69% (0.2988 => 0.3128, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.63% (0.3453 => 0.3613, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.57% (0.3192 => 0.3338, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.48% (0.4016 => 0.4196, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.43% (0.3293 => 0.3439, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.6959 => 0.7262, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 4.33% (0.3534 => 0.3687, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.26% (16.6129 => 17.3199, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.19% (0.4390 => 0.4574, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.15% (0.3756 => 0.3912, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3868 => 0.4027, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.95% (13.8202 => 14.3667, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.91% (0.9199 => 0.9559, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 3.80% (0.2945 => 0.3057, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.80% (13.2842 => 13.7888, std. dev.: 0.0168) MultiSource/Benchmarks/McCat/09-vor/vor: 3.79% (0.2925 => 0.3036, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.74% (1.2193 => 1.2649, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.57% (0.5577 => 0.5776, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (1.4563 => 1.5052, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 3.34% (0.7506 => 0.7757, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.33% (0.3246 => 0.3354, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.31% (0.4379 => 0.4524, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (1.3245 => 1.3683, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 3.25% (1.2292 => 1.2692, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.21% (1.3819 => 1.4263, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.21% (0.5637 => 0.5818, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.21% (1.1061 => 1.1416, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (3.8646 => 3.9871, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.12% (0.3755 => 0.3872, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.09% (7.2180 => 7.4407, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.08% (1.1364 => 1.1714, std. dev.: 0.0044) MultiSource/Applications/treecc/treecc: 3.07% (1.9270 => 1.9862, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.05% (1.3813 => 1.4234, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0906, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.75% (4.9865 => 5.1236, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.75% (0.7460 => 0.7665, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.49% (3.6692 => 3.7605, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 2.37% (0.8310 => 0.8507, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 2.31% (6.5754 => 6.7270, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 2.30% (14.8535 => 15.1954, std. dev.: 0.0056) MultiSource/Applications/siod/siod: 2.29% (2.1791 => 2.2290, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.18% (4.3801 => 4.4756, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.12% (0.8698 => 0.8882, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.94% (4.4433 => 4.5295, std. dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 1.94% (16.2614 => 16.5767, std. dev.: 0.0259) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.87% (1.1333 => 1.1545, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.84% (0.6135 => 0.6248, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.65% (14.5298 => 14.7690, std. dev.: 0.0223) MultiSource/Applications/d/make_dparser: 1.60% (3.1889 => 3.2399, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.59% (0.6283 => 0.6383, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2932, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.34% (2.1007 => 2.1288, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.23% (1.8175 => 2.2760, std. dev.: 0.0477) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1917, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.21% (1.2998 => 1.3935, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.87% (7.4271 => 7.7142, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8313, std. dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4559, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.60% (3.6469 => 3.7053, std. dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9587, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.38% (1.9433 => 1.9702, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1935, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.79% (22.5627 => 21.0303, std. dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.36% (0.3511 => 0.3393, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.45% (0.8818 => 0.8602, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.36% (0.9108 => 0.8984, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.83% (1.2308 => 1.1098, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.96% (20.3410 => 18.5194, std. dev.: 0.0629) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3111, std. dev.: 0.0136) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9125, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5865, std. dev.: 0.0106) SingleSource/Benchmarks/Dhrystone/dry: -2.53% (2.5089 => 2.4454, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.32% (0.4867 => 0.4754, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4996, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.58% (7.1097 => 6.9977, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2571, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7954, std. dev.: 0.0021) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1399, std. dev.: 0.0227) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -1.34% (3.0263 => 2.9856, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2369, std. dev.: 0.0082) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2224, std. dev.: 0.0259) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2557, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 05:32:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 07:32:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120711123208.A353E2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1964?compare_to=1961&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1964, Order: 160041, Start Time: 2012-07-11 11:14:04, End Time: 2012-07-11 12:32:13 To: 1961, Order: 160037, Start Time: 2012-07-11 09:28:11, End Time: 2012-07-11 10:46:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (60 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.35% (3.8236 => 3.8754, std. dev.: 0.0091) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.90% (10.3673 => 13.4670, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.85% (1.1194 => 1.2520, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.36% (2.2022 => 2.3862, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.30% (1.7609 => 1.9070, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.21% (0.3473 => 0.3758, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 7.92% (0.3497 => 0.3774, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3543 => 0.3823, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.82% (0.3543 => 0.3820, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3516 => 0.3789, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.75% (0.3561 => 0.3837, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.63% (0.3694 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.45% (0.3828 => 0.4113, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.44% (0.3927 => 0.4219, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.39% (0.3886 => 0.4173, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.88% (0.4879 => 0.5117, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.66% (0.3177 => 0.3325, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.66% (7.0540 => 7.3825, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 4.57% (10.4361 => 10.9134, std. dev.: 0.0188) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 4.08% (0.6030 => 0.6276, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 3.92% (0.5925 => 0.6157, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.75% (0.7433 => 0.7712, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 3.15% (0.7326 => 0.7557, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.70% (9.4845 => 9.7403, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.69% (0.4615 => 0.4739, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.67% (0.8172 => 0.8390, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.66% (0.5569 => 0.5717, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.57% (5.0018 => 5.1304, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.52% (4.9449 => 5.0694, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.31% (14.3668 => 14.6989, std. dev.: 0.0077) MultiSource/Applications/spiff/spiff: 2.26% (0.7835 => 0.8012, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5860 => 0.5986, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.12% (8.1363 => 8.3086, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.97% (4.2646 => 4.3484, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 1.87% (2.0273 => 2.0653, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 1.87% (1.5603 => 1.5894, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.75% (1.1861 => 1.2068, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 1.73% (1.1642 => 1.1843, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 1.71% (3.3354 => 3.3926, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.64% (0.8067 => 0.8199, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.63% (1.5415 => 1.5667, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.59% (3.8723 => 3.9339, std. dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 1.53% (5.7591 => 5.8472, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.39% (1.3050 => 1.3231, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 1.38% (17.1811 => 17.4186, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.29% (0.9765 => 0.9891, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.27% (1.4186 => 1.4366, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.17% (2.2024 => 2.2282, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9743, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7554, std. dev.: 0.0026) MultiSource/Benchmarks/llubenchmark/llu: 2.58% (3.7781 => 3.8754, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.32% (26.0924 => 26.6987, std. dev.: 0.0089) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (1.5086 => 1.5364, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4472, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2348, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6892, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 1.08% (2.9346 => 2.9663, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.90% (5.2763 => 3.1710, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.76% (5.3855 => 3.7288, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.33% (5.3526 => 3.7294, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.48% (2.9384 => 2.5423, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -10.54% (22.1758 => 19.8392, std. dev.: 0.0329) SingleSource/UnitTests/Vector/constpool: -5.38% (54.1659 => 51.2492, std. dev.: 0.0295) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.14% (3.8922 => 3.8091, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.52% (1.2373 => 1.1071, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.24% (19.9488 => 18.5039, std. dev.: 0.0469) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9145, std. dev.: 0.0097) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6853, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0823, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 07:04:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 09:04:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120711140445.D995A2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1965?compare_to=1963&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1965, Order: 160043, Start Time: 2012-07-11 12:51:08, End Time: 2012-07-11 14:04:50 To: 1963, Order: 160041, Start Time: 2012-07-11 11:09:34, End Time: 2012-07-11 12:23:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (129 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (723 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.78% (2.0176 => 2.2957, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.78% (0.7061 => 0.7610, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 7.48% (0.5818 => 0.6253, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.24% (0.5748 => 0.6164, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.15% (1.3693 => 1.4535, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.04% (0.1986 => 0.2106, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.95% (0.7710 => 0.8169, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 5.87% (0.7038 => 0.7451, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.69% (0.4062 => 0.4293, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.57% (0.5265 => 0.5558, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 5.50% (0.2781 => 0.2934, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.41% (0.4328 => 0.4562, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3022 => 0.3184, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2966 => 0.3123, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.21% (0.2782 => 0.2927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.20% (0.3578 => 0.3764, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2690 => 0.2829, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.16% (0.2596 => 0.2730, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2655 => 0.2790, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.07% (0.2721 => 0.2859, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2628 => 0.2761, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.03% (0.2726 => 0.2863, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.96% (0.2760 => 0.2897, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 4.96% (0.3789 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.96% (0.3650 => 0.3831, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 4.94% (0.3601 => 0.3779, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.92% (0.2765 => 0.2901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 4.91% (0.3663 => 0.3843, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 4.91% (0.3646 => 0.3825, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.90% (0.2937 => 0.3081, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: 4.89% (0.3623 => 0.3800, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 4.88% (0.3914 => 0.4105, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.87% (0.3489 => 0.3659, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 4.87% (0.4003 => 0.4198, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.86% (3.9660 => 4.1586, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 4.85% (0.2761 => 0.2895, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.81% (1.9828 => 2.0781, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 4.80% (0.3107 => 0.3256, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 4.72% (0.3940 => 0.4126, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.70% (0.3149 => 0.3297, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3899 => 0.4080, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.64% (0.3580 => 0.3746, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.56% (0.4390 => 0.4590, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.53% (0.3485 => 0.3643, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.43% (0.6959 => 0.7267, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 4.34% (0.3453 => 0.3603, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.32% (0.3192 => 0.3330, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.31% (0.3293 => 0.3435, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 4.18% (0.2988 => 0.3113, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.18% (0.4016 => 0.4184, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.99% (0.3534 => 0.3675, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.98% (16.6129 => 17.2735, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3756 => 0.3905, std. dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 3.87% (13.8202 => 14.3555, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.3868 => 0.4015, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.79% (0.9199 => 0.9548, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.73% (0.5577 => 0.5785, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.71% (13.2842 => 13.7770, std. dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/objinst: 3.63% (0.2945 => 0.3052, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.63% (1.2193 => 1.2636, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.2925 => 0.3028, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.42% (0.7506 => 0.7763, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.35% (0.5637 => 0.5826, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.29% (1.3245 => 1.3681, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.23% (1.4563 => 1.5034, std. dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 3.23% (1.2292 => 1.2689, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (3.8646 => 3.9840, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.03% (1.1364 => 1.1708, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.99% (0.4379 => 0.4510, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.99% (1.9270 => 1.9846, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.97% (7.2180 => 7.4321, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3755 => 0.3864, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.89% (1.3819 => 1.4218, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.88% (1.1061 => 1.1380, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.84% (1.3813 => 1.4205, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.76% (1.0594 => 1.0886, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.55% (0.7460 => 0.7650, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.52% (4.9865 => 5.1121, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.45% (0.8310 => 0.8514, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.44% (3.6692 => 3.7589, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.10% (6.5754 => 6.7136, std. dev.: 0.0139) MultiSource/Applications/JM/lencod/lencod: 2.09% (14.8535 => 15.1639, std. dev.: 0.0104) MultiSource/Applications/siod/siod: 1.97% (2.1791 => 2.2221, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.97% (4.3801 => 4.4663, std. dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 1.83% (16.2614 => 16.5585, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.83% (0.6135 => 0.6247, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.75% (0.8698 => 0.8850, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (1.1333 => 1.1526, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.68% (4.4433 => 4.5180, std. dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 1.52% (1.2749 => 1.2943, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 1.51% (14.5298 => 14.7485, std. dev.: 0.0084) MultiSource/Applications/d/make_dparser: 1.49% (3.1889 => 3.2364, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.29% (2.1007 => 2.1279, std. dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.88% (1.8175 => 2.2697, std. dev.: 0.0526) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1907, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 7.96% (1.2998 => 1.4033, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.05% (7.4271 => 7.7280, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6782, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.23% (1.0310 => 1.0540, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4560, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6469 => 3.7089, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5334, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9595, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.75% (0.4657 => 0.3970, std. dev.: 0.0083) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.08% (22.5627 => 20.9662, std. dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.70% (0.8818 => 0.8580, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.57% (0.9108 => 0.8965, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.55% (0.0997 => 0.0842, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.00% (1.2308 => 1.1077, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.25% (20.3410 => 18.4602, std. dev.: 0.0638) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3119, std. dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.24% (1.9762 => 1.9121, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5889, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: -2.43% (2.5089 => 2.4479, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5088, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2549, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9982, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7950, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1406, std. dev.: 0.0317) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -1.36% (3.0263 => 2.9851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2418, std. dev.: 0.0210) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2532, std. dev.: 0.0059) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2285, std. dev.: 0.0283) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 07:18:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 09:18:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120711141807.33CE92A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1966?compare_to=1964&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1966, Order: 160043, Start Time: 2012-07-11 12:59:53, End Time: 2012-07-11 14:18:13 To: 1964, Order: 160041, Start Time: 2012-07-11 11:14:04, End Time: 2012-07-11 12:32:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (60 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.42% (13.4670 => 13.7933, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.79% (3.8754 => 3.7672, std. dev.: 0.0093) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.05% (10.3673 => 13.7933, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.02% (1.1194 => 1.2540, std. dev.: 0.0146) SingleSource/UnitTests/ObjC/trivial-interface: 8.47% (0.3473 => 0.3767, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.26% (0.3561 => 0.3855, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.24% (0.3543 => 0.3835, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 8.22% (0.3516 => 0.3805, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.21% (0.3497 => 0.3784, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.19% (0.3543 => 0.3833, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.10% (2.2022 => 2.3805, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.07% (1.7609 => 1.9030, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 7.96% (0.3694 => 0.3988, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 7.71% (0.3828 => 0.4123, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.66% (0.3927 => 0.4228, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.59% (0.3886 => 0.4181, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.02% (0.4879 => 0.5124, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.99% (0.2065 => 0.2168, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.3177 => 0.3333, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.72% (7.0540 => 7.3868, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: 4.53% (0.6030 => 0.6303, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.49% (10.4361 => 10.9045, std. dev.: 0.0173) SingleSource/UnitTests/ObjC++/Hello: 4.41% (0.5925 => 0.6186, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.39% (0.3282 => 0.3426, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 3.67% (0.7433 => 0.7706, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 3.63% (0.7326 => 0.7592, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.78% (0.5569 => 0.5724, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.74% (0.8172 => 0.8396, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.67% (0.4615 => 0.4738, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.46% (5.0018 => 5.1249, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.41% (4.9449 => 5.0642, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (14.3668 => 14.7063, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 2.36% (0.7835 => 0.8020, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.28% (8.1363 => 8.3217, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 2.17% (9.4845 => 9.6899, std. dev.: 0.0127) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.04% (4.2646 => 4.3515, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.01% (0.5860 => 0.5978, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 1.90% (2.0273 => 2.0658, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 1.77% (1.5603 => 1.5879, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.75% (1.1861 => 1.2069, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.69% (0.8067 => 0.8203, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.65% (3.3354 => 3.3903, std. dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 1.64% (5.7591 => 5.8533, std. dev.: 0.0194) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.63% (1.5415 => 1.5666, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.42% (3.8723 => 3.9271, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.39% (1.3050 => 1.3231, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.28% (1.4186 => 1.4367, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.27% (0.9765 => 0.9889, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.20% (17.1811 => 17.3866, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.01% (2.0665 => 2.0874, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7555, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.32% (26.0924 => 26.6989, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (1.5086 => 1.5388, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4474, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2321, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.22% (2.6546 => 2.6869, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 1.14% (2.9346 => 2.9680, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.11% (1.3045 => 1.3190, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1257, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.79% (5.2763 => 3.1770, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.03% (5.3855 => 3.7143, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.53% (5.3526 => 3.7185, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.09% (2.9384 => 2.5537, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -10.50% (22.1758 => 19.8469, std. dev.: 0.0242) SingleSource/UnitTests/Vector/constpool: -5.35% (54.1659 => 51.2701, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.33% (3.8922 => 3.8014, std. dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.23% (0.0998 => 0.0846, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -9.70% (1.2373 => 1.1173, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.07% (19.9488 => 18.5387, std. dev.: 0.0376) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (8.1563 => 7.9161, std. dev.: 0.0113) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6835, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0855, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 07:31:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 09:31:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120711143110.523622A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1967?compare_to=1962&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1967, Order: 160042, Start Time: 2012-07-11 11:48:11, End Time: 2012-07-11 14:31:16 To: 1962, Order: 160036, Start Time: 2012-07-11 08:37:19, End Time: 2012-07-11 11:20:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (40 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (853 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 9.53% (0.3496 => 0.3829, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions-3: 9.39% (0.3460 => 0.3785, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.35% (0.3465 => 0.3789, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.32% (0.3446 => 0.3767, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.27% (0.3442 => 0.3761, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.26% (0.3488 => 0.3811, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.20% (0.3469 => 0.3788, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 9.04% (0.3650 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.95% (0.3643 => 0.3969, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 8.73% (0.3724 => 0.4049, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.03% (0.5826 => 0.6119, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 4.60% (0.5889 => 0.6160, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.33% (0.4361 => 0.4550, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.82% (3.5627 => 3.6989, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.80% (0.5900 => 0.6124, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.76% (1.6211 => 1.6821, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference: 3.46% (0.7171 => 0.7419, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 3.38% (0.4029 => 0.4165, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.13% (0.3930 => 0.4053, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.12% (0.5026 => 0.5183, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.10% (4.2109 => 4.3416, std. dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.09% (2.7292 => 2.8134, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.06% (0.4994 => 0.5147, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.03% (1.3152 => 1.3550, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.76% (0.5000 => 0.5138, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.72% (0.9909 => 1.0179, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.72% (2.0673 => 2.1236, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.53% (1.0781 => 1.1054, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.50% (1.9694 => 2.0187, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.45% (1.9966 => 2.0456, std. dev.: 0.0052) MultiSource/Applications/hbd/hbd: 2.38% (0.9697 => 0.9928, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (4.4195 => 4.5182, std. dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 1.91% (4.6177 => 4.7060, std. dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 1.90% (23.5202 => 23.9682, std. dev.: 0.0119) MultiSource/Benchmarks/mafft/pairlocalalign: 1.89% (2.1013 => 2.1411, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 1.87% (2.1653 => 2.2058, std. dev.: 0.0099) MultiSource/Benchmarks/MallocBench/gs/gs: 1.85% (1.8794 => 1.9142, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 1.62% (5.5417 => 5.6312, std. dev.: 0.0058) MultiSource/Applications/treecc/treecc: 1.52% (0.7875 => 0.7995, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 1.42% (1.4269 => 1.4472, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.36% (11.9555 => 11.6737, std. dev.: 0.0106) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 08:46:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 10:46:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120711154611.F07FF2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1968?compare_to=1965&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1968, Order: 160044, Start Time: 2012-07-11 14:32:32, End Time: 2012-07-11 15:46:18 To: 1965, Order: 160043, Start Time: 2012-07-11 12:51:08, End Time: 2012-07-11 14:04:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.40% (54.6470 => 56.5026, std. dev.: 0.1911) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.05% (2.0176 => 2.3011, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 8.11% (0.7061 => 0.7634, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 7.96% (0.5818 => 0.6281, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.69% (0.5748 => 0.6190, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.16% (1.3693 => 1.4537, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.04% (0.1986 => 0.2106, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.88% (0.7038 => 0.7452, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 5.79% (0.4062 => 0.4297, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.73% (0.7710 => 0.8152, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 5.56% (0.3578 => 0.3777, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.50% (0.4328 => 0.4566, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.39% (0.2781 => 0.2931, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.37% (0.3650 => 0.3846, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3022 => 0.3184, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.34% (0.5265 => 0.5546, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 5.32% (0.3646 => 0.3840, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.30% (0.3663 => 0.3857, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2966 => 0.3123, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 5.29% (0.3914 => 0.4121, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 5.28% (0.3789 => 0.3989, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.28% (0.3601 => 0.3791, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.26% (0.2721 => 0.2864, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2782 => 0.2928, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.20% (0.2596 => 0.2731, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 5.20% (0.4003 => 0.4211, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.19% (0.3623 => 0.3811, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.14% (0.2607 => 0.2741, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (0.2628 => 0.2762, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.08% (3.9660 => 4.1675, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 5.08% (0.3940 => 0.4140, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.01% (0.2655 => 0.2788, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.01% (0.2937 => 0.3084, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.98% (0.2690 => 0.2824, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.96% (0.3489 => 0.3662, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.85% (0.2761 => 0.2895, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.80% (0.3899 => 0.4086, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 4.80% (0.3107 => 0.3256, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.78% (1.9828 => 2.0776, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.78% (0.3580 => 0.3751, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.56% (0.6959 => 0.7276, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.51% (0.4390 => 0.4588, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (0.3485 => 0.3642, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.37% (0.3453 => 0.3604, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.32% (0.3192 => 0.3330, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4016 => 0.4187, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 4.18% (0.2988 => 0.3113, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.16% (0.3534 => 0.3681, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.10% (16.6129 => 17.2935, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/lists: 4.07% (0.3293 => 0.3427, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.07% (0.9199 => 0.9573, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.02% (0.3756 => 0.3907, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 4.01% (13.8202 => 14.3749, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.81% (13.2842 => 13.7899, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.71% (1.2193 => 1.2645, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.69% (0.2925 => 0.3033, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.67% (0.2914 => 0.3021, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.65% (0.3868 => 0.4009, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.55% (0.5577 => 0.5775, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.53% (0.2945 => 0.3049, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.53% (0.7506 => 0.7771, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.45% (0.3246 => 0.3358, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.41% (1.4563 => 1.5060, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.37% (0.5637 => 0.5827, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (3.8646 => 3.9936, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.26% (1.3245 => 1.3677, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.24% (0.4379 => 0.4521, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.23% (1.3819 => 1.4265, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.17% (1.1061 => 1.1412, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.2292 => 1.2678, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.11% (1.9270 => 1.9870, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.10% (1.1364 => 1.1716, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.05% (1.0594 => 1.0917, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.02% (7.2180 => 7.4360, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.02% (1.3813 => 1.4230, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.96% (0.3755 => 0.3866, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.90% (0.7460 => 0.7676, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.44% (3.6692 => 3.7588, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8310 => 0.8511, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.42% (2.1791 => 2.2318, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 2.40% (6.5754 => 6.7330, std. dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.38% (4.9865 => 5.1051, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 2.33% (14.8535 => 15.2003, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.20% (4.3801 => 4.4766, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.15% (0.6135 => 0.6267, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.01% (4.4433 => 4.5327, std. dev.: 0.0114) MultiSource/Applications/sqlite3/sqlite3: 1.95% (16.2614 => 16.5788, std. dev.: 0.0241) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.95% (1.1333 => 1.1554, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (0.8698 => 0.8864, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.77% (14.5298 => 14.7874, std. dev.: 0.0094) MultiSource/Applications/d/make_dparser: 1.68% (3.1889 => 3.2425, std. dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2937, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 24.22% (1.8175 => 2.2577, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/mandel-2: 9.28% (1.2998 => 1.4204, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.53% (2.0200 => 2.1923, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.21% (7.4271 => 7.7395, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6796, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8289, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4789, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5334, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.54% (3.6469 => 3.7032, std. dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9586, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1943, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.89% (22.5627 => 21.0074, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.08% (0.3511 => 0.3403, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.44% (0.8818 => 0.8603, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.41% (0.9108 => 0.8980, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.70% (1.2308 => 1.1114, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.84% (20.3410 => 18.5436, std. dev.: 0.0429) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.29% (2.4152 => 2.2633, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.63% (1.3780 => 1.3142, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9129, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5946, std. dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.07% (0.8342 => 0.8169, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5028, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2565, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7948, std. dev.: 0.0014) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1318, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.40% (3.0263 => 2.9839, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2430, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2575, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8489, std. dev.: 0.0090) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 09:04:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 11:04:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120711160401.2E98C2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1969?compare_to=1966&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1969, Order: 160044, Start Time: 2012-07-11 14:45:52, End Time: 2012-07-11 16:04:06 To: 1966, Order: 160043, Start Time: 2012-07-11 12:59:53, End Time: 2012-07-11 14:18:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (60 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.71% (13.7933 => 13.2811, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.26% (1.1173 => 1.1032, std. dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.11% (10.3673 => 13.2811, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.02% (1.1194 => 1.2539, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 8.55% (0.3473 => 0.3770, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3516 => 0.3810, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.32% (0.3497 => 0.3788, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.30% (0.3543 => 0.3837, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.24% (0.3543 => 0.3835, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.17% (0.3561 => 0.3852, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.16% (2.2022 => 2.3819, std. dev.: 0.0124) SingleSource/UnitTests/ObjC/for-in: 7.96% (0.3694 => 0.3988, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.96% (1.7609 => 1.9010, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.89% (0.3828 => 0.4130, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.3927 => 0.4232, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.72% (0.3886 => 0.4186, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.94% (0.2065 => 0.2167, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.76% (0.4879 => 0.5111, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.70% (7.0540 => 7.3852, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.60% (0.3177 => 0.3323, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.3282 => 0.3429, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.43% (10.4361 => 10.8989, std. dev.: 0.0161) SingleSource/UnitTests/ObjC++/Hello: 4.25% (0.5925 => 0.6177, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 4.23% (0.6030 => 0.6285, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.71% (0.7433 => 0.7709, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 3.36% (0.7326 => 0.7572, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.84% (0.5569 => 0.5727, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.79% (0.8172 => 0.8400, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.56% (0.4615 => 0.4733, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.47% (5.0018 => 5.1251, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.45% (4.9449 => 5.0660, std. dev.: 0.0049) MultiSource/Applications/hbd/hbd: 2.33% (1.5603 => 1.5966, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 2.26% (0.7835 => 0.8012, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (14.3668 => 14.6867, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.12% (8.1363 => 8.3084, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5860 => 0.5981, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 2.05% (9.4845 => 9.6790, std. dev.: 0.0147) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.02% (4.2646 => 4.3506, std. dev.: 0.0086) MultiSource/Applications/treecc/treecc: 1.91% (2.0273 => 2.0661, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.69% (1.1861 => 1.2062, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.58% (1.1642 => 1.1826, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.56% (0.8067 => 0.8193, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.53% (3.3354 => 3.3865, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.50% (2.0665 => 2.0974, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.49% (1.5415 => 1.5644, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 1.42% (5.7591 => 5.8408, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.42% (1.3050 => 1.3235, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 1.40% (3.8723 => 3.9265, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.31% (0.9765 => 0.9893, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.09% (1.4186 => 1.4340, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.07% (17.1811 => 17.3652, std. dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7466, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.19% (26.0924 => 26.6626, std. dev.: 0.0217) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (1.5086 => 1.5369, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 1.49% (2.4116 => 2.4476, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6895, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2295, std. dev.: 0.0132) MultiSource/Applications/spiff/spiff: 1.16% (2.9346 => 2.9686, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.99% (5.2763 => 3.1662, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.00% (5.3855 => 3.7161, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.53% (5.3526 => 3.7184, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.29% (2.9384 => 2.5478, std. dev.: 0.0195) MultiSource/Applications/ClamAV/clamscan: -10.56% (22.1758 => 19.8344, std. dev.: 0.0276) SingleSource/UnitTests/Vector/constpool: -5.37% (54.1659 => 51.2566, std. dev.: 0.0268) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.33% (3.8922 => 3.8014, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.23% (0.0998 => 0.0846, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.84% (1.2373 => 1.1032, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.15% (19.9488 => 18.5215, std. dev.: 0.0554) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9182, std. dev.: 0.0120) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6830, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0838, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 10:27:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 12:27:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120711172751.9B0902A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1970?compare_to=1968&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1970, Order: 160050, Start Time: 2012-07-11 16:14:09, End Time: 2012-07-11 17:27:57 To: 1968, Order: 160044, Start Time: 2012-07-11 14:32:32, End Time: 2012-07-11 15:46:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.58% (77.5762 => 80.3533, std. dev.: 0.4566) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.61% (1.4204 => 1.3975, std. dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.76% (2.0176 => 2.2953, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.61% (0.7061 => 0.7598, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 7.53% (0.5818 => 0.6256, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.32% (0.5748 => 0.6169, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.84% (1.3693 => 1.4493, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 5.76% (0.4062 => 0.4296, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.59% (0.1986 => 0.2097, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 5.56% (0.7038 => 0.7429, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.52% (0.4328 => 0.4567, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.48% (0.3578 => 0.3774, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3022 => 0.3185, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.39% (0.2781 => 0.2931, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.39% (0.2726 => 0.2873, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.34% (0.7710 => 0.8122, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-2: 5.22% (0.3601 => 0.3789, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.21% (0.3646 => 0.3836, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.18% (0.3650 => 0.3839, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.16% (0.2655 => 0.2792, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.15% (0.3789 => 0.3984, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.15% (0.2721 => 0.2861, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.10% (0.2782 => 0.2924, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.09% (0.5265 => 0.5533, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.07% (0.2937 => 0.3086, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.06% (0.2607 => 0.2739, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 5.05% (0.3663 => 0.3848, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 5.03% (0.3914 => 0.4111, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.03% (0.2765 => 0.2904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 5.02% (0.4003 => 0.4204, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/random: 5.02% (0.2690 => 0.2825, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.01% (0.2596 => 0.2726, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 4.94% (0.3623 => 0.3802, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.89% (0.2966 => 0.3111, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.88% (3.9660 => 4.1597, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 4.87% (0.2628 => 0.2756, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.86% (0.2760 => 0.2894, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.83% (1.9828 => 2.0786, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 4.82% (0.3940 => 0.4130, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.76% (0.3489 => 0.3655, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3107 => 0.3254, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.67% (0.2696 => 0.2822, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.67% (0.2761 => 0.2890, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.64% (0.3580 => 0.3746, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.57% (0.3899 => 0.4077, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.54% (0.3149 => 0.3292, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (0.3485 => 0.3640, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.31% (0.6959 => 0.7259, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.23% (0.3453 => 0.3599, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.19% (0.3534 => 0.3682, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.18% (0.2988 => 0.3113, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.14% (0.3192 => 0.3324, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.10% (0.4390 => 0.4570, std. dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 4.04% (16.6129 => 17.2839, std. dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 4.03% (13.8202 => 14.3768, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/lists: 3.98% (0.3293 => 0.3424, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.91% (0.3756 => 0.3903, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.83% (0.9199 => 0.9551, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 3.67% (0.3868 => 0.4010, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.64% (13.2842 => 13.7677, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.2925 => 0.3031, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.62% (1.2193 => 1.2634, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 3.53% (0.2945 => 0.3049, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.46% (0.5577 => 0.5770, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (1.4563 => 1.5052, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.18% (1.3245 => 1.3666, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.18% (0.5637 => 0.5816, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.14% (0.3246 => 0.3348, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.10% (0.7506 => 0.7739, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.04% (1.2292 => 1.2666, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.04% (3.8646 => 3.9821, std. dev.: 0.0090) MultiSource/Applications/treecc/treecc: 3.02% (1.9270 => 1.9852, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.97% (1.1364 => 1.1702, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.96% (1.0594 => 1.0908, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.96% (0.3755 => 0.3866, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.94% (1.1061 => 1.1386, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.89% (1.3813 => 1.4212, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.86% (1.3819 => 1.4214, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.84% (7.2180 => 7.4229, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.61% (4.9865 => 5.1168, std. dev.: 0.0088) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.52% (0.7460 => 0.7648, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.48% (3.6692 => 3.7602, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8310 => 0.8502, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.25% (6.5754 => 6.7233, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 2.21% (14.8535 => 15.1811, std. dev.: 0.0073) MultiSource/Applications/siod/siod: 2.10% (2.1791 => 2.2249, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.95% (16.2614 => 16.5789, std. dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.94% (0.8698 => 0.8867, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.94% (4.3801 => 4.4651, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.78% (1.1333 => 1.1535, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.76% (0.6135 => 0.6243, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.75% (4.4433 => 4.5211, std. dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 1.58% (14.5298 => 14.7600, std. dev.: 0.0244) MultiSource/Applications/d/make_dparser: 1.56% (3.1889 => 3.2385, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 1.46% (1.2749 => 1.2935, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.43% (2.1007 => 2.1307, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.16% (1.8175 => 2.2748, std. dev.: 0.0453) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.42% (2.0200 => 2.1900, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.07% (0.9996 => 1.0803, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: 7.52% (1.2998 => 1.3975, std. dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.17% (7.4271 => 7.7368, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9195, std. dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6796, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.35% (1.7688 => 1.8280, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4786, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.38% (1.0310 => 1.0555, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1913, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5345, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.47% (3.6469 => 3.7005, std. dev.: 0.0071) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1937, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.23% (0.8239 => 0.8340, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.06% (0.4657 => 0.4049, std. dev.: 0.0081) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.90% (22.5627 => 21.0052, std. dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.99% (0.3511 => 0.3406, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.36% (0.8818 => 0.8610, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.36% (0.9108 => 0.8984, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.11% (1.2308 => 1.1064, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.05% (20.3410 => 18.5004, std. dev.: 0.0467) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.22% (1.3780 => 1.3061, std. dev.: 0.0081) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.68% (2.6470 => 2.5497, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9130, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6009, std. dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5069, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2447, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7955, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.5254 => 2.4874, std. dev.: 0.0012) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1298, std. dev.: 0.0328) MultiSource/Applications/spiff/spiff: -1.37% (3.0263 => 2.9849, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8660, std. dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.25% (0.9692 => 0.9571, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2527, std. dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2424, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2285, std. dev.: 0.0379) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 10:41:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 12:41:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120711174154.2469E2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1971?compare_to=1967&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1971, Order: 160044, Start Time: 2012-07-11 14:58:48, End Time: 2012-07-11 17:41:59 To: 1967, Order: 160042, Start Time: 2012-07-11 11:48:11, End Time: 2012-07-11 14:31:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (39 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (854 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 9.26% (0.3446 => 0.3765, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.24% (0.3496 => 0.3819, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.20% (0.3488 => 0.3809, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.15% (0.3465 => 0.3782, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 9.04% (0.3442 => 0.3753, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.02% (0.3460 => 0.3772, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.99% (0.3469 => 0.3781, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.77% (0.3650 => 0.3970, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.62% (0.3643 => 0.3957, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/parameter-passing: 8.38% (0.3724 => 0.4036, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.65% (0.5826 => 0.6097, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.36% (0.5889 => 0.6146, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.62% (1.6211 => 1.6798, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.56% (3.5627 => 3.6894, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.49% (0.4361 => 0.4513, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.44% (0.5900 => 0.6103, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 3.24% (0.7171 => 0.7403, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.20% (0.4029 => 0.4158, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.01% (4.2109 => 4.3378, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.88% (0.5026 => 0.5171, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.85% (0.3930 => 0.4042, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.81% (1.3152 => 1.3522, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.64% (0.4994 => 0.5126, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.55% (2.7292 => 2.7989, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.50% (0.5000 => 0.5125, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.36% (2.0673 => 2.1160, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.29% (1.9694 => 2.0145, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.27% (0.9909 => 1.0134, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.09% (1.0781 => 1.1006, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.05% (1.9966 => 2.0375, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.76% (4.4195 => 4.4972, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 1.68% (1.8794 => 1.9110, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 1.58% (2.1653 => 2.1995, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 1.54% (4.6177 => 4.6887, std. dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 1.50% (5.5417 => 5.6247, std. dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: 1.49% (2.1013 => 2.1327, std. dev.: 0.0072) MultiSource/Applications/hbd/hbd: 1.46% (0.9697 => 0.9839, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 1.43% (23.5202 => 23.8572, std. dev.: 0.0186) MultiSource/Applications/lua/lua: 1.23% (1.4269 => 1.4445, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.48% (11.9555 => 11.6593, std. dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 10:49:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 12:49:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120711174946.5C9BE2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/1972?compare_to=1969&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1972, Order: 160050, Start Time: 2012-07-11 16:31:48, End Time: 2012-07-11 17:49:52 To: 1969, Order: 160044, Start Time: 2012-07-11 14:45:52, End Time: 2012-07-11 16:04:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (58 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (796 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.64% (13.2811 => 13.0635, std. dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.01% (10.3673 => 13.0635, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.33% (1.1194 => 1.2462, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.23% (0.3473 => 0.3759, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.07% (0.3543 => 0.3829, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.98% (0.3561 => 0.3845, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.92% (0.3497 => 0.3774, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.91% (0.3516 => 0.3794, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.90% (0.3543 => 0.3823, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 7.82% (0.3694 => 0.3983, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.43% (2.2022 => 2.3659, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 7.37% (0.3828 => 0.4110, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.33% (0.3927 => 0.4215, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.28% (0.3886 => 0.4169, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.23% (1.7609 => 1.8882, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 4.16% (10.4361 => 10.8702, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.14% (0.4879 => 0.5081, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.09% (0.3177 => 0.3307, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.03% (7.0540 => 7.3386, std. dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 3.91% (0.6030 => 0.6266, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 3.84% (0.3282 => 0.3408, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 3.73% (0.5925 => 0.6146, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 3.63% (0.7326 => 0.7592, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 3.62% (0.7433 => 0.7702, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.55% (0.5569 => 0.5711, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.51% (0.8172 => 0.8377, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.39% (4.9449 => 5.0631, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.28% (0.4615 => 0.4720, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5860 => 0.5985, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.13% (14.3668 => 14.6731, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.12% (5.0018 => 5.1079, std. dev.: 0.0067) MultiSource/Applications/spiff/spiff: 2.05% (0.7835 => 0.7996, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 1.92% (1.5603 => 1.5902, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.84% (8.1363 => 8.2864, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (9.4845 => 9.6495, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.61% (4.2646 => 4.3334, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 1.61% (2.0273 => 2.0600, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.46% (0.8067 => 0.8185, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.40% (1.1861 => 1.2027, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.40% (2.0665 => 2.0954, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 1.32% (1.1642 => 1.1796, std. dev.: 0.0051) MultiSource/Applications/d/make_dparser: 1.24% (3.3354 => 3.3768, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.23% (1.3050 => 1.3211, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.23% (1.5415 => 1.5604, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 1.15% (5.7591 => 5.8255, std. dev.: 0.0047) MultiSource/Applications/lua/lua: 1.13% (3.8723 => 3.9162, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.03% (0.9765 => 0.9866, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.02% (17.1811 => 17.3557, std. dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7516, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.22% (26.0924 => 26.6711, std. dev.: 0.0239) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.02% (1.5086 => 1.5391, std. dev.: 0.0105) MultiSource/Applications/minisat/minisat: 1.80% (9.1159 => 9.2802, std. dev.: 0.0220) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6877, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 1.04% (2.9346 => 2.9652, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1250, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.34% (5.2763 => 3.1477, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.51% (5.3855 => 3.6885, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.14% (5.3526 => 3.6860, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.76% (2.9384 => 2.5340, std. dev.: 0.0079) MultiSource/Applications/ClamAV/clamscan: -10.82% (22.1758 => 19.7773, std. dev.: 0.0170) SingleSource/UnitTests/Vector/constpool: -5.46% (54.1659 => 51.2101, std. dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.74% (3.8922 => 3.7856, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.41% (0.8101 => 0.7987, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.09% (1.2373 => 1.1125, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.07% (19.9488 => 18.5390, std. dev.: 0.0610) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (8.1563 => 7.9173, std. dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6936, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0863, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 12:09:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 14:09:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120711190944.B57082A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1973?compare_to=1970&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1973, Order: 160054, Start Time: 2012-07-11 17:56:02, End Time: 2012-07-11 19:09:50 To: 1970, Order: 160050, Start Time: 2012-07-11 16:14:09, End Time: 2012-07-11 17:27:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (127 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (727 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.17% (2.0176 => 2.3034, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.91% (0.5818 => 0.6220, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.90% (0.7061 => 0.7548, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.77% (0.5748 => 0.6137, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.34% (1.3693 => 1.4561, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 6.14% (0.7038 => 0.7470, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.4062 => 0.4303, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.71% (0.4328 => 0.4575, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.62% (0.2721 => 0.2874, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.54% (0.2781 => 0.2935, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.2966 => 0.3126, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3022 => 0.3185, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.34% (0.1986 => 0.2092, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.28% (0.2690 => 0.2832, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2782 => 0.2928, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.22% (0.5265 => 0.5540, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.21% (0.7710 => 0.8112, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 5.14% (0.2760 => 0.2902, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.12% (0.2655 => 0.2791, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.08% (0.2596 => 0.2728, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.07% (0.2937 => 0.3086, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.06% (0.2726 => 0.2864, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.03% (0.2765 => 0.2904, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.02% (0.2628 => 0.2760, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.99% (3.9660 => 4.1641, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.97% (0.2696 => 0.2830, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.96% (0.3489 => 0.3662, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.89% (0.2761 => 0.2896, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.89% (1.9828 => 2.0797, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.83% (0.3107 => 0.3257, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.83% (0.3149 => 0.3301, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.80% (0.3580 => 0.3752, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.72% (0.3899 => 0.4083, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.53% (0.3485 => 0.3643, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.52% (0.3453 => 0.3609, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.48% (0.3192 => 0.3335, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.41% (0.6959 => 0.7266, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2988 => 0.3118, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.33% (0.4016 => 0.4190, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.31% (0.4390 => 0.4579, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 4.28% (0.3578 => 0.3731, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.22% (0.3293 => 0.3432, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.22% (0.3650 => 0.3804, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 4.22% (0.3534 => 0.3683, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 4.17% (0.4003 => 0.4170, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 4.17% (0.3789 => 0.3947, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.17% (16.6129 => 17.3055, std. dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.15% (0.3756 => 0.3912, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 4.14% (0.3914 => 0.4076, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.13% (13.2842 => 13.8333, std. dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.13% (0.9199 => 0.9579, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 4.11% (0.3601 => 0.3749, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 4.09% (0.3646 => 0.3795, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.04% (13.8202 => 14.3792, std. dev.: 0.0098) SingleSource/UnitTests/ObjC/synchronized: 4.04% (0.3663 => 0.3811, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 3.96% (0.3940 => 0.4096, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 3.95% (0.3623 => 0.3766, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.88% (1.2193 => 1.2666, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.88% (0.3868 => 0.4018, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.69% (0.2925 => 0.3033, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.68% (0.5577 => 0.5782, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/objinst: 3.63% (0.2945 => 0.3052, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.60% (1.3813 => 1.4310, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.57% (1.3819 => 1.4312, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.45% (0.3246 => 0.3358, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.44% (1.3245 => 1.3701, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.44% (0.7506 => 0.7764, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.40% (1.1364 => 1.1750, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.37% (1.4563 => 1.5054, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.35% (0.5637 => 0.5826, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (3.8646 => 3.9902, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 3.23% (1.0594 => 1.0936, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.16% (1.2292 => 1.2681, std. dev.: 0.0123) MultiSource/Applications/treecc/treecc: 3.11% (1.9270 => 1.9870, std. dev.: 0.0061) MultiSource/Applications/Burg/burg: 3.08% (1.1061 => 1.1402, std. dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.06% (0.4379 => 0.4513, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.00% (0.7460 => 0.7684, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3755 => 0.3867, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.93% (7.2180 => 7.4293, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8310 => 0.8542, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.72% (4.9865 => 5.1221, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.62% (3.6692 => 3.7652, std. dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 2.52% (14.8535 => 15.2276, std. dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 2.50% (6.5754 => 6.7399, std. dev.: 0.0038) MultiSource/Applications/siod/siod: 2.42% (2.1791 => 2.2318, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 2.28% (16.2614 => 16.6326, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.17% (0.8698 => 0.8887, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.03% (4.3801 => 4.4691, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.99% (1.1333 => 1.1558, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 1.87% (14.5298 => 14.8022, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.86% (4.4433 => 4.5258, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.82% (3.1889 => 3.2468, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.42% (2.1007 => 2.1306, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.79% (0.4846 => 0.6968, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.88% (1.8175 => 2.2697, std. dev.: 0.0426) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.22% (2.0200 => 2.1861, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: 8.22% (1.2998 => 1.4066, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.91% (0.9996 => 1.0787, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.85% (7.4271 => 7.7128, std. dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6793, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.39% (1.7688 => 1.8288, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4788, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1907, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5336, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.54% (3.6469 => 3.7030, std. dev.: 0.0060) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: 1.33% (1.9290 => 1.9546, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1934, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.67% (22.5627 => 21.0574, std. dev.: 0.0197) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.06% (0.8818 => 0.8636, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.65% (0.0997 => 0.0841, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.62% (1.2308 => 1.1124, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.97% (20.3410 => 18.5173, std. dev.: 0.0463) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.94% (1.3780 => 1.3237, std. dev.: 0.0076) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.18% (1.9762 => 1.9133, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5981, std. dev.: 0.0121) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5108, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2570, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.52% (2.5254 => 2.4870, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7965, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1204, std. dev.: 0.0182) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.49% (0.9692 => 0.9548, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: -1.41% (3.0263 => 2.9835, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2506, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2221, std. dev.: 0.0099) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2420, std. dev.: 0.0142) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 12:35:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 14:35:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120711193532.DFA312A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1974?compare_to=1972&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1974, Order: 160056, Start Time: 2012-07-11 18:17:30, End Time: 2012-07-11 19:35:37 To: 1972, Order: 160050, Start Time: 2012-07-11 16:31:48, End Time: 2012-07-11 17:49:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (53 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (800 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.76% (13.0635 => 13.4240, std. dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.48% (10.3673 => 13.4240, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.40% (1.1194 => 1.2470, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.58% (2.2022 => 2.3691, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.42% (1.7609 => 1.8915, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 7.14% (0.3473 => 0.3721, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: 6.88% (0.3561 => 0.3806, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.86% (0.3497 => 0.3737, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 6.86% (0.3543 => 0.3786, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.83% (0.3516 => 0.3756, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.77% (0.3543 => 0.3783, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.61% (0.3694 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.40% (0.3828 => 0.4073, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.37% (0.3927 => 0.4177, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.25% (0.3886 => 0.4129, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 4.63% (10.4361 => 10.9196, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.20% (0.4879 => 0.5084, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.11% (7.0540 => 7.3436, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 3.81% (0.3282 => 0.3407, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 3.66% (0.5925 => 0.6142, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 3.63% (0.6030 => 0.6249, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.44% (0.7433 => 0.7689, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 2.77% (0.7326 => 0.7529, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (14.3668 => 14.7025, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.24% (0.5569 => 0.5694, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.21% (5.0018 => 5.1125, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.17% (0.8172 => 0.8349, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.87% (4.9449 => 5.0373, std. dev.: 0.0050) MultiSource/Applications/hbd/hbd: 1.83% (1.5603 => 1.5889, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.79% (8.1363 => 8.2823, std. dev.: 0.0057) MultiSource/Applications/spiff/spiff: 1.74% (0.7835 => 0.7971, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (9.4845 => 9.6412, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.57% (4.2646 => 4.3316, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 1.53% (5.7591 => 5.8471, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.46% (2.0665 => 2.0967, std. dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.39% (1.1861 => 1.2026, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.36% (2.0273 => 2.0548, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 1.34% (3.3354 => 3.3802, std. dev.: 0.0080) MultiSource/Applications/Burg/burg: 1.25% (1.1642 => 1.1788, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.20% (1.5415 => 1.5600, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.18% (1.3050 => 1.3204, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.15% (17.1811 => 17.3780, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 1.01% (3.8723 => 3.9116, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7554, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.18% (26.0924 => 26.6615, std. dev.: 0.0349) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4474, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2304, std. dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6876, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 1.16% (2.9346 => 2.9686, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1246, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.18% (5.2763 => 3.1564, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.60% (5.3855 => 3.6838, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.28% (5.3526 => 3.6785, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.55% (2.9384 => 2.5403, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.93% (22.1758 => 19.7528, std. dev.: 0.0148) SingleSource/UnitTests/Vector/constpool: -5.32% (54.1659 => 51.2828, std. dev.: 0.0414) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.70% (3.8922 => 3.7872, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.44% (0.8101 => 0.7984, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.07% (7.9617 => 7.8767, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.11% (1.2373 => 1.0998, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.46% (19.9488 => 18.6609, std. dev.: 0.0378) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.83% (8.1563 => 7.9252, std. dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6820, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0862, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 13:51:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 15:51:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120711205126.BF0B02A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1975?compare_to=1973&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1975, Order: 160059, Start Time: 2012-07-11 19:37:42, End Time: 2012-07-11 20:51:32 To: 1973, Order: 160054, Start Time: 2012-07-11 17:56:02, End Time: 2012-07-11 19:09:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (127 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.70% (2.0176 => 2.2941, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.08% (0.5818 => 0.6230, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.92% (0.5748 => 0.6146, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.88% (0.7061 => 0.7547, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.50% (1.3693 => 1.4583, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 6.07% (0.7038 => 0.7465, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 5.71% (0.4062 => 0.4294, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.71% (0.4328 => 0.4575, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.59% (0.1986 => 0.2097, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.59% (0.2721 => 0.2873, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.27% (0.7710 => 0.8116, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.24% (0.2596 => 0.2732, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.21% (0.2781 => 0.2926, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.19% (0.5265 => 0.5538, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2690 => 0.2829, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.12% (0.2966 => 0.3118, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.06% (0.2607 => 0.2739, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.03% (0.2782 => 0.2922, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.97% (3.9660 => 4.1632, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.97% (0.2655 => 0.2787, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 4.94% (0.2937 => 0.3082, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 4.92% (0.3149 => 0.3304, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.91% (0.2628 => 0.2757, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.88% (0.2726 => 0.2859, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.87% (0.3489 => 0.3659, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.82% (0.2760 => 0.2893, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.78% (0.2761 => 0.2893, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.73% (1.9828 => 2.0766, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 4.70% (0.3107 => 0.3253, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.64% (0.3580 => 0.3746, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.62% (0.3899 => 0.4079, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.60% (0.2696 => 0.2820, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.56% (0.6959 => 0.7276, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.43% (0.3453 => 0.3606, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 4.39% (0.3578 => 0.3735, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.36% (0.3485 => 0.3637, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.34% (0.3663 => 0.3822, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.28% (0.4016 => 0.4188, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.28% (0.3789 => 0.3951, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 4.27% (0.3914 => 0.4081, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 4.25% (0.3646 => 0.3801, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.23% (0.3192 => 0.3327, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 4.22% (0.4003 => 0.4172, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 4.21% (0.3940 => 0.4106, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 4.19% (0.3601 => 0.3752, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.19% (0.3650 => 0.3803, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.10% (13.2842 => 13.8290, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/exceptions-3: 4.09% (0.3623 => 0.3771, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.05% (0.9199 => 0.9572, std. dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 4.05% (16.6129 => 17.2852, std. dev.: 0.0231) MultiSource/Applications/SPASS/SPASS: 4.04% (13.8202 => 14.3783, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.02% (0.3756 => 0.3907, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.02% (0.2988 => 0.3108, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.96% (0.3534 => 0.3674, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 3.92% (0.3293 => 0.3422, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.85% (0.4390 => 0.4559, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.83% (1.2193 => 1.2660, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3868 => 0.4012, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.66% (0.2925 => 0.3032, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.59% (0.5577 => 0.5777, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 3.53% (0.2945 => 0.3049, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.45% (0.3246 => 0.3358, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.42% (1.3245 => 1.3698, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.40% (1.4563 => 1.5058, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.39% (0.5637 => 0.5828, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 3.37% (0.7506 => 0.7759, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.34% (1.3819 => 1.4280, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.32% (0.7460 => 0.7708, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.32% (1.3813 => 1.4271, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.30% (1.1364 => 1.1739, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 3.28% (3.8646 => 3.9914, std. dev.: 0.0130) MultiSource/Applications/treecc/treecc: 3.16% (1.9270 => 1.9879, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.13% (0.4379 => 0.4516, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.13% (1.1061 => 1.1407, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.08% (1.2292 => 1.2671, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.06% (1.0594 => 1.0918, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.92% (7.2180 => 7.4290, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3755 => 0.3858, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.67% (4.9865 => 5.1194, std. dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.56% (3.6692 => 3.7633, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.45% (6.5754 => 6.7366, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 2.36% (2.1791 => 2.2305, std. dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 2.29% (14.8535 => 15.1940, std. dev.: 0.0114) MultiSource/Applications/sqlite3/sqlite3: 2.10% (16.2614 => 16.6026, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.09% (4.3801 => 4.4718, std. dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.02% (0.8698 => 0.8874, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.94% (1.1333 => 1.1553, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.94% (0.6135 => 0.6254, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.92% (4.4433 => 4.5284, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 1.83% (3.1889 => 3.2472, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 1.77% (14.5298 => 14.7872, std. dev.: 0.0109) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (1.2749 => 1.2953, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.37% (2.1007 => 2.1295, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 25.60% (1.8175 => 2.2827, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.31% (2.0200 => 2.1878, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: 7.03% (1.2998 => 1.3912, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.00% (7.4271 => 7.7242, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9236, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6792, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8295, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4788, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0310 => 1.0568, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4563, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5089 => 1.5361, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.58% (3.6469 => 3.7046, std. dev.: 0.0151) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.40% (0.4657 => 0.4033, std. dev.: 0.0185) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.81% (22.5627 => 21.0261, std. dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.45% (0.8818 => 0.8602, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.85% (0.0997 => 0.0839, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.62% (1.2308 => 1.1001, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.97% (20.3410 => 18.5167, std. dev.: 0.0489) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.82% (1.3780 => 1.3116, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9125, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5949, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5078, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7947, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.51% (6.3560 => 6.2600, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1169, std. dev.: 0.0438) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9826, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2429, std. dev.: 0.0248) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2284, std. dev.: 0.0268) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2573, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 13:52:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 15:52:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120711205237.3F6FD2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1976?compare_to=1971&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1976, Order: 160056, Start Time: 2012-07-11 18:09:33, End Time: 2012-07-11 20:52:43 To: 1971, Order: 160044, Start Time: 2012-07-11 14:58:48, End Time: 2012-07-11 17:41:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (38 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (855 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 2.30% (1.6020 => 1.6389, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.39% (2.7947 => 2.8335, std. dev.: 0.0126) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 8.25% (0.3442 => 0.3726, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.23% (0.3465 => 0.3750, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.21% (0.3446 => 0.3729, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-3: 8.21% (0.3460 => 0.3744, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/for-in: 8.18% (0.3496 => 0.3782, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.16% (0.3469 => 0.3752, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3488 => 0.3772, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.00% (0.3650 => 0.3942, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.85% (0.3643 => 0.3929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.55% (0.3724 => 0.4005, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.27% (0.5826 => 0.6075, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 4.06% (0.5889 => 0.6128, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.13% (0.4029 => 0.4155, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (0.4361 => 0.4496, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.99% (1.6211 => 1.6695, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.87% (1.5932 => 1.6389, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 2.86% (0.7171 => 0.7376, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.80% (3.5627 => 3.6626, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.78% (0.5000 => 0.5139, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.58% (0.5900 => 0.6052, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.56% (0.4994 => 0.5122, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 2.43% (0.9909 => 1.0150, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.39% (1.3152 => 1.3466, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 2.35% (4.2109 => 4.3097, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.34% (2.0673 => 2.1156, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.25% (0.5026 => 0.5139, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 2.05% (1.0781 => 1.1002, std. dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 1.93% (23.5202 => 23.9751, std. dev.: 0.0094) MultiSource/Applications/hbd/hbd: 1.66% (0.9697 => 0.9858, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.57% (1.9694 => 2.0003, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (4.4195 => 4.4883, std. dev.: 0.0098) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.53% (2.7292 => 2.7710, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 1.42% (1.8794 => 1.9060, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.41% (1.9966 => 2.0247, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.27% (2.1653 => 2.1927, std. dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 1.17% (5.5417 => 5.6064, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 1.11% (4.6177 => 4.6691, std. dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 1.05% (2.1013 => 2.1234, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.73% (11.9555 => 11.6297, std. dev.: 0.0104) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 14:21:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 16:21:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120711212116.0DA7A2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1977?compare_to=1974&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1977, Order: 160063, Start Time: 2012-07-11 20:03:18, End Time: 2012-07-11 21:21:21 To: 1974, Order: 160056, Start Time: 2012-07-11 18:17:30, End Time: 2012-07-11 19:35:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (54 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (799 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.13% (13.4240 => 13.5759, std. dev.: 0.0157) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.95% (10.3673 => 13.5759, std. dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.18% (1.1194 => 1.2446, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.19% (0.3543 => 0.3833, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/trivial-interface: 7.98% (0.3473 => 0.3750, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.58% (0.3497 => 0.3762, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.54% (0.3543 => 0.3810, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.51% (0.3516 => 0.3780, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.44% (0.3561 => 0.3826, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.17% (1.7609 => 1.8872, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.16% (2.2022 => 2.3598, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 7.15% (0.3694 => 0.3958, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.08% (0.3927 => 0.4205, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 6.95% (0.3828 => 0.4094, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 6.85% (0.3886 => 0.4152, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.88% (0.3177 => 0.3332, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 4.21% (0.6030 => 0.6284, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 4.15% (0.5925 => 0.6171, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.10% (0.4879 => 0.5079, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.05% (10.4361 => 10.8583, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.91% (7.0540 => 7.3297, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 3.66% (0.3282 => 0.3402, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 3.28% (0.7433 => 0.7677, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 3.21% (0.7326 => 0.7561, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.57% (0.5569 => 0.5712, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.52% (0.8172 => 0.8378, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.19% (0.4615 => 0.4716, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (14.3668 => 14.6682, std. dev.: 0.0063) MultiSource/Applications/hbd/hbd: 1.99% (1.5603 => 1.5914, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.96% (4.9449 => 5.0416, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.94% (5.0018 => 5.0987, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: 1.77% (0.7835 => 0.7974, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.71% (8.1363 => 8.2753, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.67% (4.2646 => 4.3359, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (9.4845 => 9.6411, std. dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 1.64% (5.7591 => 5.8535, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.60% (1.5415 => 1.5662, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.50% (2.0665 => 2.0976, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.42% (1.1861 => 1.2029, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.37% (1.1642 => 1.1802, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 1.30% (3.3354 => 3.3786, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 1.29% (2.0273 => 2.0535, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.23% (1.3050 => 1.3211, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.12% (3.8723 => 3.9155, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7526, std. dev.: 0.0032) MultiSource/Applications/lua/lua: 2.15% (26.0924 => 26.6543, std. dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.98% (1.0313 => 1.0517, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (1.5086 => 1.5370, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2343, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6887, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 1.12% (2.9346 => 2.9675, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1247, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.49% (0.8651 => 0.1688, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.26% (5.2763 => 3.1518, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.72% (5.3855 => 3.6771, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.35% (5.3526 => 3.6746, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.59% (2.9384 => 2.5392, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -10.97% (22.1758 => 19.7427, std. dev.: 0.0187) SingleSource/UnitTests/Vector/constpool: -5.12% (54.1659 => 51.3948, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.77% (3.8922 => 3.7844, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.32% (0.8101 => 0.7994, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.04% (7.9617 => 7.8792, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.56% (1.2373 => 1.1067, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.12% (19.9488 => 18.5291, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (8.1563 => 7.9170, std. dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6916, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0841, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.06% (1.3677 => 1.3532, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 15:33:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 17:33:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120711223311.97DE72A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1978?compare_to=1975&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1978, Order: 160070, Start Time: 2012-07-11 21:19:21, End Time: 2012-07-11 22:33:17 To: 1975, Order: 160059, Start Time: 2012-07-11 19:37:42, End Time: 2012-07-11 20:51:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (123 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (730 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.41% (54.6336 => 56.4991, std. dev.: 0.0717) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.99% (2.0176 => 2.2797, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 6.64% (0.7061 => 0.7530, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.56% (0.5748 => 0.6125, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.45% (0.5818 => 0.6193, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 6.25% (1.3693 => 1.4549, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash: 5.83% (0.4062 => 0.4299, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 5.59% (0.4328 => 0.4570, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.49% (0.1986 => 0.2095, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.46% (0.7038 => 0.7422, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 5.37% (0.2628 => 0.2769, std. dev.: 0.0040) SingleSource/Regression/C++/ofstream_ctor: 5.36% (0.2781 => 0.2930, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.10% (0.3022 => 0.3176, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.06% (0.7710 => 0.8100, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.03% (0.2782 => 0.2922, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.02% (0.2966 => 0.3115, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.01% (0.2655 => 0.2788, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.99% (0.2607 => 0.2737, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.98% (0.2690 => 0.2824, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.96% (0.2760 => 0.2897, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.92% (0.2765 => 0.2901, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 4.92% (0.2726 => 0.2860, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.90% (0.2937 => 0.3081, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.89% (0.2596 => 0.2723, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.88% (0.5265 => 0.5522, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.80% (0.3580 => 0.3752, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.76% (1.9828 => 2.0772, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.75% (0.2696 => 0.2824, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.70% (0.3107 => 0.3253, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.67% (0.2761 => 0.2890, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.57% (0.3149 => 0.3293, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.56% (0.3489 => 0.3648, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.54% (0.3899 => 0.4076, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.44% (3.9660 => 4.1421, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: 4.42% (0.3192 => 0.3333, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 4.36% (0.3578 => 0.3734, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.34% (0.3453 => 0.3603, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.33% (0.3485 => 0.3636, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.27% (0.3534 => 0.3685, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: 4.27% (0.3914 => 0.4081, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.25% (0.3789 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.25% (0.3650 => 0.3805, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 4.22% (0.3601 => 0.3753, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.22% (0.2988 => 0.3114, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 4.20% (0.4003 => 0.4171, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-4: 4.20% (0.3646 => 0.3799, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.20% (0.6959 => 0.7251, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (0.3756 => 0.3911, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 4.11% (0.3623 => 0.3772, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 4.10% (0.3663 => 0.3813, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 4.06% (0.3940 => 0.4100, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.04% (0.3293 => 0.3426, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3868 => 0.4013, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.74% (0.4390 => 0.4554, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.70% (0.9199 => 0.9539, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.60% (13.8202 => 14.3176, std. dev.: 0.0117) MultiSource/Applications/kimwitu++/kc: 3.59% (16.6129 => 17.2093, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.57% (13.2842 => 13.7588, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.52% (1.2193 => 1.2622, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.17% (0.5577 => 0.5754, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.07% (1.4563 => 1.5010, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.05% (0.5637 => 0.5809, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.01% (1.2292 => 1.2662, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.98% (1.3813 => 1.4225, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.95% (1.3819 => 1.4227, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.93% (1.1364 => 1.1697, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.93% (1.3245 => 1.3633, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.88% (3.8646 => 3.9758, std. dev.: 0.0149) MultiSource/Benchmarks/nbench/nbench: 2.84% (1.0594 => 1.0895, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 2.80% (0.7506 => 0.7716, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3755 => 0.3859, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.76% (0.4379 => 0.4500, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.75% (1.1061 => 1.1365, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.63% (7.2180 => 7.4079, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.61% (1.9270 => 1.9773, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.57% (0.7460 => 0.7652, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.36% (3.6692 => 3.7559, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.35% (4.9865 => 5.1038, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/football/football: 2.25% (0.8310 => 0.8497, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.12% (6.5754 => 6.7151, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.93% (14.8535 => 15.1407, std. dev.: 0.0117) MultiSource/Applications/siod/siod: 1.93% (2.1791 => 2.2212, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.8698 => 0.8857, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.74% (16.2614 => 16.5448, std. dev.: 0.0193) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.74% (4.3801 => 4.4563, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.53% (4.4433 => 4.5113, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.51% (1.1333 => 1.1504, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.44% (14.5298 => 14.7390, std. dev.: 0.0052) MultiSource/Applications/d/make_dparser: 1.44% (3.1889 => 3.2347, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.27% (1.2749 => 1.2911, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.08% (1.8175 => 2.2915, std. dev.: 0.0382) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.36% (2.0200 => 2.1889, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 7.46% (1.2998 => 1.3968, std. dev.: 0.0095) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.77% (7.4271 => 7.7071, std. dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6767, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4788, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1897, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.86% (1.4298 => 1.4564, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.65% (3.6469 => 3.7072, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5089 => 1.5324, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.50% (1.9290 => 1.9580, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1969, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.18% (0.4657 => 0.4043, std. dev.: 0.0180) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.16% (22.5627 => 20.9465, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.8818 => 0.8581, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.05% (0.0997 => 0.0847, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.26% (1.2308 => 1.1045, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.62% (20.3410 => 18.5870, std. dev.: 0.0506) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3132, std. dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.16% (1.9762 => 1.9137, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5897, std. dev.: 0.0138) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.32% (0.4867 => 0.4754, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.02% (6.6320 => 6.4981, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2550, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7945, std. dev.: 0.0020) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1189, std. dev.: 0.0401) MultiSource/Applications/spiff/spiff: -1.45% (3.0263 => 2.9825, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4904, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.37% (9.3358 => 9.2081, std. dev.: 0.0354) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (0.9692 => 0.9564, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8673, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2509, std. dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: -1.14% (7.3305 => 7.2467, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 16:07:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 18:07:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120711230707.73E532A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1979?compare_to=1977&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1979, Order: 160076, Start Time: 2012-07-11 21:49:01, End Time: 2012-07-11 23:07:10 To: 1977, Order: 160063, Start Time: 2012-07-11 20:03:18, End Time: 2012-07-11 21:21:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (49 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (804 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.69% (13.5759 => 13.3469, std. dev.: 0.0086) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.74% (10.3673 => 13.3469, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.42% (1.1194 => 1.2472, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 7.78% (0.3497 => 0.3769, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 7.77% (0.3473 => 0.3743, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.69% (0.3561 => 0.3835, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.68% (0.3543 => 0.3815, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3516 => 0.3781, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.51% (0.3543 => 0.3809, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.42% (0.3694 => 0.3968, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.35% (1.7609 => 1.8904, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.29% (2.2022 => 2.3628, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions: 7.00% (0.3828 => 0.4096, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.95% (0.3927 => 0.4200, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.92% (0.3886 => 0.4155, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.96% (0.4879 => 0.5072, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.86% (10.4361 => 10.8392, std. dev.: 0.0137) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.84% (0.3177 => 0.3299, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.74% (7.0540 => 7.3176, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 3.47% (0.3282 => 0.3396, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 3.19% (0.7433 => 0.7670, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 3.03% (0.6030 => 0.6213, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.94% (0.5925 => 0.6099, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 2.32% (1.5603 => 1.5965, std. dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference: 2.14% (0.7326 => 0.7483, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.03% (0.8172 => 0.8338, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.03% (0.5569 => 0.5682, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.84% (5.0018 => 5.0937, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.80% (4.9449 => 5.0340, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.74% (14.3668 => 14.6165, std. dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (9.4845 => 9.6334, std. dev.: 0.0098) MultiSource/Applications/spiff/spiff: 1.54% (0.7835 => 0.7956, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.51% (8.1363 => 8.2589, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.39% (2.0665 => 2.0952, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.38% (4.2646 => 4.3236, std. dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.21% (1.1861 => 1.2005, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 1.19% (2.0273 => 2.0514, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 1.16% (5.7591 => 5.8257, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.07% (1.5415 => 1.5580, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.76% (1.1145 => 1.1898, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7526, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0313 => 1.0566, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.14% (26.0924 => 26.6508, std. dev.: 0.0285) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (1.5086 => 1.5369, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.40% (1.3045 => 1.3228, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2382, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6886, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 1.18% (2.9346 => 2.9692, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1245, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.29% (5.2763 => 3.1503, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.68% (5.3855 => 3.6794, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.33% (5.3526 => 3.6758, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.60% (2.9384 => 2.5388, std. dev.: 0.0114) MultiSource/Applications/ClamAV/clamscan: -10.93% (22.1758 => 19.7512, std. dev.: 0.0358) SingleSource/UnitTests/Vector/constpool: -5.03% (54.1659 => 51.4423, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.90% (3.8922 => 3.7793, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (0.8101 => 0.7977, std. dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.19% (7.9617 => 7.8670, std. dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2373 => 1.1096, std. dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.70% (19.9488 => 18.6131, std. dev.: 0.0572) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (8.1563 => 7.9195, std. dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6785, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0859, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 17:03:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 19:03:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120712000322.A7F6F2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1980?compare_to=1976&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1980, Order: 160070, Start Time: 2012-07-11 21:20:28, End Time: 2012-07-12 00:03:28 To: 1976, Order: 160056, Start Time: 2012-07-11 18:09:33, End Time: 2012-07-11 20:52:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (40 on baseline) Performance Improvements: 2 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 949 (853 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.46% (54.0848 => 54.8766, std. dev.: 0.0914) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.31% (129.3000 => 126.3174, std. dev.: 0.9250) SingleSource/Benchmarks/Dhrystone/fldry: -1.09% (17.3209 => 17.1319, std. dev.: 0.0646) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 8.76% (0.3460 => 0.3763, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.62% (0.3446 => 0.3743, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.61% (0.3496 => 0.3797, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.60% (0.3442 => 0.3738, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.57% (0.3465 => 0.3762, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.50% (0.3469 => 0.3764, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.46% (0.3488 => 0.3783, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.44% (0.3650 => 0.3958, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3643 => 0.3943, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.08% (0.3724 => 0.4025, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 4.34% (0.5826 => 0.6079, std. dev.: 0.0085) SingleSource/UnitTests/ObjC++/property-reference-object: 4.11% (0.5889 => 0.6131, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.25% (1.6211 => 1.6738, std. dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 3.23% (1.5932 => 1.6447, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.07% (3.5627 => 3.6719, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 2.94% (0.7171 => 0.7382, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.93% (0.5900 => 0.6073, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.93% (2.0673 => 2.1278, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.92% (0.9909 => 1.0198, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.89% (0.4361 => 0.4487, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.64% (0.4994 => 0.5126, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.57% (1.3152 => 1.3490, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.53% (0.4029 => 0.4131, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.48% (0.5000 => 0.5124, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.41% (0.5026 => 0.5147, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 2.34% (4.2109 => 4.3096, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 2.19% (1.0781 => 1.1017, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.05% (0.9697 => 0.9896, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.87% (1.9694 => 2.0063, std. dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.85% (2.7292 => 2.7796, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (1.9966 => 2.0296, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.58% (4.4195 => 4.4894, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 1.36% (23.5202 => 23.8400, std. dev.: 0.0090) MultiSource/Benchmarks/MallocBench/gs/gs: 1.36% (1.8794 => 1.9049, std. dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 1.33% (2.1653 => 2.1940, std. dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 1.13% (4.6177 => 4.6697, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 1.08% (2.1013 => 2.1240, std. dev.: 0.0083) MultiSource/Applications/SPASS/SPASS: 1.06% (5.5417 => 5.6003, std. dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.74% (0.2122 => 0.2265, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: 1.08% (2.8036 => 2.8339, std. dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.57% (11.9555 => 11.6485, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 17:15:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 19:15:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120712001500.73F612A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1981?compare_to=1978&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1981, Order: 160084, Start Time: 2012-07-11 23:01:16, End Time: 2012-07-12 00:15:06 To: 1978, Order: 160070, Start Time: 2012-07-11 21:19:21, End Time: 2012-07-11 22:33:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 15 (127 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 937 (727 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 4.18% (0.3805 => 0.3964, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 4.18% (0.3734 => 0.3890, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 4.14% (0.3813 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 4.11% (0.3799 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 4.08% (0.3753 => 0.3906, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 4.03% (0.3772 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 3.92% (0.3950 => 0.4105, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 3.75% (0.4081 => 0.4234, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 3.73% (0.4100 => 0.4253, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 3.69% (0.4171 => 0.4325, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: 3.12% (0.6193 => 0.6386, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 2.84% (0.6125 => 0.6299, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 2.36% (0.7530 => 0.7708, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 1.02% (2.2797 => 2.3030, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.02% (4.1421 => 4.1844, std. dev.: 0.0087) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.15% (2.0176 => 2.3030, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.76% (0.5818 => 0.6386, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 9.59% (0.5748 => 0.6299, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 9.16% (0.7061 => 0.7708, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.72% (0.3578 => 0.3890, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.60% (0.3650 => 0.3964, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 8.48% (0.3646 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3601 => 0.3906, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.41% (0.3663 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.34% (0.3789 => 0.4105, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.04% (0.4003 => 0.4325, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/property: 7.94% (0.3940 => 0.4253, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.81% (0.3130 => 0.3343, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.80% (0.1986 => 0.2121, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.37% (1.3693 => 1.4565, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.30% (0.7710 => 0.8196, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.92% (0.7038 => 0.7455, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.79% (0.5265 => 0.5570, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 5.71% (0.4062 => 0.4294, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.66% (0.2721 => 0.2875, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.59% (0.2596 => 0.2741, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.51% (3.9660 => 4.1844, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash2: 5.48% (0.4328 => 0.4565, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.36% (0.2782 => 0.2931, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2690 => 0.2834, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.29% (0.2628 => 0.2767, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.28% (0.2937 => 0.3092, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.25% (0.2781 => 0.2927, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.20% (0.2655 => 0.2793, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.92% (0.2726 => 0.2860, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.86% (0.3107 => 0.3258, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.86% (0.2696 => 0.2827, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.82% (0.2966 => 0.3109, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.82% (0.2760 => 0.2893, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.77% (1.9828 => 2.0774, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.76% (0.3489 => 0.3655, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.74% (0.3899 => 0.4084, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.74% (0.2761 => 0.2892, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.73% (0.6959 => 0.7288, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.64% (0.3580 => 0.3746, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3485 => 0.3641, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.39% (0.3192 => 0.3332, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.30% (16.6129 => 17.3266, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/sieve: 4.29% (0.3453 => 0.3601, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.27% (0.3534 => 0.3685, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.25% (0.9199 => 0.9590, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.23% (13.8202 => 14.4052, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 4.21% (0.2925 => 0.3048, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 4.13% (0.3293 => 0.3429, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.08% (0.4016 => 0.4180, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.08% (13.2842 => 13.8256, std. dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/matrix: 4.05% (0.2988 => 0.3109, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3756 => 0.3905, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.96% (1.2193 => 1.2676, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.5577 => 0.5795, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 3.90% (0.7506 => 0.7799, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.90% (0.4390 => 0.4561, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.83% (0.5637 => 0.5853, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.76% (1.4563 => 1.5111, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3868 => 0.4012, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.70% (0.3246 => 0.3366, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.52% (7.2180 => 7.4721, std. dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.52% (0.4379 => 0.4533, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.51% (1.9270 => 1.9947, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.50% (1.3245 => 1.3709, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 3.50% (0.2945 => 0.3048, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.49% (3.8646 => 3.9995, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.45% (1.3813 => 1.4290, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.44% (1.3819 => 1.4295, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 3.44% (1.1061 => 1.1441, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.42% (1.1364 => 1.1753, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.17% (1.2292 => 1.2682, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.17% (1.0594 => 1.0930, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.17% (0.3755 => 0.3874, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.12% (0.7460 => 0.7693, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.76% (3.6692 => 3.7705, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.65% (4.3801 => 4.4963, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 2.62% (6.5754 => 6.7475, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 2.61% (2.1791 => 2.2360, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 2.54% (0.8310 => 0.8521, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.49% (4.9865 => 5.1105, std. dev.: 0.0224) MultiSource/Applications/JM/lencod/lencod: 2.44% (14.8535 => 15.2158, std. dev.: 0.0184) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.35% (4.4433 => 4.5478, std. dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.13% (1.1333 => 1.1574, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.04% (16.2614 => 16.5938, std. dev.: 0.0199) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.96% (0.6135 => 0.6255, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.95% (0.8698 => 0.8868, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.95% (14.5298 => 14.8136, std. dev.: 0.0089) MultiSource/Applications/d/make_dparser: 1.88% (3.1889 => 3.2488, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (1.2749 => 1.2929, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.31% (2.1007 => 2.1282, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.53% (1.8175 => 2.2815, std. dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.60% (2.0200 => 2.1937, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: 8.42% (1.2998 => 1.4093, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7187, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9200, std. dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6772, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0310 => 1.0561, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1917, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4559, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.66% (3.6469 => 3.7074, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9593, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.94% (22.5627 => 20.9964, std. dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.89% (0.8818 => 0.8563, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.43% (1.2308 => 1.1024, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.02% (20.3410 => 18.5064, std. dev.: 0.0338) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.06% (1.3780 => 1.3083, std. dev.: 0.0164) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.19% (1.9762 => 1.9131, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6012, std. dev.: 0.0293) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4475, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5082, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.68% (6.3560 => 6.2490, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7945, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: -1.45% (3.0263 => 2.9825, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4902, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8630, std. dev.: 0.0069) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1486, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2428, std. dev.: 0.0241) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2558, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8454, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2389, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 17:53:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 19:53:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120712005309.961642A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1982?compare_to=1979&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1982, Order: 160090, Start Time: 2012-07-11 23:35:03, End Time: 2012-07-12 00:53:14 To: 1979, Order: 160076, Start Time: 2012-07-11 21:49:01, End Time: 2012-07-11 23:07:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 15 (57 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 917 (798 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 4.57% (0.3743 => 0.3914, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-3: 4.47% (0.3781 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.46% (0.3809 => 0.3979, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 4.35% (0.3815 => 0.3981, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 4.32% (0.3769 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 4.28% (0.3835 => 0.3999, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 4.13% (0.3968 => 0.4132, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 4.13% (0.4096 => 0.4265, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 4.00% (0.4155 => 0.4321, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 3.93% (0.4200 => 0.4365, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 3.20% (0.6099 => 0.6294, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 3.12% (0.6213 => 0.6407, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.95% (0.7483 => 0.7704, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 1.28% (13.3469 => 13.5177, std. dev.: 0.0117) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.24% (0.8338 => 0.8441, std. dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.39% (10.3673 => 13.5177, std. dev.: 0.0117) SingleSource/UnitTests/ObjC/trivial-interface: 12.70% (0.3473 => 0.3914, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-2: 12.44% (0.3497 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.36% (0.3543 => 0.3981, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.34% (0.3516 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.31% (0.3543 => 0.3979, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 12.30% (0.3561 => 0.3999, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.86% (0.3694 => 0.4132, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3828 => 0.4265, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.26% (1.1194 => 1.2455, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.83% (0.2065 => 0.2206, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.82% (2.2022 => 2.3525, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.68% (1.7609 => 1.8786, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.25% (0.6030 => 0.6407, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.23% (0.5925 => 0.6294, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.16% (0.7326 => 0.7704, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.31% (0.3177 => 0.3314, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.87% (7.0540 => 7.3268, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.85% (0.4879 => 0.5067, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.70% (10.4361 => 10.8222, std. dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: 3.40% (0.7433 => 0.7686, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.29% (0.8172 => 0.8441, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 3.05% (0.3282 => 0.3382, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.5569 => 0.5737, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.77% (0.4615 => 0.4743, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.61% (4.9449 => 5.0742, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: 2.53% (0.7835 => 0.8033, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.43% (8.1363 => 8.3344, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.38% (5.0018 => 5.1206, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.24% (4.2646 => 4.3601, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.22% (0.5860 => 0.5990, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (14.3668 => 14.6831, std. dev.: 0.0045) MultiSource/Applications/hbd/hbd: 2.19% (1.5603 => 1.5945, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.97% (1.5415 => 1.5718, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.96% (9.4845 => 9.6702, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 1.86% (1.1642 => 1.1859, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.78% (1.1861 => 1.2072, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.75% (2.0665 => 2.1027, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.65% (2.0273 => 2.0608, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.49% (0.8067 => 0.8187, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 1.48% (3.3354 => 3.3849, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 1.40% (3.8723 => 3.9265, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.30% (1.3050 => 1.3220, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.29% (0.9765 => 0.9891, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.11% (1.4186 => 1.4344, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.35% (3.6395 => 3.7616, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.20% (26.0924 => 26.6666, std. dev.: 0.0228) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.02% (1.5086 => 1.5390, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.24% (9.1159 => 9.2286, std. dev.: 0.0256) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.16% (2.6546 => 2.6855, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 1.11% (2.9346 => 2.9673, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1290, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.61% (5.2763 => 3.1337, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.83% (5.3855 => 3.6715, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.41% (5.3526 => 3.6711, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.74% (2.9384 => 2.5348, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -10.79% (22.1758 => 19.7820, std. dev.: 0.0378) SingleSource/UnitTests/Vector/constpool: -5.03% (54.1659 => 51.4424, std. dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.73% (3.8922 => 3.7858, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.23% (0.0998 => 0.0846, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -11.01% (1.2373 => 1.1011, std. dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.77% (19.9488 => 18.5978, std. dev.: 0.0447) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.82% (8.1563 => 7.9260, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6820, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0842, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 18:56:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 20:56:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120712015642.39FF72A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1983?compare_to=1981&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1983, Order: 160093, Start Time: 2012-07-12 00:42:55, End Time: 2012-07-12 01:56:47 To: 1981, Order: 160084, Start Time: 2012-07-11 23:01:16, End Time: 2012-07-12 00:15:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (129 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.93% (2.0176 => 2.2986, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 8.97% (0.5818 => 0.6340, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.92% (0.5748 => 0.6261, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.87% (0.7061 => 0.7687, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.46% (0.3578 => 0.3845, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.18% (0.3650 => 0.3912, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.16% (0.3601 => 0.3859, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.13% (0.3789 => 0.4059, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.10% (0.3646 => 0.3905, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.10% (0.3663 => 0.3923, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.09% (0.3623 => 0.3880, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.97% (0.3914 => 0.4187, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.92% (1.3693 => 1.4641, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 6.92% (0.4003 => 0.4280, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.78% (0.3940 => 0.4207, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.14% (0.1986 => 0.2108, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.01% (0.7710 => 0.8173, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 5.91% (0.4062 => 0.4302, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.80% (0.4328 => 0.4579, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.68% (0.2607 => 0.2755, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 5.67% (0.7038 => 0.7437, std. dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.54% (0.2655 => 0.2802, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.50% (0.2781 => 0.2934, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.44% (0.2628 => 0.2771, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.44% (0.2721 => 0.2869, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.25% (0.2726 => 0.2869, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.24% (0.2596 => 0.2732, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.18% (1.9828 => 2.0856, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.17% (0.2765 => 0.2908, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.15% (0.5265 => 0.5536, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2696 => 0.2834, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 5.11% (0.2760 => 0.2901, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.07% (0.2761 => 0.2901, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.97% (3.9660 => 4.1631, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 4.95% (0.3149 => 0.3305, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.92% (0.3107 => 0.3260, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.90% (0.3489 => 0.3660, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.77% (0.3899 => 0.4085, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.72% (0.3580 => 0.3749, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.70% (0.3192 => 0.3342, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.68% (0.3485 => 0.3648, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.62% (0.4390 => 0.4593, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 4.52% (0.3453 => 0.3609, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.43% (0.3293 => 0.3439, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.38% (0.2988 => 0.3119, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3756 => 0.3916, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4016 => 0.4187, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.24% (0.3534 => 0.3684, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.18% (0.6959 => 0.7250, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.03% (0.5577 => 0.5802, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.96% (0.9199 => 0.9563, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 3.93% (16.6129 => 17.2659, std. dev.: 0.0108) MultiSource/Applications/SPASS/SPASS: 3.88% (13.8202 => 14.3562, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/moments: 3.88% (0.3868 => 0.4018, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.78% (1.2193 => 1.2654, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.77% (13.2842 => 13.7845, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.2945 => 0.3055, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.59% (0.2925 => 0.3030, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.37% (0.5637 => 0.5827, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.29% (1.2292 => 1.2697, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.27% (0.3246 => 0.3352, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.26% (0.7506 => 0.7751, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.4563 => 1.5038, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.21% (1.3245 => 1.3670, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.21% (3.8646 => 3.9885, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.14% (1.3819 => 1.4253, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.13% (0.4379 => 0.4516, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.12% (1.3813 => 1.4244, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.11% (1.1364 => 1.1717, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.09% (0.3755 => 0.3871, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.08% (7.2180 => 7.4403, std. dev.: 0.0058) MultiSource/Applications/Burg/burg: 3.01% (1.1061 => 1.1394, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 2.97% (1.0594 => 1.0909, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.91% (0.7460 => 0.7677, std. dev.: 0.0037) MultiSource/Applications/treecc/treecc: 2.88% (1.9270 => 1.9825, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.49% (3.6692 => 3.7604, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.41% (4.9865 => 5.1067, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8310 => 0.8505, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.21% (6.5754 => 6.7204, std. dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 2.20% (14.8535 => 15.1799, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.13% (4.3801 => 4.4732, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.09% (4.4433 => 4.5360, std. dev.: 0.0106) MultiSource/Applications/siod/siod: 2.03% (2.1791 => 2.2234, std. dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.97% (0.8698 => 0.8869, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.83% (0.6135 => 0.6247, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.83% (16.2614 => 16.5582, std. dev.: 0.0214) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.81% (1.1333 => 1.1538, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.60% (14.5298 => 14.7616, std. dev.: 0.0103) MultiSource/Applications/d/make_dparser: 1.57% (3.1889 => 3.2391, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2927, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.11% (2.1007 => 2.1240, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.57% (1.8175 => 2.2641, std. dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.41% (2.0200 => 2.1899, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: 7.65% (1.2998 => 1.3992, std. dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7332, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9195, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6786, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8290, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.87% (3.6469 => 3.7151, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5089 => 1.5335, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (1.9290 => 1.9562, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.05% (22.5627 => 20.9726, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.46% (0.8818 => 0.8601, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2308 => 1.0983, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.93% (20.3410 => 18.5239, std. dev.: 0.0411) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.51% (1.3780 => 1.3021, std. dev.: 0.0108) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9124, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5956, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4476, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5098, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2521, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1130, std. dev.: 0.0172) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7946, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: -1.44% (3.0263 => 2.9827, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.31% (9.3358 => 9.2137, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2370, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 19:39:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 21:39:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120712023903.21D6F2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1984?compare_to=1982&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1984, Order: 160097, Start Time: 2012-07-12 01:20:57, End Time: 2012-07-12 02:39:08 To: 1982, Order: 160090, Start Time: 2012-07-11 23:35:03, End Time: 2012-07-12 00:53:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (55 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (800 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.95% (13.5177 => 13.1192, std. dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.54% (10.3673 => 13.1192, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.26% (1.1194 => 1.2455, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.60% (0.3473 => 0.3841, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.32% (0.3516 => 0.3879, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.24% (0.3497 => 0.3855, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.22% (0.3543 => 0.3905, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.19% (0.3543 => 0.3904, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.11% (0.3561 => 0.3921, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.83% (0.3694 => 0.4057, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.46% (0.3828 => 0.4190, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.40% (0.3927 => 0.4296, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 9.26% (0.3886 => 0.4246, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.20% (1.7609 => 1.8877, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.83% (2.2022 => 2.3526, std. dev.: 0.0138) SingleSource/UnitTests/ObjC++/Hello: 5.52% (0.5925 => 0.6252, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.47% (0.6030 => 0.6360, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.2065 => 0.2169, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 4.34% (0.7326 => 0.7644, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.28% (0.3177 => 0.3313, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.94% (0.4879 => 0.5071, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.91% (10.4361 => 10.8437, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.66% (7.0540 => 7.3119, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 3.36% (0.7433 => 0.7683, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 3.26% (0.3282 => 0.3389, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.92% (0.8172 => 0.8411, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.59% (0.5569 => 0.5713, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (0.4615 => 0.4734, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.12% (5.0018 => 5.1080, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.09% (4.9449 => 5.0482, std. dev.: 0.0113) MultiSource/Applications/spiff/spiff: 2.04% (0.7835 => 0.7995, std. dev.: 0.0039) MultiSource/Applications/hbd/hbd: 2.02% (1.5603 => 1.5918, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (14.3668 => 14.6491, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.96% (8.1363 => 8.2960, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.89% (4.2646 => 4.3453, std. dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 1.87% (9.4845 => 9.6623, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.84% (0.5860 => 0.5968, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 1.55% (1.1642 => 1.1822, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.48% (1.1861 => 1.2037, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 1.46% (2.0273 => 2.0569, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.32% (1.5415 => 1.5619, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.31% (0.8067 => 0.8173, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.23% (1.3050 => 1.3210, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.21% (3.3354 => 3.3757, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.16% (3.8723 => 3.9173, std. dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 1.01% (5.7591 => 5.8171, std. dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9749, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.80% (1.1145 => 1.1903, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7489, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.20% (26.0924 => 26.6668, std. dev.: 0.0368) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (1.5086 => 1.5382, std. dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2373, std. dev.: 0.0177) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6897, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 1.03% (2.9346 => 2.9648, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1247, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.35% (5.2763 => 3.1474, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.84% (5.3855 => 3.6710, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.51% (5.3526 => 3.6659, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.62% (2.9384 => 2.5381, std. dev.: 0.0133) MultiSource/Applications/ClamAV/clamscan: -10.93% (22.1758 => 19.7517, std. dev.: 0.0344) SingleSource/UnitTests/Vector/constpool: -5.07% (54.1659 => 51.4220, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.72% (3.8922 => 3.7863, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.23% (0.0998 => 0.0846, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.49% (1.2373 => 1.1075, std. dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.07% (19.9488 => 18.5386, std. dev.: 0.0697) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.97% (8.1563 => 7.9141, std. dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6908, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0872, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 20:14:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 22:14:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120712031416.ED1232A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1985?compare_to=1980&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1985, Order: 160093, Start Time: 2012-07-12 00:31:12, End Time: 2012-07-12 03:14:23 To: 1980, Order: 160070, Start Time: 2012-07-11 21:20:28, End Time: 2012-07-12 00:03:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 14 (42 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 937 (851 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 3.40% (0.3762 => 0.3890, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 3.37% (0.3743 => 0.3869, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 3.29% (0.3764 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.28% (0.3783 => 0.3907, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 3.26% (0.3738 => 0.3860, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 3.19% (0.3797 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 3.14% (0.3763 => 0.3881, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 3.07% (0.3943 => 0.4064, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 3.03% (0.3958 => 0.4078, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.94% (0.6131 => 0.6311, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 2.93% (0.4025 => 0.4143, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.86% (0.6079 => 0.6253, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.56% (0.7382 => 0.7571, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.42% (23.8400 => 24.1787, std. dev.: 0.0121) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -2.09% (1.6447 => 1.6104, std. dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.28% (0.3446 => 0.3869, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.27% (0.3465 => 0.3890, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3460 => 0.3881, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.14% (0.3442 => 0.3860, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.08% (0.3469 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.07% (0.3496 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.01% (0.3488 => 0.3907, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.73% (0.3650 => 0.4078, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.56% (0.3643 => 0.4064, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.25% (0.3724 => 0.4143, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.33% (0.5826 => 0.6253, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.17% (0.5889 => 0.6311, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.58% (0.7171 => 0.7571, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.92% (1.6211 => 1.6846, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.77% (3.5627 => 3.6970, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.60% (0.4361 => 0.4518, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.40% (0.4029 => 0.4166, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.36% (0.5900 => 0.6098, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.22% (1.3152 => 1.3576, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.08% (0.5026 => 0.5181, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.00% (0.3930 => 0.4048, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.94% (4.2109 => 4.3347, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (0.3625 => 0.3731, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.90% (0.4994 => 0.5139, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.89% (0.9909 => 1.0195, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (2.0673 => 2.1253, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 2.80% (23.5202 => 24.1787, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.71% (1.9694 => 2.0227, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.62% (0.5000 => 0.5131, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 2.52% (0.9697 => 0.9941, std. dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.51% (2.7292 => 2.7978, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.47% (1.9966 => 2.0459, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 2.37% (1.0781 => 1.1037, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.15% (0.4658 => 0.4758, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 2.08% (1.8794 => 1.9185, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.05% (4.4195 => 4.5100, std. dev.: 0.0082) MultiSource/Applications/JM/ldecod/ldecod: 1.81% (2.1653 => 2.2044, std. dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 1.75% (4.6177 => 4.6987, std. dev.: 0.0116) MultiSource/Benchmarks/mafft/pairlocalalign: 1.69% (2.1013 => 2.1368, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 1.68% (0.7875 => 0.8007, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 1.61% (5.5417 => 5.6310, std. dev.: 0.0059) MultiSource/Applications/lua/lua: 1.56% (1.4269 => 1.4492, std. dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.91% (11.9555 => 11.7272, std. dev.: 0.0097) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 20:38:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 22:38:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120712033816.AAFE92A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1986?compare_to=1983&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1986, Order: 160101, Start Time: 2012-07-12 02:24:40, End Time: 2012-07-12 03:38:22 To: 1983, Order: 160093, Start Time: 2012-07-12 00:42:55, End Time: 2012-07-12 01:56:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (124 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (727 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.67% (1.3021 => 1.3239, std. dev.: 0.0070) SingleSource/Benchmarks/McGill/chomp: 1.04% (1.0983 => 1.1097, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lemon/lemon: -1.25% (1.4538 => 1.4356, std. dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.52% (2.0176 => 2.2903, std. dev.: 0.0147) SingleSource/UnitTests/ObjC++/property-reference-object: 8.85% (0.5818 => 0.6333, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.82% (0.7061 => 0.7684, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5748 => 0.6246, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.93% (0.3578 => 0.3826, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.69% (0.3663 => 0.3908, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: 6.66% (0.3646 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.65% (0.3623 => 0.3864, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.65% (0.3789 => 0.4041, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.65% (1.3693 => 1.4603, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 6.64% (0.3601 => 0.3840, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.58% (0.3650 => 0.3890, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.54% (0.3914 => 0.4170, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.47% (0.4003 => 0.4262, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.42% (0.3940 => 0.4193, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 5.98% (0.4328 => 0.4587, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.94% (0.1986 => 0.2104, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.72% (0.2781 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.72% (0.2782 => 0.2941, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2607 => 0.2753, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.58% (0.7038 => 0.7431, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.54% (0.7710 => 0.8137, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.46% (0.3022 => 0.3187, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.42% (0.2655 => 0.2799, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 5.29% (0.4062 => 0.4277, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.29% (0.2760 => 0.2906, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.28% (0.2765 => 0.2911, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.15% (0.3107 => 0.3267, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.11% (0.2721 => 0.2860, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2761 => 0.2902, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.08% (0.2596 => 0.2728, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2696 => 0.2833, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.07% (0.5265 => 0.5532, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.00% (1.9828 => 2.0819, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 4.99% (0.3149 => 0.3306, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.84% (0.3489 => 0.3658, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.80% (0.3580 => 0.3752, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.78% (3.9660 => 4.1554, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.74% (0.3899 => 0.4084, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 4.72% (0.2988 => 0.3129, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.56% (0.3485 => 0.3644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.3453 => 0.3610, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.54% (0.3192 => 0.3337, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.34% (0.3293 => 0.3436, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.31% (0.4016 => 0.4189, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3756 => 0.3916, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 4.24% (0.3534 => 0.3684, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.02% (0.6959 => 0.7239, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.93% (0.3868 => 0.4020, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.85% (16.6129 => 17.2530, std. dev.: 0.0241) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.78% (0.9199 => 0.9547, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.2945 => 0.3055, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.58% (13.8202 => 14.3150, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.55% (1.2193 => 1.2626, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.2925 => 0.3028, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.45% (13.2842 => 13.7427, std. dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.39% (0.5637 => 0.5828, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.28% (0.5577 => 0.5760, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.27% (1.2292 => 1.2694, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.23% (1.3819 => 1.4266, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.21% (1.4563 => 1.5031, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.10% (1.3245 => 1.3655, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.09% (0.3755 => 0.3871, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.06% (1.3813 => 1.4235, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.04% (1.1364 => 1.1710, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 3.01% (0.7506 => 0.7732, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.97% (0.4379 => 0.4509, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (3.8646 => 3.9777, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.85% (7.2180 => 7.4234, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 2.80% (1.1061 => 1.1371, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.73% (0.7460 => 0.7664, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.65% (1.9270 => 1.9780, std. dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.57% (4.9865 => 5.1147, std. dev.: 0.0261) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.22% (3.6692 => 3.7505, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.8310 => 0.8485, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.99% (2.1791 => 2.2224, std. dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 1.96% (6.5754 => 6.7045, std. dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.95% (0.8698 => 0.8868, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.91% (14.8535 => 15.1368, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.87% (4.3801 => 4.4622, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.83% (16.2614 => 16.5591, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.72% (4.4433 => 4.5196, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.70% (0.6135 => 0.6239, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.62% (1.1333 => 1.1517, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.50% (14.5298 => 14.7478, std. dev.: 0.0199) MultiSource/Applications/d/make_dparser: 1.36% (3.1889 => 3.2322, std. dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2909, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.87% (1.8175 => 2.2695, std. dev.: 0.0180) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.36% (2.0200 => 2.1888, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: 8.32% (1.2998 => 1.4080, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.45% (1.5824 => 1.7003, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.14% (7.4271 => 7.7344, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9887, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9216, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6798, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.52% (2.8606 => 2.9612, std. dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8290, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5352, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (3.6469 => 3.7084, std. dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1941, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.09% (22.5627 => 20.9626, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.8818 => 0.8575, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.54% (0.6576 => 0.6475, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.12% (0.9108 => 0.9006, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2308 => 1.1097, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.61% (20.3410 => 18.5891, std. dev.: 0.0213) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.93% (1.3780 => 1.3239, std. dev.: 0.0070) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9127, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5820, std. dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5031, std. dev.: 0.0059) MultiSource/Applications/spiff/spiff: -1.80% (3.0263 => 2.9718, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2512, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1120, std. dev.: 0.0263) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7952, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std. dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2433, std. dev.: 0.0077) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2258, std. dev.: 0.0256) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2555, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8492, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 21:24:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 11 Jul 2012 23:24:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120712042449.0099E2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1987?compare_to=1984&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1987, Order: 160102, Start Time: 2012-07-12 03:06:49, End Time: 2012-07-12 04:24:55 To: 1984, Order: 160097, Start Time: 2012-07-12 01:20:57, End Time: 2012-07-12 02:39:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (59 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (796 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (13.1192 => 13.4076, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 1.12% (10.8437 => 10.9649, std. dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lemon/lemon: -1.26% (1.4501 => 1.4319, std. dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.33% (10.3673 => 13.4076, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.25% (1.1194 => 1.2453, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.71% (0.3473 => 0.3845, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.47% (0.3516 => 0.3884, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.39% (0.3543 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.36% (0.3543 => 0.3910, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.33% (0.3561 => 0.3929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.96% (0.3694 => 0.4062, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.69% (0.3828 => 0.4199, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.62% (0.3886 => 0.4260, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.57% (0.3927 => 0.4303, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.12% (1.7609 => 1.9039, std. dev.: 0.0093) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.52% (2.2022 => 2.3678, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 5.52% (0.6030 => 0.6363, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.50% (0.5925 => 0.6251, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.07% (10.4361 => 10.9649, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.99% (0.2065 => 0.2168, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.53% (0.3177 => 0.3321, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 4.46% (0.7326 => 0.7653, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 4.24% (0.3282 => 0.3421, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.20% (0.4879 => 0.5084, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.98% (7.0540 => 7.3349, std. dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 3.83% (0.7433 => 0.7718, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.83% (0.8172 => 0.8403, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.75% (0.4615 => 0.4742, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.75% (0.5569 => 0.5722, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.61% (4.2646 => 4.3760, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.56% (5.0018 => 5.1297, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.54% (4.9449 => 5.0703, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (14.3668 => 14.7229, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 2.30% (0.7835 => 0.8015, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.20% (8.1363 => 8.3153, std. dev.: 0.0038) MultiSource/Applications/hbd/hbd: 2.18% (1.5603 => 1.5943, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5860 => 0.5983, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 2.10% (9.4845 => 9.6833, std. dev.: 0.0049) MultiSource/Applications/treecc/treecc: 1.86% (2.0273 => 2.0651, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 1.84% (1.1642 => 1.1856, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.75% (1.1861 => 1.2068, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.74% (1.5415 => 1.5683, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.66% (3.3354 => 3.3908, std. dev.: 0.0038) MultiSource/Applications/lua/lua: 1.59% (3.8723 => 3.9338, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.51% (0.8067 => 0.8189, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.49% (1.3050 => 1.3245, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 1.39% (5.7591 => 5.8393, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.37% (2.0665 => 2.0948, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.35% (0.9765 => 0.9897, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.34% (17.1811 => 17.4115, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.15% (1.4186 => 1.4349, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.80% (1.1145 => 1.1903, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7465, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.38% (1.0313 => 1.0558, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.08% (26.0924 => 26.6355, std. dev.: 0.0296) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.5086 => 1.5376, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4460, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2437, std. dev.: 0.0132) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.29% (2.6546 => 2.6889, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.36% (5.2763 => 3.1466, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.52% (5.3855 => 3.6882, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.23% (5.3526 => 3.6812, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.77% (2.9384 => 2.5338, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -10.46% (22.1758 => 19.8559, std. dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: -5.10% (54.1659 => 51.4020, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.38% (3.8922 => 3.7996, std. dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.35% (1.2373 => 1.1093, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.48% (19.9488 => 18.6571, std. dev.: 0.0232) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (8.1563 => 7.9176, std. dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6859, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0838, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 22:19:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 00:19:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120712051957.BC15A2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1988?compare_to=1986&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1988, Order: 160103, Start Time: 2012-07-12 04:06:10, End Time: 2012-07-12 05:20:03 To: 1986, Order: 160101, Start Time: 2012-07-12 02:24:40, End Time: 2012-07-12 03:38:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (132 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (722 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/treecc/treecc: 1.04% (1.9780 => 1.9986, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.83% (54.4977 => 56.5831, std. dev.: 0.1101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.69% (78.9136 => 81.0357, std. dev.: 0.0933) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.32% (2.0176 => 2.3066, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.11% (0.5818 => 0.6348, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5748 => 0.6263, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.41% (0.7061 => 0.7655, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.95% (0.3650 => 0.3940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.60% (0.3578 => 0.3850, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.39% (0.3601 => 0.3867, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.35% (0.3646 => 0.3914, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.32% (0.3663 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.31% (0.3623 => 0.3888, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3789 => 0.4065, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.20% (0.3914 => 0.4196, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.14% (0.4003 => 0.4289, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.14% (1.3693 => 1.4671, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.06% (0.3940 => 0.4218, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 6.73% (0.7038 => 0.7512, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.1986 => 0.2113, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.18% (0.4062 => 0.4313, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.03% (0.4328 => 0.4589, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.97% (0.2596 => 0.2751, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.81% (0.5265 => 0.5571, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 5.79% (0.2781 => 0.2942, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.75% (0.7710 => 0.8153, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.72% (0.2782 => 0.2941, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.65% (0.2655 => 0.2805, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.62% (0.2721 => 0.2874, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2607 => 0.2753, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.55% (3.9660 => 4.1860, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.38% (0.2937 => 0.3095, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 5.36% (0.2726 => 0.2872, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.22% (0.2761 => 0.2905, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.21% (0.3899 => 0.4102, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/except: 5.18% (0.2760 => 0.2903, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.17% (0.3580 => 0.3765, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.14% (1.9828 => 2.0847, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.3107 => 0.3265, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.07% (0.3489 => 0.3666, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.05% (0.3149 => 0.3308, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.99% (0.4390 => 0.4609, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.93% (0.6959 => 0.7302, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 4.87% (0.3453 => 0.3621, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3192 => 0.3346, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.79% (16.6129 => 17.4087, std. dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.73% (0.3485 => 0.3650, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.63% (0.4016 => 0.4202, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3293 => 0.3443, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.3756 => 0.3926, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 4.50% (13.8202 => 14.4424, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/lists1: 4.50% (0.3534 => 0.3693, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.49% (0.9199 => 0.9612, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/matrix: 4.48% (0.2988 => 0.3122, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.38% (0.2925 => 0.3053, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.21% (1.2193 => 1.2706, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/moments: 4.14% (0.3868 => 0.4028, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.03% (13.2842 => 13.8195, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.5577 => 0.5799, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.97% (0.7506 => 0.7804, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.92% (1.4563 => 1.5134, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.92% (0.5637 => 0.5858, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.2945 => 0.3060, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.89% (1.3245 => 1.3760, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.88% (0.3246 => 0.3372, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 3.86% (3.8646 => 4.0136, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 3.80% (1.1061 => 1.1481, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.73% (1.3819 => 1.4334, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.72% (0.4379 => 0.4542, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.72% (1.9270 => 1.9986, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.70% (1.1364 => 1.1784, std. dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 3.57% (1.2292 => 1.2731, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.57% (0.2914 => 0.3018, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.55% (1.0594 => 1.0970, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.49% (1.3813 => 1.4295, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.43% (7.2180 => 7.4653, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3755 => 0.3883, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.27% (0.7460 => 0.7704, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.17% (4.9865 => 5.1445, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.05% (3.6692 => 3.7810, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 2.91% (2.1791 => 2.2425, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 2.76% (0.8310 => 0.8539, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.73% (6.5754 => 6.7546, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.71% (14.8535 => 15.2563, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.65% (4.3801 => 4.4961, std. dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.61% (0.8698 => 0.8925, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 2.48% (0.4113 => 0.4215, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.47% (16.2614 => 16.6633, std. dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.38% (1.1333 => 1.1603, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.38% (4.4433 => 4.5490, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.25% (0.4791 => 0.4899, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.08% (14.5298 => 14.8313, std. dev.: 0.0104) MultiSource/Applications/d/make_dparser: 2.05% (3.1889 => 3.2542, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.89% (0.6283 => 0.6402, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.84% (1.2749 => 1.2983, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.73% (2.1007 => 2.1370, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.34% (1.5188 => 1.5392, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.17% (3.2742 => 3.3124, std. dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2596, std. dev.: 0.0458) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.27% (2.0200 => 2.1870, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.17% (0.9996 => 1.0813, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: 7.56% (1.2998 => 1.3981, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7314, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.52% (2.8606 => 2.9614, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.35% (1.7688 => 1.8281, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0310 => 1.0562, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1909, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.76% (3.6469 => 3.7111, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5331, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -9.66% (0.4657 => 0.4207, std. dev.: 0.0139) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.5627 => 21.1417, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.91% (0.8818 => 0.8650, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.66% (1.2308 => 1.1119, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.76% (20.3410 => 18.5593, std. dev.: 0.0208) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3068, std. dev.: 0.0092) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9129, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5989, std. dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4465, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5072, std. dev.: 0.0048) MultiSource/Applications/spiff/spiff: -1.83% (3.0263 => 2.9708, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2553, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7940, std. dev.: 0.0019) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1245, std. dev.: 0.0182) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.38% (9.3358 => 9.2066, std. dev.: 0.0194) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.20% (0.9692 => 0.9576, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2535, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8464, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 23:10:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 01:10:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120712061042.474242A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1989?compare_to=1987&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1989, Order: 160103, Start Time: 2012-07-12 04:52:33, End Time: 2012-07-12 06:10:46 To: 1987, Order: 160102, Start Time: 2012-07-12 03:06:49, End Time: 2012-07-12 04:24:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (794 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.37% (10.3673 => 13.4121, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 11.66% (0.3473 => 0.3878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.35% (0.3497 => 0.3894, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3543 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.29% (0.3516 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.23% (0.3543 => 0.3941, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.22% (1.1194 => 1.2450, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.15% (0.3561 => 0.3958, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/for-in: 10.83% (0.3694 => 0.4094, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.45% (0.3886 => 0.4292, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3927 => 0.4335, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.97% (1.7609 => 1.9013, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.21% (2.2022 => 2.3610, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2065 => 0.2210, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.12% (0.6030 => 0.6399, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.09% (0.5925 => 0.6286, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.60% (0.7326 => 0.7736, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 4.78% (10.4361 => 10.9352, std. dev.: 0.0180) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.60% (0.3177 => 0.3323, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.18% (0.4879 => 0.5083, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.18% (7.0540 => 7.3489, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/oourafft: 3.93% (0.3282 => 0.3411, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.87% (0.7433 => 0.7721, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.26% (0.8172 => 0.8438, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.84% (0.4615 => 0.4746, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.82% (0.5569 => 0.5726, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.73% (4.9449 => 5.0801, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.62% (5.0018 => 5.1326, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.51% (14.3668 => 14.7268, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: 2.50% (0.7835 => 0.8031, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.44% (8.1363 => 8.3348, std. dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (4.2646 => 4.3618, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 2.21% (9.4845 => 9.6940, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.20% (0.4636 => 0.4738, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.18% (1.5603 => 1.5943, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5860 => 0.5985, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.05% (1.1642 => 1.1881, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.94% (1.1861 => 1.2091, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.88% (2.0273 => 2.0655, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.74% (1.5415 => 1.5683, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 1.74% (3.3354 => 3.3933, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 1.68% (3.8723 => 3.9374, std. dev.: 0.0193) MultiSource/Applications/oggenc/oggenc: 1.60% (5.7591 => 5.8513, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.59% (1.3050 => 1.3258, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.51% (2.0665 => 2.0978, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.48% (0.8067 => 0.8186, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.44% (17.1811 => 17.4284, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.34% (0.9765 => 0.9896, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.23% (1.4186 => 1.4360, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.04% (1.2842 => 1.2976, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7539, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0313 => 1.0559, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.13% (26.0924 => 26.6493, std. dev.: 0.0321) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5086 => 1.5349, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6901, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2338, std. dev.: 0.0361) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1255, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.40% (5.2763 => 3.1449, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.54% (5.3855 => 3.6868, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.17% (5.3526 => 3.6842, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.65% (2.9384 => 2.5372, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -10.57% (22.1758 => 19.8316, std. dev.: 0.0326) SingleSource/UnitTests/Vector/constpool: -5.02% (54.1659 => 51.4453, std. dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.20% (3.8922 => 3.8065, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.35% (1.2373 => 1.1093, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.33% (19.9488 => 18.4860, std. dev.: 0.0635) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9183, std. dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6832, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.09% (1.4460 => 1.4303, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 11 23:25:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 01:25:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120712062503.DD9522A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1990?compare_to=1985&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1990, Order: 160102, Start Time: 2012-07-12 03:42:00, End Time: 2012-07-12 06:25:10 To: 1985, Order: 160093, Start Time: 2012-07-12 00:31:12, End Time: 2012-07-12 03:14:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (39 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (854 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.18% (2.0496 => 2.0942, std. dev.: 0.0114) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.57% (24.1787 => 23.8000, std. dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.89% (0.3465 => 0.3877, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.87% (0.3446 => 0.3855, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.84% (0.3496 => 0.3910, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.82% (0.3442 => 0.3849, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.82% (0.3460 => 0.3869, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.76% (0.3469 => 0.3877, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.75% (0.3488 => 0.3898, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.42% (0.3650 => 0.4067, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3643 => 0.4052, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3724 => 0.4130, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.04% (0.5826 => 0.6236, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.78% (0.5889 => 0.6288, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 5.63% (0.7171 => 0.7575, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.76% (1.6211 => 1.6821, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.76% (0.5900 => 0.6122, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.68% (3.5627 => 3.6939, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.32% (0.4361 => 0.4506, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (0.5026 => 0.5190, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 3.08% (0.4029 => 0.4153, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.90% (0.4994 => 0.5139, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (1.3152 => 1.3528, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.79% (0.9909 => 1.0185, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.75% (0.3930 => 0.4038, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.74% (2.0673 => 2.1240, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.74% (0.5000 => 0.5137, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.68% (4.2109 => 4.3237, std. dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.50% (2.7292 => 2.7973, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (1.9694 => 2.0167, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.38% (0.9697 => 0.9928, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.14% (1.9966 => 2.0393, std. dev.: 0.0039) MultiSource/Applications/d/make_dparser: 2.06% (1.0781 => 1.1003, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (4.4195 => 4.5056, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 1.83% (1.8794 => 1.9137, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 1.58% (2.1653 => 2.1995, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (2.1013 => 2.1336, std. dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 1.52% (4.6177 => 4.6879, std. dev.: 0.0143) MultiSource/Applications/SPASS/SPASS: 1.28% (5.5417 => 5.6126, std. dev.: 0.0128) MultiSource/Benchmarks/Bullet/bullet: 1.19% (23.5202 => 23.8000, std. dev.: 0.0076) MultiSource/Applications/lua/lua: 1.07% (1.4269 => 1.4422, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.38% (11.9555 => 11.6706, std. dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 00:02:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 02:02:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120712070236.AF0132A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1991?compare_to=1988&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1991, Order: 160107, Start Time: 2012-07-12 05:47:56, End Time: 2012-07-12 07:02:41 To: 1988, Order: 160103, Start Time: 2012-07-12 04:06:10, End Time: 2012-07-12 05:20:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (125 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (730 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.46% (81.0357 => 79.8490, std. dev.: 0.4366) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.71% (2.0176 => 2.2942, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.35% (0.5818 => 0.6362, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.10% (0.5748 => 0.6271, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 8.85% (0.7061 => 0.7686, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3578 => 0.3889, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.50% (0.3601 => 0.3907, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.42% (0.3646 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.37% (0.3789 => 0.4106, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.36% (0.3650 => 0.3955, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.30% (0.3663 => 0.3967, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3623 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.09% (0.4003 => 0.4327, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.07% (0.3940 => 0.4258, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.02% (1.3693 => 1.4654, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.52% (0.7038 => 0.7497, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.4062 => 0.4320, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.10% (0.4328 => 0.4592, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.10% (0.7710 => 0.8180, std. dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: 5.90% (0.2781 => 0.2945, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.89% (0.2596 => 0.2749, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.85% (0.5265 => 0.5573, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.79% (0.2782 => 0.2943, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.2655 => 0.2804, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.59% (0.3022 => 0.3191, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2765 => 0.2919, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.2721 => 0.2872, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 5.52% (0.2628 => 0.2773, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.52% (0.2937 => 0.3099, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.50% (0.2726 => 0.2876, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.39% (3.9660 => 4.1799, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.32% (1.9828 => 2.0882, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2696 => 0.2839, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.26% (0.3899 => 0.4104, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.17% (0.3580 => 0.3765, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.08% (0.4390 => 0.4613, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 4.95% (0.3453 => 0.3624, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.85% (0.3485 => 0.3654, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.84% (0.6959 => 0.7296, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.70% (0.3534 => 0.3700, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3293 => 0.3447, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.59% (16.6129 => 17.3748, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/matrix: 4.55% (0.2988 => 0.3124, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.54% (0.9199 => 0.9617, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.34% (0.2925 => 0.3052, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 4.32% (13.8202 => 14.4179, std. dev.: 0.0329) SingleSource/Benchmarks/Shootout-C++/moments: 4.32% (0.3868 => 0.4035, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.16% (1.2193 => 1.2700, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2945 => 0.3065, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.89% (13.2842 => 13.8016, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.5577 => 0.5793, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.85% (0.5637 => 0.5854, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.84% (0.4379 => 0.4547, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.73% (0.7506 => 0.7786, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.73% (0.3246 => 0.3367, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.4563 => 1.5098, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (3.8646 => 4.0062, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.66% (1.3245 => 1.3730, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.58% (1.2292 => 1.2732, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.57% (1.1061 => 1.1456, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.56% (1.1364 => 1.1768, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.52% (7.2180 => 7.4720, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.50% (0.2914 => 0.3016, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.47% (1.3819 => 1.4299, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.33% (0.3755 => 0.3880, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.0594 => 1.0941, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.26% (1.3813 => 1.4263, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.14% (0.7460 => 0.7694, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.06% (4.9865 => 5.1393, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.77% (3.6692 => 3.7710, std. dev.: 0.0038) MultiSource/Applications/siod/siod: 2.72% (2.1791 => 2.2383, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 2.54% (0.8310 => 0.8521, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.53% (6.5754 => 6.7419, std. dev.: 0.0099) MultiSource/Applications/JM/lencod/lencod: 2.50% (14.8535 => 15.2251, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.45% (4.3801 => 4.4874, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.35% (0.6135 => 0.6279, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.30% (4.4433 => 4.5457, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.21% (1.1333 => 1.1583, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 2.14% (16.2614 => 16.6092, std. dev.: 0.0112) MultiSource/Applications/ClamAV/clamscan: 1.92% (14.5298 => 14.8092, std. dev.: 0.0122) MultiSource/Applications/d/make_dparser: 1.90% (3.1889 => 3.2495, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.59% (0.6283 => 0.6383, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.56% (1.2749 => 1.2948, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.39% (2.1007 => 2.1300, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/fbench: 24.96% (1.8175 => 2.2712, std. dev.: 0.0239) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1909, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 6.93% (1.2998 => 1.3899, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.05% (7.4271 => 7.7281, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4789, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.75% (3.6469 => 3.7107, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5346, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.03% (10.7476 => 10.8583, std. dev.: 0.0282) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.53% (22.5627 => 21.0894, std. dev.: 0.4236) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.36% (0.8818 => 0.8610, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.59% (1.2308 => 1.1128, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.49% (20.3410 => 18.6134, std. dev.: 0.0145) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3118, std. dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.68% (2.6470 => 2.5497, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9127, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5975, std. dev.: 0.0117) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4475, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5021, std. dev.: 0.0067) MultiSource/Applications/spiff/spiff: -1.83% (3.0263 => 2.9708, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2512, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.7991, std. dev.: 0.1052) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1208, std. dev.: 0.0195) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std. dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2524, std. dev.: 0.0045) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2307, std. dev.: 0.0126) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 00:59:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 02:59:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120712075909.9A6722A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/1992?compare_to=1989&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1992, Order: 160107, Start Time: 2012-07-12 06:38:34, End Time: 2012-07-12 07:59:15 To: 1989, Order: 160103, Start Time: 2012-07-12 04:52:33, End Time: 2012-07-12 06:10:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (52 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (803 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.47% (10.3673 => 13.2157, std. dev.: 0.0864) SingleSource/UnitTests/ObjC/trivial-interface: 11.83% (0.3473 => 0.3884, std. dev.: 0.0076) SingleSource/UnitTests/ObjC/exceptions-3: 11.58% (0.3516 => 0.3923, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-2: 11.47% (0.3497 => 0.3898, std. dev.: 0.0135) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.37% (0.3543 => 0.3946, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-4: 11.35% (0.3543 => 0.3945, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/synchronized: 11.26% (0.3561 => 0.3962, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/for-in: 11.02% (0.3694 => 0.4101, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.01% (1.1194 => 1.2427, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 10.79% (0.3828 => 0.4241, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/property: 10.68% (0.3886 => 0.4301, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.53% (1.7609 => 1.8935, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 6.98% (0.1432 => 0.1532, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.96% (2.2022 => 2.3555, std. dev.: 0.0114) SingleSource/UnitTests/ObjC++/Hello: 5.91% (0.5925 => 0.6275, std. dev.: 0.0096) SingleSource/UnitTests/ObjC++/property-reference-object: 5.89% (0.6030 => 0.6385, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.2065 => 0.2169, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 4.39% (10.4361 => 10.8945, std. dev.: 0.0200) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.25% (0.3177 => 0.3312, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.96% (0.4879 => 0.5072, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.88% (7.0540 => 7.3277, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/oourafft: 3.72% (0.3282 => 0.3404, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 3.63% (0.7433 => 0.7703, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.21% (0.8172 => 0.8434, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.96% (0.5569 => 0.5734, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: 2.54% (0.7835 => 0.8034, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.46% (4.9449 => 5.0666, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.39% (5.0018 => 5.1214, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (14.3668 => 14.6885, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.19% (8.1363 => 8.3146, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.10% (4.2646 => 4.3540, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 2.06% (1.5603 => 1.5924, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.76% (1.1861 => 1.2070, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 1.72% (2.0273 => 2.0621, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 1.62% (3.8723 => 3.9349, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.56% (1.3050 => 1.3253, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.55% (1.5415 => 1.5654, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 1.52% (3.3354 => 3.3862, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 1.36% (5.7591 => 5.8375, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.30% (0.9765 => 0.9892, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.27% (1.4186 => 1.4366, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 1.16% (17.1811 => 17.3803, std. dev.: 0.0209) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7491, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.11% (26.0924 => 26.6440, std. dev.: 0.0378) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5086 => 1.5360, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4473, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6883, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2246, std. dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.50% (5.2763 => 3.1394, std. dev.: 0.0133) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.55% (5.3855 => 3.6864, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.29% (5.3526 => 3.6777, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.86% (2.9384 => 2.5312, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: -10.69% (22.1758 => 19.8063, std. dev.: 0.0550) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.42% (3.8922 => 3.7980, std. dev.: 0.0123) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.96% (1.2373 => 1.1017, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.89% (19.9488 => 18.5743, std. dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.79% (8.1563 => 7.9286, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6851, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0841, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.07% (1.4460 => 1.4305, std. dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 01:48:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 03:48:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120712084834.B91712A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1993?compare_to=1991&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1993, Order: 160110, Start Time: 2012-07-12 07:34:37, End Time: 2012-07-12 08:48:38 To: 1991, Order: 160107, Start Time: 2012-07-12 05:47:56, End Time: 2012-07-12 07:02:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (127 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (727 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.32% (2.0176 => 2.3065, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.45% (0.5818 => 0.6368, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.27% (0.5748 => 0.6281, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.68% (0.3650 => 0.3967, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3578 => 0.3887, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.39% (0.3646 => 0.3952, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.39% (0.3601 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.34% (0.7061 => 0.7650, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/for-in: 8.29% (0.3789 => 0.4103, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.23% (0.3623 => 0.3921, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.22% (0.3663 => 0.3964, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.20% (0.3914 => 0.4235, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.14% (0.4003 => 0.4329, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.33% (1.3693 => 1.4697, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.55% (0.7038 => 0.7499, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.1986 => 0.2113, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2781 => 0.2957, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4328 => 0.4593, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.98% (0.7710 => 0.8171, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.4062 => 0.4303, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.86% (0.2765 => 0.2927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3022 => 0.3197, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.79% (0.2782 => 0.2943, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.72% (0.5265 => 0.5566, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 5.68% (0.2607 => 0.2755, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.66% (0.2596 => 0.2743, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 5.61% (0.2726 => 0.2879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.59% (0.2628 => 0.2775, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.55% (1.9828 => 2.0929, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2760 => 0.2913, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.48% (0.2721 => 0.2870, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.46% (3.9660 => 4.1825, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.42% (0.3580 => 0.3774, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3489 => 0.3675, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.31% (0.3899 => 0.4106, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2696 => 0.2839, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.27% (0.3149 => 0.3315, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.15% (0.3453 => 0.3631, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.94% (0.3485 => 0.3657, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.91% (0.6959 => 0.7301, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.86% (0.4016 => 0.4211, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.77% (0.3293 => 0.3450, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2988 => 0.3130, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.71% (0.3756 => 0.3933, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.67% (0.3534 => 0.3699, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 4.65% (16.6129 => 17.3856, std. dev.: 0.0155) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.4390 => 0.4583, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.37% (0.9199 => 0.9601, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 4.37% (13.8202 => 14.4241, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.2945 => 0.3072, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.27% (0.3868 => 0.4033, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.24% (0.2925 => 0.3049, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.09% (1.2193 => 1.2692, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.08% (13.2842 => 13.8265, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.5577 => 0.5799, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.83% (0.5637 => 0.5853, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3246 => 0.3369, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 3.77% (3.8646 => 4.0102, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.73% (1.2292 => 1.2750, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.3245 => 1.3734, std. dev.: 0.0129) MultiSource/Applications/spiff/spiff: 3.61% (0.7506 => 0.7777, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.61% (0.4379 => 0.4537, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.55% (1.4563 => 1.5080, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 3.53% (1.1061 => 1.1452, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.50% (1.1364 => 1.1762, std. dev.: 0.0054) MultiSource/Applications/treecc/treecc: 3.43% (1.9270 => 1.9931, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.38% (0.3755 => 0.3882, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.32% (1.3813 => 1.4272, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.30% (1.0594 => 1.0944, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.29% (7.2180 => 7.4556, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.24% (1.3819 => 1.4267, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.04% (0.7460 => 0.7687, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.95% (4.9865 => 5.1335, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.77% (3.6692 => 3.7710, std. dev.: 0.0127) MultiSource/Applications/siod/siod: 2.69% (2.1791 => 2.2378, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.54% (14.8535 => 15.2313, std. dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: 2.48% (6.5754 => 6.7384, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.44% (0.8698 => 0.8910, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.41% (4.3801 => 4.4857, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.25% (0.6135 => 0.6273, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.20% (4.4433 => 4.5412, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 2.18% (16.2614 => 16.6166, std. dev.: 0.0188) MultiSource/Applications/d/make_dparser: 2.16% (3.1889 => 3.2577, std. dev.: 0.0171) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.13% (1.1333 => 1.1574, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 1.99% (14.5298 => 14.8193, std. dev.: 0.0144) MultiSource/Applications/SIBsim4/SIBsim4: 1.63% (1.2749 => 1.2957, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2573, std. dev.: 0.0403) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1930, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9996 => 1.0772, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.54% (1.0895 => 1.1716, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.85% (1.2998 => 1.3758, std. dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.13% (7.4271 => 7.7339, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9190, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6774, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8311, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4789, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1896, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5354, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.61% (3.6469 => 3.7055, std. dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1940, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.62% (22.5627 => 21.0697, std. dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.28% (0.8818 => 0.8617, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.37% (1.2308 => 1.1032, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.80% (20.3410 => 18.5518, std. dev.: 0.0307) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.06% (1.3780 => 1.3083, std. dev.: 0.0264) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9124, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5945, std. dev.: 0.0148) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5019, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: -1.83% (3.0263 => 2.9708, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2528, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/heapsort: -1.59% (3.9173 => 3.8550, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7952, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1293, std. dev.: 0.0293) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2156, std. dev.: 0.0336) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2369, std. dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2525, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 02:38:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 04:38:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120712093848.E51CA2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1994?compare_to=1990&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1994, Order: 160107, Start Time: 2012-07-12 06:52:47, End Time: 2012-07-12 09:38:54 To: 1990, Order: 160102, Start Time: 2012-07-12 03:42:00, End Time: 2012-07-12 06:25:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 7 (48 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 945 (845 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.08% (2.7973 => 2.8275, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.03% (1.3528 => 1.3668, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.03% (2.0393 => 2.0604, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (2.1995 => 2.2221, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 1.03% (2.1336 => 2.1555, std. dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 1.00% (4.6879 => 4.7350, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.93% (126.2107 => 129.9030, std. dev.: 0.1870) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.49% (0.3446 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.48% (0.3465 => 0.3932, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/for-in: 13.44% (0.3496 => 0.3966, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.34% (0.3442 => 0.3901, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.25% (0.3488 => 0.3950, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 12.88% (0.3650 => 0.4120, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.74% (0.3643 => 0.4107, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.30% (0.3724 => 0.4182, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.32% (0.5889 => 0.6320, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.31% (0.5826 => 0.6252, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.1620 => 0.1722, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.98% (0.7171 => 0.7600, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.98% (0.5900 => 0.6194, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.67% (3.5627 => 3.7289, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.66% (1.6211 => 1.6967, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (0.5026 => 0.5259, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.23% (0.4994 => 0.5205, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.20% (0.4361 => 0.4544, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.07% (0.4029 => 0.4193, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.92% (1.3152 => 1.3668, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.72% (0.5000 => 0.5186, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 3.65% (4.2109 => 4.3644, std. dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.60% (2.7292 => 2.8275, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.57% (0.9909 => 1.0263, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.57% (0.3362 => 0.3482, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.51% (0.3930 => 0.4068, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.20% (1.9966 => 2.0604, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.18% (1.9694 => 2.0320, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.10% (2.0673 => 2.1314, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 3.03% (1.0781 => 1.1108, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.00% (0.9697 => 0.9988, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.89% (0.4146 => 0.4266, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.74% (0.3903 => 0.4010, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.68% (0.4658 => 0.4783, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.62% (2.1653 => 2.2221, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (0.3890 => 0.3991, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.59% (1.8794 => 1.9280, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 2.58% (2.1013 => 2.1555, std. dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 2.54% (4.6177 => 4.7350, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (4.4195 => 4.5211, std. dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 2.23% (5.5417 => 5.6652, std. dev.: 0.0078) MultiSource/Applications/siod/siod: 2.05% (0.6634 => 0.6770, std. dev.: 0.0047) MultiSource/Applications/treecc/treecc: 2.02% (0.7875 => 0.8034, std. dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 2.01% (23.5202 => 23.9919, std. dev.: 0.0106) MultiSource/Applications/lua/lua: 2.00% (1.4269 => 1.4555, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 1.18% (1.5932 => 1.6120, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.97% (11.9555 => 11.7194, std. dev.: 0.0107) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 02:45:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 04:45:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120712094542.E305A2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1995?compare_to=1992&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1995, Order: 160111, Start Time: 2012-07-12 08:27:22, End Time: 2012-07-12 09:45:47 To: 1992, Order: 160107, Start Time: 2012-07-12 06:38:34, End Time: 2012-07-12 07:59:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (56 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (798 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.35% (77.9989 => 79.8281, std. dev.: 0.1631) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.19% (10.3673 => 13.2897, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/trivial-interface: 12.35% (0.3473 => 0.3902, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3497 => 0.3916, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.97% (0.3543 => 0.3967, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.83% (0.3543 => 0.3962, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 11.77% (0.3516 => 0.3930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.68% (0.3561 => 0.3977, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.43% (1.1194 => 1.2473, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 11.40% (0.3694 => 0.4115, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.95% (0.3828 => 0.4247, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.83% (0.3886 => 0.4307, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.75% (0.3927 => 0.4349, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.56% (1.7609 => 1.8941, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.42% (2.2022 => 2.3657, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 6.75% (0.5925 => 0.6325, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.70% (0.6030 => 0.6434, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 5.46% (0.7326 => 0.7726, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.23% (0.2065 => 0.2173, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.63% (0.3177 => 0.3324, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.49% (7.0540 => 7.3705, std. dev.: 0.0198) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.31% (0.8172 => 0.8524, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.4879 => 0.5078, std. dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.07% (0.3121 => 0.3248, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 3.81% (0.7433 => 0.7716, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 3.75% (10.4361 => 10.8273, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/oourafft: 3.41% (0.3282 => 0.3394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.06% (0.4615 => 0.4756, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 2.76% (0.7835 => 0.8051, std. dev.: 0.0040) MultiSource/Applications/hbd/hbd: 2.59% (1.5603 => 1.6007, std. dev.: 0.0080) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.53% (5.0018 => 5.1284, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.51% (0.5569 => 0.5709, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.44% (0.5860 => 0.6003, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.42% (8.1363 => 8.3335, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.41% (4.9449 => 5.0642, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (14.3668 => 14.6855, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.10% (2.0665 => 2.1098, std. dev.: 0.0112) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.03% (4.2646 => 4.3513, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 1.84% (9.4845 => 9.6594, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.74% (1.1861 => 1.2067, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 1.65% (3.8723 => 3.9360, std. dev.: 0.0083) MultiSource/Applications/treecc/treecc: 1.63% (2.0273 => 2.0604, std. dev.: 0.0052) MultiSource/Applications/d/make_dparser: 1.61% (3.3354 => 3.3892, std. dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 1.55% (1.2842 => 1.3041, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.54% (1.5415 => 1.5653, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.27% (1.3050 => 1.3216, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 1.26% (5.7591 => 5.8317, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.19% (17.1811 => 17.3851, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.03% (0.9765 => 0.9866, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7547, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0313 => 1.0559, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.12% (26.0924 => 26.6462, std. dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.47% (2.6546 => 2.6936, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.47% (9.1159 => 9.2498, std. dev.: 0.0229) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.48% (5.2763 => 3.1404, std. dev.: 0.0091) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.25% (5.3855 => 3.7028, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.93% (5.3526 => 3.6971, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.67% (2.9384 => 2.5368, std. dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: -10.66% (22.1758 => 19.8123, std. dev.: 0.0432) SingleSource/UnitTests/Vector/constpool: -5.12% (54.1659 => 51.3949, std. dev.: 0.0517) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.64% (3.8922 => 3.7893, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.81% (1.2373 => 1.1036, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.90% (19.9488 => 18.5730, std. dev.: 0.0470) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9159, std. dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6842, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0857, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: -1.09% (1.4460 => 1.4303, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 03:30:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 05:30:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120712103043.47E9B2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1996?compare_to=1993&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1996, Order: 160113, Start Time: 2012-07-12 09:16:30, End Time: 2012-07-12 10:30:48 To: 1993, Order: 160110, Start Time: 2012-07-12 07:34:37, End Time: 2012-07-12 08:48:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (129 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.59% (1.3083 => 1.3291, std. dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.20% (2.0176 => 2.3042, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 9.73% (0.5818 => 0.6384, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.59% (0.5748 => 0.6299, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.16% (0.7061 => 0.7708, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3578 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3650 => 0.3956, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 8.37% (0.3646 => 0.3951, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.33% (0.3601 => 0.3901, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 8.30% (0.3663 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.29% (0.3789 => 0.4103, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3623 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3914 => 0.4236, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.4003 => 0.4328, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.07% (0.3940 => 0.4258, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.49% (1.3693 => 1.4719, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.95% (0.1986 => 0.2124, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.69% (0.7038 => 0.7509, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 6.45% (0.4062 => 0.4324, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.42% (0.4328 => 0.4606, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.29% (0.2781 => 0.2956, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.28% (0.7710 => 0.8194, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.07% (0.2782 => 0.2951, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.02% (0.3022 => 0.3204, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.99% (0.2690 => 0.2851, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.98% (0.2607 => 0.2763, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.97% (0.2596 => 0.2751, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.93% (0.2765 => 0.2929, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.87% (0.2966 => 0.3140, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.83% (0.2760 => 0.2921, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.83% (0.2726 => 0.2885, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.82% (0.2937 => 0.3108, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.80% (0.2655 => 0.2809, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.78% (0.2628 => 0.2780, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.76% (1.9828 => 2.0970, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.74% (0.5265 => 0.5567, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 5.72% (0.2761 => 0.2919, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.62% (0.2721 => 0.2874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3107 => 0.3280, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2696 => 0.2845, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.51% (0.3899 => 0.4114, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.3489 => 0.3679, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.43% (0.3149 => 0.3320, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.41% (3.9660 => 4.1807, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.32% (0.6959 => 0.7329, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.23% (0.4016 => 0.4226, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.19% (0.3485 => 0.3666, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.01% (0.3293 => 0.3458, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (0.3756 => 0.3939, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.67% (16.6129 => 17.3881, std. dev.: 0.0110) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.53% (0.4390 => 0.4589, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 4.52% (0.3868 => 0.4043, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.41% (13.8202 => 14.4293, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.34% (0.9199 => 0.9598, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.2945 => 0.3072, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.21% (0.2925 => 0.3048, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.18% (13.2842 => 13.8398, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.04% (1.2193 => 1.2686, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.02% (0.5577 => 0.5801, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.97% (0.7506 => 0.7804, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.87% (3.8646 => 4.0140, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.2292 => 1.2763, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.80% (0.5637 => 0.5851, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.68% (1.9270 => 1.9979, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.68% (0.4379 => 0.4540, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.67% (1.3245 => 1.3731, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.64% (0.3246 => 0.3364, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.61% (1.4563 => 1.5089, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 3.60% (1.1061 => 1.1459, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.53% (1.1364 => 1.1765, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.47% (1.3813 => 1.4292, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.47% (0.2914 => 0.3015, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3755 => 0.3885, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.44% (7.2180 => 7.4664, std. dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 3.27% (1.0594 => 1.0940, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.26% (1.3819 => 1.4270, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.23% (0.7460 => 0.7701, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.93% (4.9865 => 5.1328, std. dev.: 0.0107) MultiSource/Applications/siod/siod: 2.93% (2.1791 => 2.2430, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.76% (3.6692 => 3.7703, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.57% (4.3801 => 4.4927, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (0.8310 => 0.8522, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.48% (6.5754 => 6.7387, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 2.46% (14.8535 => 15.2194, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.45% (0.8698 => 0.8911, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.42% (4.4433 => 4.5508, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.28% (1.1333 => 1.1591, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 2.15% (16.2614 => 16.6114, std. dev.: 0.0211) MultiSource/Applications/d/make_dparser: 2.06% (3.1889 => 3.2545, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 2.03% (14.5298 => 14.8245, std. dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.67% (0.6283 => 0.6388, std. dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 1.58% (1.2749 => 1.2951, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.37% (2.1007 => 2.1295, std. dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.87% (1.8175 => 2.2695, std. dev.: 0.0236) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.45% (2.0200 => 2.1907, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.08% (0.9996 => 1.0804, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: 6.62% (1.2998 => 1.3858, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7354, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9226, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6791, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5340, std. dev.: 0.0079) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9592, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.51% (3.6469 => 3.7021, std. dev.: 0.0093) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.62% (22.5627 => 21.0701, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.29% (0.8818 => 0.8616, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.63% (1.2308 => 1.1123, std. dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.73% (20.3410 => 18.5650, std. dev.: 0.0543) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.68% (2.6470 => 2.5497, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.55% (1.3780 => 1.3291, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9129, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5892, std. dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4461, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.86% (3.0263 => 2.9701, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5092, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7954, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.51% (6.3560 => 6.2601, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1290, std. dev.: 0.0184) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8682, std. dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2419, std. dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2542, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2363, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 04:32:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 06:32:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120712113216.B63F32A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1997?compare_to=1995&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 1997, Order: 160120, Start Time: 2012-07-12 10:14:00, End Time: 2012-07-12 11:32:19 To: 1995, Order: 160111, Start Time: 2012-07-12 08:27:22, End Time: 2012-07-12 09:45:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (54 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (799 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.19% (13.2897 => 13.4481, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.25% (55.2118 => 56.4544, std. dev.: 0.0687) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.72% (10.3673 => 13.4481, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.35% (1.1194 => 1.2464, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.94% (0.3473 => 0.3853, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.70% (0.3543 => 0.3922, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 10.69% (0.3497 => 0.3871, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.61% (0.3543 => 0.3919, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.55% (0.3516 => 0.3887, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.23% (0.3694 => 0.4072, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.74% (0.3828 => 0.4201, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.70% (0.3927 => 0.4308, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 9.65% (0.3886 => 0.4261, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.56% (1.7609 => 1.8940, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 7.26% (0.1432 => 0.1536, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.87% (2.2022 => 2.3534, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.38% (0.5925 => 0.6303, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.24% (0.6030 => 0.6406, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.98% (0.7326 => 0.7764, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.16% (0.3177 => 0.3341, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.89% (0.2065 => 0.2166, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.14% (0.4879 => 0.5081, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.02% (7.0540 => 7.3375, std. dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 3.62% (0.7433 => 0.7702, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 3.47% (10.4361 => 10.7982, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/oourafft: 3.17% (0.3282 => 0.3386, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.10% (0.8172 => 0.8425, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.53% (0.5569 => 0.5710, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.45% (0.4615 => 0.4728, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.25% (4.9449 => 5.0564, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 2.22% (0.7835 => 0.8009, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 2.19% (1.5603 => 1.5944, std. dev.: 0.0095) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.16% (5.0018 => 5.1097, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.97% (8.1363 => 8.2964, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.93% (14.3668 => 14.6434, std. dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 1.87% (9.4845 => 9.6616, std. dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.73% (4.2646 => 4.3383, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.60% (2.0665 => 2.0995, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.39% (0.8067 => 0.8179, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.37% (1.1861 => 1.2023, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.37% (1.1642 => 1.1801, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.27% (1.3050 => 1.3216, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.27% (2.0273 => 2.0530, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 1.18% (3.3354 => 3.3747, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7591 => 5.8223, std. dev.: 0.0072) MultiSource/Applications/lua/lua: 1.06% (3.8723 => 3.9132, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.16% (3.6395 => 3.7544, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.24% (1.0313 => 1.0544, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.18% (26.0924 => 26.6617, std. dev.: 0.0361) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.95% (1.5086 => 1.5380, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6893, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2343, std. dev.: 0.0111) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.49% (0.8651 => 0.1688, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.11% (5.2763 => 3.1600, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.73% (5.3855 => 3.6766, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.34% (5.3526 => 3.6751, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.45% (2.9384 => 2.5432, std. dev.: 0.0104) MultiSource/Applications/ClamAV/clamscan: -10.95% (22.1758 => 19.7470, std. dev.: 0.0180) SingleSource/UnitTests/Vector/constpool: -5.35% (54.1659 => 51.2679, std. dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.79% (3.8922 => 3.7835, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.36% (0.8101 => 0.7991, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.23% (0.0998 => 0.0846, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.59% (1.2373 => 1.1063, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.87% (19.9488 => 18.5789, std. dev.: 0.0361) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.85% (8.1563 => 7.9235, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6927, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0821, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.04% (1.4460 => 1.4309, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 05:12:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 07:12:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120712121238.36FE82A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1998?compare_to=1996&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 1998, Order: 160124, Start Time: 2012-07-12 10:58:47, End Time: 2012-07-12 12:12:45 To: 1996, Order: 160113, Start Time: 2012-07-12 09:16:30, End Time: 2012-07-12 10:30:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (126 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (727 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.23% (2.0176 => 2.2845, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.13% (0.5818 => 0.6349, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.09% (0.7061 => 0.7703, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5748 => 0.6268, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 7.94% (0.3578 => 0.3862, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.69% (0.3601 => 0.3878, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.67% (0.3650 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.62% (0.3646 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.59% (0.3623 => 0.3898, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.52% (0.3789 => 0.4074, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.51% (0.3663 => 0.3938, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.37% (0.4003 => 0.4298, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.23% (0.3940 => 0.4225, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 6.84% (1.3693 => 1.4629, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.55% (0.1986 => 0.2116, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4328 => 0.4596, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.08% (0.7710 => 0.8179, std. dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 5.95% (0.7038 => 0.7457, std. dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 5.75% (0.2781 => 0.2941, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.62% (0.5265 => 0.5561, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: 5.52% (0.2607 => 0.2751, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.46% (0.2655 => 0.2800, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.44% (0.2721 => 0.2869, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.43% (0.2782 => 0.2933, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.39% (0.2596 => 0.2736, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 5.37% (0.4062 => 0.4280, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3022 => 0.3184, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2690 => 0.2834, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.29% (0.2628 => 0.2767, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.28% (0.2726 => 0.2870, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.28% (0.2937 => 0.3092, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.26% (0.2966 => 0.3122, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.26% (0.3899 => 0.4104, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.18% (0.2761 => 0.2904, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.16% (1.9828 => 2.0852, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2696 => 0.2834, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.11% (0.2760 => 0.2901, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.10% (0.3489 => 0.3667, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (0.2765 => 0.2906, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.02% (3.9660 => 4.1652, std. dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ary: 4.96% (0.3107 => 0.3261, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.92% (0.3580 => 0.3756, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.90% (0.6959 => 0.7300, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.89% (0.3149 => 0.3303, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (0.3485 => 0.3655, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.74% (0.4390 => 0.4598, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.61% (0.3192 => 0.3339, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.3453 => 0.3610, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.38% (0.2988 => 0.3119, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.36% (0.3534 => 0.3688, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.31% (0.3293 => 0.3435, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.21% (0.4016 => 0.4185, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.14% (16.6129 => 17.3014, std. dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (0.3756 => 0.3911, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.04% (0.9199 => 0.9571, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.93% (0.3868 => 0.4020, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.88% (13.8202 => 14.3569, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/objinst: 3.87% (0.2945 => 0.3059, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.83% (0.2925 => 0.3037, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.78% (1.2193 => 1.2654, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.75% (13.2842 => 13.7817, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.64% (0.5577 => 0.5780, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.52% (0.7506 => 0.7770, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.48% (0.3246 => 0.3359, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.42% (0.5637 => 0.5830, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.42% (1.2292 => 1.2712, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.38% (0.4379 => 0.4527, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (1.4563 => 1.5053, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 3.36% (3.8646 => 3.9945, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.35% (1.3245 => 1.3689, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.28% (0.7460 => 0.7705, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.28% (1.1061 => 1.1424, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.22% (1.1364 => 1.1730, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 3.16% (1.9270 => 1.9878, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.09% (7.2180 => 7.4410, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3755 => 0.3870, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.02% (1.3819 => 1.4236, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.00% (1.0594 => 1.0912, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.82% (1.3813 => 1.4203, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.54% (3.6692 => 3.7625, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.36% (4.9865 => 5.1043, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8310 => 0.8505, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 2.34% (2.1791 => 2.2301, std. dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (4.3801 => 4.4821, std. dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.18% (0.6135 => 0.6269, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 2.14% (14.8535 => 15.1717, std. dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.09% (4.4433 => 4.5361, std. dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (6.5754 => 6.7126, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (0.8698 => 0.8873, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.80% (1.1333 => 1.1537, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.77% (16.2614 => 16.5497, std. dev.: 0.0202) MultiSource/Applications/d/make_dparser: 1.72% (3.1889 => 3.2437, std. dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 1.66% (14.5298 => 14.7705, std. dev.: 0.0137) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2922, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std. dev.: 0.0220) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1919, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: 7.69% (1.2998 => 1.3998, std. dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.7000, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (4.5947 => 4.8135, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 4.17% (7.4271 => 7.7367, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6792, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8311, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (1.5089 => 1.5344, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.51% (3.6469 => 3.7018, std. dev.: 0.0062) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1965, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (22.5627 => 20.9351, std. dev.: 0.0219) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3511 => 0.3399, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.63% (0.8818 => 0.8586, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.43% (1.2308 => 1.1024, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.56% (20.3410 => 18.5999, std. dev.: 0.0847) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.68% (1.3780 => 1.3135, std. dev.: 0.0074) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9126, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5859, std. dev.: 0.0119) SingleSource/Benchmarks/Dhrystone/dry: -2.53% (2.5089 => 2.4455, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5083, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: -1.82% (3.0263 => 2.9712, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2549, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7949, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1425, std. dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.34% (9.3358 => 9.2103, std. dev.: 0.0122) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2514, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8700, std. dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2424, std. dev.: 0.0090) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 05:51:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 07:51:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120712125151.714742A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/1999?compare_to=1994&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 1999, Order: 160118, Start Time: 2012-07-12 10:08:22, End Time: 2012-07-12 12:51:57 To: 1994, Order: 160107, Start Time: 2012-07-12 06:52:47, End Time: 2012-07-12 09:38:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (80 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (813 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 34.26% (0.3792 => 0.5091, std. dev.: 0.0277) SingleSource/UnitTests/ObjC/exceptions-4: 12.61% (0.3465 => 0.3902, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-2: 12.57% (0.3446 => 0.3879, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 12.44% (0.3496 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3460 => 0.3890, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3442 => 0.3869, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3488 => 0.3919, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 12.34% (0.3469 => 0.3897, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.08% (0.3650 => 0.4091, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.97% (0.3643 => 0.4079, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.55% (0.3724 => 0.4154, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.64% (0.5826 => 0.6271, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.47% (0.5889 => 0.6329, std. dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference: 6.53% (0.7171 => 0.7639, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.69% (0.5900 => 0.6177, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.52% (1.6211 => 1.6944, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (0.5026 => 0.5251, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.42% (3.5627 => 3.7202, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.05% (0.3362 => 0.3498, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 3.98% (0.2714 => 0.2822, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.94% (0.2738 => 0.2846, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.93% (0.2750 => 0.2858, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.90% (1.3152 => 1.3665, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.90% (0.2875 => 0.2987, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.89% (0.2725 => 0.2831, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2792 => 0.2899, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.80% (0.2866 => 0.2975, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.78% (0.2780 => 0.2885, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.77% (0.4029 => 0.4181, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3195 => 0.3315, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.74% (0.2911 => 0.3020, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.74% (0.2729 => 0.2831, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.70% (0.2813 => 0.2917, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.67% (0.2803 => 0.2906, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.66% (0.3004 => 0.3114, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 3.63% (0.9697 => 1.0049, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.62% (0.4994 => 0.5175, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.62% (2.0673 => 2.1421, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wc: 3.62% (0.3096 => 0.3208, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.61% (0.2823 => 0.2925, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.61% (0.9909 => 1.0267, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 3.59% (0.3258 => 0.3375, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.59% (4.2109 => 4.3620, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary3: 3.58% (0.3267 => 0.3384, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.52% (0.5000 => 0.5176, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.44% (0.3930 => 0.4065, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 3.38% (0.3317 => 0.3429, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.35% (2.7292 => 2.8206, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.33% (0.3060 => 0.3162, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.33% (0.3124 => 0.3228, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.29% (0.3348 => 0.3458, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3282 => 0.3389, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: 3.16% (0.3477 => 0.3587, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.14% (0.4146 => 0.4276, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 3.13% (0.3678 => 0.3793, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.09% (0.3726 => 0.3841, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 3.07% (1.0781 => 1.1112, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.3845 => 0.3962, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.03% (0.3625 => 0.3735, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (1.9694 => 2.0286, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.01% (0.4658 => 0.4798, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.93% (1.9966 => 2.0552, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.87% (0.3690 => 0.3796, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.75% (0.4251 => 0.4368, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.61% (2.1013 => 2.1562, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.59% (0.3981 => 0.4084, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.47% (23.5202 => 24.1021, std. dev.: 0.0154) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.46% (4.4195 => 4.5281, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/gs/gs: 2.44% (1.8794 => 1.9253, std. dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 2.43% (2.1653 => 2.2179, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.5012 => 0.5130, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.35% (4.6177 => 4.7263, std. dev.: 0.0144) MultiSource/Applications/SPASS/SPASS: 2.29% (5.5417 => 5.6686, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 2.20% (1.4269 => 1.4583, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 2.20% (0.7875 => 0.8048, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.16% (0.6435 => 0.6574, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.07% (0.6634 => 0.6771, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.89% (0.5546 => 0.5651, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 1.51% (1.5932 => 1.6173, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.70% (11.9555 => 11.7522, std. dev.: 0.0135) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 06:18:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 08:18:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120712131822.62B452A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2000?compare_to=1997&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2000, Order: 160125, Start Time: 2012-07-12 12:00:13, End Time: 2012-07-12 13:18:29 To: 1997, Order: 160120, Start Time: 2012-07-12 10:14:00, End Time: 2012-07-12 11:32:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (62 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (793 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.47% (3.7677 => 3.8606, std. dev.: 0.0310) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.48% (10.3673 => 13.4237, std. dev.: 0.0117) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3473 => 0.3900, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3497 => 0.3916, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.85% (0.3543 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.83% (0.3516 => 0.3932, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.68% (0.3561 => 0.3977, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.29% (0.3694 => 0.4111, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.27% (1.1194 => 1.2456, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.92% (0.3927 => 0.4356, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.06% (1.7609 => 1.9028, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.07% (2.2022 => 2.3578, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 6.31% (0.5925 => 0.6299, std. dev.: 0.0081) SingleSource/UnitTests/ObjC++/property-reference-object: 6.20% (0.6030 => 0.6404, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.60% (0.7326 => 0.7736, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.23% (0.2065 => 0.2173, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.69% (0.4879 => 0.5108, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.44% (0.3177 => 0.3318, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.24% (7.0540 => 7.3530, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 3.72% (10.4361 => 10.8244, std. dev.: 0.0130) MultiSource/Applications/lambda-0_1_3/lambda: 3.69% (0.7433 => 0.7707, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.43% (0.5569 => 0.5760, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 3.29% (0.3282 => 0.3390, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.07% (0.8172 => 0.8423, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.75% (0.4615 => 0.4742, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.49% (5.0018 => 5.1262, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.43% (4.9449 => 5.0652, std. dev.: 0.0061) MultiSource/Applications/hbd/hbd: 2.42% (1.5603 => 1.5980, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 2.39% (0.7835 => 0.8022, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (14.3668 => 14.7033, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.30% (8.1363 => 8.3235, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.24% (0.5860 => 0.5991, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 2.16% (9.4845 => 9.6894, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.16% (0.4636 => 0.4736, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.09% (4.2646 => 4.3538, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.97% (2.0665 => 2.1072, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.91% (1.5415 => 1.5710, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 1.77% (2.0273 => 2.0632, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.77% (1.1861 => 1.2071, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.76% (1.1642 => 1.1847, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.60% (0.8067 => 0.8196, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.52% (1.3050 => 1.3249, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7591 => 5.8465, std. dev.: 0.0031) MultiSource/Applications/d/make_dparser: 1.51% (3.3354 => 3.3856, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 1.43% (3.8723 => 3.9278, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.42% (0.9765 => 0.9904, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.30% (1.4186 => 1.4371, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.21% (1.2842 => 1.2998, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 1.18% (17.1811 => 17.3832, std. dev.: 0.0171) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7505, std. dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.26% (1.0313 => 1.0546, std. dev.: 0.0009) MultiSource/Benchmarks/llubenchmark/llu: 2.18% (3.7781 => 3.8606, std. dev.: 0.0310) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.03% (1.5086 => 1.5392, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.00% (26.0924 => 26.6145, std. dev.: 0.0431) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4460, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2399, std. dev.: 0.0172) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6879, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.30% (5.2763 => 3.1500, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.50% (5.3855 => 3.6889, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.17% (5.3526 => 3.6840, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.79% (2.9384 => 2.5333, std. dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: -10.65% (22.1758 => 19.8142, std. dev.: 0.0312) SingleSource/UnitTests/Vector/constpool: -5.39% (54.1659 => 51.2438, std. dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.55% (3.8922 => 3.7929, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.01% (1.2373 => 1.1135, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.46% (19.9488 => 18.4609, std. dev.: 0.0659) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (8.1563 => 7.9169, std. dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6904, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0836, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 06:54:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 08:54:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120712135421.889252A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2001?compare_to=1998&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2001, Order: 160125, Start Time: 2012-07-12 12:40:34, End Time: 2012-07-12 13:54:28 To: 1998, Order: 160124, Start Time: 2012-07-12 10:58:47, End Time: 2012-07-12 12:12:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (125 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (727 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 4.78% (0.4121 => 0.4318, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.4091 => 56.3020, std. dev.: 0.0915) MultiSource/Benchmarks/llubenchmark/llu: 2.19% (3.7587 => 3.8410, std. dev.: 0.0117) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.30% (2.0176 => 2.2860, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference-object: 9.14% (0.5818 => 0.6350, std. dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference: 9.01% (0.7061 => 0.7697, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.99% (0.5748 => 0.6265, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.91% (0.3578 => 0.3861, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.72% (0.3601 => 0.3879, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3646 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.64% (0.3650 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.62% (0.3663 => 0.3942, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.55% (0.3789 => 0.4075, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3623 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.49% (0.3914 => 0.4207, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.32% (0.4003 => 0.4296, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 7.26% (0.3940 => 0.4226, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.72% (1.3693 => 1.4613, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.34% (0.1986 => 0.2112, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.14% (0.2655 => 0.2818, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 6.11% (0.7038 => 0.7468, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (0.4328 => 0.4591, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 5.98% (0.4062 => 0.4305, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.72% (0.2781 => 0.2940, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.68% (0.5265 => 0.5564, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.51% (0.7710 => 0.8135, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2690 => 0.2837, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.2607 => 0.2749, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.43% (0.3022 => 0.3186, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.33% (0.2628 => 0.2768, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.25% (0.2726 => 0.2869, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.24% (0.2765 => 0.2910, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.24% (0.2937 => 0.3091, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.23% (0.2966 => 0.3121, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.22% (1.9828 => 2.0863, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 5.22% (0.2760 => 0.2904, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.22% (0.2761 => 0.2905, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.19% (3.9660 => 4.1718, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.10% (0.3489 => 0.3667, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.05% (0.3899 => 0.4096, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 5.05% (0.3149 => 0.3308, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.00% (0.3580 => 0.3759, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.92% (0.3107 => 0.3260, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.82% (0.3485 => 0.3653, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.78% (0.4390 => 0.4600, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 4.60% (0.3453 => 0.3612, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.52% (0.2988 => 0.3123, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.44% (0.6959 => 0.7268, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 4.37% (0.3293 => 0.3437, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 4.36% (0.3534 => 0.3688, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.28% (0.4016 => 0.4188, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3756 => 0.3916, std. dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 4.14% (16.6129 => 17.3007, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.10% (0.9199 => 0.9576, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 4.01% (0.3868 => 0.4023, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.5577 => 0.5799, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.2945 => 0.3060, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 3.89% (13.8202 => 14.3578, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.84% (1.2193 => 1.2661, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.83% (0.2925 => 0.3037, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: 3.77% (0.7506 => 0.7789, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.73% (13.2842 => 13.7792, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.60% (0.5637 => 0.5840, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.54% (0.4379 => 0.4534, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.48% (1.2292 => 1.2720, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (1.4563 => 1.5053, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.36% (0.3246 => 0.3355, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.29% (3.8646 => 3.9916, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (1.3245 => 1.3679, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.12% (1.1364 => 1.1719, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.11% (1.1061 => 1.1405, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.09% (7.2180 => 7.4409, std. dev.: 0.0070) MultiSource/Applications/treecc/treecc: 3.05% (1.9270 => 1.9857, std. dev.: 0.0137) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.03% (0.7460 => 0.7686, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.0594 => 1.0913, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3755 => 0.3867, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.85% (1.3819 => 1.4213, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.82% (1.3813 => 1.4203, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (3.6692 => 3.7620, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 2.47% (2.1791 => 2.2329, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.46% (4.9865 => 5.1093, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.8310 => 0.8510, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.10% (0.6135 => 0.6264, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.10% (4.3801 => 4.4719, std. dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: 2.06% (14.8535 => 15.1596, std. dev.: 0.0163) MultiSource/Applications/JM/ldecod/ldecod: 2.03% (6.5754 => 6.7092, std. dev.: 0.0153) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.91% (4.4433 => 4.5283, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.85% (1.1333 => 1.1543, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.74% (16.2614 => 16.5449, std. dev.: 0.0091) MultiSource/Applications/ClamAV/clamscan: 1.72% (14.5298 => 14.7790, std. dev.: 0.0141) MultiSource/Applications/d/make_dparser: 1.66% (3.1889 => 3.2418, std. dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2936, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 25.05% (1.8175 => 2.2728, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.49% (2.0200 => 2.1914, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 6.59% (1.2998 => 1.3854, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.94% (7.4271 => 7.7194, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9199, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6792, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8309, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4788, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1917, std. dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 1.80% (3.7731 => 3.8410, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.67% (3.6469 => 3.7079, std. dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.14% (1.9290 => 1.9509, std. dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -7.28% (0.4657 => 0.4318, std. dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.14% (22.5627 => 20.9510, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.16% (0.3511 => 0.3400, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.62% (0.8818 => 0.8587, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.55% (0.6576 => 0.6474, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.05% (0.0997 => 0.0847, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.62% (1.2308 => 1.1124, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.59% (20.3410 => 18.5941, std. dev.: 0.0352) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.76% (1.3780 => 1.3124, std. dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9123, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5969, std. dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5016, std. dev.: 0.0069) MultiSource/Applications/spiff/spiff: -1.80% (3.0263 => 2.9718, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2497, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.58% (7.1097 => 6.9977, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.55% (26.5159 => 26.1058, std. dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7944, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.43% (9.3358 => 9.2024, std. dev.: 0.0255) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8655, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.23% (0.9692 => 0.9573, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2526, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 08:04:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 10:04:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120712150429.633D42A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2002?compare_to=2000&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2002, Order: 160127, Start Time: 2012-07-12 13:46:17, End Time: 2012-07-12 15:04:35 To: 2000, Order: 160125, Start Time: 2012-07-12 12:00:13, End Time: 2012-07-12 13:18:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (58 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (796 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.18% (54.9547 => 56.7035, std. dev.: 0.0155) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.46% (10.3673 => 13.4220, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 12.18% (0.3473 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.95% (0.3497 => 0.3915, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.88% (0.3543 => 0.3964, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.83% (0.3516 => 0.3932, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.83% (0.3543 => 0.3962, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3561 => 0.3976, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.42% (0.3694 => 0.4116, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.25% (1.1194 => 1.2453, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.95% (0.3828 => 0.4247, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.80% (0.3927 => 0.4351, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.73% (0.3886 => 0.4303, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.16% (1.7609 => 1.9046, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.26% (0.2065 => 0.2215, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.00% (2.2022 => 2.3564, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.24% (0.5925 => 0.6295, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.24% (0.6030 => 0.6406, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.66% (0.7326 => 0.7741, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.38% (0.3177 => 0.3316, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.25% (7.0540 => 7.3540, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.11% (0.8172 => 0.8508, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.4879 => 0.5078, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 3.69% (0.7433 => 0.7707, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 3.69% (10.4361 => 10.8207, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/oourafft: 3.47% (0.3282 => 0.3396, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.27% (0.4615 => 0.4766, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.90% (5.0018 => 5.1467, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.73% (0.5569 => 0.5721, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.66% (0.4103 => 0.4212, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.52% (4.9449 => 5.0693, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.44% (14.3668 => 14.7167, std. dev.: 0.0042) MultiSource/Applications/hbd/hbd: 2.35% (1.5603 => 1.5970, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.34% (8.1363 => 8.3269, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.27% (0.5860 => 0.5993, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.21% (0.7835 => 0.8008, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.16% (0.4636 => 0.4736, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 2.13% (9.4845 => 9.6865, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.06% (4.2646 => 4.3523, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.93% (1.5415 => 1.5713, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.91% (2.0665 => 2.1060, std. dev.: 0.0031) MultiSource/Applications/d/make_dparser: 1.70% (3.3354 => 3.3920, std. dev.: 0.0110) MultiSource/Applications/treecc/treecc: 1.62% (2.0273 => 2.0601, std. dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 1.50% (5.7591 => 5.8454, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.49% (1.3050 => 1.3245, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.45% (0.8067 => 0.8184, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 1.34% (3.8723 => 3.9243, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.24% (0.9765 => 0.9886, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.21% (17.1811 => 17.3885, std. dev.: 0.0153) MultiSource/Applications/hexxagon/hexxagon: 1.18% (1.2842 => 1.2994, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9741, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.81% (1.1145 => 1.1904, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7547, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.17% (26.0924 => 26.6595, std. dev.: 0.0304) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4462, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2363, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6890, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.29% (5.2763 => 3.1504, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.48% (5.3855 => 3.6902, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.16% (5.3526 => 3.6846, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.73% (2.9384 => 2.5349, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -10.66% (22.1758 => 19.8126, std. dev.: 0.0219) SingleSource/UnitTests/Vector/constpool: -5.30% (54.1659 => 51.2959, std. dev.: 0.0391) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.49% (3.8922 => 3.7951, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.53% (0.0998 => 0.0843, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.54% (1.2373 => 1.1069, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.03% (19.9488 => 18.5472, std. dev.: 0.0592) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.86% (8.1563 => 7.9234, std. dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6838, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0866, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.06% (1.4460 => 1.4307, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 08:36:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 10:36:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120712153611.B9F142A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2003?compare_to=2001&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2003, Order: 160129, Start Time: 2012-07-12 14:22:17, End Time: 2012-07-12 15:36:18 To: 2001, Order: 160125, Start Time: 2012-07-12 12:40:34, End Time: 2012-07-12 13:54:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (128 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.43% (78.9541 => 80.8719, std. dev.: 0.1871) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.05% (42.0798 => 42.5229, std. dev.: 0.0516) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.23% (2.0176 => 2.2845, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.11% (0.7061 => 0.7704, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.02% (0.5818 => 0.6343, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5748 => 0.6263, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.27% (0.3650 => 0.3952, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.99% (0.3578 => 0.3864, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 7.79% (0.3646 => 0.3930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.69% (0.3601 => 0.3878, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.59% (0.3663 => 0.3941, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: 7.55% (0.3789 => 0.4075, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3623 => 0.3896, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 7.43% (0.3914 => 0.4205, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 7.32% (0.4003 => 0.4296, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.18% (0.3940 => 0.4223, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.78% (1.3693 => 1.4621, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.61% (0.3130 => 0.3337, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.50% (0.1986 => 0.2115, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 6.11% (0.4062 => 0.4310, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.04% (0.7038 => 0.7463, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 5.96% (0.4328 => 0.4586, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.89% (0.7710 => 0.8164, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 5.68% (0.2781 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.54% (0.2761 => 0.2914, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.54% (0.2655 => 0.2802, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.46% (0.2782 => 0.2934, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.43% (0.2596 => 0.2737, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.5265 => 0.5550, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3022 => 0.3185, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 5.33% (0.2607 => 0.2746, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.28% (0.2690 => 0.2832, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.18% (0.2628 => 0.2764, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.17% (0.2765 => 0.2908, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.16% (1.9828 => 2.0851, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 5.14% (0.2760 => 0.2902, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.2937 => 0.3088, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.05% (0.3899 => 0.4096, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.04% (0.3489 => 0.3665, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.02% (3.9660 => 4.1649, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.01% (0.2696 => 0.2831, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 4.92% (0.3107 => 0.3260, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.86% (0.3580 => 0.3754, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.83% (0.3149 => 0.3301, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.76% (0.3192 => 0.3344, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.65% (0.3485 => 0.3647, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.62% (0.3293 => 0.3445, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.53% (0.4390 => 0.4589, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.53% (0.6959 => 0.7274, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 4.49% (0.3453 => 0.3608, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.42% (0.3756 => 0.3922, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2988 => 0.3118, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 4.24% (0.3534 => 0.3684, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.23% (0.4016 => 0.4186, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.13% (0.9199 => 0.9579, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.05% (16.6129 => 17.2853, std. dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/objinst: 4.01% (0.2945 => 0.3063, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.88% (0.3868 => 0.4018, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.83% (13.8202 => 14.3490, std. dev.: 0.0128) MultiSource/Benchmarks/McCat/09-vor/vor: 3.76% (0.2925 => 0.3035, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (1.2193 => 1.2647, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.70% (13.2842 => 13.7752, std. dev.: 0.0202) MultiSource/Applications/spiff/spiff: 3.66% (0.7506 => 0.7781, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.5637 => 0.5842, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.53% (0.5577 => 0.5774, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.45% (0.3246 => 0.3358, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (1.4563 => 1.5052, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.35% (1.2292 => 1.2704, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 3.26% (1.1061 => 1.1422, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.24% (0.4379 => 0.4521, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (1.3245 => 1.3672, std. dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 3.21% (3.8646 => 3.9885, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.11% (1.1364 => 1.1717, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.05% (7.2180 => 7.4385, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.03% (1.3819 => 1.4238, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.00% (1.9270 => 1.9848, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.0594 => 1.0911, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.91% (1.3813 => 1.4215, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3755 => 0.3864, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.86% (0.7460 => 0.7673, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.50% (4.9865 => 5.1112, std. dev.: 0.0202) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.44% (3.6692 => 3.7587, std. dev.: 0.0042) MultiSource/Applications/siod/siod: 2.40% (2.1791 => 2.2313, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.21% (0.8310 => 0.8494, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.21% (4.3801 => 4.4768, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 2.06% (14.8535 => 15.1595, std. dev.: 0.0205) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6135 => 0.6261, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 2.02% (6.5754 => 6.7079, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (0.8698 => 0.8872, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.97% (4.4433 => 4.5308, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.71% (1.1333 => 1.1527, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.69% (14.5298 => 14.7758, std. dev.: 0.0077) MultiSource/Applications/d/make_dparser: 1.67% (3.1889 => 3.2423, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.65% (16.2614 => 16.5298, std. dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 1.38% (1.2749 => 1.2925, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.95% (1.8175 => 2.2709, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1921, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.10% (0.9996 => 1.0806, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: 7.16% (1.2998 => 1.3929, std. dev.: 0.0174) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.06% (7.4271 => 7.7288, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9216, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6794, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1907, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.73% (3.6469 => 3.7101, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (1.5089 => 1.5344, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1971, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: 1.22% (1.9290 => 1.9525, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2143, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.08% (10.7476 => 10.8637, std. dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.18% (22.5627 => 20.9417, std. dev.: 0.0132) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.13% (0.3511 => 0.3401, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.61% (0.8818 => 0.8588, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.43% (1.2308 => 1.1147, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.96% (20.3410 => 18.5191, std. dev.: 0.0265) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std. dev.: 0.0093) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9123, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5951, std. dev.: 0.0223) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5060, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -1.73% (3.0263 => 2.9740, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9980, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2571, std. dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7944, std. dev.: 0.0017) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1170, std. dev.: 0.0206) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8594, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2152, std. dev.: 0.0392) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.29% (0.9692 => 0.9567, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2536, std. dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -1.08% (7.3305 => 7.2514, std. dev.: 0.0068) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 09:03:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 11:03:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120712160324.234FF2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2004?compare_to=1999&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2004, Order: 160125, Start Time: 2012-07-12 13:19:43, End Time: 2012-07-12 16:03:30 To: 1999, Order: 160118, Start Time: 2012-07-12 10:08:22, End Time: 2012-07-12 12:51:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (62 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 949 (831 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.63% (124.5761 => 127.8526, std. dev.: 1.1376) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.71% (2.0602 => 2.0954, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/whetstone: 1.28% (2.8056 => 2.8416, std. dev.: 0.0113) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 22.23% (0.3792 => 0.4635, std. dev.: 0.0296) SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3465 => 0.3942, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.76% (0.3446 => 0.3920, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.74% (0.3442 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.73% (0.3460 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.70% (0.3496 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.56% (0.3488 => 0.3961, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 13.55% (0.3469 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.26% (0.3650 => 0.4134, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.12% (0.3643 => 0.4121, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.76% (0.3724 => 0.4199, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.55% (0.5826 => 0.6266, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.28% (0.5889 => 0.6318, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 6.37% (0.7171 => 0.7628, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.97% (0.5900 => 0.6193, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.90% (3.5627 => 3.7374, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.89% (1.6211 => 1.7003, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.33% (0.4361 => 0.4550, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.27% (1.3152 => 1.3714, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.24% (0.5026 => 0.5239, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.12% (0.4029 => 0.4195, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.91% (2.7292 => 2.8360, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.80% (0.2738 => 0.2842, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.77% (0.3930 => 0.4078, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.66% (0.3195 => 0.3312, std. dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.64% (4.2109 => 4.3643, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 3.60% (0.9909 => 1.0266, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.51% (0.2875 => 0.2976, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.48% (0.4994 => 0.5168, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.43% (1.9966 => 2.0650, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.36% (0.5000 => 0.5168, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.35% (1.9694 => 2.0353, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 3.29% (0.3096 => 0.3198, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.25% (2.0673 => 2.1345, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 3.24% (0.3267 => 0.3373, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3258 => 0.3363, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.01% (0.3317 => 0.3417, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.00% (0.3362 => 0.3463, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (0.3625 => 0.3730, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.86% (0.4658 => 0.4791, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 2.82% (2.1013 => 2.1605, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 2.80% (0.4146 => 0.4262, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 2.79% (0.3726 => 0.3830, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 2.77% (1.0781 => 1.1080, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: 2.77% (0.3678 => 0.3780, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.72% (0.9697 => 0.9961, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 2.70% (23.5202 => 24.1541, std. dev.: 0.0168) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.67% (0.3890 => 0.3994, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.56% (0.3903 => 0.4003, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.55% (5.5417 => 5.6828, std. dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 2.54% (4.6177 => 4.7351, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: 2.49% (0.4251 => 0.4357, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (1.8794 => 1.9255, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.41% (4.4195 => 4.5262, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 2.36% (2.1653 => 2.2165, std. dev.: 0.0081) MultiSource/Applications/lua/lua: 2.11% (1.4269 => 1.4570, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.99% (0.6634 => 0.6766, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 1.89% (0.5546 => 0.5651, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.6435 => 0.6552, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 1.36% (1.5932 => 1.6148, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.36% (2.8036 => 2.8416, std. dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.78% (11.9555 => 11.7432, std. dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 09:50:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 11:50:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120712165035.40C692A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2005?compare_to=2002&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2005, Order: 160132, Start Time: 2012-07-12 15:32:21, End Time: 2012-07-12 16:50:42 To: 2002, Order: 160127, Start Time: 2012-07-12 13:46:17, End Time: 2012-07-12 15:04:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (793 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.48% (10.3673 => 13.4237, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 12.18% (0.3473 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.92% (0.3497 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.86% (0.3516 => 0.3933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.83% (0.3543 => 0.3962, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.80% (0.3543 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.68% (0.3561 => 0.3977, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: 11.34% (0.3694 => 0.4113, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.30% (1.1194 => 1.2459, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.92% (0.3828 => 0.4246, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.80% (0.3927 => 0.4351, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.18% (1.7609 => 1.9050, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.05% (2.2022 => 2.3574, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.18% (0.5925 => 0.6291, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.15% (0.6030 => 0.6401, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.66% (0.7326 => 0.7741, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.18% (0.2065 => 0.2172, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.47% (0.3177 => 0.3319, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.27% (7.0540 => 7.3549, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.14% (0.4879 => 0.5081, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.70% (10.4361 => 10.8224, std. dev.: 0.0097) MultiSource/Applications/lambda-0_1_3/lambda: 3.65% (0.7433 => 0.7704, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.27% (0.8172 => 0.8439, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 3.23% (0.3282 => 0.3388, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.19% (0.4615 => 0.4762, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.68% (0.5569 => 0.5718, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.59% (4.9449 => 5.0728, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 2.49% (1.5603 => 1.5992, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.49% (5.0018 => 5.1262, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.40% (8.1363 => 8.3318, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 2.34% (0.7835 => 0.8018, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (14.3668 => 14.6970, std. dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.25% (0.5860 => 0.5992, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 2.15% (9.4845 => 9.6883, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.11% (4.2646 => 4.3544, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.97% (2.0665 => 2.1073, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.91% (1.5415 => 1.5709, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.81% (1.1861 => 1.2076, std. dev.: 0.0035) MultiSource/Applications/lua/lua: 1.68% (3.8723 => 3.9375, std. dev.: 0.0081) MultiSource/Applications/Burg/burg: 1.68% (1.1642 => 1.1838, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.66% (0.8067 => 0.8201, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.64% (0.6450 => 0.6556, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.59% (3.3354 => 3.3883, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.56% (1.3050 => 1.3253, std. dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 1.55% (5.7591 => 5.8481, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.53% (2.0273 => 2.0584, std. dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 1.33% (17.1811 => 17.4091, std. dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.29% (0.9765 => 0.9891, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.21% (1.2842 => 1.2997, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.09% (1.4186 => 1.4341, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7538, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.20% (26.0924 => 26.6665, std. dev.: 0.0142) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5367, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4473, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2400, std. dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6893, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.36% (5.2763 => 3.1470, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.45% (5.3855 => 3.6919, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.20% (5.3526 => 3.6824, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.75% (2.9384 => 2.5343, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -10.67% (22.1758 => 19.8101, std. dev.: 0.0153) SingleSource/UnitTests/Vector/constpool: -5.34% (54.1659 => 51.2759, std. dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.52% (3.8922 => 3.7940, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.26% (1.2373 => 1.1103, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.91% (19.9488 => 18.5710, std. dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (8.1563 => 7.9248, std. dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6848, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0857, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.07% (1.4460 => 1.4306, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 10:18:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 12:18:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120712171810.AB74C2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2006?compare_to=2003&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2006, Order: 160132, Start Time: 2012-07-12 16:04:16, End Time: 2012-07-12 17:18:17 To: 2003, Order: 160129, Start Time: 2012-07-12 14:22:17, End Time: 2012-07-12 15:36:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (125 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.21% (2.0176 => 2.2841, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 9.09% (0.7061 => 0.7703, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.08% (0.5818 => 0.6346, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5748 => 0.6267, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.94% (0.3578 => 0.3862, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.84% (0.3650 => 0.3936, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 7.75% (0.3601 => 0.3880, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.65% (0.3646 => 0.3925, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.59% (0.3663 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.56% (0.3623 => 0.3897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.55% (0.3789 => 0.4075, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.42% (0.4003 => 0.4300, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.26% (0.3940 => 0.4226, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.79% (1.3693 => 1.4623, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1986 => 0.2117, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.51% (0.2596 => 0.2765, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.45% (0.3130 => 0.3332, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.30% (0.7710 => 0.8196, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.04% (0.7038 => 0.7463, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 6.03% (0.4328 => 0.4589, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.98% (0.4062 => 0.4305, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.94% (0.5265 => 0.5578, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 5.72% (0.2781 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.52% (0.2607 => 0.2751, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.51% (0.2721 => 0.2871, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.39% (0.2782 => 0.2932, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2690 => 0.2835, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.33% (0.3022 => 0.3183, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.26% (0.2966 => 0.3122, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2628 => 0.2766, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.22% (0.2761 => 0.2905, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.21% (0.2726 => 0.2868, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (1.9828 => 2.0858, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/except: 5.18% (0.2760 => 0.2903, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.2937 => 0.3088, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3489 => 0.3668, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2696 => 0.2834, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.11% (3.9660 => 4.1685, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.06% (0.2765 => 0.2905, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.03% (0.3899 => 0.4095, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 4.99% (0.3107 => 0.3262, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.89% (0.3580 => 0.3755, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.83% (0.4390 => 0.4602, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 4.80% (0.3149 => 0.3300, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.79% (0.6959 => 0.7292, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.71% (0.3485 => 0.3649, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 4.60% (0.3453 => 0.3612, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.57% (0.3192 => 0.3338, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.43% (0.3293 => 0.3439, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2988 => 0.3118, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.28% (0.4016 => 0.4188, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.27% (0.3534 => 0.3685, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3756 => 0.3916, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.22% (16.6129 => 17.3135, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.08% (0.9199 => 0.9574, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.05% (0.5577 => 0.5803, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.90% (0.3868 => 0.4019, std. dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 3.90% (13.8202 => 14.3587, std. dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.85% (1.2193 => 1.2662, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 3.83% (0.2925 => 0.3037, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.74% (13.2842 => 13.7815, std. dev.: 0.0125) MultiSource/Applications/spiff/spiff: 3.70% (0.7506 => 0.7784, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.61% (1.2292 => 1.2736, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.58% (0.5637 => 0.5839, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.48% (1.4563 => 1.5070, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.42% (0.3246 => 0.3357, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.40% (3.8646 => 3.9959, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.34% (1.3245 => 1.3688, std. dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.31% (0.4379 => 0.4524, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (0.7460 => 0.7703, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 3.24% (1.1061 => 1.1419, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.10% (7.2180 => 7.4417, std. dev.: 0.0041) MultiSource/Applications/treecc/treecc: 3.09% (1.9270 => 1.9866, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.08% (1.1364 => 1.1714, std. dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.0594 => 1.0915, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.99% (1.3819 => 1.4232, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3755 => 0.3864, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.90% (1.3813 => 1.4213, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.46% (3.6692 => 3.7596, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.36% (4.9865 => 5.1044, std. dev.: 0.0176) MultiSource/Applications/siod/siod: 2.34% (2.1791 => 2.2301, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.31% (0.6135 => 0.6277, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.31% (4.3801 => 4.4812, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.24% (0.8310 => 0.8496, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 2.09% (14.8535 => 15.1635, std. dev.: 0.0162) MultiSource/Applications/JM/ldecod/ldecod: 2.02% (6.5754 => 6.7080, std. dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.00% (1.1333 => 1.1560, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.98% (4.4433 => 4.5311, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (0.8698 => 0.8864, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.70% (16.2614 => 16.5382, std. dev.: 0.0196) MultiSource/Applications/ClamAV/clamscan: 1.65% (14.5298 => 14.7701, std. dev.: 0.0164) MultiSource/Applications/d/make_dparser: 1.59% (3.1889 => 3.2396, std. dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.06% (1.8175 => 2.2729, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.42% (2.0200 => 2.1901, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.92% (0.9996 => 1.0788, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: 7.59% (1.2998 => 1.3985, std. dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.21% (7.4271 => 7.7396, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9190, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6780, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8291, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0310 => 1.0556, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1907, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (3.6469 => 3.7086, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5343, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (1.9290 => 1.9582, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.54% (0.4657 => 0.4166, std. dev.: 0.0121) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.17% (22.5627 => 20.9453, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3511 => 0.3399, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.35% (0.8818 => 0.8611, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.58% (1.2308 => 1.1129, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.49% (20.3410 => 18.6138, std. dev.: 0.0455) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.55% (1.3780 => 1.3153, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.17% (1.9762 => 1.9136, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.23% (8.8259 => 8.6290, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5100, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: -1.76% (3.0263 => 2.9731, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.52% (6.3560 => 6.2593, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7956, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1229, std. dev.: 0.0223) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4889, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2503, std. dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2401, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2296, std. dev.: 0.0400) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 11:36:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 13:36:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120712183652.445322A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2007?compare_to=2005&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2007, Order: 160133, Start Time: 2012-07-12 17:18:31, End Time: 2012-07-12 18:36:59 To: 2005, Order: 160132, Start Time: 2012-07-12 15:32:21, End Time: 2012-07-12 16:50:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (794 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.42% (10.3673 => 13.4173, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 12.09% (0.3473 => 0.3893, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.84% (0.3497 => 0.3911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.83% (0.3516 => 0.3932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.74% (0.3543 => 0.3959, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 11.71% (0.3543 => 0.3958, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3561 => 0.3976, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.29% (1.1194 => 1.2458, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.29% (0.3694 => 0.4111, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.02% (0.3828 => 0.4250, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.91% (0.3886 => 0.4310, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3927 => 0.4350, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.07% (1.7609 => 1.9030, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.04% (2.2022 => 2.3573, std. dev.: 0.0094) SingleSource/UnitTests/ObjC++/property-reference-object: 6.22% (0.6030 => 0.6405, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5925 => 0.6293, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 5.58% (0.7326 => 0.7735, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.52% (0.2065 => 0.2179, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.47% (0.3177 => 0.3319, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.38% (7.0540 => 7.3629, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.16% (0.4879 => 0.5082, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 3.83% (0.7433 => 0.7718, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 3.70% (10.4361 => 10.8219, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/oourafft: 3.32% (0.3282 => 0.3391, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.21% (0.8172 => 0.8434, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.84% (0.5569 => 0.5727, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.80% (0.4615 => 0.4744, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 2.49% (0.7835 => 0.8030, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.46% (5.0018 => 5.1247, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.43% (4.9449 => 5.0649, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.35% (8.1363 => 8.3276, std. dev.: 0.0064) MultiSource/Applications/hbd/hbd: 2.31% (1.5603 => 1.5963, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (14.3668 => 14.6958, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.20% (0.5860 => 0.5989, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.10% (4.2646 => 4.3543, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (9.4845 => 9.6813, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.91% (2.0665 => 2.1060, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.75% (1.1861 => 1.2068, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.67% (3.3354 => 3.3910, std. dev.: 0.0108) MultiSource/Applications/Burg/burg: 1.63% (1.1642 => 1.1832, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.61% (2.0273 => 2.0599, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.59% (0.8067 => 0.8195, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 1.58% (3.8723 => 3.9333, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.56% (1.5415 => 1.5656, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 1.54% (5.7591 => 5.8479, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.52% (1.3050 => 1.3249, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.23% (0.9765 => 0.9885, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.16% (17.1811 => 17.3808, std. dev.: 0.0166) MultiSource/Applications/hexxagon/hexxagon: 1.15% (1.2842 => 1.2990, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.12% (1.4186 => 1.4345, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.80% (1.1145 => 1.1903, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.27% (3.6395 => 3.7584, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.35% (1.0313 => 1.0555, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.16% (26.0924 => 26.6551, std. dev.: 0.0121) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (1.5086 => 1.5374, std. dev.: 0.0111) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4472, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2430, std. dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6887, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.10% (1.3045 => 1.3188, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.29% (5.2763 => 3.1507, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.49% (5.3855 => 3.6897, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.19% (5.3526 => 3.6833, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.72% (2.9384 => 2.5353, std. dev.: 0.0077) MultiSource/Applications/ClamAV/clamscan: -10.64% (22.1758 => 19.8170, std. dev.: 0.0192) SingleSource/UnitTests/Vector/constpool: -5.31% (54.1659 => 51.2901, std. dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.45% (3.8922 => 3.7968, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.71% (1.2373 => 1.1171, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.02% (19.9488 => 18.5477, std. dev.: 0.0609) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9204, std. dev.: 0.0068) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6808, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0866, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 12:00:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 14:00:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120712190009.A85D62A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2008?compare_to=2006&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2008, Order: 160133, Start Time: 2012-07-12 17:46:09, End Time: 2012-07-12 19:00:14 To: 2006, Order: 160132, Start Time: 2012-07-12 16:04:16, End Time: 2012-07-12 17:18:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (128 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.30% (2.0176 => 2.2860, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.12% (0.7061 => 0.7705, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.11% (0.5818 => 0.6348, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.94% (0.5748 => 0.6262, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.91% (0.3578 => 0.3861, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.73% (0.3650 => 0.3932, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 7.72% (0.3601 => 0.3879, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3646 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.62% (0.3663 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.50% (0.3789 => 0.4073, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.48% (0.3623 => 0.3894, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.29% (0.4003 => 0.4295, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.28% (0.3940 => 0.4227, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 6.89% (1.3693 => 1.4636, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1986 => 0.2117, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 6.21% (0.7038 => 0.7475, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.03% (0.4328 => 0.4589, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.91% (0.7710 => 0.8166, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 5.88% (0.4062 => 0.4301, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 5.72% (0.2781 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.66% (0.3022 => 0.3193, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.51% (0.5265 => 0.5555, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.50% (0.2782 => 0.2935, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.2607 => 0.2749, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.43% (0.2596 => 0.2737, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.40% (0.2628 => 0.2770, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.32% (0.2765 => 0.2912, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2690 => 0.2833, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.28% (0.2726 => 0.2870, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.27% (1.9828 => 2.0873, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.26% (0.2966 => 0.3122, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.22% (0.2761 => 0.2905, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 5.21% (0.2937 => 0.3090, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.16% (0.3489 => 0.3669, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.14% (0.2760 => 0.2902, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2696 => 0.2834, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.11% (3.9660 => 4.1685, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 5.05% (0.3107 => 0.3264, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.3899 => 0.4094, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.00% (0.6959 => 0.7307, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.97% (0.3580 => 0.3758, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 4.95% (0.3149 => 0.3305, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.82% (0.3485 => 0.3653, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.61% (0.3192 => 0.3339, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.58% (0.4390 => 0.4591, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.58% (0.3453 => 0.3611, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.48% (0.2988 => 0.3122, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.39% (0.3534 => 0.3689, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.37% (0.3293 => 0.3437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.33% (0.4016 => 0.4190, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3756 => 0.3916, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 4.23% (16.6129 => 17.3158, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2945 => 0.3066, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.10% (0.9199 => 0.9576, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 4.00% (13.8202 => 14.3724, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/moments: 3.96% (0.3868 => 0.4021, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.85% (13.2842 => 13.7953, std. dev.: 0.0090) MultiSource/Benchmarks/McCat/09-vor/vor: 3.83% (0.2925 => 0.3037, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.81% (1.2193 => 1.2658, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.68% (0.5577 => 0.5782, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.57% (0.2914 => 0.3018, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 3.56% (0.7506 => 0.7773, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.53% (0.5637 => 0.5836, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 3.48% (3.8646 => 3.9991, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 3.44% (1.1061 => 1.1442, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.42% (0.3246 => 0.3357, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.39% (1.2292 => 1.2709, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (1.3245 => 1.3684, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.31% (0.4379 => 0.4524, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.26% (7.2180 => 7.4536, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (1.4563 => 1.5036, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.15% (1.1364 => 1.1722, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 3.11% (1.9270 => 1.9870, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.99% (1.3813 => 1.4226, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.99% (1.3819 => 1.4232, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.96% (0.3755 => 0.3866, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.94% (0.7460 => 0.7679, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8310 => 0.8528, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.52% (2.1791 => 2.2341, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.52% (4.9865 => 5.1120, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.46% (3.6692 => 3.7594, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 2.25% (6.5754 => 6.7231, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (4.3801 => 4.4759, std. dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 2.08% (14.8535 => 15.1627, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.06% (0.8698 => 0.8877, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.97% (4.4433 => 4.5308, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6135 => 0.6253, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.78% (1.1333 => 1.1535, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.73% (16.2614 => 16.5430, std. dev.: 0.0117) MultiSource/Applications/d/make_dparser: 1.73% (3.1889 => 3.2440, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 1.70% (14.5298 => 14.7775, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.13% (2.1007 => 2.1244, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.66% (1.8175 => 2.2657, std. dev.: 0.0200) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.64% (2.0200 => 2.1945, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: 8.09% (1.2998 => 1.4049, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9996 => 1.0780, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.22% (7.4271 => 7.7408, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6793, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4788, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.93% (3.6469 => 3.7174, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5352, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9588, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.10% (22.5627 => 20.9604, std. dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.08% (0.3511 => 0.3403, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.42% (0.8818 => 0.8605, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -9.63% (1.2308 => 1.1123, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.67% (20.3410 => 18.5770, std. dev.: 0.0625) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.25% (1.3780 => 1.3194, std. dev.: 0.0043) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.15% (1.9762 => 1.9139, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5968, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: -2.52% (2.5089 => 2.4456, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -1.82% (3.0263 => 2.9711, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5111, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2558, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9984, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.55% (0.6589 => 0.6487, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7973, std. dev.: 0.0024) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1218, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.44% (9.3358 => 9.2012, std. dev.: 0.0162) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8626, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2501, std. dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2412, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 12:14:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 14:14:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120712191450.ED0A62A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2009?compare_to=2004&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2009, Order: 160132, Start Time: 2012-07-12 16:31:17, End Time: 2012-07-12 19:14:58 To: 2004, Order: 160125, Start Time: 2012-07-12 13:19:43, End Time: 2012-07-12 16:03:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (835 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 24.55% (0.3792 => 0.4723, std. dev.: 0.0285) SingleSource/UnitTests/ObjC/exceptions-3: 13.76% (0.3460 => 0.3936, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3446 => 0.3917, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.65% (0.3442 => 0.3912, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.62% (0.3465 => 0.3937, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.62% (0.3496 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.56% (0.3488 => 0.3961, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.40% (0.3650 => 0.4139, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.07% (0.3643 => 0.4119, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.70% (0.3724 => 0.4197, std. dev.: 0.0083) SingleSource/UnitTests/ObjC++/Hello: 7.62% (0.5826 => 0.6270, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.32% (0.5889 => 0.6320, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.69% (0.7171 => 0.7579, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.98% (3.5627 => 3.7400, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.76% (1.6211 => 1.6983, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.59% (0.4029 => 0.4214, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.33% (0.4361 => 0.4550, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.32% (0.5900 => 0.6155, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.09% (1.3152 => 1.3690, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.88% (0.4994 => 0.5188, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.82% (0.5000 => 0.5191, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.82% (0.3930 => 0.4080, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.80% (2.7292 => 2.8330, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.73% (0.2738 => 0.2840, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.71% (0.9909 => 1.0277, std. dev.: 0.0064) MultiSource/Applications/ClamAV/clamscan: 3.61% (4.2109 => 4.3628, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.56% (0.5026 => 0.5205, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.41% (1.9694 => 2.0365, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.26% (0.3195 => 0.3299, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.25% (1.9966 => 2.0614, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.19% (2.0673 => 2.1332, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 3.18% (0.3267 => 0.3371, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.10% (0.3258 => 0.3359, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.00% (0.9697 => 0.9988, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (0.3625 => 0.3731, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.85% (2.1013 => 2.1611, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.81% (0.4658 => 0.4789, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.78% (0.3845 => 0.3952, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 2.74% (0.3726 => 0.3828, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.69% (1.0781 => 1.1071, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.66% (1.8794 => 1.9293, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 2.63% (23.5202 => 24.1385, std. dev.: 0.0133) MultiSource/Applications/JM/lencod/lencod: 2.58% (4.6177 => 4.7367, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 2.58% (5.5417 => 5.6845, std. dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 2.48% (2.1653 => 2.2189, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.44% (0.4139 => 0.4240, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (4.4195 => 4.5264, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.4251 => 0.4352, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.36% (0.7875 => 0.8061, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.08% (1.4269 => 1.4566, std. dev.: 0.0076) MultiSource/Applications/siod/siod: 1.96% (0.6634 => 0.6764, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.80% (0.5546 => 0.5646, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.74% (0.6435 => 0.6547, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 1.31% (1.5932 => 1.6140, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.30% (0.2122 => 0.2277, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.89% (2.4764 => 2.4296, std. dev.: 0.0181) MultiSource/Applications/kimwitu++/kc: -1.76% (11.9555 => 11.7452, std. dev.: 0.0129) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 13:22:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 15:22:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120712202258.1F1B72A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2010?compare_to=2007&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2010, Order: 160137, Start Time: 2012-07-12 19:04:47, End Time: 2012-07-12 20:23:05 To: 2007, Order: 160133, Start Time: 2012-07-12 17:18:31, End Time: 2012-07-12 18:36:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (61 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (793 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.79% (13.4173 => 13.1765, std. dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.10% (10.3673 => 13.1765, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 12.55% (0.3473 => 0.3909, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.32% (0.3497 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.25% (0.3543 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3561 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.14% (0.3543 => 0.3973, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.09% (0.3516 => 0.3941, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.80% (0.3694 => 0.4130, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.43% (1.1194 => 1.2474, std. dev.: 0.0113) SingleSource/UnitTests/ObjC/exceptions: 11.21% (0.3828 => 0.4257, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.50% (1.7609 => 1.9105, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.2065 => 0.2222, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.42% (2.2022 => 2.3656, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 7.26% (0.1432 => 0.1536, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.84% (0.5925 => 0.6330, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.82% (0.6030 => 0.6441, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.20% (0.7326 => 0.7780, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.88% (0.3177 => 0.3332, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.49% (7.0540 => 7.3705, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.28% (0.4879 => 0.5088, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.97% (0.4615 => 0.4798, std. dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 3.73% (0.7433 => 0.7710, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 3.72% (0.3282 => 0.3404, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.70% (10.4361 => 10.8220, std. dev.: 0.0165) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.46% (0.8172 => 0.8455, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.14% (0.5569 => 0.5744, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (4.9449 => 5.0804, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.73% (5.0018 => 5.1381, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.55% (8.1363 => 8.3438, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 2.46% (0.7835 => 0.8028, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.39% (0.4636 => 0.4747, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.38% (0.4289 => 0.4391, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.37% (14.3668 => 14.7077, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 2.36% (9.4845 => 9.7084, std. dev.: 0.0127) MultiSource/Applications/hbd/hbd: 2.33% (1.5603 => 1.5967, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.25% (4.2646 => 4.3607, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.24% (0.5860 => 0.5991, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.01% (2.0665 => 2.1081, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.94% (1.1861 => 1.2091, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.90% (1.5415 => 1.5708, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 1.72% (2.0273 => 2.0622, std. dev.: 0.0051) MultiSource/Applications/d/make_dparser: 1.69% (3.3354 => 3.3917, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.68% (1.3050 => 1.3269, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.64% (0.8067 => 0.8199, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.55% (3.8723 => 3.9325, std. dev.: 0.0072) MultiSource/Applications/oggenc/oggenc: 1.50% (5.7591 => 5.8454, std. dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.38% (0.9765 => 0.9900, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.33% (1.2842 => 1.3013, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.27% (1.4186 => 1.4366, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.25% (17.1811 => 17.3966, std. dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9741, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.81% (1.1145 => 1.1904, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7506, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.10% (26.0924 => 26.6404, std. dev.: 0.0262) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5086 => 1.5361, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4472, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (2.6546 => 2.6921, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2396, std. dev.: 0.0130) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.34% (5.2763 => 3.1479, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6988, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.98% (5.3526 => 3.6942, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.76% (2.9384 => 2.5340, std. dev.: 0.0182) MultiSource/Applications/ClamAV/clamscan: -10.42% (22.1758 => 19.8642, std. dev.: 0.0171) SingleSource/UnitTests/Vector/constpool: -5.39% (54.1659 => 51.2470, std. dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.46% (3.8922 => 3.7965, std. dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.34% (1.2373 => 1.1094, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.30% (19.9488 => 18.4931, std. dev.: 0.0686) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (8.1563 => 7.9166, std. dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6824, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0847, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.03% (1.4460 => 1.4311, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 13:42:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 15:42:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120712204207.5C8F32A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2011?compare_to=2008&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2011, Order: 160138, Start Time: 2012-07-12 19:28:13, End Time: 2012-07-12 20:42:14 To: 2008, Order: 160133, Start Time: 2012-07-12 17:46:09, End Time: 2012-07-12 19:00:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (122 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (730 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.50% (54.5497 => 56.4616, std. dev.: 0.1343) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.37% (2.0176 => 2.2873, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference: 9.16% (0.7061 => 0.7708, std. dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference-object: 9.09% (0.5818 => 0.6347, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.99% (0.5748 => 0.6265, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.91% (0.3578 => 0.3861, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.64% (0.3601 => 0.3876, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 7.62% (0.3646 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.62% (0.3623 => 0.3899, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.62% (0.3650 => 0.3928, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.59% (0.3663 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.51% (0.3914 => 0.4208, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.47% (0.3789 => 0.4072, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.29% (0.4003 => 0.4295, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/property: 7.21% (0.3940 => 0.4224, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.70% (1.3693 => 1.4611, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.50% (0.1986 => 0.2115, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.24% (0.4328 => 0.4598, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4062 => 0.4307, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 6.02% (0.7038 => 0.7462, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.87% (0.5265 => 0.5574, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.72% (0.2781 => 0.2940, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.60% (0.7710 => 0.8142, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2690 => 0.2838, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.47% (0.2596 => 0.2738, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.46% (0.2782 => 0.2934, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 5.44% (0.2628 => 0.2771, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.43% (0.3022 => 0.3186, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.42% (0.2655 => 0.2799, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.2966 => 0.3126, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.38% (0.2696 => 0.2841, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.31% (0.2937 => 0.3093, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.2721 => 0.2865, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.29% (1.9828 => 2.0877, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.3107 => 0.3271, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 5.25% (0.2726 => 0.2869, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.22% (0.2760 => 0.2904, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.22% (0.2761 => 0.2905, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.14% (0.2765 => 0.2907, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3489 => 0.3668, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.06% (0.3580 => 0.3761, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.03% (3.9660 => 4.1654, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.03% (0.3899 => 0.4095, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.76% (0.3485 => 0.3651, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.72% (0.2988 => 0.3129, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.61% (0.3192 => 0.3339, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.49% (0.3453 => 0.3608, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.48% (0.6959 => 0.7271, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 4.36% (0.3534 => 0.3688, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.28% (0.4390 => 0.4578, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.28% (0.3293 => 0.3434, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4016 => 0.4187, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (0.3756 => 0.3914, std. dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 4.17% (16.6129 => 17.3063, std. dev.: 0.0276) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.00% (0.9199 => 0.9567, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.00% (0.5577 => 0.5800, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.96% (0.3868 => 0.4021, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.2945 => 0.3060, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.89% (13.8202 => 14.3581, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.84% (1.2193 => 1.2661, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.76% (13.2842 => 13.7842, std. dev.: 0.0217) MultiSource/Benchmarks/McCat/09-vor/vor: 3.73% (0.2925 => 0.3034, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.67% (1.2292 => 1.2743, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.55% (0.5637 => 0.5837, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.43% (1.3245 => 1.3699, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.40% (0.7506 => 0.7761, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.37% (1.4563 => 1.5054, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 3.35% (1.1061 => 1.1431, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.29% (0.4379 => 0.4523, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (3.8646 => 3.9901, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.23% (1.1364 => 1.1731, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.12% (7.2180 => 7.4429, std. dev.: 0.0053) MultiSource/Applications/treecc/treecc: 3.07% (1.9270 => 1.9862, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.02% (1.3819 => 1.4236, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.00% (1.3813 => 1.4228, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.98% (1.0594 => 1.0910, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.96% (0.7460 => 0.7681, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.46% (3.6692 => 3.7596, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.41% (4.9865 => 5.1068, std. dev.: 0.0060) MultiSource/Applications/siod/siod: 2.33% (2.1791 => 2.2299, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8310 => 0.8502, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.12% (0.6135 => 0.6265, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.12% (0.8698 => 0.8882, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.09% (4.3801 => 4.4715, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 2.09% (14.8535 => 15.1633, std. dev.: 0.0197) MultiSource/Applications/JM/ldecod/ldecod: 2.06% (6.5754 => 6.7109, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.94% (4.4433 => 4.5294, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.80% (1.1333 => 1.1537, std. dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: 1.77% (16.2614 => 16.5490, std. dev.: 0.0166) MultiSource/Applications/d/make_dparser: 1.68% (3.1889 => 3.2424, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 25.14% (1.8175 => 2.2744, std. dev.: 0.0504) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.28% (2.0200 => 2.1873, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 6.69% (1.2998 => 1.3868, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.05% (7.4271 => 7.7282, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9219, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6779, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5352, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.45% (3.6469 => 3.6998, std. dev.: 0.0074) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.15% (22.5627 => 20.9498, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3511 => 0.3399, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.48% (0.8818 => 0.8599, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.58% (0.6576 => 0.6472, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.14% (1.2308 => 1.1060, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.97% (20.3410 => 18.5171, std. dev.: 0.0643) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std. dev.: 0.0241) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.25% (1.9762 => 1.9120, std. dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5921, std. dev.: 0.0095) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4463, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5052, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: -1.82% (3.0263 => 2.9713, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2532, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9982, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7952, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0018) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1544, std. dev.: 0.0088) MultiSource/Applications/minisat/minisat: -1.31% (9.3358 => 9.2131, std. dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2516, std. dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2434, std. dev.: 0.0095) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 15:08:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 17:08:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120712220853.8E3F42A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2012?compare_to=2010&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2012, Order: 160139, Start Time: 2012-07-12 20:50:47, End Time: 2012-07-12 22:09:00 To: 2010, Order: 160137, Start Time: 2012-07-12 19:04:47, End Time: 2012-07-12 20:23:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (794 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.75% (10.3673 => 13.1404, std. dev.: 0.0096) SingleSource/UnitTests/ObjC/trivial-interface: 11.95% (0.3473 => 0.3888, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.84% (0.3497 => 0.3911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 11.63% (0.3516 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.49% (0.3561 => 0.3970, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.22% (1.1194 => 1.2450, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 11.21% (0.3694 => 0.4108, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.82% (0.3828 => 0.4242, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.63% (0.3886 => 0.4299, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.71% (1.7609 => 1.8966, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.89% (2.2022 => 2.3540, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 6.62% (0.6030 => 0.6429, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.58% (0.5925 => 0.6315, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 6.06% (0.7326 => 0.7770, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.38% (0.2065 => 0.2176, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.47% (0.3177 => 0.3319, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.11% (7.0540 => 7.3439, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.10% (0.4879 => 0.5079, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 3.74% (0.7433 => 0.7711, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.66% (10.4361 => 10.8176, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/oourafft: 3.41% (0.3282 => 0.3394, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.30% (0.8172 => 0.8442, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.19% (0.4615 => 0.4762, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.84% (0.5569 => 0.5727, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.69% (0.7835 => 0.8046, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (4.9449 => 5.0737, std. dev.: 0.0138) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.57% (5.0018 => 5.1302, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.41% (0.5860 => 0.6001, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.33% (8.1363 => 8.3256, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (14.3668 => 14.6963, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.25% (4.2646 => 4.3605, std. dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: 2.22% (9.4845 => 9.6951, std. dev.: 0.0060) MultiSource/Applications/hbd/hbd: 2.19% (1.5603 => 1.5944, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.85% (1.1861 => 1.2081, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.83% (2.0665 => 2.1044, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.81% (0.8067 => 0.8213, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 1.72% (1.1642 => 1.1842, std. dev.: 0.0037) MultiSource/Applications/treecc/treecc: 1.72% (2.0273 => 2.0621, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.65% (1.5415 => 1.5670, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.63% (1.3050 => 1.3263, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 1.56% (3.3354 => 3.3873, std. dev.: 0.0047) MultiSource/Applications/lua/lua: 1.51% (3.8723 => 3.9309, std. dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 1.34% (5.7591 => 5.8363, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.27% (0.9765 => 0.9889, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.20% (1.4186 => 1.4356, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.16% (17.1811 => 17.3810, std. dev.: 0.0098) MultiSource/Applications/hexxagon/hexxagon: 1.10% (1.2842 => 1.2983, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9743, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7597, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.11% (26.0924 => 26.6425, std. dev.: 0.0109) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (1.5086 => 1.5374, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6897, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.31% (9.1159 => 9.2354, std. dev.: 0.0135) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.49% (0.8651 => 0.1688, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.23% (5.2763 => 3.1539, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.77% (5.3855 => 3.6746, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.39% (5.3526 => 3.6722, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.63% (2.9384 => 2.5380, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -10.63% (22.1758 => 19.8190, std. dev.: 0.0128) SingleSource/UnitTests/Vector/constpool: -5.38% (54.1659 => 51.2533, std. dev.: 0.0380) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.48% (3.8922 => 3.7955, std. dev.: 0.0159) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.16% (1.2373 => 1.1116, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.62% (19.9488 => 18.6272, std. dev.: 0.0464) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.87% (8.1563 => 7.9220, std. dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6857, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0857, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.06% (1.4460 => 1.4307, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 15:23:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 17:23:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120712222355.2F11E2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2013?compare_to=2011&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2013, Order: 160139, Start Time: 2012-07-12 21:10:08, End Time: 2012-07-12 22:24:02 To: 2011, Order: 160138, Start Time: 2012-07-12 19:28:13, End Time: 2012-07-12 20:42:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (126 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.99% (1.3868 => 1.4144, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/lowercase: 1.32% (7.9443 => 8.0490, std. dev.: 0.0253) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.24% (2.0176 => 2.2847, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference-object: 8.80% (0.5818 => 0.6330, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.78% (0.7061 => 0.7681, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5748 => 0.6246, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3578 => 0.3843, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.29% (0.3650 => 0.3916, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 7.19% (0.3601 => 0.3860, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.16% (0.3646 => 0.3907, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.15% (0.3663 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.13% (0.3789 => 0.4059, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.07% (0.3623 => 0.3879, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.03% (0.3914 => 0.4189, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.92% (0.4003 => 0.4280, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 6.88% (0.3940 => 0.4211, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.75% (1.3693 => 1.4617, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.37% (0.7710 => 0.8201, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.24% (0.1986 => 0.2110, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.01% (0.7038 => 0.7461, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 5.87% (0.4328 => 0.4582, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.47% (0.4062 => 0.4284, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.44% (0.2721 => 0.2869, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.39% (0.2596 => 0.2736, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 5.32% (0.2781 => 0.2929, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.30% (0.5265 => 0.5544, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.16% (0.2655 => 0.2792, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.16% (0.2966 => 0.3119, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.14% (0.2782 => 0.2925, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.06% (0.2690 => 0.2826, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.02% (3.9660 => 4.1650, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.02% (0.3489 => 0.3664, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: 4.95% (0.2628 => 0.2758, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.94% (0.2937 => 0.3082, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.93% (0.2760 => 0.2896, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.92% (1.9828 => 2.0804, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.92% (0.3580 => 0.3756, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.92% (0.2726 => 0.2860, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.89% (0.2761 => 0.2896, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.85% (0.2765 => 0.2899, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.75% (0.2696 => 0.2824, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.74% (0.3899 => 0.4084, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3107 => 0.3254, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.56% (0.6959 => 0.7276, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.49% (0.4390 => 0.4587, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3485 => 0.3641, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.32% (0.3192 => 0.3330, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.29% (0.3453 => 0.3601, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.13% (0.3534 => 0.3680, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.12% (0.2988 => 0.3111, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.07% (0.3293 => 0.3427, std. dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 4.03% (16.6129 => 17.2821, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.01% (0.9199 => 0.9568, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3756 => 0.3905, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.96% (0.4016 => 0.4175, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.79% (1.2193 => 1.2655, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.78% (13.8202 => 14.3428, std. dev.: 0.0189) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.71% (13.2842 => 13.7767, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.3868 => 0.4011, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.66% (0.2925 => 0.3032, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.64% (0.5577 => 0.5780, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.60% (0.5637 => 0.5840, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 3.57% (0.2945 => 0.3050, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.56% (1.3245 => 1.3717, std. dev.: 0.0052) MultiSource/Applications/spiff/spiff: 3.45% (0.7506 => 0.7765, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.43% (1.4563 => 1.5063, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 3.38% (1.2292 => 1.2708, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.33% (0.3246 => 0.3354, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.27% (3.8646 => 3.9909, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.24% (0.4379 => 0.4521, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.21% (1.1061 => 1.1416, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.11% (1.1364 => 1.1717, std. dev.: 0.0049) MultiSource/Applications/treecc/treecc: 3.09% (1.9270 => 1.9865, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.05% (1.3819 => 1.4241, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.96% (7.2180 => 7.4317, std. dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.0594 => 1.0904, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.91% (0.7460 => 0.7677, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.85% (1.3813 => 1.4206, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3755 => 0.3857, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.43% (4.9865 => 5.1078, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.35% (2.1791 => 2.2302, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 2.32% (0.8310 => 0.8503, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (3.6692 => 3.7533, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.10% (4.3801 => 4.4722, std. dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 2.05% (14.8535 => 15.1575, std. dev.: 0.0141) MultiSource/Applications/JM/ldecod/ldecod: 1.97% (6.5754 => 6.7052, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.89% (0.8698 => 0.8862, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.87% (0.6135 => 0.6250, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.87% (4.4433 => 4.5263, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.78% (16.2614 => 16.5513, std. dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.73% (1.1333 => 1.1529, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.69% (14.5298 => 14.7752, std. dev.: 0.0063) MultiSource/Applications/d/make_dparser: 1.68% (3.1889 => 3.2424, std. dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 1.28% (1.2749 => 1.2912, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.68% (1.8175 => 2.2660, std. dev.: 0.0288) SingleSource/Benchmarks/Misc/mandel-2: 8.82% (1.2998 => 1.4144, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.38% (2.0200 => 2.1893, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.48% (1.0895 => 1.1710, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (4.5947 => 4.8136, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.20% (7.4271 => 7.7388, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6787, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4807, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.74% (3.6469 => 3.7103, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0067) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.14% (22.5627 => 20.9510, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.13% (0.3511 => 0.3401, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.52% (0.8818 => 0.8596, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.10% (0.9108 => 0.9008, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.55% (0.0997 => 0.0842, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.40% (1.2308 => 1.1028, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.06% (20.3410 => 18.4976, std. dev.: 0.0874) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.36% (1.3780 => 1.3042, std. dev.: 0.0102) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9129, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.6003, std. dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5091, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: -1.73% (3.0263 => 2.9739, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2522, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9982, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1135, std. dev.: 0.0663) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7950, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.38% (2.5254 => 2.4906, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2173, std. dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2418, std. dev.: 0.0259) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2558, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 15:26:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 17:26:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120712222604.AF4DA2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2014?compare_to=2009&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2014, Order: 160138, Start Time: 2012-07-12 19:42:39, End Time: 2012-07-12 22:26:11 To: 2009, Order: 160132, Start Time: 2012-07-12 16:31:17, End Time: 2012-07-12 19:14:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (74 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 949 (819 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.96% (126.5970 => 131.6042, std. dev.: 0.2232) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.38% (54.1728 => 54.9221, std. dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.80% (2.0974 => 2.0596, std. dev.: 0.0141) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.68% (0.3465 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.64% (0.3446 => 0.3916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.56% (0.3496 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.49% (0.3469 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.44% (0.3460 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.39% (0.3442 => 0.3903, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.36% (0.3488 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.99% (0.3650 => 0.4124, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.90% (0.3643 => 0.4113, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.41% (0.3724 => 0.4186, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 7.52% (0.5826 => 0.6264, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.27% (0.5889 => 0.6317, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.08% (0.7171 => 0.7607, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.84% (1.6211 => 1.6995, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.76% (0.5026 => 0.5265, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.65% (3.5627 => 3.7283, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.05% (0.5900 => 0.6139, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 4.05% (0.4029 => 0.4192, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.01% (0.4361 => 0.4536, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 3.96% (0.9697 => 1.0081, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.92% (1.3152 => 1.3668, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.2866 => 0.2978, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.82% (0.2750 => 0.2855, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 3.82% (0.2725 => 0.2829, std. dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.77% (2.7292 => 2.8321, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 3.76% (0.2714 => 0.2816, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.74% (0.4994 => 0.5181, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.72% (0.3930 => 0.4076, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.69% (0.2738 => 0.2839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.67% (0.2780 => 0.2882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.65% (0.2792 => 0.2894, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.63% (0.3195 => 0.3311, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 3.61% (4.2109 => 4.3628, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 3.60% (0.3004 => 0.3112, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.59% (0.9909 => 1.0265, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 3.57% (0.2803 => 0.2903, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.55% (0.2875 => 0.2977, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.47% (2.0673 => 2.1391, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 3.46% (0.3267 => 0.3380, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.42% (0.3096 => 0.3202, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.41% (0.3258 => 0.3369, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.28% (0.5000 => 0.5164, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.27% (0.3362 => 0.3472, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 3.26% (0.3317 => 0.3425, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.21% (1.9694 => 2.0327, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.20% (0.3124 => 0.3224, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.20% (0.4658 => 0.4807, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.18% (1.9966 => 2.0601, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/lists: 3.14% (0.3348 => 0.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.04% (0.4146 => 0.4272, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3726 => 0.3839, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.96% (0.3678 => 0.3787, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3477 => 0.3580, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.87% (0.3625 => 0.3729, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.86% (1.0781 => 1.1089, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 2.80% (2.1013 => 2.1601, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.71% (0.3690 => 0.3790, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.67% (0.3890 => 0.3994, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 2.67% (23.5202 => 24.1485, std. dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/hash2: 2.56% (0.4251 => 0.4360, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.54% (0.3981 => 0.4082, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.48% (4.6177 => 4.7322, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 2.46% (1.8794 => 1.9257, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.41% (4.4195 => 4.5261, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.33% (5.5417 => 5.6707, std. dev.: 0.0142) MultiSource/Applications/JM/ldecod/ldecod: 2.31% (2.1653 => 2.2153, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 2.31% (0.5546 => 0.5674, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 2.13% (0.5012 => 0.5119, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.04% (0.7875 => 0.8036, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.94% (0.6634 => 0.6763, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (0.6435 => 0.6558, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.82% (1.4269 => 1.4529, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 1.61% (1.5932 => 1.6188, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.94% (11.9555 => 11.7236, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 16:55:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 18:55:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120712235502.D256B2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2015?compare_to=2012&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2015, Order: 160144, Start Time: 2012-07-12 22:36:45, End Time: 2012-07-12 23:55:10 To: 2012, Order: 160139, Start Time: 2012-07-12 20:50:47, End Time: 2012-07-12 22:09:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (59 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.81% (55.0555 => 56.6001, std. dev.: 0.0309) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.85% (10.3673 => 13.1514, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3473 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.83% (0.3543 => 0.3962, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 11.66% (0.3516 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.64% (0.3497 => 0.3904, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.49% (0.3561 => 0.3970, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.27% (1.1194 => 1.2456, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 11.21% (0.3694 => 0.4108, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.79% (0.3828 => 0.4241, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.65% (0.3886 => 0.4300, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.59% (0.3927 => 0.4343, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.76% (1.7609 => 1.8976, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.91% (2.2022 => 2.3544, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.67% (0.5925 => 0.6320, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.58% (0.6030 => 0.6427, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.02% (0.7326 => 0.7767, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.52% (0.2065 => 0.2179, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.56% (0.3177 => 0.3322, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.21% (7.0540 => 7.3512, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.06% (0.4879 => 0.5077, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.91% (10.4361 => 10.8444, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 3.62% (0.7433 => 0.7702, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 3.47% (0.3282 => 0.3396, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.40% (0.4615 => 0.4772, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.32% (0.8172 => 0.8443, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.89% (0.5569 => 0.5730, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.78% (4.9449 => 5.0822, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.59% (5.0018 => 5.1311, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 2.49% (0.7835 => 0.8030, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 2.37% (9.4845 => 9.7096, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (14.3668 => 14.7027, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.31% (8.1363 => 8.3244, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (4.2646 => 4.3618, std. dev.: 0.0044) MultiSource/Applications/hbd/hbd: 2.20% (1.5603 => 1.5946, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.18% (0.5860 => 0.5988, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.97% (1.5415 => 1.5719, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.89% (1.1861 => 1.2085, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.80% (2.0665 => 2.1037, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 1.75% (2.0273 => 2.0628, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.72% (1.3050 => 1.3275, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.71% (3.3354 => 3.3926, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.60% (0.8067 => 0.8196, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.52% (3.8723 => 3.9310, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.47% (0.9765 => 0.9909, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.33% (5.7591 => 5.8359, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.23% (1.4186 => 1.4360, std. dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 1.20% (17.1811 => 17.3878, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 1.14% (1.2842 => 1.2988, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7596, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.24% (1.0313 => 1.0544, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.05% (26.0924 => 26.6264, std. dev.: 0.0321) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.93% (1.5086 => 1.5377, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4472, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2454, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6896, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1274, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.49% (0.8651 => 0.1688, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.20% (5.2763 => 3.1550, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.76% (5.3855 => 3.6749, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.37% (5.3526 => 3.6734, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.54% (2.9384 => 2.5406, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.67% (22.1758 => 19.8101, std. dev.: 0.0207) SingleSource/UnitTests/Vector/constpool: -5.39% (54.1659 => 51.2445, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.38% (3.8922 => 3.7997, std. dev.: 0.0145) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.20% (1.2373 => 1.1111, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.09% (19.9488 => 18.5353, std. dev.: 0.0294) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.91% (8.1563 => 7.9193, std. dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6844, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0847, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.03% (1.4460 => 1.4311, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 17:05:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 19:05:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120713000554.991622A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/2016?compare_to=2013&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2016, Order: 160144, Start Time: 2012-07-12 22:52:08, End Time: 2012-07-13 00:06:01 To: 2013, Order: 160139, Start Time: 2012-07-12 21:10:08, End Time: 2012-07-12 22:24:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.07% (1.3042 => 1.3181, std. dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.55% (2.0176 => 2.2909, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.82% (0.5818 => 0.6331, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.78% (0.7061 => 0.7681, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5748 => 0.6246, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.49% (0.3578 => 0.3846, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.28% (0.3601 => 0.3863, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.23% (0.3650 => 0.3914, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 7.16% (0.3646 => 0.3907, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.10% (0.3663 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.07% (0.3789 => 0.4057, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.01% (0.3623 => 0.3877, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.99% (0.4003 => 0.4283, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.95% (0.3914 => 0.4186, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.85% (0.3940 => 0.4210, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.74% (0.3130 => 0.3341, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.58% (1.3693 => 1.4594, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.19% (0.7038 => 0.7474, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.99% (0.1986 => 0.2105, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 5.98% (0.4328 => 0.4587, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 5.79% (0.4062 => 0.4297, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.46% (0.3022 => 0.3187, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.43% (0.5265 => 0.5551, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.43% (0.2596 => 0.2737, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.40% (0.7710 => 0.8126, std. dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 5.39% (0.2781 => 0.2931, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.14% (0.2782 => 0.2925, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.13% (0.2690 => 0.2828, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.13% (0.3899 => 0.4099, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.12% (3.9660 => 4.1689, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.11% (0.2721 => 0.2860, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2628 => 0.2761, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.05% (0.2655 => 0.2789, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.02% (0.2966 => 0.3115, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.00% (0.2760 => 0.2898, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.99% (1.9828 => 2.0818, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.96% (0.2761 => 0.2898, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2726 => 0.2861, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.94% (0.2937 => 0.3082, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.90% (0.3489 => 0.3660, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.88% (0.2765 => 0.2900, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.86% (0.2696 => 0.2827, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.80% (0.3580 => 0.3752, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.80% (0.3107 => 0.3256, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.61% (0.6959 => 0.7280, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.53% (0.3485 => 0.3643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.35% (0.3192 => 0.3331, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.32% (0.3453 => 0.3602, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.24% (16.6129 => 17.3176, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/lists: 4.22% (0.3293 => 0.3432, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.19% (0.3534 => 0.3682, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.18% (0.2988 => 0.3113, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.18% (0.4016 => 0.4184, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.09% (0.9199 => 0.9575, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.05% (0.3756 => 0.3908, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.98% (13.8202 => 14.3705, std. dev.: 0.0131) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.96% (0.4390 => 0.4564, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: 3.90% (0.3868 => 0.4019, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.73% (0.2925 => 0.3034, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.69% (0.5577 => 0.5783, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.67% (1.2193 => 1.2641, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.67% (13.2842 => 13.7720, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/objinst: 3.60% (0.2945 => 0.3051, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 3.58% (0.7506 => 0.7775, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.42% (0.3246 => 0.3357, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.34% (0.5637 => 0.5825, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.32% (1.4563 => 1.5047, std. dev.: 0.0158) MultiSource/Benchmarks/MallocBench/gs/gs: 3.32% (3.8646 => 3.9928, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.30% (1.3245 => 1.3682, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.25% (1.2292 => 1.2691, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.24% (0.4379 => 0.4521, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.22% (1.9270 => 1.9890, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 3.17% (1.1061 => 1.1412, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.08% (1.1364 => 1.1714, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.06% (1.0594 => 1.0918, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.99% (7.2180 => 7.4337, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.86% (0.7460 => 0.7673, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.83% (1.3819 => 1.4210, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3755 => 0.3858, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.61% (1.3813 => 1.4174, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 2.49% (2.1791 => 2.2334, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.46% (4.9865 => 5.1090, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 2.32% (0.8310 => 0.8503, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.30% (3.6692 => 3.7535, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.27% (4.3801 => 4.4794, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 2.12% (6.5754 => 6.7147, std. dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.10% (0.6135 => 0.6264, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.07% (14.8535 => 15.1603, std. dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (0.8698 => 0.8872, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.91% (4.4433 => 4.5283, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.90% (16.2614 => 16.5707, std. dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.87% (1.1333 => 1.1545, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.67% (3.1889 => 3.2420, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 1.65% (14.5298 => 14.7689, std. dev.: 0.0087) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2922, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.06% (2.1007 => 2.1230, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.09% (1.8175 => 2.2736, std. dev.: 0.0480) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.54% (2.0200 => 2.1925, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 7.43% (1.2998 => 1.3964, std. dev.: 0.0147) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.82% (7.4271 => 7.7108, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6793, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4788, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0310 => 1.0562, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1894, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.82% (3.6469 => 3.7131, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (1.5089 => 1.5338, std. dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.06% (22.5627 => 20.9703, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.25% (0.4657 => 0.4366, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.65% (0.0997 => 0.0841, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.69% (1.2308 => 1.0992, std. dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.58% (20.3410 => 18.5962, std. dev.: 0.0569) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3181, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9128, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5891, std. dev.: 0.0198) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5067, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: -1.81% (3.0263 => 2.9715, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2504, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7936, std. dev.: 0.0025) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1281, std. dev.: 0.0150) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8602, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2178, std. dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2402, std. dev.: 0.0276) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2525, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8480, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 18:36:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 20:36:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120713013655.72AE92A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2017?compare_to=2014&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2017, Order: 160144, Start Time: 2012-07-12 22:53:51, End Time: 2012-07-13 01:37:03 To: 2014, Order: 160138, Start Time: 2012-07-12 19:42:39, End Time: 2012-07-12 22:26:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (835 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.44% (0.3446 => 0.3909, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.36% (0.3465 => 0.3928, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 13.16% (0.3442 => 0.3895, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.16% (0.3496 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.12% (0.3460 => 0.3914, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.12% (0.3469 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.10% (0.3488 => 0.3945, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.60% (0.3643 => 0.4102, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.16% (0.3724 => 0.4177, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.68% (0.3792 => 0.4121, std. dev.: 0.0088) SingleSource/UnitTests/ObjC++/Hello: 7.33% (0.5826 => 0.6253, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.06% (0.5889 => 0.6305, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 5.59% (0.7171 => 0.7572, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.13% (0.5026 => 0.5284, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.46% (3.5627 => 3.7216, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.40% (1.6211 => 1.6925, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.06% (0.4361 => 0.4538, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.93% (0.5900 => 0.6132, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.93% (1.3152 => 1.3669, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.90% (0.4994 => 0.5189, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.90% (0.9697 => 1.0075, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.87% (0.2866 => 0.2977, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 3.87% (0.4029 => 0.4185, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.69% (0.3930 => 0.4075, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.51% (0.2875 => 0.2976, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.46% (0.3004 => 0.3108, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.46% (2.7292 => 2.8236, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.44% (0.3195 => 0.3305, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 3.34% (0.3267 => 0.3376, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.32% (0.5000 => 0.5166, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.32% (4.2109 => 4.3505, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 3.29% (0.3317 => 0.3426, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.28% (0.3258 => 0.3365, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.27% (0.9909 => 1.0233, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.21% (2.0673 => 2.1337, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.12% (0.3362 => 0.3467, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.07% (1.9966 => 2.0578, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.03% (1.9694 => 2.0290, std. dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 2.80% (2.1013 => 2.1602, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 2.79% (0.3726 => 0.3830, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 2.72% (0.3678 => 0.3778, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.71% (0.4658 => 0.4784, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 2.70% (0.4146 => 0.4258, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 2.62% (1.0781 => 1.1063, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (0.3890 => 0.3991, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 2.56% (0.4251 => 0.4360, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.41% (23.5202 => 24.0865, std. dev.: 0.0135) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.39% (4.4195 => 4.5251, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 2.28% (4.6177 => 4.7231, std. dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 2.22% (2.1653 => 2.2133, std. dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 2.04% (5.5417 => 5.6546, std. dev.: 0.0117) MultiSource/Applications/treecc/treecc: 2.03% (0.7875 => 0.8035, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.02% (1.8794 => 1.9174, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 1.83% (1.4269 => 1.4530, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 1.70% (0.6634 => 0.6747, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.68% (0.6435 => 0.6543, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 1.34% (1.5932 => 1.6146, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.97% (11.9555 => 11.7195, std. dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 18:40:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 20:40:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120713014058.91EC32A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2018?compare_to=2015&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2018, Order: 160149, Start Time: 2012-07-13 00:22:54, End Time: 2012-07-13 01:41:04 To: 2015, Order: 160144, Start Time: 2012-07-12 22:36:45, End Time: 2012-07-12 23:55:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (60 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (794 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.13% (13.1514 => 13.6947, std. dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.10% (10.3673 => 13.6947, std. dev.: 0.0123) SingleSource/UnitTests/ObjC/trivial-interface: 12.90% (0.3473 => 0.3921, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.67% (0.3497 => 0.3940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.62% (0.3543 => 0.3990, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.51% (0.3516 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.45% (0.3543 => 0.3984, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.41% (0.3561 => 0.4003, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.02% (0.3694 => 0.4138, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.43% (0.3927 => 0.4376, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.37% (0.3886 => 0.4328, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.10% (1.1194 => 1.2437, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.56% (0.3817 => 0.4182, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.77% (1.7609 => 1.8977, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.18% (2.2022 => 2.3604, std. dev.: 0.0113) SingleSource/UnitTests/ObjC++/Hello: 6.92% (0.5925 => 0.6335, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.72% (0.6030 => 0.6435, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.20% (0.7326 => 0.7780, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.47% (0.2065 => 0.2178, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.42% (10.4361 => 10.8974, std. dev.: 0.0124) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.34% (0.3177 => 0.3315, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.29% (7.0540 => 7.3564, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.81% (0.4879 => 0.5065, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.69% (0.7433 => 0.7707, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.41% (0.8172 => 0.8451, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 3.38% (0.3282 => 0.3393, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.14% (0.4615 => 0.4760, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.91% (0.5569 => 0.5731, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.62% (4.9449 => 5.0746, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.55% (0.7835 => 0.8035, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.52% (5.0018 => 5.1280, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.47% (8.1363 => 8.3369, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (14.3668 => 14.6969, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 2.29% (1.5603 => 1.5960, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.21% (4.2646 => 4.3588, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5860 => 0.5985, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 2.05% (9.4845 => 9.6789, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.01% (2.0665 => 2.1081, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 1.88% (1.1642 => 1.1861, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.79% (1.1861 => 1.2073, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 1.59% (2.0273 => 2.0596, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.55% (0.8067 => 0.8192, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 1.55% (3.8723 => 3.9322, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.54% (1.3050 => 1.3251, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.53% (1.5415 => 1.5651, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 1.50% (3.3354 => 3.3853, std. dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 1.39% (5.7591 => 5.8391, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.24% (0.9765 => 0.9886, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.23% (1.2842 => 1.3000, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.16% (17.1811 => 17.3797, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.09% (1.4186 => 1.4340, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7512, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.08% (26.0924 => 26.6356, std. dev.: 0.0198) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (1.5086 => 1.5382, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4463, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2389, std. dev.: 0.0185) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6898, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.45% (0.8651 => 0.1691, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.47% (5.2763 => 3.1411, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.64% (5.3855 => 3.6814, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.33% (5.3526 => 3.6754, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.84% (2.9384 => 2.5318, std. dev.: 0.0176) MultiSource/Applications/ClamAV/clamscan: -10.63% (22.1758 => 19.8184, std. dev.: 0.0068) SingleSource/UnitTests/Vector/constpool: -5.33% (54.1659 => 51.2800, std. dev.: 0.0251) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.75% (3.8922 => 3.7852, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2373 => 1.1062, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.46% (19.9488 => 18.4616, std. dev.: 0.0589) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9132, std. dev.: 0.0125) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6880, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0855, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: -1.15% (1.4460 => 1.4294, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 18:47:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 20:47:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120713014730.6B3F62A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2019?compare_to=2016&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2019, Order: 160149, Start Time: 2012-07-13 00:33:49, End Time: 2012-07-13 01:47:36 To: 2016, Order: 160144, Start Time: 2012-07-12 22:52:08, End Time: 2012-07-13 00:06:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (127 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.04% (78.0729 => 80.4437, std. dev.: 0.4599) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.34% (1.4664 => 1.4860, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: 1.20% (1.0992 => 1.1124, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.47% (2.0176 => 2.2894, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.63% (0.5818 => 0.6378, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.57% (0.5748 => 0.6298, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3578 => 0.3912, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.25% (0.3601 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.16% (0.7061 => 0.7708, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.15% (0.3650 => 0.3984, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.05% (0.3646 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.03% (0.3623 => 0.3950, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.98% (0.3663 => 0.3992, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.92% (0.3789 => 0.4127, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.71% (0.3914 => 0.4255, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.54% (0.4003 => 0.4345, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.48% (0.3940 => 0.4274, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.05% (0.1986 => 0.2126, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.61% (0.3130 => 0.3337, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 6.43% (1.3693 => 1.4574, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.12% (0.7710 => 0.8182, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 5.71% (0.4328 => 0.4575, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.66% (0.2596 => 0.2743, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.51% (0.5265 => 0.5555, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.47% (0.7038 => 0.7423, std. dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 5.39% (0.2781 => 0.2931, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.30% (3.9660 => 4.1761, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.18% (0.2782 => 0.2926, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4062 => 0.4272, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.11% (0.2721 => 0.2860, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.06% (0.3022 => 0.3175, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.06% (0.2690 => 0.2826, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.04% (0.2937 => 0.3085, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.99% (0.2726 => 0.2862, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.93% (0.2655 => 0.2786, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.86% (0.2760 => 0.2894, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.85% (0.2765 => 0.2899, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.84% (1.9828 => 2.0787, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.82% (0.2966 => 0.3109, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.78% (0.2761 => 0.2893, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3107 => 0.3252, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.57% (0.3899 => 0.4077, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.54% (0.3149 => 0.3292, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.53% (0.3580 => 0.3742, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (0.3485 => 0.3640, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.44% (0.6959 => 0.7268, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 4.23% (0.3192 => 0.3327, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.17% (0.3453 => 0.3597, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.15% (0.9199 => 0.9581, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.10% (0.3293 => 0.3428, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.08% (0.2988 => 0.3110, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.05% (0.3534 => 0.3677, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.01% (16.6129 => 17.2795, std. dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.99% (0.3756 => 0.3906, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.98% (0.4016 => 0.4176, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.95% (13.8202 => 14.3665, std. dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.90% (0.4390 => 0.4561, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 3.83% (0.2925 => 0.3037, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.81% (1.2193 => 1.2658, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.79% (13.2842 => 13.7875, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.73% (0.5577 => 0.5785, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.71% (0.5637 => 0.5846, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.3868 => 0.4011, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 3.57% (0.2945 => 0.3050, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.54% (0.4379 => 0.4534, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 3.52% (0.7506 => 0.7770, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.51% (7.2180 => 7.4715, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.50% (1.3245 => 1.3708, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.41% (1.1364 => 1.1751, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.31% (1.4563 => 1.5045, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.27% (1.1061 => 1.1423, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3246 => 0.3350, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.15% (1.3813 => 1.4248, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.15% (3.8646 => 3.9863, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 3.10% (1.2292 => 1.2673, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.08% (1.3819 => 1.4245, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.06% (0.7460 => 0.7688, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.98% (1.9270 => 1.9845, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0906, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3755 => 0.3858, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.64% (3.6692 => 3.7661, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (4.3801 => 4.4852, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 2.36% (0.8310 => 0.8506, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 2.29% (14.8535 => 15.1938, std. dev.: 0.0104) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.26% (4.9865 => 5.0992, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.16% (6.5754 => 6.7177, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.11% (4.4433 => 4.5370, std. dev.: 0.0043) MultiSource/Applications/siod/siod: 2.08% (2.1791 => 2.2244, std. dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.02% (0.6135 => 0.6259, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.92% (1.1333 => 1.1551, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.87% (0.8698 => 0.8861, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.77% (3.1889 => 3.2454, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 1.76% (14.5298 => 14.7860, std. dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 1.76% (16.2614 => 16.5481, std. dev.: 0.0210) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2914, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.98% (1.8175 => 2.2715, std. dev.: 0.0450) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.65% (2.0200 => 2.1947, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.05% (1.2998 => 1.3915, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7358, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9197, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6788, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9615, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8306, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4783, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.67% (3.6469 => 3.7078, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5333, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9572, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1943, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 1.03% (10.7476 => 10.8582, std. dev.: 0.0296) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.78% (0.4657 => 0.4155, std. dev.: 0.0128) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (22.5627 => 20.9370, std. dev.: 0.0193) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3511 => 0.3399, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.59% (0.8818 => 0.8590, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.55% (0.0997 => 0.0832, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -9.62% (1.2308 => 1.1124, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.95% (20.3410 => 18.5195, std. dev.: 0.0475) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.63% (1.3780 => 1.3142, std. dev.: 0.0098) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.26% (1.9762 => 1.9118, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.8259 => 8.5748, std. dev.: 0.0195) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4867 => 0.4748, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5096, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -1.72% (3.0263 => 2.9742, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2488, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7945, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.49% (2.5254 => 2.4877, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1255, std. dev.: 0.0231) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -1.30% (5.3167 => 5.2475, std. dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2408, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2223, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 20:27:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 22:27:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120713032718.C1AC92A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2020?compare_to=2018&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2020, Order: 160159, Start Time: 2012-07-13 02:09:10, End Time: 2012-07-13 03:27:25 To: 2018, Order: 160149, Start Time: 2012-07-13 00:22:54, End Time: 2012-07-13 01:41:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (57 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (797 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.60% (54.5249 => 56.4883, std. dev.: 0.1244) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.79% (10.3673 => 13.5593, std. dev.: 0.0101) SingleSource/UnitTests/ObjC/trivial-interface: 12.35% (0.3473 => 0.3902, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.07% (0.3497 => 0.3919, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.00% (0.3516 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.00% (0.3543 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.00% (0.3543 => 0.3968, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/synchronized: 11.91% (0.3561 => 0.3985, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3694 => 0.4121, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.53% (1.1194 => 1.2485, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.01% (0.3886 => 0.4314, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.98% (0.3927 => 0.4358, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.79% (1.7609 => 1.8980, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.55% (2.2022 => 2.3684, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.58% (0.6030 => 0.6427, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.46% (0.5925 => 0.6308, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 5.91% (0.7326 => 0.7759, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.56% (0.3177 => 0.3322, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.37% (7.0540 => 7.3624, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.09% (0.8172 => 0.8506, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.06% (0.4879 => 0.5077, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.89% (10.4361 => 10.8420, std. dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.66% (0.4615 => 0.4784, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 3.63% (0.3282 => 0.3401, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.58% (0.7433 => 0.7699, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.73% (0.5569 => 0.5721, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.58% (5.0018 => 5.1307, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.55% (4.9449 => 5.0712, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 2.50% (0.7835 => 0.8031, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.47% (8.1363 => 8.3374, std. dev.: 0.0049) MultiSource/Applications/hbd/hbd: 2.26% (1.5603 => 1.5955, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (14.3668 => 14.6876, std. dev.: 0.0145) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.16% (4.2646 => 4.3569, std. dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 2.12% (9.4845 => 9.6860, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5860 => 0.5983, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 1.80% (1.1642 => 1.1851, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (2.0665 => 2.1031, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (1.1861 => 1.2065, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.65% (2.0273 => 2.0608, std. dev.: 0.0095) MultiSource/Applications/d/make_dparser: 1.54% (3.3354 => 3.3869, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.46% (1.5415 => 1.5640, std. dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 1.44% (5.7591 => 5.8421, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.43% (3.8723 => 3.9276, std. dev.: 0.0133) MultiSource/Applications/hexxagon/hexxagon: 1.33% (1.2842 => 1.3013, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.28% (1.3050 => 1.3217, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.04% (1.4186 => 1.4333, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.16% (3.6395 => 3.7544, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.98% (1.5086 => 1.5384, std. dev.: 0.0103) MultiSource/Applications/lua/lua: 1.97% (26.0924 => 26.6069, std. dev.: 0.0400) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2418, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.17% (2.6546 => 2.6856, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.39% (5.2763 => 3.1451, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.39% (5.3855 => 3.6948, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.09% (5.3526 => 3.6885, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.61% (2.9384 => 2.5385, std. dev.: 0.0055) MultiSource/Applications/ClamAV/clamscan: -10.65% (22.1758 => 19.8150, std. dev.: 0.0118) SingleSource/UnitTests/Vector/constpool: -5.15% (54.1659 => 51.3788, std. dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.69% (3.8922 => 3.7874, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.91% (1.2373 => 1.1023, std. dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.66% (19.9488 => 18.6208, std. dev.: 0.0300) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.87% (8.1563 => 7.9221, std. dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6851, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0813, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.04% (1.4460 => 1.4310, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 20:29:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 22:29:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120713032910.383CD2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2021?compare_to=2019&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2021, Order: 160159, Start Time: 2012-07-13 02:15:31, End Time: 2012-07-13 03:29:16 To: 2019, Order: 160149, Start Time: 2012-07-13 00:33:49, End Time: 2012-07-13 01:47:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.74% (54.8455 => 56.3502, std. dev.: 0.0765) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.44% (2.0176 => 2.2887, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.66% (0.5818 => 0.6380, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 9.55% (0.5748 => 0.6297, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.26% (0.7061 => 0.7715, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.15% (0.3650 => 0.3984, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.94% (0.3578 => 0.3898, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.80% (0.3601 => 0.3918, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 8.56% (0.3646 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.54% (0.3663 => 0.3976, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.50% (0.3623 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.42% (0.3789 => 0.4108, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.30% (0.3914 => 0.4239, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 8.17% (0.4003 => 0.4330, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.02% (0.3940 => 0.4256, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.20% (0.1986 => 0.2129, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 6.97% (1.3693 => 1.4648, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 6.38% (0.4062 => 0.4321, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.05% (0.4328 => 0.4590, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.04% (0.2781 => 0.2949, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.92% (0.7038 => 0.7455, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.76% (0.2655 => 0.2808, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.75% (0.7710 => 0.8153, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3022 => 0.3195, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.72% (0.2782 => 0.2941, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.68% (0.2607 => 0.2755, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.66% (0.2596 => 0.2743, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 5.65% (0.2937 => 0.3103, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.58% (0.5265 => 0.5559, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 5.54% (0.2726 => 0.2877, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.53% (0.2765 => 0.2918, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.47% (1.9828 => 2.0913, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.40% (0.2760 => 0.2909, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.37% (0.2721 => 0.2867, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.32% (0.2761 => 0.2908, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.31% (0.3580 => 0.3770, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.30% (0.3489 => 0.3674, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.28% (0.3899 => 0.4105, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.3107 => 0.3271, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.13% (3.9660 => 4.1696, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.92% (0.3192 => 0.3349, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.91% (0.3485 => 0.3656, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.77% (0.6959 => 0.7291, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 4.72% (0.3453 => 0.3616, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.63% (0.3756 => 0.3930, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.63% (0.4016 => 0.4202, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.59% (0.3293 => 0.3444, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.59% (0.2988 => 0.3125, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.58% (0.3534 => 0.3696, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.35% (0.4390 => 0.4581, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 4.20% (16.6129 => 17.3114, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 4.19% (0.3868 => 0.4030, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2945 => 0.3064, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.01% (0.9199 => 0.9568, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.91% (13.8202 => 14.3603, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/09-vor/vor: 3.79% (0.2925 => 0.3036, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.77% (1.2193 => 1.2653, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.65% (13.2842 => 13.7691, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.62% (0.5577 => 0.5779, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.53% (1.2292 => 1.2726, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.52% (1.3819 => 1.4305, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.51% (0.5637 => 0.5835, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (3.8646 => 3.9997, std. dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.47% (0.4379 => 0.4531, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: 3.45% (0.7506 => 0.7765, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.36% (7.2180 => 7.4607, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.27% (1.3245 => 1.3678, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.27% (0.3246 => 0.3352, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.27% (1.3813 => 1.4264, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 3.21% (1.1061 => 1.1416, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.19% (1.1364 => 1.1727, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3755 => 0.3873, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.09% (1.4563 => 1.5013, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.00% (0.7460 => 0.7684, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.99% (1.9270 => 1.9847, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.0594 => 1.0904, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.49% (3.6692 => 3.7604, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.44% (4.9865 => 5.1083, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (4.3801 => 4.4759, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 2.18% (2.1791 => 2.2265, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.17% (14.8535 => 15.1755, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 2.13% (0.8310 => 0.8487, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.12% (6.5754 => 6.7149, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.09% (0.8698 => 0.8880, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.03% (4.4433 => 4.5335, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.99% (0.6135 => 0.6257, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.82% (1.1333 => 1.1539, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.73% (16.2614 => 16.5423, std. dev.: 0.0228) MultiSource/Applications/d/make_dparser: 1.69% (3.1889 => 3.2429, std. dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 1.69% (14.5298 => 14.7747, std. dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (1.2749 => 1.2906, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.94% (1.8175 => 2.2707, std. dev.: 0.0200) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.49% (2.0200 => 2.1915, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.51% (1.2998 => 1.3974, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7355, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9215, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6800, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8314, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4801, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.96% (4.1080 => 4.1884, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9588, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.46% (3.6469 => 3.7003, std. dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1936, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.24% (0.8239 => 0.8341, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.79% (0.4657 => 0.4108, std. dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.15% (22.5627 => 20.9494, std. dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.70% (0.8818 => 0.8580, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.20% (1.2308 => 1.1052, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.83% (20.3410 => 18.5448, std. dev.: 0.0238) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.27% (1.3780 => 1.3054, std. dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9130, std. dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5904, std. dev.: 0.0114) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.76% (6.6320 => 6.5150, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: -1.73% (3.0263 => 2.9740, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2526, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.54% (26.5159 => 26.1064, std. dev.: 0.0509) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7953, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3305 => 7.2244, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8619, std. dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.39% (0.8342 => 0.8226, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.35% (9.3358 => 9.2097, std. dev.: 0.0360) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2590, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 21:47:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 12 Jul 2012 23:47:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120713044751.363162A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2022?compare_to=2017&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2022, Order: 160159, Start Time: 2012-07-13 02:04:44, End Time: 2012-07-13 04:47:58 To: 2017, Order: 160144, Start Time: 2012-07-12 22:53:51, End Time: 2012-07-13 01:37:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (46 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 949 (847 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 4.71% (0.2270 => 0.2377, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.83% (2.0686 => 2.1065, std. dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.15% (1.0075 => 0.9959, std. dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 12.32% (0.3442 => 0.3866, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.31% (0.3460 => 0.3886, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 12.25% (0.3446 => 0.3868, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.24% (0.3488 => 0.3915, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.21% (0.3465 => 0.3888, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.19% (0.3496 => 0.3922, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.05% (0.3469 => 0.3887, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.86% (0.3643 => 0.4075, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.81% (0.3650 => 0.4081, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.49% (0.3724 => 0.4152, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.75% (0.5826 => 0.6219, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.49% (0.3792 => 0.4038, std. dev.: 0.0092) SingleSource/UnitTests/ObjC++/property-reference-object: 6.38% (0.5889 => 0.6265, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 4.92% (0.7171 => 0.7524, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.92% (0.5900 => 0.6190, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.91% (0.5026 => 0.5273, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.62% (3.5627 => 3.7273, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.49% (1.6211 => 1.6939, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (0.4994 => 0.5210, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.13% (0.4361 => 0.4541, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.80% (1.3152 => 1.3652, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 3.75% (0.4029 => 0.4180, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.73% (0.2866 => 0.2973, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.46% (0.3930 => 0.4066, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.32% (2.7292 => 2.8199, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 3.31% (23.5202 => 24.2995, std. dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: 3.26% (4.2109 => 4.3480, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.16% (1.9694 => 2.0317, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.14% (0.5000 => 0.5157, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.88% (0.9909 => 1.0194, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.82% (2.0673 => 2.1256, std. dev.: 0.0046) MultiSource/Applications/d/make_dparser: 2.81% (1.0781 => 1.1084, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.76% (1.9966 => 2.0518, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (0.3890 => 0.3997, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.75% (0.4658 => 0.4786, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 2.70% (0.9697 => 0.9959, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 2.60% (2.1013 => 2.1560, std. dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 2.57% (5.5417 => 5.6841, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (1.8794 => 1.9254, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (4.4195 => 4.5246, std. dev.: 0.0080) MultiSource/Applications/JM/lencod/lencod: 2.36% (4.6177 => 4.7266, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.30% (2.1653 => 2.2151, std. dev.: 0.0092) MultiSource/Applications/oggenc/oggenc: 2.03% (1.5932 => 1.6255, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.99% (0.7875 => 0.8032, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.78% (1.4269 => 1.4523, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.60% (0.6634 => 0.6740, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.83% (11.9555 => 11.7371, std. dev.: 0.0125) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 23:00:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 01:00:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120713060009.528482A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2023?compare_to=2021&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2023, Order: 160161, Start Time: 2012-07-13 04:46:23, End Time: 2012-07-13 06:00:14 To: 2021, Order: 160159, Start Time: 2012-07-13 02:15:31, End Time: 2012-07-13 03:29:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (127 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.85% (2.0176 => 2.2971, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: 9.61% (0.5818 => 0.6377, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.59% (0.5748 => 0.6299, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.26% (0.7061 => 0.7715, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.20% (0.3578 => 0.3907, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.96% (0.3650 => 0.3977, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.94% (0.3601 => 0.3923, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.89% (0.3646 => 0.3970, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.78% (0.3623 => 0.3941, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.76% (0.3663 => 0.3984, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.69% (0.3914 => 0.4254, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.68% (0.3789 => 0.4118, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.39% (0.4003 => 0.4339, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.30% (0.3940 => 0.4267, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.20% (0.1986 => 0.2129, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.67% (1.3693 => 1.4607, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.29% (0.7710 => 0.8195, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4328 => 0.4596, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.08% (0.2781 => 0.2950, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 5.92% (0.7038 => 0.7455, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.82% (0.3022 => 0.3198, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.79% (0.2782 => 0.2943, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.79% (0.4062 => 0.4297, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.76% (0.2655 => 0.2808, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.76% (0.2690 => 0.2845, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.70% (0.2596 => 0.2744, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.54% (0.2761 => 0.2914, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.54% (0.2726 => 0.2877, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.52% (1.9828 => 2.0923, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wc: 5.52% (0.2937 => 0.3099, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.51% (0.5265 => 0.5555, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2765 => 0.2917, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.47% (0.2760 => 0.2911, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.44% (0.2721 => 0.2869, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.3107 => 0.3275, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.26% (0.3899 => 0.4104, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.24% (3.9660 => 4.1739, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.20% (0.3580 => 0.3766, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.02% (0.3485 => 0.3660, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.95% (0.3192 => 0.3350, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2988 => 0.3130, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.71% (0.3293 => 0.3448, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.58% (0.3534 => 0.3696, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.48% (0.6959 => 0.7271, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.31% (0.4390 => 0.4579, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.25% (16.6129 => 17.3193, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/moments: 4.24% (0.3868 => 0.4032, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.01% (13.8202 => 14.3743, std. dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.98% (0.9199 => 0.9565, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 3.97% (0.2925 => 0.3041, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.89% (1.2193 => 1.2667, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.78% (0.5577 => 0.5788, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.74% (13.2842 => 13.7815, std. dev.: 0.0152) MultiSource/Applications/hexxagon/hexxagon: 3.60% (1.2292 => 1.2734, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.56% (0.4379 => 0.4535, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.56% (0.7506 => 0.7773, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.56% (7.2180 => 7.4747, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.54% (1.3819 => 1.4308, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.53% (0.5637 => 0.5836, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.37% (1.3813 => 1.4278, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3755 => 0.3881, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.34% (1.1364 => 1.1744, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 3.34% (1.1061 => 1.1430, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 3.32% (3.8646 => 3.9930, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.32% (1.3245 => 1.3685, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (1.4563 => 1.5036, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.16% (0.7460 => 0.7696, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.96% (1.9270 => 1.9841, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.0594 => 1.0902, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.81% (3.6692 => 3.7724, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.47% (4.9865 => 5.1095, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.35% (14.8535 => 15.2020, std. dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.34% (4.3801 => 4.4827, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (6.5754 => 6.7261, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.15% (4.4433 => 4.5388, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8310 => 0.8488, std. dev.: 0.0047) MultiSource/Applications/siod/siod: 2.12% (2.1791 => 2.2254, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.06% (0.8698 => 0.8877, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.96% (0.6135 => 0.6255, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.94% (1.1333 => 1.1553, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.92% (3.1889 => 3.2500, std. dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 1.80% (16.2614 => 16.5545, std. dev.: 0.0184) MultiSource/Applications/ClamAV/clamscan: 1.71% (14.5298 => 14.7789, std. dev.: 0.0146) MultiSource/Applications/SIBsim4/SIBsim4: 1.35% (1.2749 => 1.2921, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 25.37% (1.8175 => 2.2786, std. dev.: 0.0484) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.0200 => 2.1886, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: 8.11% (1.2998 => 1.4052, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9867, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.77% (7.4271 => 7.7073, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6794, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.37% (1.7688 => 1.8284, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1909, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.92% (3.6469 => 3.7169, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (1.5089 => 1.5353, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5074, std. dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/fldry: 1.34% (1.9290 => 1.9548, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1964, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.70% (0.4657 => 0.4112, std. dev.: 0.0076) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.12% (22.5627 => 20.9559, std. dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.54% (0.8818 => 0.8594, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.55% (0.0997 => 0.0842, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.65% (1.2308 => 1.1120, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.89% (20.3410 => 18.5322, std. dev.: 0.0435) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3092, std. dev.: 0.0109) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.24% (1.9762 => 1.9121, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6023, std. dev.: 0.0145) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4476, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5050, std. dev.: 0.0064) MultiSource/Applications/spiff/spiff: -1.85% (3.0263 => 2.9702, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2560, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7949, std. dev.: 0.0014) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1146, std. dev.: 0.0373) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.48% (0.9692 => 0.9549, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2196, std. dev.: 0.0311) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2424, std. dev.: 0.0092) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2586, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 12 23:04:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 01:04:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120713060433.9142A2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2024?compare_to=2020&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2024, Order: 160161, Start Time: 2012-07-13 04:46:29, End Time: 2012-07-13 06:04:41 To: 2020, Order: 160159, Start Time: 2012-07-13 02:09:10, End Time: 2012-07-13 03:27:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (797 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.94% (10.3673 => 13.5747, std. dev.: 0.0085) SingleSource/UnitTests/ObjC/trivial-interface: 12.24% (0.3473 => 0.3898, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.84% (0.3497 => 0.3911, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.83% (0.3516 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.80% (0.3543 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.77% (0.3543 => 0.3960, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3561 => 0.3976, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 11.34% (0.3694 => 0.4113, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.28% (1.1194 => 1.2457, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 10.84% (0.3828 => 0.4243, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.79% (1.7609 => 1.8981, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.71% (2.2022 => 2.3720, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.40% (0.6030 => 0.6416, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.24% (0.5925 => 0.6295, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.68% (0.7326 => 0.7742, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.47% (0.2065 => 0.2178, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.3177 => 0.3327, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.57% (7.0540 => 7.3764, std. dev.: 0.0092) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.22% (0.8172 => 0.8517, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.00% (0.4879 => 0.5074, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 3.93% (0.3282 => 0.3411, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.88% (10.4361 => 10.8409, std. dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.62% (0.4615 => 0.4782, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.30% (0.7433 => 0.7678, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.62% (0.5569 => 0.5715, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.61% (8.1363 => 8.3487, std. dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.53% (5.0018 => 5.1281, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.52% (4.9449 => 5.0697, std. dev.: 0.0043) MultiSource/Applications/spiff/spiff: 2.27% (0.7835 => 0.8013, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.25% (14.3668 => 14.6901, std. dev.: 0.0181) MultiSource/Applications/hbd/hbd: 2.12% (1.5603 => 1.5934, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5860 => 0.5981, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.06% (4.2646 => 4.3526, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 2.03% (9.4845 => 9.6771, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.96% (2.0665 => 2.1071, std. dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.68% (1.1861 => 1.2060, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 1.60% (1.1642 => 1.1828, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.52% (1.3050 => 1.3249, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.46% (2.0273 => 2.0569, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.45% (0.8067 => 0.8184, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.39% (1.5415 => 1.5629, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.36% (3.3354 => 3.3808, std. dev.: 0.0136) MultiSource/Applications/oggenc/oggenc: 1.36% (5.7591 => 5.8374, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 1.36% (3.8723 => 3.9248, std. dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: 1.15% (17.1811 => 17.3792, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.13% (0.9765 => 0.9875, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.81% (1.1145 => 1.1904, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7543, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.94% (26.0924 => 26.5989, std. dev.: 0.0417) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2390, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6883, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.47% (5.2763 => 3.1411, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6985, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.03% (5.3526 => 3.6918, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.68% (2.9384 => 2.5365, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -10.67% (22.1758 => 19.8097, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -5.02% (54.1659 => 51.4459, std. dev.: 0.0573) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.89% (3.8922 => 3.7798, std. dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.23% (0.0998 => 0.0846, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.02% (1.2373 => 1.1009, std. dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.67% (19.9488 => 18.6184, std. dev.: 0.0378) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (8.1563 => 7.9175, std. dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.57% (32.5116 => 31.6772, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/salsa20: -1.99% (10.2830 => 10.0784, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.04% (1.4460 => 1.4310, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 00:44:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 02:44:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120713074459.4D3432A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2025?compare_to=2023&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2025, Order: 160162, Start Time: 2012-07-13 06:27:59, End Time: 2012-07-13 07:45:05 To: 2023, Order: 160161, Start Time: 2012-07-13 04:46:23, End Time: 2012-07-13 06:00:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (738 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.78% (2.0176 => 2.2957, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 9.64% (0.5818 => 0.6379, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.64% (0.5748 => 0.6302, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.14% (0.3578 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.91% (0.3601 => 0.3922, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.85% (0.3650 => 0.3973, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 8.83% (0.3623 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.83% (0.3646 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.82% (0.3663 => 0.3986, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.77% (0.7061 => 0.7680, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 8.63% (0.3789 => 0.4116, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.56% (0.3914 => 0.4249, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.37% (0.4003 => 0.4338, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 8.32% (0.3940 => 0.4268, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.15% (0.1986 => 0.2128, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 6.59% (1.3693 => 1.4595, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.23% (0.7710 => 0.8190, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (0.4328 => 0.4591, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 5.78% (0.7038 => 0.7445, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.72% (0.2782 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.66% (0.4062 => 0.4292, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.65% (0.2655 => 0.2805, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.64% (0.5265 => 0.5562, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.62% (0.2596 => 0.2742, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.52% (0.2937 => 0.3099, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.47% (1.9828 => 2.0913, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.44% (0.2721 => 0.2869, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.43% (0.2761 => 0.2911, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.40% (0.2760 => 0.2909, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.2966 => 0.3126, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.27% (0.3489 => 0.3673, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.22% (3.9660 => 4.1732, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.12% (0.3107 => 0.3266, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.11% (0.3580 => 0.3763, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.08% (0.3149 => 0.3309, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.08% (0.3899 => 0.4097, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.96% (0.3485 => 0.3658, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.86% (0.3192 => 0.3347, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.65% (0.2988 => 0.3127, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists: 4.62% (0.3293 => 0.3445, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.57% (0.6959 => 0.7277, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 4.56% (0.3534 => 0.3695, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.24% (0.4390 => 0.4576, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 4.22% (16.6129 => 17.3134, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/moments: 4.16% (0.3868 => 0.4029, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.05% (0.9199 => 0.9572, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2945 => 0.3064, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.97% (0.2925 => 0.3041, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.83% (1.2193 => 1.2660, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.78% (13.2842 => 13.7858, std. dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.77% (0.5577 => 0.5787, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.65% (0.4379 => 0.4539, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.5637 => 0.5842, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.60% (1.2292 => 1.2734, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.52% (7.2180 => 7.4719, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.52% (1.3819 => 1.4305, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (3.8646 => 4.0000, std. dev.: 0.0137) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.50% (0.2914 => 0.3016, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.40% (1.3813 => 1.4282, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.32% (1.1364 => 1.1741, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.30% (1.4563 => 1.5044, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3246 => 0.3351, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.3245 => 1.3673, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3755 => 0.3873, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.11% (0.7460 => 0.7692, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.97% (1.0594 => 1.0909, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.58% (3.6692 => 3.7637, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.52% (4.9865 => 5.1124, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.29% (4.3801 => 4.4805, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 2.18% (0.8310 => 0.8491, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.15% (0.6135 => 0.6267, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.14% (4.4433 => 4.5385, std. dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.97% (0.8698 => 0.8869, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.94% (1.1333 => 1.1553, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.72% (16.2614 => 16.5414, std. dev.: 0.0355) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.96% (1.8175 => 2.2712, std. dev.: 0.0275) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1891, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: 8.16% (1.2998 => 1.4058, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.95% (0.9996 => 1.0791, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.7000, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7301, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9216, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6794, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8291, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1892, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5089 => 1.5361, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.68% (3.6469 => 3.7081, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5110, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.11% (22.5627 => 20.9593, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.59% (1.2308 => 1.1128, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.59% (20.3410 => 18.5929, std. dev.: 0.0181) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3133, std. dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.24% (1.9762 => 1.9122, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5980, std. dev.: 0.0155) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5062, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -1.67% (3.0263 => 2.9758, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.58% (7.1097 => 6.9977, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2567, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7957, std. dev.: 0.0027) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1196, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.48% (0.9692 => 0.9549, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2515, std. dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: -1.17% (7.3305 => 7.2444, std. dev.: 0.0078) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 00:53:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 02:53:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120713075309.8E3362A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2026?compare_to=2024&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2026, Order: 160162, Start Time: 2012-07-13 06:32:24, End Time: 2012-07-13 07:53:15 To: 2024, Order: 160161, Start Time: 2012-07-13 04:46:29, End Time: 2012-07-13 06:04:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (54 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (802 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.01% (28.5277 => 29.6711, std. dev.: 0.1267) SingleSource/Benchmarks/Misc/lowercase: 1.27% (7.9539 => 8.0551, std. dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.01% (10.3673 => 13.5822, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.50% (0.3543 => 0.3986, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.27% (0.3473 => 0.3899, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.95% (0.3497 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.80% (0.3516 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.77% (0.3561 => 0.3980, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.37% (0.3694 => 0.4114, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.36% (1.1194 => 1.2466, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 11.08% (0.3828 => 0.4252, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 10.98% (0.3927 => 0.4358, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.89% (0.3886 => 0.4309, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.83% (1.7609 => 1.8988, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.73% (2.2022 => 2.3725, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.50% (0.6030 => 0.6422, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.35% (0.5925 => 0.6301, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.81% (0.7326 => 0.7752, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.61% (7.0540 => 7.3791, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.49% (0.4879 => 0.5098, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.18% (0.4615 => 0.4808, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.04% (10.4361 => 10.8573, std. dev.: 0.0161) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.83% (0.8172 => 0.8485, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 3.48% (0.7433 => 0.7692, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.05% (0.5569 => 0.5739, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 2.94% (0.7835 => 0.8065, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.80% (5.0018 => 5.1418, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.65% (4.9449 => 5.0761, std. dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.58% (8.1363 => 8.3466, std. dev.: 0.0060) MultiSource/Applications/hbd/hbd: 2.47% (1.5603 => 1.5988, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (14.3668 => 14.6800, std. dev.: 0.0174) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.15% (4.2646 => 4.3561, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5860 => 0.5985, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 2.06% (9.4845 => 9.6803, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.93% (2.0665 => 2.1064, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.78% (0.6450 => 0.6565, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.64% (2.0273 => 2.0605, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.64% (1.1861 => 1.2055, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 1.49% (3.3354 => 3.3852, std. dev.: 0.0094) MultiSource/Applications/lua/lua: 1.49% (3.8723 => 3.9300, std. dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.47% (1.3050 => 1.3242, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7591 => 5.8428, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.35% (1.5415 => 1.5623, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.20% (0.9765 => 0.9882, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.01% (1.4186 => 1.4329, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.10% (2.6778 => 2.9750, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7518, std. dev.: 0.0200) MultiSource/Applications/lua/lua: 2.20% (26.0924 => 26.6661, std. dev.: 0.0364) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5086 => 1.5354, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6890, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2331, std. dev.: 0.0306) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.40% (5.2763 => 3.1448, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.36% (5.3855 => 3.6968, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.00% (5.3526 => 3.6935, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.59% (2.9384 => 2.5392, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.53% (22.1758 => 19.8409, std. dev.: 0.0403) SingleSource/UnitTests/Vector/constpool: -5.13% (54.1659 => 51.3864, std. dev.: 0.0251) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.53% (1.2373 => 1.1194, std. dev.: 0.0343) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.48% (19.9488 => 18.4562, std. dev.: 0.0626) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.76% (8.1563 => 7.9315, std. dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6913, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -1.97% (10.2830 => 10.0801, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3526, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 01:01:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 03:01:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120713080130.52A322A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2027?compare_to=2022&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2027, Order: 160161, Start Time: 2012-07-13 05:15:35, End Time: 2012-07-13 08:01:37 To: 2022, Order: 160159, Start Time: 2012-07-13 02:04:44, End Time: 2012-07-13 04:47:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (44 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (849 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.39% (0.3446 => 0.3873, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions-4: 12.38% (0.3465 => 0.3894, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-3: 12.34% (0.3460 => 0.3887, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: 12.32% (0.3442 => 0.3866, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/for-in: 12.30% (0.3496 => 0.3926, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.18% (0.3488 => 0.3913, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3469 => 0.3891, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/property: 12.05% (0.3650 => 0.4090, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions: 11.80% (0.3643 => 0.4073, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/parameter-passing: 11.39% (0.3724 => 0.4148, std. dev.: 0.0065) SingleSource/UnitTests/ObjC++/Hello: 7.23% (0.5826 => 0.6247, std. dev.: 0.0118) SingleSource/UnitTests/ObjC++/property-reference-object: 6.84% (0.5889 => 0.6292, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.93% (0.5900 => 0.6191, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.76% (0.5026 => 0.5265, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.58% (3.5627 => 3.7257, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.47% (1.6211 => 1.6936, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (0.4994 => 0.5210, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.04% (0.4361 => 0.4537, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.79% (1.3152 => 1.3650, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 3.77% (0.4029 => 0.4181, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.69% (0.2736 => 0.2837, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.66% (0.3930 => 0.4074, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.66% (0.2866 => 0.2971, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.50% (0.5000 => 0.5175, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.43% (2.7292 => 2.8228, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 3.36% (4.2109 => 4.3523, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (1.9694 => 2.0329, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.11% (0.9909 => 1.0217, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.98% (0.4658 => 0.4797, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.96% (1.9966 => 2.0557, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (0.3890 => 0.4003, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.80% (2.0673 => 2.1252, std. dev.: 0.0057) MultiSource/Applications/d/make_dparser: 2.65% (1.0781 => 1.1067, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 2.52% (0.9697 => 0.9941, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.46% (0.4139 => 0.4241, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (4.4195 => 4.5220, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.27% (2.1653 => 2.2145, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 2.26% (5.5417 => 5.6671, std. dev.: 0.0098) MultiSource/Benchmarks/MallocBench/gs/gs: 2.18% (1.8794 => 1.9204, std. dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 2.17% (4.6177 => 4.7178, std. dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 2.07% (1.5932 => 1.6261, std. dev.: 0.0064) MultiSource/Applications/treecc/treecc: 1.89% (0.7875 => 0.8024, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 1.75% (1.4269 => 1.4518, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.88% (11.9555 => 11.7309, std. dev.: 0.0068) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 02:26:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 04:26:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120713092659.7A75D2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2028?compare_to=2025&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2028, Order: 160163, Start Time: 2012-07-13 08:13:13, End Time: 2012-07-13 09:27:06 To: 2025, Order: 160162, Start Time: 2012-07-13 06:27:59, End Time: 2012-07-13 07:45:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (125 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (730 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.86% (54.9139 => 56.4817, std. dev.: 0.0376) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.86% (2.0176 => 2.2973, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 9.87% (0.5818 => 0.6392, std. dev.: 0.0065) SingleSource/UnitTests/ObjC++/Hello: 9.59% (0.5748 => 0.6299, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.20% (0.3578 => 0.3907, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.94% (0.3601 => 0.3923, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.90% (0.3650 => 0.3975, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 8.86% (0.3646 => 0.3969, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.76% (0.3663 => 0.3984, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.75% (0.3623 => 0.3940, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.71% (0.3789 => 0.4119, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.65% (0.7061 => 0.7672, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.58% (0.3914 => 0.4250, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.49% (0.4003 => 0.4343, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.30% (0.3940 => 0.4267, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.30% (0.1986 => 0.2131, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.57% (1.3693 => 1.4593, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.23% (0.7710 => 0.8190, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4328 => 0.4593, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.08% (0.2781 => 0.2950, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.87% (0.7038 => 0.7451, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.86% (0.2782 => 0.2945, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.82% (0.2596 => 0.2747, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.79% (0.2607 => 0.2758, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.64% (0.5265 => 0.5562, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.64% (0.4062 => 0.4291, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.62% (0.2721 => 0.2874, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.2655 => 0.2804, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.61% (1.9828 => 2.0940, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/fibo: 5.59% (0.2628 => 0.2775, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.58% (0.2726 => 0.2878, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.51% (0.2760 => 0.2912, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.45% (0.2937 => 0.3097, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.43% (0.2761 => 0.2911, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.38% (0.2696 => 0.2841, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.30% (0.3489 => 0.3674, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.28% (3.9660 => 4.1755, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.25% (0.3580 => 0.3768, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.15% (0.3107 => 0.3267, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.14% (0.3149 => 0.3311, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.13% (0.3899 => 0.4099, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.11% (0.3485 => 0.3663, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.71% (0.3293 => 0.3448, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 4.69% (0.3453 => 0.3615, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 4.65% (0.2988 => 0.3127, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.58% (0.3534 => 0.3696, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.51% (0.6959 => 0.7273, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.48% (0.4016 => 0.4196, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.28% (0.4390 => 0.4578, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 4.27% (16.6129 => 17.3216, std. dev.: 0.0185) MultiSource/Applications/SPASS/SPASS: 4.22% (13.8202 => 14.4036, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: 4.21% (0.3868 => 0.4031, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.03% (0.2925 => 0.3043, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.01% (0.9199 => 0.9568, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.84% (1.2193 => 1.2661, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.82% (0.5577 => 0.5790, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.81% (13.2842 => 13.7902, std. dev.: 0.0078) MultiSource/Applications/spiff/spiff: 3.72% (0.7506 => 0.7785, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.65% (1.2292 => 1.2741, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.62% (0.5637 => 0.5841, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.59% (7.2180 => 7.4771, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.52% (1.3819 => 1.4305, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.52% (0.4379 => 0.4533, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.51% (1.4563 => 1.5074, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (3.8646 => 3.9997, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.48% (1.3813 => 1.4294, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 3.33% (1.1061 => 1.1429, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.30% (1.1364 => 1.1739, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.24% (1.3245 => 1.3674, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3246 => 0.3351, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.20% (0.3755 => 0.3875, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.12% (0.7460 => 0.7693, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.12% (1.9270 => 1.9871, std. dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0907, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.65% (3.6692 => 3.7664, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 2.45% (6.5754 => 6.7367, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.45% (4.9865 => 5.1088, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (4.3801 => 4.4821, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 2.31% (14.8535 => 15.1969, std. dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/football/football: 2.29% (0.8310 => 0.8500, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.20% (4.4433 => 4.5409, std. dev.: 0.0051) MultiSource/Applications/siod/siod: 2.17% (2.1791 => 2.2263, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.05% (0.8698 => 0.8876, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.02% (0.6135 => 0.6259, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.79% (16.2614 => 16.5527, std. dev.: 0.0279) MultiSource/Applications/d/make_dparser: 1.75% (3.1889 => 3.2448, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 1.73% (14.5298 => 14.7817, std. dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2923, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.85% (1.8175 => 2.2691, std. dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1911, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.25% (1.2998 => 1.3940, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.97% (7.4271 => 7.7217, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9195, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6773, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4803, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1892, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.66% (3.6469 => 3.7076, std. dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9578, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1869, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.07% (22.5627 => 20.9679, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.75% (0.0997 => 0.0840, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.19% (1.2308 => 1.1054, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.71% (20.3410 => 18.5699, std. dev.: 0.0587) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0083) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9124, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6005, std. dev.: 0.0116) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5070, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: -1.75% (3.0263 => 2.9732, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2482, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.61% (26.5159 => 26.0890, std. dev.: 0.0449) SingleSource/Benchmarks/Shootout/heapsort: -1.58% (3.9173 => 3.8556, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7949, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.27% (0.9692 => 0.9569, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2375, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2500, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2285, std. dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 02:39:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 04:39:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120713093921.BBB822A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2029?compare_to=2026&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2029, Order: 160163, Start Time: 2012-07-13 08:21:23, End Time: 2012-07-13 09:39:29 To: 2026, Order: 160162, Start Time: 2012-07-13 06:32:24, End Time: 2012-07-13 07:53:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (55 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (799 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.80% (55.5553 => 56.5577, std. dev.: 0.0183) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.87% (10.3673 => 13.5681, std. dev.: 0.0091) SingleSource/UnitTests/ObjC/trivial-interface: 12.27% (0.3473 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.92% (0.3497 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.92% (0.3516 => 0.3935, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.85% (0.3543 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.85% (0.3543 => 0.3963, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.85% (0.3561 => 0.3983, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 11.40% (0.3694 => 0.4115, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.28% (1.1194 => 1.2457, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions: 11.08% (0.3828 => 0.4252, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.85% (0.3927 => 0.4353, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.79% (1.7609 => 1.8980, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.72% (2.2022 => 2.3723, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.43% (0.6030 => 0.6418, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.31% (0.5925 => 0.6299, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.52% (0.2065 => 0.2179, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 5.09% (0.7326 => 0.7699, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.56% (7.0540 => 7.3755, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.44% (0.3177 => 0.3318, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 4.08% (0.3282 => 0.3416, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.96% (0.4879 => 0.5072, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.89% (10.4361 => 10.8425, std. dev.: 0.0071) MultiSource/Applications/lambda-0_1_3/lambda: 3.55% (0.7433 => 0.7697, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.22% (0.8172 => 0.8435, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.77% (0.4615 => 0.4743, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (5.0018 => 5.1361, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.51% (8.1363 => 8.3405, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.46% (4.9449 => 5.0667, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (14.3668 => 14.7053, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: 2.30% (0.7835 => 0.8015, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 2.14% (1.5603 => 1.5937, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5860 => 0.5981, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.04% (4.2646 => 4.3518, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.95% (9.4845 => 9.6699, std. dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.79% (2.0665 => 2.1035, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.73% (1.1861 => 1.2066, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.46% (0.8067 => 0.8185, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.37% (5.7591 => 5.8381, std. dev.: 0.0059) MultiSource/Applications/d/make_dparser: 1.34% (3.3354 => 3.3802, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.29% (1.5415 => 1.5614, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.26% (3.8723 => 3.9210, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.11% (0.9765 => 0.9873, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.06% (1.2842 => 1.2978, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.05% (17.1811 => 17.3618, std. dev.: 0.0160) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.80% (1.1145 => 1.1903, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7538, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.05% (26.0924 => 26.6284, std. dev.: 0.0452) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.5086 => 1.5376, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4460, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2431, std. dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6880, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.41% (5.2763 => 3.1443, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.33% (5.3855 => 3.6983, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.07% (5.3526 => 3.6898, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.70% (2.9384 => 2.5359, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -10.67% (22.1758 => 19.8094, std. dev.: 0.0171) SingleSource/UnitTests/Vector/constpool: -5.13% (54.1659 => 51.3888, std. dev.: 0.0606) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.75% (3.8922 => 3.7851, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.33% (0.0998 => 0.0835, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -10.05% (1.2373 => 1.1129, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.27% (19.9488 => 18.4981, std. dev.: 0.0363) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.78% (8.1563 => 7.9298, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6821, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0852, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: -1.20% (1.4460 => 1.4286, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 04:12:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 06:12:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120713111253.A5EC32A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2030?compare_to=2027&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2030, Order: 160163, Start Time: 2012-07-13 08:29:35, End Time: 2012-07-13 11:13:02 To: 2027, Order: 160161, Start Time: 2012-07-13 05:15:35, End Time: 2012-07-13 08:01:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (43 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (850 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.13% (125.0021 => 131.4209, std. dev.: 0.2270) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.48% (0.3446 => 0.3876, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.44% (0.3465 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.41% (0.3488 => 0.3921, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 12.34% (0.3469 => 0.3897, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3442 => 0.3865, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.27% (0.3496 => 0.3925, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 12.25% (0.3460 => 0.3884, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.92% (0.3650 => 0.4085, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.78% (0.3643 => 0.4072, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3724 => 0.4149, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.09% (0.5826 => 0.6239, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.76% (0.5889 => 0.6287, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.35% (0.7171 => 0.7555, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.63% (3.5627 => 3.7277, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.55% (1.6211 => 1.6948, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.20% (0.5900 => 0.6148, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.17% (0.4361 => 0.4543, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.77% (0.4029 => 0.4181, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.73% (1.3152 => 1.3642, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.64% (0.4994 => 0.5176, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.59% (0.3930 => 0.4071, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.48% (0.5026 => 0.5201, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.38% (0.5000 => 0.5169, std. dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.38% (2.7292 => 2.8214, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.32% (4.2109 => 4.3508, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (1.9694 => 2.0328, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 3.02% (0.9909 => 1.0208, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 2.94% (23.5202 => 24.2128, std. dev.: 0.0306) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.87% (1.9966 => 2.0539, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 2.79% (1.0781 => 1.1082, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.77% (2.0673 => 2.1246, std. dev.: 0.0089) MultiSource/Applications/hbd/hbd: 2.65% (0.9697 => 0.9954, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.62% (0.4658 => 0.4780, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.35% (5.5417 => 5.6718, std. dev.: 0.0140) MultiSource/Benchmarks/MallocBench/gs/gs: 2.33% (1.8794 => 1.9232, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 2.26% (2.1013 => 2.1488, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (4.4195 => 4.5172, std. dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 2.18% (2.1653 => 2.2124, std. dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 2.13% (4.6177 => 4.7159, std. dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 2.05% (1.5932 => 1.6258, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 1.97% (0.7875 => 0.8030, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.68% (1.4269 => 1.4509, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.90% (11.9555 => 11.7282, std. dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 05:01:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 07:01:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120713120135.AA9D82A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2031?compare_to=2028&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2031, Order: 160166, Start Time: 2012-07-13 10:47:52, End Time: 2012-07-13 12:01:43 To: 2028, Order: 160163, Start Time: 2012-07-13 08:13:13, End Time: 2012-07-13 09:27:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (126 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (727 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.10% (79.1702 => 80.0414, std. dev.: 0.3298) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.83% (2.0176 => 2.2966, std. dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference-object: 9.59% (0.5818 => 0.6376, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.53% (0.5748 => 0.6296, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.20% (0.3578 => 0.3907, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.91% (0.3601 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.83% (0.3646 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.82% (0.3650 => 0.3972, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.78% (0.3623 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.76% (0.3663 => 0.3984, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.66% (0.3789 => 0.4117, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.64% (0.7061 => 0.7671, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: 8.53% (0.3914 => 0.4248, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.37% (0.4003 => 0.4338, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.25% (0.3940 => 0.4265, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.15% (0.1986 => 0.2128, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 6.51% (1.3693 => 1.4584, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.41% (0.7710 => 0.8204, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 6.08% (0.2781 => 0.2950, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (0.4328 => 0.4591, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.79% (0.2782 => 0.2943, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.76% (0.2690 => 0.2845, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.70% (0.2596 => 0.2744, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 5.69% (0.4062 => 0.4293, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.65% (0.2655 => 0.2805, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.59% (0.2628 => 0.2775, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.59% (0.3022 => 0.3191, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2765 => 0.2919, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.56% (0.7038 => 0.7429, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.55% (0.5265 => 0.5557, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.50% (0.2726 => 0.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.48% (0.2721 => 0.2870, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.47% (1.9828 => 2.0913, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.43% (0.2966 => 0.3127, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.33% (0.2760 => 0.2907, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.28% (3.9660 => 4.1753, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 5.21% (0.3149 => 0.3313, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.3107 => 0.3268, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.11% (0.3580 => 0.3763, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.10% (0.3489 => 0.3667, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.05% (0.3899 => 0.4096, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.96% (0.3485 => 0.3658, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.89% (0.3192 => 0.3348, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.81% (0.3453 => 0.3619, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3293 => 0.3446, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 4.62% (0.2988 => 0.3126, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.58% (0.6959 => 0.7278, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 4.50% (0.3534 => 0.3693, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.39% (0.3756 => 0.3921, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.2945 => 0.3072, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.28% (0.4390 => 0.4578, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 4.16% (16.6129 => 17.3037, std. dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/moments: 4.14% (0.3868 => 0.4028, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.08% (0.9199 => 0.9574, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.03% (13.8202 => 14.3770, std. dev.: 0.0076) MultiSource/Benchmarks/McCat/09-vor/vor: 3.90% (0.2925 => 0.3039, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.90% (1.2193 => 1.2668, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.73% (13.2842 => 13.7802, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.73% (0.5577 => 0.5785, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.60% (1.2292 => 1.2735, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 3.60% (0.7506 => 0.7776, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.52% (0.4379 => 0.4533, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.52% (7.2180 => 7.4718, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.49% (0.5637 => 0.5834, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.47% (0.2914 => 0.3015, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.41% (1.4563 => 1.5059, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 3.38% (3.8646 => 3.9952, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.37% (1.3813 => 1.4278, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.31% (1.1061 => 1.1427, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.30% (0.3755 => 0.3879, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.29% (1.3819 => 1.4274, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (1.3245 => 1.3671, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.20% (1.1364 => 1.1728, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3246 => 0.3349, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.08% (0.7460 => 0.7690, std. dev.: 0.0045) MultiSource/Applications/treecc/treecc: 2.99% (1.9270 => 1.9846, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0907, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.83% (3.6692 => 3.7729, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 2.45% (0.8310 => 0.8514, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.41% (4.9865 => 5.1067, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.37% (4.3801 => 4.4840, std. dev.: 0.0101) MultiSource/Applications/JM/lencod/lencod: 2.33% (14.8535 => 15.1993, std. dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 2.26% (6.5754 => 6.7243, std. dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.08% (4.4433 => 4.5357, std. dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (0.8698 => 0.8873, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.91% (1.1333 => 1.1550, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6135 => 0.6252, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.75% (14.5298 => 14.7838, std. dev.: 0.0067) MultiSource/Applications/d/make_dparser: 1.74% (3.1889 => 3.2445, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 1.73% (16.2614 => 16.5433, std. dev.: 0.0207) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (1.2749 => 1.2906, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2635, std. dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.54% (2.0200 => 2.1925, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.14% (1.2998 => 1.3796, std. dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7359, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9211, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6775, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8311, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.38% (1.0310 => 1.0555, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1895, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.59% (3.6469 => 3.7048, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5089 => 1.5327, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.20% (1.9290 => 1.9521, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.34% (0.4657 => 0.3989, std. dev.: 0.0151) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.10% (22.5627 => 20.9608, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.61% (0.8818 => 0.8588, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.05% (0.0997 => 0.0847, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2308 => 1.1038, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.93% (20.3410 => 18.5242, std. dev.: 0.0479) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.06% (1.3780 => 1.3083, std. dev.: 0.0083) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9124, std. dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.42% (8.8259 => 8.6124, std. dev.: 0.0079) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5093, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: -1.74% (3.0263 => 2.9736, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.63% (26.5159 => 26.0844, std. dev.: 0.0345) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2529, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7963, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8623, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.33% (9.3358 => 9.2115, std. dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2514, std. dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2408, std. dev.: 0.0081) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 05:06:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 07:06:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120713120600.6B8AF2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2032?compare_to=2029&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2032, Order: 160166, Start Time: 2012-07-13 10:47:58, End Time: 2012-07-13 12:06:08 To: 2029, Order: 160163, Start Time: 2012-07-13 08:21:23, End Time: 2012-07-13 09:39:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (57 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (797 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.84% (2.3211 => 2.2785, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.97% (10.3673 => 13.5784, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 12.18% (0.3473 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.89% (0.3516 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.87% (0.3497 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.85% (0.3543 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.68% (0.3561 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.34% (0.3694 => 0.4113, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.30% (1.1194 => 1.2459, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.80% (0.3927 => 0.4351, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.82% (1.7609 => 1.8986, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.73% (2.2022 => 2.3725, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.2065 => 0.2203, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.42% (0.6030 => 0.6417, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.30% (0.5925 => 0.6298, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.05% (0.7326 => 0.7696, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.55% (7.0540 => 7.3752, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.47% (0.3177 => 0.3319, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.02% (0.4879 => 0.5075, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 3.99% (0.3282 => 0.3413, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 3.95% (10.4361 => 10.8480, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.41% (0.5569 => 0.5759, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 3.26% (0.7433 => 0.7675, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.86% (0.8172 => 0.8406, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.82% (0.4615 => 0.4745, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.49% (8.1363 => 8.3388, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.48% (5.0018 => 5.1260, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.45% (4.9449 => 5.0662, std. dev.: 0.0048) MultiSource/Applications/spiff/spiff: 2.41% (0.7835 => 0.8024, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.22% (9.4845 => 9.6949, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (14.3668 => 14.6755, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.06% (4.2646 => 4.3524, std. dev.: 0.0043) MultiSource/Applications/hbd/hbd: 2.06% (1.5603 => 1.5924, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.91% (0.5860 => 0.5972, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.74% (2.0665 => 2.1024, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 1.68% (1.1642 => 1.1838, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.67% (1.1861 => 1.2059, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.45% (0.8067 => 0.8184, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 1.44% (2.0273 => 2.0564, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 1.41% (5.7591 => 5.8401, std. dev.: 0.0142) MultiSource/Applications/d/make_dparser: 1.36% (3.3354 => 3.3807, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.30% (1.3050 => 1.3220, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.26% (1.5415 => 1.5609, std. dev.: 0.0044) MultiSource/Applications/lua/lua: 1.22% (3.8723 => 3.9197, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.19% (0.9765 => 0.9881, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7491, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.29% (1.5086 => 1.5431, std. dev.: 0.0066) MultiSource/Applications/lua/lua: 2.20% (26.0924 => 26.6668, std. dev.: 0.0233) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4473, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2376, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.29% (2.6546 => 2.6888, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.46% (5.2763 => 3.1414, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.36% (5.3855 => 3.6967, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.06% (5.3526 => 3.6900, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.65% (2.9384 => 2.5373, std. dev.: 0.0214) MultiSource/Applications/ClamAV/clamscan: -10.68% (22.1758 => 19.8067, std. dev.: 0.0194) SingleSource/UnitTests/Vector/constpool: -5.11% (54.1659 => 51.3955, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.83% (3.8922 => 3.7819, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -11.02% (1.2373 => 1.1010, std. dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.97% (19.9488 => 18.5585, std. dev.: 0.0527) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9159, std. dev.: 0.0058) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6858, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0822, std. dev.: 0.0026) MultiSource/Applications/lemon/lemon: -1.11% (1.4460 => 1.4299, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 07:20:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 09:20:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120713142010.1B54B2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2033?compare_to=2031&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2033, Order: 160167, Start Time: 2012-07-13 13:06:26, End Time: 2012-07-13 14:20:16 To: 2031, Order: 160166, Start Time: 2012-07-13 10:47:52, End Time: 2012-07-13 12:01:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (126 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (728 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.62% (1.3796 => 1.4157, std. dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.82% (2.0176 => 2.2964, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.64% (0.5818 => 0.6379, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.60% (0.5748 => 0.6300, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.17% (0.3578 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.91% (0.3601 => 0.3922, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.90% (0.3650 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.83% (0.3646 => 0.3968, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.79% (0.3663 => 0.3985, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.75% (0.3623 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.68% (0.7061 => 0.7674, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.63% (0.3789 => 0.4116, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 8.61% (0.3914 => 0.4251, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.42% (0.4003 => 0.4340, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.32% (0.3940 => 0.4268, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.05% (0.1986 => 0.2126, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 6.69% (1.3693 => 1.4609, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2781 => 0.2957, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (0.4328 => 0.4591, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.07% (0.7710 => 0.8178, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.97% (0.2782 => 0.2948, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.84% (0.2690 => 0.2847, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.80% (0.7038 => 0.7446, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.79% (0.2607 => 0.2758, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.78% (0.2596 => 0.2746, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.66% (0.3022 => 0.3193, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.64% (0.4062 => 0.4291, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.2655 => 0.2804, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.60% (0.5265 => 0.5560, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.59% (0.2628 => 0.2775, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.58% (0.2937 => 0.3101, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.52% (1.9828 => 2.0923, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.51% (0.2721 => 0.2871, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.50% (0.2726 => 0.2876, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.26% (3.9660 => 4.1746, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.25% (0.3485 => 0.3668, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.19% (0.3489 => 0.3670, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.16% (0.3899 => 0.4100, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.15% (0.3107 => 0.3267, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.13% (0.6959 => 0.7316, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 5.08% (0.3192 => 0.3354, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.92% (0.3293 => 0.3455, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 4.89% (0.3453 => 0.3622, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.4016 => 0.4205, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.65% (0.2988 => 0.3127, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.31% (0.4390 => 0.4579, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.20% (16.6129 => 17.3100, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 4.08% (13.8202 => 14.3846, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.08% (0.9199 => 0.9574, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.00% (0.2925 => 0.3042, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.81% (1.2193 => 1.2658, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.74% (1.2292 => 1.2752, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.71% (13.2842 => 13.7776, std. dev.: 0.0190) MultiSource/Applications/spiff/spiff: 3.65% (0.7506 => 0.7780, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.64% (0.5577 => 0.5780, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.60% (3.8646 => 4.0037, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.57% (0.5637 => 0.5838, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.55% (7.2180 => 7.4744, std. dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.54% (0.4379 => 0.4534, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.50% (1.3245 => 1.3708, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.2914 => 0.3014, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (1.4563 => 1.5057, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.36% (1.3813 => 1.4277, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.36% (0.3246 => 0.3355, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.31% (1.3819 => 1.4277, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 3.27% (1.1061 => 1.1423, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.24% (1.1364 => 1.1732, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.12% (0.3755 => 0.3872, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.03% (0.7460 => 0.7686, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.97% (1.0594 => 1.0909, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 2.92% (1.9270 => 1.9833, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.62% (3.6692 => 3.7654, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.44% (4.9865 => 5.1082, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 2.38% (0.8310 => 0.8508, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.36% (14.8535 => 15.2046, std. dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.27% (4.3801 => 4.4794, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.25% (6.5754 => 6.7233, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.16% (0.8698 => 0.8886, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.14% (2.1791 => 2.2258, std. dev.: 0.0138) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.13% (4.4433 => 4.5379, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.00% (0.6135 => 0.6258, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.85% (1.1333 => 1.1543, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 1.80% (14.5298 => 14.7919, std. dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: 1.80% (16.2614 => 16.5547, std. dev.: 0.0207) MultiSource/Applications/d/make_dparser: 1.74% (3.1889 => 3.2444, std. dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 1.56% (1.2749 => 1.2948, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.68% (1.8175 => 2.2661, std. dev.: 0.0266) SingleSource/Benchmarks/Misc/mandel-2: 8.92% (1.2998 => 1.4157, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.44% (2.0200 => 2.1904, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.48% (1.5824 => 1.7007, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.22% (7.4271 => 7.7406, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9188, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6778, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4782, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5334, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.58% (3.6469 => 3.7047, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.13% (22.5627 => 20.9541, std. dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.57% (0.8818 => 0.8591, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1126, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.78% (20.3410 => 18.5543, std. dev.: 0.0233) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3107, std. dev.: 0.0241) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -3.19% (1.9762 => 1.9132, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.48% (8.8259 => 8.6066, std. dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4476, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5055, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: -1.82% (3.0263 => 2.9711, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2573, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7945, std. dev.: 0.0015) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1250, std. dev.: 0.0234) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2244, std. dev.: 0.0397) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2543, std. dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: -1.16% (7.3305 => 7.2457, std. dev.: 0.0096) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 07:23:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 09:23:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120713142338.E04A32A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2034?compare_to=2030&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2034, Order: 160166, Start Time: 2012-07-13 11:40:47, End Time: 2012-07-13 14:23:47 To: 2030, Order: 160163, Start Time: 2012-07-13 08:29:35, End Time: 2012-07-13 11:13:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (44 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (849 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.39% (0.3496 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.33% (0.3446 => 0.3871, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.27% (0.3465 => 0.3890, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.23% (0.3442 => 0.3863, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3460 => 0.3883, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.18% (0.3488 => 0.3913, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.14% (0.3469 => 0.3890, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.84% (0.3650 => 0.4082, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 11.69% (0.3643 => 0.4069, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3724 => 0.4146, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.05% (0.5826 => 0.6237, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 6.84% (0.5889 => 0.6292, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.1620 => 0.1726, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.33% (0.7171 => 0.7553, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.54% (3.5627 => 3.7243, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.49% (0.5900 => 0.6165, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.41% (1.6211 => 1.6926, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.99% (0.4361 => 0.4535, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.76% (1.3152 => 1.3647, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.70% (0.4994 => 0.5179, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.67% (0.4029 => 0.4177, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.62% (0.5000 => 0.5181, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.59% (0.3930 => 0.4071, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (0.5026 => 0.5199, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 3.31% (4.2109 => 4.3501, std. dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.26% (2.7292 => 2.8181, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.06% (1.9694 => 2.0296, std. dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: 2.94% (23.5202 => 24.2115, std. dev.: 0.0135) MultiSource/Applications/hexxagon/hexxagon: 2.93% (0.9909 => 1.0199, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.77% (1.9966 => 2.0519, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.67% (2.0673 => 2.1226, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 2.63% (1.0781 => 1.1065, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.51% (0.4658 => 0.4775, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 2.47% (0.9697 => 0.9937, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.21% (5.5417 => 5.6643, std. dev.: 0.0088) MultiSource/Applications/JM/ldecod/ldecod: 2.15% (2.1653 => 2.2119, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 2.15% (2.1013 => 2.1464, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.11% (4.6177 => 4.7153, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.11% (4.4195 => 4.5127, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.05% (1.8794 => 1.9180, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 2.02% (1.5932 => 1.6254, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.84% (0.7875 => 0.8020, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.65% (1.4269 => 1.4505, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.95% (11.9555 => 11.7224, std. dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 07:24:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 09:24:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120713142425.06E802A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2035?compare_to=2032&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2035, Order: 160167, Start Time: 2012-07-13 13:06:19, End Time: 2012-07-13 14:24:32 To: 2032, Order: 160166, Start Time: 2012-07-13 10:47:58, End Time: 2012-07-13 12:06:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (796 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.07% (10.3673 => 13.5881, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 12.24% (0.3473 => 0.3898, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.04% (0.3497 => 0.3918, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.00% (0.3516 => 0.3938, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.91% (0.3543 => 0.3965, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: 11.68% (0.3561 => 0.3977, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.35% (1.1194 => 1.2465, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.34% (0.3694 => 0.4113, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.75% (0.3927 => 0.4349, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.80% (1.7609 => 1.8982, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.72% (2.2022 => 2.3721, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.37% (0.6030 => 0.6414, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5925 => 0.6293, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2065 => 0.2180, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.12% (0.7326 => 0.7701, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.60% (7.0540 => 7.3783, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.47% (0.3177 => 0.3319, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.28% (0.4879 => 0.5088, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 3.99% (0.3282 => 0.3413, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.89% (10.4361 => 10.8425, std. dev.: 0.0085) MultiSource/Applications/lambda-0_1_3/lambda: 3.20% (0.7433 => 0.7671, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.17% (0.8172 => 0.8431, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.82% (0.5569 => 0.5726, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.80% (0.4615 => 0.4744, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.56% (5.0018 => 5.1297, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.54% (8.1363 => 8.3432, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.44% (4.9449 => 5.0657, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.25% (14.3668 => 14.6896, std. dev.: 0.0166) MultiSource/Applications/spiff/spiff: 2.22% (0.7835 => 0.8009, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 2.16% (1.1642 => 1.1893, std. dev.: 0.0048) MultiSource/Applications/hbd/hbd: 2.11% (1.5603 => 1.5933, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.06% (4.2646 => 4.3523, std. dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: 1.98% (9.4845 => 9.6726, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.96% (0.5860 => 0.5975, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (2.0665 => 2.1031, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.69% (1.1861 => 1.2062, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.52% (2.0273 => 2.0581, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.50% (1.3050 => 1.3246, std. dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 1.40% (5.7591 => 5.8399, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 1.31% (3.3354 => 3.3791, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.30% (3.8723 => 3.9225, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.28% (1.5415 => 1.5613, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.15% (0.9765 => 0.9877, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.06% (1.4186 => 1.4336, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7501, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.36% (1.0313 => 1.0556, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.22% (26.0924 => 26.6724, std. dev.: 0.0933) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5366, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.49% (1.3045 => 1.3239, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2406, std. dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.21% (2.6546 => 2.6866, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.43% (5.2763 => 3.1432, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.37% (5.3855 => 3.6961, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.02% (5.3526 => 3.6921, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.63% (2.9384 => 2.5378, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -10.68% (22.1758 => 19.8065, std. dev.: 0.0095) SingleSource/UnitTests/Vector/constpool: -5.13% (54.1659 => 51.3879, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.67% (3.8922 => 3.7884, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2373 => 1.1019, std. dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.31% (19.9488 => 18.4896, std. dev.: 0.1050) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9130, std. dev.: 0.0145) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6895, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0857, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.02% (1.4460 => 1.4312, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 09:01:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 11:01:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120713160149.ECFC82A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2036?compare_to=2033&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2036, Order: 160173, Start Time: 2012-07-13 14:48:10, End Time: 2012-07-13 16:01:57 To: 2033, Order: 160167, Start Time: 2012-07-13 13:06:26, End Time: 2012-07-13 14:20:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (124 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (729 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.51% (54.1740 => 56.6152, std. dev.: 0.0106) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.57% (2.0176 => 2.2914, std. dev.: 0.0151) SingleSource/UnitTests/ObjC++/property-reference-object: 9.80% (0.5818 => 0.6388, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 9.71% (0.5748 => 0.6306, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.19% (0.7061 => 0.7710, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3578 => 0.3889, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3601 => 0.3906, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.26% (0.3646 => 0.3947, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.25% (0.3650 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.19% (0.3663 => 0.3963, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 8.13% (0.3789 => 0.4097, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions: 8.12% (0.3914 => 0.4232, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 8.11% (0.3623 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.92% (0.4003 => 0.4320, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.77% (0.3940 => 0.4246, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.90% (0.1986 => 0.2123, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.77% (1.3693 => 1.4620, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (0.4328 => 0.4591, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.98% (0.7710 => 0.8171, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.94% (0.7038 => 0.7456, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 5.86% (0.2781 => 0.2944, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.66% (0.2596 => 0.2743, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2607 => 0.2754, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2782 => 0.2937, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.55% (0.5265 => 0.5557, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/random: 5.54% (0.2690 => 0.2839, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.46% (0.3899 => 0.4112, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.46% (0.2655 => 0.2800, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.42% (0.4062 => 0.4282, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3022 => 0.3185, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 5.37% (0.2628 => 0.2769, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.32% (0.2761 => 0.2908, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.32% (0.2726 => 0.2871, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.32% (0.2765 => 0.2912, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.30% (1.9828 => 2.0879, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.29% (0.2760 => 0.2906, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.28% (0.3580 => 0.3769, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 5.28% (0.2937 => 0.3092, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2696 => 0.2834, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.09% (3.9660 => 4.1680, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.08% (0.3485 => 0.3662, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.07% (0.3489 => 0.3666, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.07% (0.2721 => 0.2859, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.06% (0.4390 => 0.4612, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 4.96% (0.3107 => 0.3261, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.92% (0.3149 => 0.3304, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.83% (0.6959 => 0.7295, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 4.70% (0.3192 => 0.3342, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.63% (0.3453 => 0.3613, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.52% (0.2988 => 0.3123, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.40% (0.3293 => 0.3438, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.36% (0.3534 => 0.3688, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.30% (16.6129 => 17.3272, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4016 => 0.4187, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.01% (0.9199 => 0.9568, std. dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: 4.00% (13.8202 => 14.3724, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/moments: 3.96% (0.3868 => 0.4021, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.94% (0.2945 => 0.3061, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 3.90% (0.2925 => 0.3039, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.71% (0.5577 => 0.5784, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 3.70% (0.7506 => 0.7784, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.69% (1.2193 => 1.2643, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.68% (13.2842 => 13.7736, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.61% (1.3245 => 1.3723, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.46% (0.5637 => 0.5832, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.46% (1.2292 => 1.2717, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.45% (0.4379 => 0.4530, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 3.40% (3.8646 => 3.9961, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.33% (0.3246 => 0.3354, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.31% (7.2180 => 7.4569, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.28% (1.4563 => 1.5040, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.19% (1.9270 => 1.9885, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 3.17% (1.1061 => 1.1412, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.16% (1.1364 => 1.1723, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.12% (1.3813 => 1.4244, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.06% (0.7460 => 0.7688, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.04% (1.3819 => 1.4239, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.04% (0.3755 => 0.3869, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.94% (1.0594 => 1.0905, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.47% (3.6692 => 3.7599, std. dev.: 0.0113) MultiSource/Applications/siod/siod: 2.38% (2.1791 => 2.2310, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.36% (4.9865 => 5.1042, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8310 => 0.8502, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (4.3801 => 4.4762, std. dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (6.5754 => 6.7195, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 2.15% (14.8535 => 15.1724, std. dev.: 0.0100) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.03% (4.4433 => 4.5333, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.94% (0.8698 => 0.8867, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.80% (1.1333 => 1.1537, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 1.74% (14.5298 => 14.7821, std. dev.: 0.0077) MultiSource/Applications/d/make_dparser: 1.71% (3.1889 => 3.2435, std. dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 1.63% (16.2614 => 16.5264, std. dev.: 0.0166) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 24.94% (1.8175 => 2.2707, std. dev.: 0.0473) SingleSource/Benchmarks/Misc/mandel-2: 8.71% (1.2998 => 1.4130, std. dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1912, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7299, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1891, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5345, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.57% (3.6469 => 3.7041, std. dev.: 0.0054) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5106, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.60% (0.4657 => 0.4070, std. dev.: 0.0113) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.09% (22.5627 => 20.9630, std. dev.: 0.0171) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.93% (0.8818 => 0.8560, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.45% (0.0997 => 0.0843, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.69% (1.2308 => 1.0992, std. dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.97% (20.3410 => 18.5155, std. dev.: 0.0451) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.98% (1.3780 => 1.3094, std. dev.: 0.0060) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9125, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5995, std. dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5028, std. dev.: 0.0054) MultiSource/Applications/spiff/spiff: -1.80% (3.0263 => 2.9717, std. dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2589, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7954, std. dev.: 0.0022) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1321, std. dev.: 0.0415) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8615, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2365, std. dev.: 0.0193) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2170, std. dev.: 0.0291) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2531, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 09:10:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 11:10:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120713161029.978542A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2037?compare_to=2035&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2037, Order: 160173, Start Time: 2012-07-13 14:52:21, End Time: 2012-07-13 16:10:38 To: 2035, Order: 160167, Start Time: 2012-07-13 13:06:19, End Time: 2012-07-13 14:24:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (59 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.35% (0.7701 => 0.7805, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.31% (1.1019 => 1.1163, std. dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.95% (10.3673 => 13.6800, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 12.21% (0.3473 => 0.3897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.89% (0.3516 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.84% (0.3497 => 0.3911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.74% (0.3543 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.71% (0.3543 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.68% (0.3561 => 0.3977, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.68% (1.1194 => 1.2501, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/for-in: 11.32% (0.3694 => 0.4112, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.87% (0.3927 => 0.4354, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.83% (0.3886 => 0.4307, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.88% (1.7609 => 1.8997, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.73% (2.2022 => 2.3725, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.26% (0.1432 => 0.1536, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.24% (0.5925 => 0.6354, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.08% (0.6030 => 0.6457, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 6.54% (0.7326 => 0.7805, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.42% (0.2065 => 0.2177, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (7.0540 => 7.4009, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.3177 => 0.3327, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.24% (0.4879 => 0.5086, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 4.04% (10.4361 => 10.8576, std. dev.: 0.0146) MultiSource/Applications/lambda-0_1_3/lambda: 3.83% (0.7433 => 0.7718, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 3.81% (0.3282 => 0.3407, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.14% (0.8172 => 0.8429, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.12% (0.4615 => 0.4759, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.0018 => 5.1536, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.84% (0.5569 => 0.5727, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (4.9449 => 5.0770, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.65% (0.7835 => 0.8043, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.60% (14.3668 => 14.7409, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.60% (8.1363 => 8.3478, std. dev.: 0.0080) MultiSource/Applications/hbd/hbd: 2.42% (1.5603 => 1.5980, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.39% (0.4636 => 0.4747, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.34% (0.5860 => 0.5997, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.26% (9.4845 => 9.6984, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.23% (4.2646 => 4.3595, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.21% (2.0665 => 2.1121, std. dev.: 0.0063) MultiSource/Applications/d/make_dparser: 1.95% (3.3354 => 3.4006, std. dev.: 0.0085) MultiSource/Applications/lua/lua: 1.89% (3.8723 => 3.9454, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.86% (1.1861 => 1.2082, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.79% (1.1642 => 1.1850, std. dev.: 0.0056) MultiSource/Applications/treecc/treecc: 1.76% (2.0273 => 2.0629, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.70% (0.8067 => 0.8204, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.67% (5.7591 => 5.8552, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 1.50% (1.2842 => 1.3035, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.50% (1.5415 => 1.5646, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.47% (17.1811 => 17.4339, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.41% (0.9765 => 0.9903, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.25% (1.4186 => 1.4364, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.80% (1.1145 => 1.1903, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7517, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0560, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.24% (26.0924 => 26.6759, std. dev.: 0.0219) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6897, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2330, std. dev.: 0.0107) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1255, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.35% (5.2763 => 3.1471, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.03% (5.3855 => 3.7143, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.74% (5.3526 => 3.7073, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.26% (2.9384 => 2.5487, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -10.42% (22.1758 => 19.8644, std. dev.: 0.0178) SingleSource/UnitTests/Vector/constpool: -4.92% (54.1659 => 51.5009, std. dev.: 0.0768) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.45% (3.8922 => 3.7968, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.78% (1.2373 => 1.1163, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.18% (19.9488 => 18.5172, std. dev.: 0.0485) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.79% (8.1563 => 7.9287, std. dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6845, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0839, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.00% (1.4460 => 1.4315, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 10:34:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 12:34:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120713173428.DB08D2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2038?compare_to=2034&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2038, Order: 160173, Start Time: 2012-07-13 14:51:24, End Time: 2012-07-13 17:34:37 To: 2034, Order: 160166, Start Time: 2012-07-13 11:40:47, End Time: 2012-07-13 14:23:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (44 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (849 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.84% (0.3465 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.83% (0.3446 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.73% (0.3442 => 0.3880, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.70% (0.3496 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.64% (0.3488 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.63% (0.3469 => 0.3907, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3460 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.22% (0.3650 => 0.4096, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions: 12.19% (0.3643 => 0.4087, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3724 => 0.4163, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5826 => 0.6256, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.03% (0.5889 => 0.6303, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 5.52% (0.7171 => 0.7567, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.58% (0.5900 => 0.6170, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.54% (1.6211 => 1.6947, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.52% (3.5627 => 3.7236, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.08% (0.4361 => 0.4539, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.80% (0.4029 => 0.4182, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.58% (0.5026 => 0.5206, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.57% (2.7292 => 2.8267, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.55% (1.3152 => 1.3619, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.49% (0.3930 => 0.4067, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.40% (0.4994 => 0.5164, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.34% (0.5000 => 0.5167, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.32% (4.2109 => 4.3505, std. dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: 3.13% (0.9909 => 1.0219, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.93% (1.9694 => 2.0271, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.90% (2.0673 => 2.1273, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.87% (1.9966 => 2.0539, std. dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 2.80% (23.5202 => 24.1781, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 2.72% (0.9697 => 0.9961, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.71% (0.4658 => 0.4784, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.55% (1.0781 => 1.1056, std. dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: 2.24% (2.1013 => 2.1483, std. dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 2.12% (2.1653 => 2.2112, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (4.4195 => 4.5125, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.10% (4.6177 => 4.7148, std. dev.: 0.0096) MultiSource/Benchmarks/MallocBench/gs/gs: 2.00% (1.8794 => 1.9170, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 1.89% (5.5417 => 5.6467, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.77% (0.7875 => 0.8014, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.75% (1.4269 => 1.4519, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.36% (1.5932 => 1.6148, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.98% (0.2122 => 0.2249, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.99% (11.9555 => 11.7179, std. dev.: 0.0137) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 10:43:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 12:43:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120713174335.5D9B22A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2039?compare_to=2036&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2039, Order: 160174, Start Time: 2012-07-13 16:29:50, End Time: 2012-07-13 17:43:43 To: 2036, Order: 160173, Start Time: 2012-07-13 14:48:10, End Time: 2012-07-13 16:01:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.23% (1.0992 => 1.1127, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.39% (1.4130 => 1.3933, std. dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.52% (2.0176 => 2.2904, std. dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference-object: 9.90% (0.5818 => 0.6394, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 9.73% (0.5748 => 0.6307, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.78% (0.3578 => 0.3892, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.74% (0.7061 => 0.7678, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.53% (0.3601 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.48% (0.3646 => 0.3955, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.45% (0.3623 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.44% (0.3650 => 0.3958, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 8.41% (0.3663 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3789 => 0.4104, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.20% (0.3914 => 0.4235, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.20% (0.3940 => 0.4263, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 8.17% (0.4003 => 0.4330, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.90% (0.1986 => 0.2123, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.86% (1.3693 => 1.4633, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.18% (0.7038 => 0.7473, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.10% (0.7710 => 0.8180, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.05% (0.4328 => 0.4590, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.86% (0.2781 => 0.2944, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.79% (0.2782 => 0.2943, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3022 => 0.3194, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.68% (0.2607 => 0.2755, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.62% (0.2596 => 0.2742, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.55% (0.5265 => 0.5557, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 5.54% (0.4062 => 0.4287, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.52% (0.2628 => 0.2773, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.47% (0.2726 => 0.2875, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.46% (1.9828 => 2.0911, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.40% (0.2760 => 0.2909, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.2966 => 0.3126, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 5.38% (0.2937 => 0.3095, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.38% (0.2696 => 0.2841, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.33% (0.3899 => 0.4107, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3489 => 0.3675, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.24% (3.9660 => 4.1740, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.20% (0.3580 => 0.3766, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 5.15% (0.3107 => 0.3267, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.15% (0.2721 => 0.2861, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.05% (0.3485 => 0.3661, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.02% (0.3149 => 0.3307, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.86% (0.3192 => 0.3347, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.72% (0.3453 => 0.3616, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.72% (0.2988 => 0.3129, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.62% (0.3293 => 0.3445, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.53% (0.4016 => 0.4198, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.51% (0.6959 => 0.7273, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists1: 4.50% (0.3534 => 0.3693, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.47% (0.3756 => 0.3924, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.34% (16.6129 => 17.3337, std. dev.: 0.0215) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.33% (0.4390 => 0.4580, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 4.14% (0.3868 => 0.4028, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2945 => 0.3065, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.05% (13.8202 => 14.3797, std. dev.: 0.0099) MultiSource/Benchmarks/McCat/09-vor/vor: 4.03% (0.2925 => 0.3043, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.00% (0.9199 => 0.9567, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.85% (13.2842 => 13.7950, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.81% (1.2193 => 1.2657, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.71% (0.5577 => 0.5784, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.60% (1.2292 => 1.2734, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.54% (0.4379 => 0.4534, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.47% (3.8646 => 3.9987, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.47% (7.2180 => 7.4684, std. dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.47% (0.2914 => 0.3015, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.45% (0.7506 => 0.7765, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.44% (1.3245 => 1.3701, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 3.42% (1.1061 => 1.1439, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.41% (0.5637 => 0.5829, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.33% (0.3246 => 0.3354, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.20% (1.1364 => 1.1728, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.20% (0.3755 => 0.3875, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.19% (1.4563 => 1.5028, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.16% (1.3813 => 1.4249, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 3.13% (1.9270 => 1.9874, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.08% (1.3819 => 1.4244, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.02% (0.7460 => 0.7685, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.0594 => 1.0896, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.50% (4.9865 => 5.1111, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.49% (3.6692 => 3.7604, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 2.46% (2.1791 => 2.2327, std. dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.34% (4.3801 => 4.4824, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/football/football: 2.21% (0.8310 => 0.8494, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (6.5754 => 6.7195, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.17% (0.8698 => 0.8887, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.16% (4.4433 => 4.5391, std. dev.: 0.0099) MultiSource/Applications/JM/lencod/lencod: 2.15% (14.8535 => 15.1727, std. dev.: 0.0144) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.01% (1.1333 => 1.1561, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.00% (0.6135 => 0.6258, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.81% (3.1889 => 3.2466, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 1.71% (14.5298 => 14.7781, std. dev.: 0.0183) MultiSource/Applications/sqlite3/sqlite3: 1.71% (16.2614 => 16.5392, std. dev.: 0.0230) MultiSource/Applications/SIBsim4/SIBsim4: 1.33% (1.2749 => 1.2919, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.90% (1.8175 => 2.2701, std. dev.: 0.0468) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.40% (2.0200 => 2.1897, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.19% (1.2998 => 1.3933, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (4.5947 => 4.8136, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7315, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6782, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8299, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.27% (1.0310 => 1.0544, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (3.6469 => 3.7086, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5089 => 1.5332, std. dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (1.9290 => 1.9557, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.84% (0.4657 => 0.4152, std. dev.: 0.0080) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.05% (22.5627 => 20.9731, std. dev.: 0.0171) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.87% (0.8818 => 0.8565, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.75% (0.0997 => 0.0840, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1127, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.60% (20.3410 => 18.5926, std. dev.: 0.0668) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3130, std. dev.: 0.0074) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9130, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.8259 => 8.5670, std. dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5022, std. dev.: 0.0046) MultiSource/Applications/spiff/spiff: -1.77% (3.0263 => 2.9727, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9984, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2575, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7956, std. dev.: 0.0019) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1233, std. dev.: 0.0200) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4890, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.31% (9.3358 => 9.2137, std. dev.: 0.0213) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2441, std. dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2546, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8491, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 10:56:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 12:56:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120713175624.8E0BE2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2040?compare_to=2037&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2040, Order: 160174, Start Time: 2012-07-13 16:38:20, End Time: 2012-07-13 17:56:33 To: 2037, Order: 160173, Start Time: 2012-07-13 14:52:21, End Time: 2012-07-13 16:10:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (64 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (790 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.40% (1.1163 => 1.1007, std. dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.12% (10.3673 => 13.6975, std. dev.: 0.0178) SingleSource/UnitTests/ObjC/trivial-interface: 12.55% (0.3473 => 0.3909, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.31% (0.3543 => 0.3979, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3497 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3516 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.08% (0.3543 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.08% (0.3561 => 0.3991, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.72% (0.3694 => 0.4127, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.43% (1.1194 => 1.2473, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3828 => 0.4264, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.30% (0.3886 => 0.4325, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.72% (2.2022 => 2.3723, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.51% (1.7609 => 1.8931, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.11% (0.5925 => 0.6346, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.98% (0.6030 => 0.6451, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.07% (0.7326 => 0.7771, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.86% (0.2065 => 0.2186, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.84% (7.0540 => 7.3957, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.3177 => 0.3327, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.22% (0.4879 => 0.5085, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.07% (10.4361 => 10.8609, std. dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: 3.93% (0.7433 => 0.7725, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 3.87% (0.3282 => 0.3409, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.25% (0.4615 => 0.4765, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.19% (0.8172 => 0.8433, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5569 => 0.5733, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.82% (5.0018 => 5.1430, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.73% (4.9449 => 5.0801, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.71% (8.1363 => 8.3568, std. dev.: 0.0071) MultiSource/Applications/spiff/spiff: 2.71% (0.7835 => 0.8047, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.63% (14.3668 => 14.7452, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.60% (2.0665 => 2.1203, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 2.55% (1.5603 => 1.6001, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.52% (0.4636 => 0.4753, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.42% (4.2646 => 4.3678, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.30% (0.5860 => 0.5995, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.29% (9.4845 => 9.7019, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 2.09% (1.1642 => 1.1885, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.92% (1.1861 => 1.2089, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.91% (0.8067 => 0.8221, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 1.84% (2.0273 => 2.0647, std. dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/bigfib: 1.73% (0.6456 => 0.6568, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.73% (3.3354 => 3.3930, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 1.68% (3.8723 => 3.9372, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.65% (1.3050 => 1.3265, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.64% (1.2842 => 1.3052, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.53% (5.7591 => 5.8471, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.49% (1.5415 => 1.5644, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.47% (0.9765 => 0.9909, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.22% (1.4186 => 1.4359, std. dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 1.22% (17.1811 => 17.3899, std. dev.: 0.0149) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7597, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.25% (26.0924 => 26.6794, std. dev.: 0.0427) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (1.5086 => 1.5365, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4474, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6893, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2341, std. dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.23% (1.3045 => 1.3205, std. dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.33% (5.2763 => 3.1486, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.13% (5.3855 => 3.7089, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.86% (5.3526 => 3.7006, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.44% (2.9384 => 2.5434, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.55% (22.1758 => 19.8352, std. dev.: 0.0085) SingleSource/UnitTests/Vector/constpool: -5.06% (54.1659 => 51.4228, std. dev.: 0.0444) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.55% (3.8922 => 3.7928, std. dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.63% (0.0998 => 0.0842, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.04% (1.2373 => 1.1007, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.12% (19.9488 => 18.5293, std. dev.: 0.0476) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.83% (8.1563 => 7.9255, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6923, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0835, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.04% (1.4460 => 1.4310, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 12:50:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 14:50:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120713195029.4741C2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2041?compare_to=2039&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2041, Order: 160176, Start Time: 2012-07-13 18:36:30, End Time: 2012-07-13 19:50:37 To: 2039, Order: 160174, Start Time: 2012-07-13 16:29:50, End Time: 2012-07-13 17:43:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (124 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (729 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.51% (2.0176 => 2.2902, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 9.87% (0.5818 => 0.6392, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.79% (0.5748 => 0.6311, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.55% (0.7061 => 0.7735, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 8.75% (0.3578 => 0.3891, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3601 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.50% (0.3646 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.47% (0.3650 => 0.3959, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 8.46% (0.3663 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3789 => 0.4107, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.39% (0.3623 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.25% (0.3914 => 0.4237, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.22% (0.4003 => 0.4332, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.07% (0.3940 => 0.4258, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 6.95% (1.3693 => 1.4644, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.55% (0.7710 => 0.8215, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.22% (0.7038 => 0.7476, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.11% (0.2782 => 0.2952, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (0.4328 => 0.4591, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.88% (0.2655 => 0.2811, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.79% (1.9828 => 2.0976, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.72% (0.5265 => 0.5566, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 5.72% (0.2607 => 0.2756, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.70% (0.2596 => 0.2744, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3022 => 0.3194, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 5.69% (0.4062 => 0.4293, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.65% (0.2761 => 0.2917, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.59% (0.2628 => 0.2775, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.51% (0.2760 => 0.2912, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.50% (0.2726 => 0.2876, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.36% (0.3899 => 0.4108, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.28% (0.3580 => 0.3769, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.27% (0.3489 => 0.3673, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.25% (3.9660 => 4.1741, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.15% (0.2721 => 0.2861, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.14% (0.3149 => 0.3311, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.08% (0.3192 => 0.3354, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.06% (0.4390 => 0.4612, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.02% (0.6959 => 0.7308, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.99% (0.3485 => 0.3659, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.87% (0.3453 => 0.3621, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 4.62% (0.2988 => 0.3126, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.62% (0.3293 => 0.3445, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.61% (0.3534 => 0.3697, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.56% (16.6129 => 17.3706, std. dev.: 0.2048) SingleSource/Benchmarks/Shootout-C++/moments: 4.40% (0.3868 => 0.4038, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.24% (0.2945 => 0.3070, std. dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 4.16% (13.8202 => 14.3952, std. dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.08% (0.9199 => 0.9574, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.94% (0.7506 => 0.7802, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.91% (1.2193 => 1.2670, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.82% (13.2842 => 13.7914, std. dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.78% (0.5577 => 0.5788, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.74% (0.2914 => 0.3023, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.69% (1.2292 => 1.2745, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.60% (1.3245 => 1.3722, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.60% (0.5637 => 0.5840, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.59% (1.1061 => 1.1458, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 3.59% (3.8646 => 4.0033, std. dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.52% (0.4379 => 0.4533, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.51% (7.2180 => 7.4710, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.48% (0.3246 => 0.3359, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (1.4563 => 1.5057, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.38% (1.9270 => 1.9921, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.32% (0.7460 => 0.7708, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.29% (1.3819 => 1.4274, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.23% (1.1364 => 1.1731, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.21% (1.3813 => 1.4256, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.20% (0.3755 => 0.3875, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.0594 => 1.0904, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.55% (2.1791 => 2.2347, std. dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.55% (4.9865 => 5.1137, std. dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.52% (3.6692 => 3.7617, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.45% (4.3801 => 4.4872, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.39% (4.4433 => 4.5497, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 2.32% (0.8310 => 0.8503, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.31% (6.5754 => 6.7273, std. dev.: 0.0120) MultiSource/Applications/JM/lencod/lencod: 2.30% (14.8535 => 15.1954, std. dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.17% (0.8698 => 0.8887, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6135 => 0.6263, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.08% (1.1333 => 1.1569, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 1.93% (3.1889 => 3.2503, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 1.82% (16.2614 => 16.5572, std. dev.: 0.0135) MultiSource/Applications/ClamAV/clamscan: 1.72% (14.5298 => 14.7790, std. dev.: 0.0119) MultiSource/Applications/SIBsim4/SIBsim4: 1.31% (1.2749 => 1.2916, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.1007 => 2.1232, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 25.41% (1.8175 => 2.2793, std. dev.: 0.0453) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.22% (2.0200 => 2.1860, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: 7.92% (1.2998 => 1.4027, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.06% (7.4271 => 7.7290, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6800, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4787, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.77% (3.6469 => 3.7113, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5337, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.63% (0.4657 => 0.4162, std. dev.: 0.0128) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.03% (22.5627 => 20.9775, std. dev.: 0.0191) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.02% (1.2308 => 1.1075, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.61% (20.3410 => 18.5901, std. dev.: 0.0264) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.31% (1.3780 => 1.3186, std. dev.: 0.0087) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.61% (2.6470 => 2.5514, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.24% (1.9762 => 1.9121, std. dev.: 0.0148) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5945, std. dev.: 0.0153) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.32% (0.4867 => 0.4754, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5083, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: -1.75% (3.0263 => 2.9733, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9980, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8572, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7949, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.49% (2.5254 => 2.4878, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.49% (6.3560 => 6.2616, std. dev.: 0.0034) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1327, std. dev.: 0.0239) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.27% (0.9692 => 0.9569, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2204, std. dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2518, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2415, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8478, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 12:54:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 14:54:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120713195424.66F772A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2042?compare_to=2040&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2042, Order: 160176, Start Time: 2012-07-13 18:36:21, End Time: 2012-07-13 19:54:33 To: 2040, Order: 160174, Start Time: 2012-07-13 16:38:20, End Time: 2012-07-13 17:56:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (65 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (789 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.94% (3.7646 => 3.8378, std. dev.: 0.0211) SingleSource/Benchmarks/McGill/chomp: 1.20% (1.1007 => 1.1139, std. dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.14% (10.3673 => 13.6990, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/trivial-interface: 12.50% (0.3473 => 0.3907, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.21% (0.3497 => 0.3924, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3516 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3543 => 0.3974, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.11% (0.3543 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.10% (0.3561 => 0.3992, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.72% (0.3694 => 0.4127, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.53% (1.1194 => 1.2485, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.26% (0.3828 => 0.4259, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.25% (0.3886 => 0.4323, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.71% (2.2022 => 2.3719, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.70% (0.3817 => 0.4111, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.47% (1.7609 => 1.8925, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2065 => 0.2210, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 7.01% (0.6030 => 0.6453, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.94% (0.5925 => 0.6336, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.43% (0.7326 => 0.7797, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.84% (7.0540 => 7.3952, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.78% (0.3177 => 0.3329, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.24% (0.4879 => 0.5086, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.06% (0.7433 => 0.7735, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.06% (10.4361 => 10.8599, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 3.93% (0.3282 => 0.3411, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.27% (0.4615 => 0.4766, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.13% (0.8172 => 0.8428, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.98% (5.0018 => 5.1508, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.90% (4.9449 => 5.0882, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.86% (0.5569 => 0.5728, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.82% (8.1363 => 8.3657, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.76% (14.3668 => 14.7631, std. dev.: 0.0076) MultiSource/Applications/spiff/spiff: 2.64% (0.7835 => 0.8042, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.55% (0.4636 => 0.4754, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 2.54% (1.5603 => 1.6000, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.52% (2.0665 => 2.1186, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (4.2646 => 4.3695, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.45% (0.8067 => 0.8265, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 2.30% (9.4845 => 9.7030, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.22% (0.5860 => 0.5990, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.05% (1.1642 => 1.1881, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.95% (1.5415 => 1.5716, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.89% (1.1861 => 1.2085, std. dev.: 0.0063) MultiSource/Applications/treecc/treecc: 1.82% (2.0273 => 2.0641, std. dev.: 0.0074) MultiSource/Applications/d/make_dparser: 1.81% (3.3354 => 3.3957, std. dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.77% (0.6450 => 0.6564, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.70% (1.2842 => 1.3060, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.65% (1.3050 => 1.3265, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 1.64% (0.6456 => 0.6562, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 1.63% (3.8723 => 3.9353, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 1.50% (5.7591 => 5.8455, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.43% (0.9765 => 0.9905, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.37% (17.1811 => 17.4173, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.39% (3.6395 => 3.7628, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.22% (26.0924 => 26.6711, std. dev.: 0.0221) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5357, std. dev.: 0.0102) MultiSource/Benchmarks/llubenchmark/llu: 1.58% (3.7781 => 3.8378, std. dev.: 0.0211) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2382, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6881, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.30% (5.2763 => 3.1502, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.17% (5.3855 => 3.7071, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.85% (5.3526 => 3.7011, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.31% (2.9384 => 2.5472, std. dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: -10.51% (22.1758 => 19.8443, std. dev.: 0.0075) SingleSource/UnitTests/Vector/constpool: -4.96% (54.1659 => 51.4793, std. dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.65% (3.8922 => 3.7890, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.97% (1.2373 => 1.1139, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.76% (19.9488 => 18.6002, std. dev.: 0.0585) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.88% (8.1563 => 7.9217, std. dev.: 0.0096) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.57% (32.5116 => 31.6771, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0845, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: -1.09% (1.4460 => 1.4303, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 13:45:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 15:45:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120713204509.2012A2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2043?compare_to=2038&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2043, Order: 160174, Start Time: 2012-07-13 18:02:23, End Time: 2012-07-13 20:45:16 To: 2038, Order: 160173, Start Time: 2012-07-13 14:51:24, End Time: 2012-07-13 17:34:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (71 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (822 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 6.49% (0.2265 => 0.2412, std. dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 12.99% (0.3442 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.96% (0.3465 => 0.3914, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.91% (0.3446 => 0.3891, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.90% (0.3496 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.89% (0.3460 => 0.3906, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.82% (0.3488 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.80% (0.3469 => 0.3913, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/property: 12.52% (0.3650 => 0.4107, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 12.41% (0.3643 => 0.4095, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.92% (0.3724 => 0.4168, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.60% (0.5826 => 0.6269, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.22% (0.5889 => 0.6314, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.65% (0.7171 => 0.7576, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.93% (3.5627 => 3.7384, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.75% (0.5900 => 0.6180, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.73% (1.6211 => 1.6978, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 4.40% (0.2750 => 0.2871, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.15% (0.4361 => 0.4542, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.04% (2.7292 => 2.8395, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.90% (0.4994 => 0.5189, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.90% (0.4029 => 0.4186, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.89% (0.3930 => 0.4083, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (1.3152 => 1.3653, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 3.80% (0.2714 => 0.2817, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.69% (0.2738 => 0.2839, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.69% (0.2875 => 0.2981, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.62% (0.5026 => 0.5208, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.60% (0.3004 => 0.3112, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.59% (0.9909 => 1.0265, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.59% (0.2813 => 0.2914, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.58% (0.2792 => 0.2892, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.58% (0.5000 => 0.5179, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 3.57% (0.2803 => 0.2903, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.57% (2.0673 => 2.1410, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 3.54% (0.2823 => 0.2923, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.54% (4.2109 => 4.3600, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 3.46% (0.3267 => 0.3380, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3195 => 0.3304, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 3.39% (0.3096 => 0.3201, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.33% (0.3362 => 0.3474, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.32% (23.5202 => 24.3004, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary: 3.31% (0.3258 => 0.3366, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3124 => 0.3226, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.25% (1.9694 => 2.0335, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.22% (1.9966 => 2.0608, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3317 => 0.3421, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.11% (0.4658 => 0.4803, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.11% (0.3282 => 0.3384, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.06% (0.3625 => 0.3736, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 3.03% (0.9697 => 0.9991, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.02% (0.3348 => 0.3449, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 2.91% (0.3678 => 0.3785, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 2.84% (0.3726 => 0.3832, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.83% (1.0781 => 1.1086, std. dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.67% (0.3890 => 0.3994, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.3845 => 0.3946, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 2.62% (2.1013 => 2.1564, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 2.56% (0.4251 => 0.4360, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.51% (0.4146 => 0.4250, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 2.35% (4.6177 => 4.7264, std. dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: 2.35% (2.1653 => 2.2162, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (4.4195 => 4.5228, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.25% (5.5417 => 5.6664, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 2.13% (1.8794 => 1.9194, std. dev.: 0.0053) MultiSource/Applications/treecc/treecc: 2.02% (0.7875 => 0.8034, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.5012 => 0.5112, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.86% (1.4269 => 1.4534, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.77% (0.6435 => 0.6549, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 1.74% (1.5932 => 1.6210, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.63% (0.2122 => 0.2284, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.77% (11.9555 => 11.7444, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 14:32:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 16:32:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120713213235.45E1E2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2044?compare_to=2041&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2044, Order: 160183, Start Time: 2012-07-13 20:18:35, End Time: 2012-07-13 21:32:42 To: 2041, Order: 160176, Start Time: 2012-07-13 18:36:30, End Time: 2012-07-13 19:50:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.03% (78.5836 => 80.1796, std. dev.: 0.5793) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.49% (2.0176 => 2.2897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.88% (0.5748 => 0.6316, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 9.86% (0.7061 => 0.7757, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.81% (0.5818 => 0.6389, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.86% (0.3578 => 0.3895, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.72% (0.3601 => 0.3915, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.60% (0.3650 => 0.3964, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.58% (0.3646 => 0.3959, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.44% (0.3663 => 0.3972, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.42% (0.3623 => 0.3928, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.34% (0.3789 => 0.4105, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.30% (0.3914 => 0.4239, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: 8.07% (0.4003 => 0.4326, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.99% (0.3940 => 0.4255, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.00% (0.1986 => 0.2125, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.85% (1.3693 => 1.4631, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.21% (0.7710 => 0.8189, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4328 => 0.4593, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.86% (0.2781 => 0.2944, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.80% (0.7038 => 0.7446, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.75% (0.2782 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.55% (0.2596 => 0.2740, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.54% (0.2726 => 0.2877, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3022 => 0.3189, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.49% (0.4062 => 0.4285, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.49% (1.9828 => 2.0916, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/except: 5.47% (0.2760 => 0.2911, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.47% (0.5265 => 0.5553, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.43% (0.2966 => 0.3127, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.41% (0.2937 => 0.3096, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2761 => 0.2910, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.35% (0.2765 => 0.2913, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3489 => 0.3675, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.3107 => 0.3271, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.15% (0.2721 => 0.2861, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.11% (3.9660 => 4.1688, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.08% (0.3899 => 0.4097, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.03% (0.3580 => 0.3760, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.96% (0.3485 => 0.3658, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4390 => 0.4607, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 4.86% (0.3192 => 0.3347, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.84% (0.3453 => 0.3620, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 4.65% (0.2988 => 0.3127, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.59% (0.3293 => 0.3444, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.53% (0.3534 => 0.3694, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.50% (0.6959 => 0.7272, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.37% (0.3756 => 0.3920, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.14% (0.3868 => 0.4028, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.09% (16.6129 => 17.2927, std. dev.: 0.0243) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2945 => 0.3064, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.00% (0.9199 => 0.9567, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.00% (0.5577 => 0.5800, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.94% (13.8202 => 14.3643, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: 3.86% (0.2925 => 0.3038, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.78% (0.7506 => 0.7790, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.75% (1.2193 => 1.2650, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.75% (13.2842 => 13.7818, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.59% (0.4379 => 0.4536, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.53% (0.2914 => 0.3017, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.53% (0.5637 => 0.5836, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.49% (1.2292 => 1.2721, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.42% (7.2180 => 7.4651, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.37% (1.4563 => 1.5054, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.26% (1.1364 => 1.1734, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.25% (1.3245 => 1.3675, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3246 => 0.3351, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.20% (1.1061 => 1.1415, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 3.20% (3.8646 => 3.9882, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.16% (0.7460 => 0.7696, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3755 => 0.3873, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.09% (1.9270 => 1.9866, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.07% (1.3813 => 1.4237, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.05% (1.3819 => 1.4240, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.0594 => 1.0898, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.51% (3.6692 => 3.7613, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.30% (4.9865 => 5.1010, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (4.3801 => 4.4791, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 2.22% (14.8535 => 15.1832, std. dev.: 0.0082) MultiSource/Applications/JM/ldecod/ldecod: 2.13% (6.5754 => 6.7155, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 2.13% (0.8310 => 0.8487, std. dev.: 0.0035) MultiSource/Applications/siod/siod: 2.12% (2.1791 => 2.2254, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.08% (4.4433 => 4.5358, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.05% (0.8698 => 0.8876, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.99% (0.6135 => 0.6257, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.94% (1.1333 => 1.1553, std. dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 1.80% (14.5298 => 14.7916, std. dev.: 0.0082) MultiSource/Applications/d/make_dparser: 1.75% (3.1889 => 3.2447, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.68% (16.2614 => 16.5340, std. dev.: 0.0114) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.08% (0.1824 => 0.3540, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.94% (1.8175 => 2.2708, std. dev.: 0.0412) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1903, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: 7.32% (1.2998 => 1.3950, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7314, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6779, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5346, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.59% (3.6469 => 3.7048, std. dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9584, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.11% (22.5627 => 20.9580, std. dev.: 0.0144) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.60% (0.8818 => 0.8589, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.12% (0.9108 => 0.9006, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.96% (1.2308 => 1.1082, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (20.3410 => 18.6307, std. dev.: 0.0749) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.26% (1.3780 => 1.3055, std. dev.: 0.0095) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9130, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4474, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.39% (8.8259 => 8.6147, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5134, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: -1.74% (3.0263 => 2.9737, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2552, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.56% (26.5159 => 26.1034, std. dev.: 0.0433) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7956, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.35% (0.8342 => 0.8229, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2144, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.30% (0.9692 => 0.9566, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std. dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2544, std. dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: -1.14% (7.3305 => 7.2470, std. dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 14:40:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 16:40:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120713214027.226F22A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2045?compare_to=2042&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2045, Order: 160183, Start Time: 2012-07-13 20:22:17, End Time: 2012-07-13 21:40:36 To: 2042, Order: 160176, Start Time: 2012-07-13 18:36:21, End Time: 2012-07-13 19:54:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (794 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.22% (10.3673 => 13.7081, std. dev.: 0.0072) SingleSource/UnitTests/ObjC/trivial-interface: 12.21% (0.3473 => 0.3897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.95% (0.3497 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.80% (0.3543 => 0.3961, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.69% (0.3516 => 0.3927, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/for-in: 11.42% (0.3694 => 0.4116, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.88% (1.1194 => 1.2412, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.87% (0.3828 => 0.4244, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.86% (0.3886 => 0.4308, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3927 => 0.4350, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.37% (2.2022 => 2.3645, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.95% (1.7609 => 1.8832, std. dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 6.45% (0.6030 => 0.6419, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.43% (0.5925 => 0.6306, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.95% (0.7326 => 0.7762, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.47% (0.3177 => 0.3319, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.42% (7.0540 => 7.3657, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 4.02% (10.4361 => 10.8555, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.87% (0.4879 => 0.5068, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.81% (0.7433 => 0.7716, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 3.66% (0.3282 => 0.3402, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.21% (0.8172 => 0.8434, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5569 => 0.5736, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.90% (0.4615 => 0.4749, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.83% (4.9449 => 5.0850, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.68% (5.0018 => 5.1356, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.55% (8.1363 => 8.3438, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.49% (14.3668 => 14.7248, std. dev.: 0.0122) MultiSource/Applications/spiff/spiff: 2.40% (0.7835 => 0.8023, std. dev.: 0.0056) MultiSource/Applications/hbd/hbd: 2.39% (1.5603 => 1.5976, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.38% (4.2646 => 4.3662, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.29% (0.5860 => 0.5994, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.29% (0.4636 => 0.4742, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.19% (9.4845 => 9.6921, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (2.0665 => 2.1106, std. dev.: 0.0043) MultiSource/Applications/Burg/burg: 1.93% (1.1642 => 1.1867, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.88% (1.1861 => 1.2084, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 1.75% (2.0273 => 2.0627, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.73% (1.5415 => 1.5681, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 1.69% (3.3354 => 3.3919, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.59% (3.8723 => 3.9340, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 1.55% (0.6456 => 0.6556, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.48% (1.3050 => 1.3243, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.42% (5.7591 => 5.8406, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.35% (0.9765 => 0.9897, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.34% (1.2842 => 1.3014, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.29% (17.1811 => 17.4028, std. dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.17% (1.4186 => 1.4352, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7532, std. dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0561, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.14% (26.0924 => 26.6515, std. dev.: 0.0251) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2460, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 1.41% (2.4116 => 2.4456, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6898, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.45% (5.2763 => 3.1419, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.52% (5.3855 => 3.6879, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.24% (5.3526 => 3.6803, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.66% (2.9384 => 2.5370, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.70% (22.1758 => 19.8028, std. dev.: 0.0092) SingleSource/UnitTests/Vector/constpool: -5.17% (54.1659 => 51.3675, std. dev.: 0.0335) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.59% (3.8922 => 3.7913, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.26% (1.2373 => 1.1103, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.12% (19.9488 => 18.5275, std. dev.: 0.1087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (8.1563 => 7.9249, std. dev.: 0.0068) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6803, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: -1.98% (10.2830 => 10.0790, std. dev.: 0.0034) MultiSource/Applications/lemon/lemon: -1.10% (1.4460 => 1.4301, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 16:14:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 18:14:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120713231413.1D7C32A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2046?compare_to=2044&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2046, Order: 160194, Start Time: 2012-07-13 22:00:28, End Time: 2012-07-13 23:14:20 To: 2044, Order: 160183, Start Time: 2012-07-13 20:18:35, End Time: 2012-07-13 21:32:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 8 (8 on baseline) Performance Regressions: 4 (124 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 939 (721 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc/flops SingleSource/UnitTests/Vector/sumarray Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.43% (25.9664 => 26.3375, std. dev.: 0.0907) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: 6.95% (18.6307 => 19.9264, std. dev.: 0.0938) MultiSource/Benchmarks/llubenchmark/llu: 2.25% (3.7921 => 3.8776, std. dev.: 0.0148) MultiSource/Applications/lua/lua: 1.13% (26.1034 => 26.3979, std. dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std. dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc/flops SingleSource/UnitTests/Vector/sumarray Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.71% (2.0176 => 2.2942, std. dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference-object: 9.64% (0.5818 => 0.6379, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.59% (0.5748 => 0.6299, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 9.33% (0.7061 => 0.7720, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3650 => 0.3956, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.16% (0.3578 => 0.3870, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.04% (0.3646 => 0.3939, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 7.94% (0.3601 => 0.3887, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.86% (0.3663 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.78% (0.3623 => 0.3905, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.76% (0.3789 => 0.4083, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.64% (0.3914 => 0.4213, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.4003 => 0.4303, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.41% (0.3940 => 0.4232, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.95% (1.3693 => 1.4645, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1986 => 0.2122, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.18% (0.4062 => 0.4313, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4328 => 0.4593, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.02% (0.7710 => 0.8174, std. dev.: 0.0036) SingleSource/Regression/C++/ofstream_ctor: 5.90% (0.2781 => 0.2945, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.85% (0.7038 => 0.7450, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.68% (0.2607 => 0.2755, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.59% (0.2628 => 0.2775, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3022 => 0.3189, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.51% (0.2596 => 0.2739, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.49% (0.5265 => 0.5554, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.45% (0.2937 => 0.3097, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.44% (0.2721 => 0.2869, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2761 => 0.2910, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.2966 => 0.3126, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.39% (0.2765 => 0.2914, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.38% (1.9828 => 2.0895, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 5.36% (0.2760 => 0.2908, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3489 => 0.3675, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.21% (0.3107 => 0.3269, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.19% (3.9660 => 4.1720, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.18% (0.3899 => 0.4101, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 5.14% (0.3149 => 0.3311, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.08% (0.3580 => 0.3762, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.99% (0.3485 => 0.3659, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.99% (0.4390 => 0.4609, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 4.75% (0.3453 => 0.3617, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.60% (0.6959 => 0.7279, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.59% (0.2988 => 0.3125, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3293 => 0.3443, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.50% (0.3534 => 0.3693, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.48% (0.4016 => 0.4196, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.3756 => 0.3923, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.19% (0.3868 => 0.4030, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.18% (16.6129 => 17.3080, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.09% (0.5577 => 0.5805, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.02% (0.9199 => 0.9569, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 4.00% (13.8202 => 14.3732, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/objinst: 3.97% (0.2945 => 0.3062, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.93% (0.2925 => 0.3040, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.90% (13.2842 => 13.8028, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.76% (1.2193 => 1.2651, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.57% (0.5637 => 0.5838, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.56% (0.4379 => 0.4535, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.56% (0.7506 => 0.7773, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.47% (1.2292 => 1.2719, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.34% (1.3245 => 1.3688, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.34% (7.2180 => 7.4594, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.33% (0.3246 => 0.3354, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.31% (1.1061 => 1.1427, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 3.31% (3.8646 => 3.9924, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.24% (1.1364 => 1.1732, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.23% (1.3819 => 1.4265, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.22% (1.4563 => 1.5032, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.17% (1.3813 => 1.4251, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.16% (0.7460 => 0.7696, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.14% (1.9270 => 1.9876, std. dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3755 => 0.3873, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.0594 => 1.0911, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.52% (3.6692 => 3.7616, std. dev.: 0.0148) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.32% (4.9865 => 5.1020, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8310 => 0.8501, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.29% (4.3801 => 4.4805, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 2.27% (6.5754 => 6.7244, std. dev.: 0.0159) MultiSource/Applications/JM/lencod/lencod: 2.25% (14.8535 => 15.1870, std. dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.22% (0.8698 => 0.8891, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.18% (2.1791 => 2.2265, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.17% (4.4433 => 4.5397, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.10% (0.6135 => 0.6264, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.91% (1.1333 => 1.1549, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 1.79% (14.5298 => 14.7896, std. dev.: 0.0142) MultiSource/Applications/d/make_dparser: 1.78% (3.1889 => 3.2458, std. dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 1.77% (16.2614 => 16.5490, std. dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.62% (0.6283 => 0.6385, std. dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 1.33% (1.2749 => 1.2918, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.22% (1.8175 => 2.2577, std. dev.: 0.0253) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1890, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9996 => 1.0782, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: 7.55% (1.2998 => 1.3979, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 3.82% (7.4271 => 7.7107, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9234, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6791, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.50% (1.7688 => 1.8307, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0005) MultiSource/Benchmarks/llubenchmark/llu: 2.77% (3.7731 => 3.8776, std. dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.95% (4.1080 => 4.1883, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5339, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.61% (3.6469 => 3.7057, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 1.06% (10.7476 => 10.8610, std. dev.: 0.0300) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.93% (22.5627 => 20.9984, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.61% (0.8818 => 0.8588, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.65% (1.2308 => 1.0997, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.98% (1.3780 => 1.3094, std. dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.68% (2.6470 => 2.5495, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9125, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.8259 => 8.5675, std. dev.: 0.0176) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.04% (20.3410 => 19.9264, std. dev.: 0.0938) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5036, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -1.71% (3.0263 => 2.9744, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.69% (28.2225 => 27.7445, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2547, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.51% (0.9692 => 0.9546, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.43% (7.3305 => 7.2258, std. dev.: 0.0241) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.33% (9.3358 => 9.2112, std. dev.: 0.0138) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2507, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8701, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8466, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 16:51:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 18:51:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120713235157.45CE52A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2047?compare_to=2045&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2047, Order: 160194, Start Time: 2012-07-13 22:08:14, End Time: 2012-07-13 23:52:06 To: 2045, Order: 160183, Start Time: 2012-07-13 20:22:17, End Time: 2012-07-13 21:40:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 16 (17 on baseline) Performance Regressions: 3 (60 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (19 on baseline) Unchanged Tests: 912 (780 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/salsa20 SingleSource/UnitTests/Vector/sumarray Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: 7.18% (18.5275 => 19.8581, std. dev.: 0.0943) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.40% (55.1606 => 56.4840, std. dev.: 0.0646) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.21% (79.1617 => 80.9103, std. dev.: 0.3943) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/salsa20 SingleSource/UnitTests/Vector/sumarray Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.16% (10.3673 => 13.7018, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3473 => 0.3904, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3516 => 0.3946, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.14% (0.3543 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.07% (0.3497 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.97% (0.3543 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.93% (0.3561 => 0.3986, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.73% (1.1194 => 1.2507, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 11.53% (0.3694 => 0.4120, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.15% (0.3828 => 0.4255, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 11.08% (0.3927 => 0.4362, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.70% (1.7609 => 1.8965, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.33% (2.2022 => 2.3636, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 7.14% (0.5925 => 0.6348, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.08% (0.6030 => 0.6457, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.97% (0.2065 => 0.2209, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 6.78% (0.1622 => 0.1732, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.95% (0.7326 => 0.7762, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.75% (0.3177 => 0.3328, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.50% (7.0540 => 7.3715, std. dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: 4.32% (10.4361 => 10.8873, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.4879 => 0.5089, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 3.81% (0.3282 => 0.3407, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.70% (0.7433 => 0.7708, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.51% (0.4615 => 0.4777, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.22% (0.8172 => 0.8435, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.89% (0.5569 => 0.5730, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.75% (5.0018 => 5.1395, std. dev.: 0.0073) MultiSource/Applications/hbd/hbd: 2.63% (1.5603 => 1.6013, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (4.9449 => 5.0737, std. dev.: 0.0099) MultiSource/Applications/spiff/spiff: 2.57% (0.7835 => 0.8036, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.53% (8.1363 => 8.3425, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 2.47% (0.4299 => 0.4405, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (14.3668 => 14.7184, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.38% (2.0665 => 2.1156, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 2.34% (9.4845 => 9.7063, std. dev.: 0.0132) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.23% (4.2646 => 4.3598, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.18% (0.5860 => 0.5988, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.00% (0.8067 => 0.8228, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.83% (1.1642 => 1.1855, std. dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.82% (1.1861 => 1.2077, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.77% (2.0273 => 2.0632, std. dev.: 0.0100) MultiSource/Applications/d/make_dparser: 1.71% (3.3354 => 3.3924, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.70% (1.3050 => 1.3272, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.67% (1.5415 => 1.5673, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 1.56% (5.7591 => 5.8488, std. dev.: 0.0053) MultiSource/Applications/lua/lua: 1.55% (3.8723 => 3.9322, std. dev.: 0.0083) MultiSource/Applications/hexxagon/hexxagon: 1.40% (1.2842 => 1.3022, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.29% (0.9765 => 0.9891, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.22% (1.4186 => 1.4359, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.18% (17.1811 => 17.3830, std. dev.: 0.0393) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.39% (26.0924 => 26.7150, std. dev.: 0.0446) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.95% (1.5086 => 1.5380, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.51% (9.1159 => 9.2539, std. dev.: 0.0269) SingleSource/Benchmarks/Dhrystone/dry: 1.42% (2.4116 => 2.4458, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.38% (2.6546 => 2.6912, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.24% (2.3135 => 2.3423, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1257, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.05% (5.2763 => 3.1633, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.37% (5.3855 => 3.6961, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.07% (5.3526 => 3.6897, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.35% (2.9384 => 2.5460, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.48% (22.1758 => 19.8509, std. dev.: 0.0139) SingleSource/UnitTests/Vector/constpool: -4.89% (54.1659 => 51.5169, std. dev.: 0.0354) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.44% (3.8922 => 3.7971, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -10.13% (1.2373 => 1.1119, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9180, std. dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6850, std. dev.: 0.0056) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.14% (1.4460 => 1.4295, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 16:56:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 18:56:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120713235623.053652A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2048?compare_to=2043&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2048, Order: 160188, Start Time: 2012-07-13 21:13:00, End Time: 2012-07-13 23:56:31 To: 2043, Order: 160174, Start Time: 2012-07-13 18:02:23, End Time: 2012-07-13 20:45:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (75 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (817 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 19.07% (99.4748 => 118.4456, std. dev.: 0.0751) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.09% (1.6752 => 1.6935, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.76% (0.3446 => 0.3920, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.74% (0.3465 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.73% (0.3496 => 0.3976, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.73% (0.3460 => 0.3935, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 13.71% (0.3442 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.62% (0.3488 => 0.3963, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 13.61% (0.3469 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.18% (0.3650 => 0.4131, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 13.07% (0.3643 => 0.4119, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.86% (0.3724 => 0.4203, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.86% (0.5826 => 0.6284, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.40% (0.5889 => 0.6325, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.84% (0.7171 => 0.7590, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.14% (3.5627 => 3.7457, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.79% (1.6211 => 1.6987, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.42% (0.5900 => 0.6161, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.33% (0.4361 => 0.4550, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.23% (2.7292 => 2.8447, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.14% (1.3152 => 1.3697, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 4.07% (0.4029 => 0.4193, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 4.00% (0.2750 => 0.2860, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.94% (0.5000 => 0.5197, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.87% (0.3930 => 0.4082, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.85% (0.2725 => 0.2830, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.82% (0.5026 => 0.5218, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.80% (0.2738 => 0.2842, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 3.80% (0.2714 => 0.2817, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.78% (0.4994 => 0.5183, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 3.78% (0.3096 => 0.3213, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 3.78% (0.2780 => 0.2885, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 3.73% (0.3004 => 0.3116, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.69% (0.2875 => 0.2981, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.66% (0.9909 => 1.0272, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.62% (0.2792 => 0.2893, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.60% (0.2803 => 0.2904, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.58% (0.2823 => 0.2924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.56% (0.2811 => 0.2911, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 3.54% (4.2109 => 4.3598, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.50% (2.0673 => 2.1397, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.47% (0.2911 => 0.3012, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.40% (0.3267 => 0.3378, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.35% (0.3195 => 0.3302, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.35% (0.3258 => 0.3367, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.32% (1.9694 => 2.0348, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3124 => 0.3226, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.25% (1.9966 => 2.0614, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 3.24% (0.3678 => 0.3797, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (0.3348 => 0.3456, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3317 => 0.3423, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.15% (0.9697 => 1.0002, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3726 => 0.3842, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 3.11% (23.5202 => 24.2511, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.05% (0.3282 => 0.3382, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.01% (0.3625 => 0.3734, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 2.93% (1.0781 => 1.1097, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 2.90% (0.3477 => 0.3578, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.79% (2.1013 => 2.1600, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.71% (0.3690 => 0.3790, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.64% (0.4658 => 0.4781, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (0.3890 => 0.3991, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4146 => 0.4252, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.49% (0.4251 => 0.4357, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.46% (4.4195 => 4.5281, std. dev.: 0.0144) MultiSource/Applications/SPASS/SPASS: 2.45% (5.5417 => 5.6772, std. dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (2.1653 => 2.2170, std. dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: 2.31% (4.6177 => 4.7245, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 2.27% (1.8794 => 1.9221, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.07% (0.7875 => 0.8038, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.07% (1.4269 => 1.4564, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.5012 => 0.5112, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.93% (0.5546 => 0.5653, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.6435 => 0.6552, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 1.79% (1.5932 => 1.6217, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.82% (11.9555 => 11.7374, std. dev.: 0.0189) SingleSource/UnitTests/Vector/constpool: -1.39% (2.4764 => 2.4421, std. dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 17:55:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 19:55:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120714005554.472A52A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2049?compare_to=2046&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2049, Order: 160197, Start Time: 2012-07-13 23:42:18, End Time: 2012-07-14 00:56:00 To: 2046, Order: 160194, Start Time: 2012-07-13 22:00:28, End Time: 2012-07-13 23:14:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Passes: 8 (0 on baseline) Performance Regressions: 3 (127 on baseline) Performance Improvements: 3 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 938 (727 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc/flops SingleSource/UnitTests/Vector/sumarray Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/Vector/build2: 2.19% (1.3564 => 1.3861, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9420 => 1.9675, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.09% (2.6804 => 2.7097, std. dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.41% (26.3375 => 25.9655, std. dev.: 0.0219) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -6.92% (19.9264 => 18.5466, std. dev.: 0.0614) MultiSource/Applications/lua/lua: -1.03% (26.3979 => 26.1265, std. dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.04% (2.0176 => 2.3009, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.87% (0.5818 => 0.6392, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.81% (0.5748 => 0.6312, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.56% (0.7061 => 0.7736, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 8.44% (0.3578 => 0.3880, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.22% (0.3663 => 0.3964, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.20% (0.3646 => 0.3945, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.19% (0.3601 => 0.3896, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3650 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.13% (0.3789 => 0.4097, std. dev.: 0.0080) SingleSource/UnitTests/ObjC/exceptions-3: 8.06% (0.3623 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.89% (0.3914 => 0.4223, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.4003 => 0.4314, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.69% (0.3940 => 0.4243, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1986 => 0.2122, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 6.64% (1.3693 => 1.4602, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.04% (0.7710 => 0.8176, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4062 => 0.4307, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.89% (0.4328 => 0.4583, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 5.75% (0.2781 => 0.2941, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.74% (0.7038 => 0.7442, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.64% (0.2782 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.2655 => 0.2804, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.59% (0.2596 => 0.2741, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.56% (0.3022 => 0.3190, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.45% (0.5265 => 0.5552, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.2607 => 0.2749, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2690 => 0.2835, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.34% (1.9828 => 2.0886, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: 5.33% (0.2628 => 0.2768, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.32% (0.2765 => 0.2912, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.25% (3.9660 => 4.1743, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 5.25% (0.2726 => 0.2869, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.23% (0.2966 => 0.3121, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.22% (0.2721 => 0.2863, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.22% (0.2760 => 0.2904, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.22% (0.2761 => 0.2905, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.21% (0.2937 => 0.3090, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.19% (0.2696 => 0.2836, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.05% (0.3485 => 0.3661, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.04% (0.3489 => 0.3665, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.03% (0.3899 => 0.4095, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.99% (0.3107 => 0.3262, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.94% (0.3580 => 0.3757, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.86% (0.3149 => 0.3302, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3192 => 0.3346, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.3453 => 0.3610, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.50% (0.6959 => 0.7272, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 4.48% (0.2988 => 0.3122, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.46% (0.3293 => 0.3440, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.43% (0.4016 => 0.4194, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.34% (0.3756 => 0.3919, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 4.30% (0.3534 => 0.3686, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.21% (0.4390 => 0.4575, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 4.15% (16.6129 => 17.3029, std. dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/moments: 4.03% (0.3868 => 0.4024, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.01% (13.8202 => 14.3745, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.00% (0.9199 => 0.9567, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 3.84% (0.2945 => 0.3058, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.83% (1.2193 => 1.2660, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 3.79% (0.2925 => 0.3036, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.78% (13.2842 => 13.7862, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.66% (0.5577 => 0.5781, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.49% (0.4379 => 0.4532, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 3.48% (0.7506 => 0.7767, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.39% (0.5637 => 0.5828, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.37% (7.2180 => 7.4616, std. dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: 3.35% (1.2292 => 1.2704, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 3.32% (3.8646 => 3.9928, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.28% (1.4563 => 1.5040, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 3.27% (1.1061 => 1.1423, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.25% (1.3245 => 1.3676, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.25% (1.1364 => 1.1733, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.18% (1.3819 => 1.4258, std. dev.: 0.0085) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.16% (1.3813 => 1.4249, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3246 => 0.3346, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.07% (0.7460 => 0.7689, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.05% (1.9270 => 1.9857, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.0594 => 1.0914, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.96% (0.3755 => 0.3866, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.55% (3.6692 => 3.7628, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.29% (4.3801 => 4.4802, std. dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.27% (4.9865 => 5.0999, std. dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/football/football: 2.23% (0.8310 => 0.8495, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.16% (6.5754 => 6.7176, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 2.16% (2.1791 => 2.2261, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 2.15% (14.8535 => 15.1725, std. dev.: 0.0162) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.10% (4.4433 => 4.5364, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.05% (0.8698 => 0.8876, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.00% (0.6135 => 0.6258, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.94% (1.1333 => 1.1553, std. dev.: 0.0043) MultiSource/Applications/d/make_dparser: 1.86% (3.1889 => 3.2481, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.63% (14.5298 => 14.7669, std. dev.: 0.0185) MultiSource/Applications/sqlite3/sqlite3: 1.57% (16.2614 => 16.5167, std. dev.: 0.0285) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2914, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.39% (1.8175 => 2.2607, std. dev.: 0.0497) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1916, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.45% (1.2998 => 1.3967, std. dev.: 0.0105) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.34% (1.5824 => 1.6986, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7351, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9196, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6781, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.56% (1.7688 => 1.8318, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5355, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.72% (3.6469 => 3.7095, std. dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: 1.05% (1.9290 => 1.9492, std. dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.07% (22.5627 => 20.9681, std. dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.45% (0.0997 => 0.0843, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1126, std. dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.82% (20.3410 => 18.5466, std. dev.: 0.0614) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.62% (1.3780 => 1.3144, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.60% (2.6470 => 2.5516, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9129, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6027, std. dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4474, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.28% (0.4867 => 0.4756, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5009, std. dev.: 0.0116) MultiSource/Applications/spiff/spiff: -1.81% (3.0263 => 2.9716, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2544, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9980, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7930, std. dev.: 0.0024) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1265, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.29% (0.9692 => 0.9567, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2407, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8705, std. dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2533, std. dev.: 0.0068) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2322, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 18:37:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 20:37:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120714013745.CF9282A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2050?compare_to=2047&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2050, Order: 160207, Start Time: 2012-07-14 00:19:47, End Time: 2012-07-14 01:37:53 To: 2047, Order: 160194, Start Time: 2012-07-13 22:08:14, End Time: 2012-07-13 23:52:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 16 (1 on baseline) Performance Regressions: 1 (59 on baseline) Performance Improvements: 6 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 909 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/salsa20 SingleSource/UnitTests/Vector/sumarray Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/Vector/build2: 2.20% (1.3564 => 1.3862, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.14% (13.7018 => 13.4089, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.25% (2.1156 => 2.0892, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.16% (3.1633 => 3.1266, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -6.88% (19.8581 => 18.4927, std. dev.: 0.0944) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.20% (80.9103 => 78.3252, std. dev.: 0.9962) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.15% (2.0597 => 2.0361, std. dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.34% (10.3673 => 13.4089, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 12.35% (0.3473 => 0.3902, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.10% (0.3497 => 0.3920, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.06% (0.3516 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.02% (0.3543 => 0.3969, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.91% (0.3561 => 0.3985, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3694 => 0.4121, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.18% (0.3828 => 0.4256, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (1.1194 => 1.2435, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.00% (0.3927 => 0.4359, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.99% (0.3886 => 0.4313, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.59% (2.2022 => 2.3694, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.93% (1.7609 => 1.8830, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.82% (0.6030 => 0.6381, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.79% (0.5925 => 0.6268, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 4.91% (0.7326 => 0.7686, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.50% (10.4361 => 10.9053, std. dev.: 0.0115) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.15% (0.3177 => 0.3309, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.14% (7.0540 => 7.3458, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 3.87% (0.3282 => 0.3409, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.81% (0.4879 => 0.5065, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.65% (0.8172 => 0.8470, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 3.48% (0.7433 => 0.7692, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.82% (0.5569 => 0.5726, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.77% (4.9449 => 5.0821, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.73% (0.4615 => 0.4741, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.53% (5.0018 => 5.1285, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.43% (0.7835 => 0.8025, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.36% (8.1363 => 8.3281, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (14.3668 => 14.7041, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.09% (4.2646 => 4.3536, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5860 => 0.5981, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.02% (1.1642 => 1.1877, std. dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 1.95% (9.4845 => 9.6692, std. dev.: 0.0066) MultiSource/Applications/hbd/hbd: 1.90% (1.5603 => 1.5899, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.80% (1.1861 => 1.2074, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.75% (2.0273 => 2.0627, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 1.62% (3.3354 => 3.3896, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.62% (1.5415 => 1.5664, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.60% (0.8067 => 0.8196, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 1.48% (5.7591 => 5.8443, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.45% (3.8723 => 3.9285, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.39% (1.3050 => 1.3231, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.10% (2.0665 => 2.0892, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.10% (17.1811 => 17.3695, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.09% (0.9765 => 0.9871, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.02% (1.4186 => 1.4330, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (3.6395 => 3.7475, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.09% (26.0924 => 26.6366, std. dev.: 0.0318) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5367, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 1.50% (2.4116 => 2.4478, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 1.31% (9.1159 => 9.2351, std. dev.: 0.0320) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6883, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.49% (0.8651 => 0.1688, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.74% (5.2763 => 3.1266, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.41% (5.3855 => 3.6937, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.19% (5.3526 => 3.6832, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.90% (2.9384 => 2.5300, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -10.56% (22.1758 => 19.8348, std. dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: -5.42% (54.1659 => 51.2276, std. dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.77% (3.8922 => 3.7844, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.73% (0.0998 => 0.0841, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1166, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.30% (19.9488 => 18.4927, std. dev.: 0.0944) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9180, std. dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6915, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0859, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.01% (1.4460 => 1.4314, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 19:37:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 21:37:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120714023719.A23F82A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2051?compare_to=2049&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2051, Order: 160210, Start Time: 2012-07-14 01:23:41, End Time: 2012-07-14 02:37:27 To: 2049, Order: 160197, Start Time: 2012-07-13 23:42:18, End Time: 2012-07-14 00:56:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.16% (55.8582 => 56.5056, std. dev.: 0.1046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.91% (2.0176 => 2.2983, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 9.67% (0.5748 => 0.6304, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.66% (0.5818 => 0.6380, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.33% (0.7061 => 0.7720, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.89% (0.3578 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.66% (0.3601 => 0.3913, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3646 => 0.3961, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.60% (0.3650 => 0.3964, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 8.53% (0.3623 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.52% (0.3789 => 0.4112, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.44% (0.3663 => 0.3972, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.38% (0.3914 => 0.4242, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 8.32% (0.4003 => 0.4336, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 8.22% (0.3940 => 0.4264, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.80% (0.1986 => 0.2121, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.57% (1.3693 => 1.4592, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.11% (0.7710 => 0.8181, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.10% (0.7038 => 0.7467, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.87% (0.4328 => 0.4582, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.78% (0.2596 => 0.2746, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.68% (0.5265 => 0.5564, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.2721 => 0.2872, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (3.9660 => 4.1849, std. dev.: 0.0130) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2781 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2782 => 0.2928, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.23% (0.3022 => 0.3180, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.19% (0.4062 => 0.4273, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.18% (0.2607 => 0.2742, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.09% (0.2690 => 0.2827, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.05% (0.2655 => 0.2789, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.02% (0.2966 => 0.3115, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.00% (0.6959 => 0.7307, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 4.99% (0.2726 => 0.2862, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.93% (0.2696 => 0.2829, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.93% (0.2760 => 0.2896, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.92% (0.3580 => 0.3756, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.90% (1.9828 => 2.0800, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.87% (0.3899 => 0.4089, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.85% (0.2761 => 0.2895, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.85% (0.2765 => 0.2899, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.83% (0.2937 => 0.3079, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3107 => 0.3252, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.65% (16.6129 => 17.3859, std. dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.56% (0.3485 => 0.3644, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.32% (0.9199 => 0.9596, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.31% (13.8202 => 14.4160, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary2: 4.29% (0.3192 => 0.3329, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.28% (0.4016 => 0.4188, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.17% (0.2925 => 0.3047, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.17% (0.3453 => 0.3597, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.16% (0.3534 => 0.3681, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.15% (13.2842 => 13.8361, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.10% (0.3756 => 0.3910, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.07% (0.3293 => 0.3427, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.06% (1.2193 => 1.2688, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.05% (0.5577 => 0.5803, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: 4.05% (0.2988 => 0.3109, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.02% (0.7506 => 0.7808, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.94% (1.3819 => 1.4363, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.89% (1.1061 => 1.1491, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.87% (0.4390 => 0.4560, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.3868 => 0.4015, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.78% (1.3813 => 1.4335, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.67% (0.5637 => 0.5844, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.66% (1.4563 => 1.5096, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 3.64% (3.8646 => 4.0053, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.63% (0.4379 => 0.4538, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.60% (0.2945 => 0.3051, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.59% (1.3245 => 1.3721, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.57% (0.3246 => 0.3362, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.50% (1.1364 => 1.1762, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.49% (1.9270 => 1.9942, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.47% (7.2180 => 7.4687, std. dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.2914 => 0.3014, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.25% (1.0594 => 1.0938, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.23% (1.2292 => 1.2689, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.10% (0.7460 => 0.7691, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 2.84% (2.1791 => 2.2410, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.80% (0.3755 => 0.3860, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.79% (3.6692 => 3.7715, std. dev.: 0.0123) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.73% (4.9865 => 5.1228, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.54% (6.5754 => 6.7426, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.54% (4.3801 => 4.4913, std. dev.: 0.0116) MultiSource/Applications/JM/lencod/lencod: 2.52% (14.8535 => 15.2271, std. dev.: 0.0108) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.39% (4.4433 => 4.5495, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.18% (0.6135 => 0.6269, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.17% (3.1889 => 3.2581, std. dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.16% (1.1333 => 1.1578, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.12% (0.8698 => 0.8882, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.04% (14.5298 => 14.8257, std. dev.: 0.0126) MultiSource/Applications/sqlite3/sqlite3: 1.95% (16.2614 => 16.5784, std. dev.: 0.0247) MultiSource/Applications/SIBsim4/SIBsim4: 1.38% (1.2749 => 1.2925, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.21% (2.1007 => 2.1262, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.96% (1.8175 => 2.2712, std. dev.: 0.0523) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1934, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.03% (0.9996 => 1.0799, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.52% (1.0895 => 1.1714, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: 6.54% (1.2998 => 1.3848, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.20% (7.4271 => 7.7390, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9219, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4790, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5355, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.75% (3.6469 => 3.7106, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9595, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 1.16% (10.7476 => 10.8718, std. dev.: 0.0345) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.80% (22.5627 => 21.0277, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.46% (0.8818 => 0.8601, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.70% (1.2308 => 1.1114, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.71% (20.3410 => 18.5701, std. dev.: 0.0926) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.47% (1.3780 => 1.3164, std. dev.: 0.0112) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5513, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.25% (1.9762 => 1.9120, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5936, std. dev.: 0.0139) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5076, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -1.73% (3.0263 => 2.9738, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2552, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8568, std. dev.: 0.0163) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7955, std. dev.: 0.0018) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1179, std. dev.: 0.0234) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.47% (0.9692 => 0.9550, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.35% (0.8342 => 0.8229, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2213, std. dev.: 0.0119) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2417, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.3167 => 5.2612, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 20:07:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 22:07:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120714030732.5CAEE2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2052?compare_to=2048&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2052, Order: 160207, Start Time: 2012-07-14 00:24:16, End Time: 2012-07-14 03:07:40 To: 2048, Order: 160188, Start Time: 2012-07-13 21:13:00, End Time: 2012-07-13 23:56:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (53 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 949 (840 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.64% (125.9122 => 130.4948, std. dev.: 0.3308) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.29% (54.1638 => 54.8609, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/whetstone: 1.16% (2.8088 => 2.8415, std. dev.: 0.0064) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 13.67% (0.3496 => 0.3974, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3446 => 0.3917, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.63% (0.3442 => 0.3911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.62% (0.3465 => 0.3937, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.58% (0.3460 => 0.3930, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.56% (0.3488 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.49% (0.3469 => 0.3937, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.18% (0.3650 => 0.4131, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.07% (0.3643 => 0.4119, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.65% (0.3724 => 0.4195, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.91% (0.3792 => 0.4130, std. dev.: 0.0072) SingleSource/UnitTests/ObjC++/Hello: 7.42% (0.5826 => 0.6258, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.03% (0.5889 => 0.6303, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.2014 => 0.2129, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.52% (0.7171 => 0.7567, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.24% (0.5900 => 0.6209, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.18% (3.5627 => 3.7473, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.11% (1.6211 => 1.7039, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.74% (0.4029 => 0.4220, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (2.7292 => 2.8554, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.59% (0.4361 => 0.4561, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.35% (1.3152 => 1.3724, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.34% (0.5026 => 0.5244, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.23% (0.4994 => 0.5205, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.19% (0.2866 => 0.2986, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.94% (0.5000 => 0.5197, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.92% (0.3930 => 0.4084, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2750 => 0.2851, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.67% (4.2109 => 4.3655, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.37% (0.4658 => 0.4815, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.35% (1.9694 => 2.0353, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.24% (2.0673 => 2.1342, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.21% (0.9909 => 1.0227, std. dev.: 0.0107) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.20% (1.9966 => 2.0604, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 3.05% (2.1013 => 2.1654, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 3.02% (1.0781 => 1.1107, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 2.89% (0.9697 => 0.9977, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.83% (0.3890 => 0.4000, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.75% (0.3678 => 0.3779, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.71% (1.8794 => 1.9304, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (4.4195 => 4.5389, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.69% (0.3903 => 0.4008, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.64% (5.5417 => 5.6881, std. dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (2.1653 => 2.2217, std. dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 2.60% (23.5202 => 24.1306, std. dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: 2.49% (4.6177 => 4.7329, std. dev.: 0.0056) MultiSource/Applications/treecc/treecc: 2.40% (0.7875 => 0.8064, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.27% (1.4269 => 1.4593, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.11% (0.5546 => 0.5663, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.03% (0.6634 => 0.6769, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 1.79% (1.5932 => 1.6217, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.35% (2.8036 => 2.8415, std. dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.67% (11.9555 => 11.7561, std. dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 20:23:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 13 Jul 2012 22:23:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120714032343.3686A2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2053?compare_to=2050&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2053, Order: 160210, Start Time: 2012-07-14 02:05:32, End Time: 2012-07-14 03:23:52 To: 2050, Order: 160207, Start Time: 2012-07-14 00:19:47, End Time: 2012-07-14 01:37:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 13 (68 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 919 (786 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.37% (13.4089 => 13.7264, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.78% (3.6832 => 3.7487, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.75% (3.6937 => 3.7584, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.73% (2.3694 => 2.4105, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.60% (2.0892 => 2.1227, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.54% (3.1266 => 3.1748, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 1.54% (0.7686 => 0.7804, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.46% (1.2435 => 1.2616, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.45% (7.3458 => 7.4524, std. dev.: 0.0215) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.43% (2.5300 => 2.5663, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 1.34% (1.2909 => 1.3082, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 1.17% (1.5899 => 1.6085, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.16% (1.8830 => 1.9048, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.40% (10.3673 => 13.7264, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 13.56% (0.3473 => 0.3944, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.23% (0.3516 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.21% (0.3497 => 0.3959, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.21% (0.3543 => 0.4011, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.12% (0.3543 => 0.4008, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3561 => 0.4027, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.70% (1.1194 => 1.2616, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/for-in: 12.70% (0.3694 => 0.4163, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.20% (0.3828 => 0.4295, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.15% (0.3886 => 0.4358, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.04% (0.3927 => 0.4400, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.46% (2.2022 => 2.4105, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.17% (1.7609 => 1.9048, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5925 => 0.6357, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 7.16% (0.6030 => 0.6462, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.52% (0.7326 => 0.7804, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.65% (7.0540 => 7.4524, std. dev.: 0.0215) SingleSource/Benchmarks/Misc/oourafft: 5.51% (0.3282 => 0.3463, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.09% (10.4361 => 10.9672, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.98% (0.4879 => 0.5122, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.97% (0.7433 => 0.7728, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.95% (0.8172 => 0.8495, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.70% (0.2700 => 0.2800, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.21% (0.4615 => 0.4763, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.13% (5.0018 => 5.1586, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.10% (4.9449 => 5.0984, std. dev.: 0.0113) MultiSource/Applications/hbd/hbd: 3.09% (1.5603 => 1.6085, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.07% (0.5569 => 0.5740, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.02% (8.1363 => 8.3819, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.90% (0.3650 => 0.3756, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.85% (0.7835 => 0.8058, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3865 => 0.3972, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.72% (2.0665 => 2.1227, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.67% (14.3668 => 14.7507, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.4636 => 0.4758, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.59% (0.5860 => 0.6012, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.57% (4.2646 => 4.3743, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.53% (0.4103 => 0.4207, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 2.39% (9.4845 => 9.7111, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 2.35% (0.4289 => 0.4390, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.19% (1.1642 => 1.1897, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.08% (1.1861 => 1.2108, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.06% (0.8067 => 0.8233, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.94% (2.0273 => 2.0666, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 1.91% (3.3354 => 3.3991, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 1.90% (5.7591 => 5.8685, std. dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 1.87% (1.2842 => 1.3082, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.86% (1.5415 => 1.5701, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.84% (3.8723 => 3.9436, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.75% (1.3050 => 1.3279, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 1.61% (0.6456 => 0.6560, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.58% (0.6450 => 0.6552, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.45% (1.4186 => 1.4392, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.42% (0.9765 => 0.9904, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.29% (17.1811 => 17.4028, std. dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.99% (3.6395 => 3.7484, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.85% (26.0924 => 26.5746, std. dev.: 0.0653) MultiSource/Applications/minisat/minisat: 1.76% (9.1159 => 9.2759, std. dev.: 0.0268) SingleSource/Benchmarks/Dhrystone/dry: 1.40% (2.4116 => 2.4453, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6881, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.83% (5.2763 => 3.1748, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.21% (5.3855 => 3.7584, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.96% (5.3526 => 3.7487, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.66% (2.9384 => 2.5663, std. dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: -10.01% (22.1758 => 19.9566, std. dev.: 0.0064) SingleSource/UnitTests/Vector/constpool: -5.25% (54.1659 => 51.3227, std. dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.37% (3.8922 => 3.8000, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.73% (0.0998 => 0.0841, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.86% (1.2373 => 1.1029, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.73% (19.9488 => 18.6070, std. dev.: 0.0250) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (8.1563 => 7.9162, std. dev.: 0.0087) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6832, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0858, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.04% (1.4460 => 1.4310, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 23:18:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 01:18:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120714061838.236F42A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2054?compare_to=2052&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2054, Order: 160210, Start Time: 2012-07-14 03:35:26, End Time: 2012-07-14 06:18:47 To: 2052, Order: 160207, Start Time: 2012-07-14 00:24:16, End Time: 2012-07-14 03:07:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (48 on baseline) Performance Improvements: 1 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (844 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.64% (2.4591 => 2.3942, std. dev.: 0.0131) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.36% (0.3465 => 0.3928, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.35% (0.3446 => 0.3906, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/trivial-interface: 13.28% (0.3442 => 0.3899, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 13.24% (0.3496 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.24% (0.3460 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.16% (0.3488 => 0.3947, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 13.14% (0.3469 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.77% (0.3650 => 0.4116, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.65% (0.3643 => 0.4104, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.27% (0.3724 => 0.4181, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.14% (0.5826 => 0.6242, std. dev.: 0.0087) SingleSource/UnitTests/ObjC++/property-reference-object: 7.05% (0.5889 => 0.6304, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.42% (0.7171 => 0.7560, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.90% (1.6211 => 1.7006, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.80% (3.5627 => 3.7338, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.59% (0.5900 => 0.6171, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.38% (0.5026 => 0.5246, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.24% (0.4361 => 0.4546, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 4.12% (0.4029 => 0.4195, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.09% (2.7292 => 2.8407, std. dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: 3.95% (4.2109 => 4.3773, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.94% (0.4994 => 0.5191, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.90% (1.3152 => 1.3665, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.84% (0.5000 => 0.5192, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.82% (0.2750 => 0.2855, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.69% (0.3930 => 0.4075, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.29% (1.9694 => 2.0341, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.15% (1.9966 => 2.0595, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 3.10% (23.5202 => 24.2486, std. dev.: 0.0088) MultiSource/Applications/d/make_dparser: 2.96% (1.0781 => 1.1100, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 2.96% (0.9909 => 1.0202, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.96% (2.0673 => 2.1284, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.85% (0.9697 => 0.9973, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.79% (0.4658 => 0.4788, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.77% (4.4195 => 4.5418, std. dev.: 0.0110) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (0.3890 => 0.3997, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.70% (2.1013 => 2.1580, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.70% (1.8794 => 1.9301, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 2.42% (2.1653 => 2.2176, std. dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 2.39% (4.6177 => 4.7279, std. dev.: 0.0139) MultiSource/Applications/SPASS/SPASS: 2.35% (5.5417 => 5.6722, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.31% (0.7875 => 0.8057, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.01% (1.4269 => 1.4556, std. dev.: 0.0062) MultiSource/Applications/Burg/burg: 1.89% (0.5546 => 0.5651, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 1.86% (1.5932 => 1.6228, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.68% (0.6435 => 0.6543, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 1.55% (0.6634 => 0.6737, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.32% (2.4764 => 2.3942, std. dev.: 0.0131) MultiSource/Applications/kimwitu++/kc: -1.72% (11.9555 => 11.7495, std. dev.: 0.0220) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 23:50:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 01:50:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120714065020.613A62A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2055?compare_to=2051&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2055, Order: 160218, Start Time: 2012-07-14 05:36:40, End Time: 2012-07-14 06:50:28 To: 2051, Order: 160210, Start Time: 2012-07-14 01:23:41, End Time: 2012-07-14 02:37:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.13% (1.3848 => 1.4004, std. dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.96% (2.0176 => 2.2993, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 9.88% (0.5818 => 0.6393, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.74% (0.5748 => 0.6308, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.40% (0.7061 => 0.7725, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.17% (0.3578 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.07% (0.3650 => 0.3981, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 8.97% (0.3646 => 0.3973, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.94% (0.3601 => 0.3923, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.71% (0.3789 => 0.4119, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.71% (0.3663 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.69% (0.3623 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.58% (0.3914 => 0.4250, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.49% (0.4003 => 0.4343, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.38% (0.3940 => 0.4270, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.30% (0.1986 => 0.2131, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.41% (0.7710 => 0.8204, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 6.32% (1.3693 => 1.4559, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.97% (0.2596 => 0.2751, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.94% (0.5265 => 0.5578, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.94% (0.7038 => 0.7456, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.70% (0.2721 => 0.2876, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.4062 => 0.4288, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.56% (3.9660 => 4.1866, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash2: 5.52% (0.4328 => 0.4567, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.14% (0.2781 => 0.2924, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.10% (0.6959 => 0.7314, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.05% (0.2655 => 0.2789, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.00% (0.2782 => 0.2921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.94% (0.2690 => 0.2823, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.93% (0.3489 => 0.3661, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2607 => 0.2733, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.82% (1.9828 => 2.0784, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.82% (0.2966 => 0.3109, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.79% (0.2628 => 0.2754, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.72% (0.3580 => 0.3749, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.72% (0.3899 => 0.4083, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 4.71% (0.2761 => 0.2891, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.70% (0.2937 => 0.3075, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.70% (0.2726 => 0.2854, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.68% (16.6129 => 17.3899, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/except: 4.64% (0.2760 => 0.2888, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.53% (0.2696 => 0.2818, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.41% (0.3107 => 0.3244, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.35% (0.9199 => 0.9599, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.32% (0.3149 => 0.3285, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.26% (13.8202 => 14.4084, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/09-vor/vor: 4.24% (0.2925 => 0.3049, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.3192 => 0.3325, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.05% (1.2193 => 1.2687, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.01% (0.4390 => 0.4566, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3453 => 0.3591, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.5577 => 0.5799, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.93% (0.3534 => 0.3673, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.92% (0.2988 => 0.3105, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.91% (0.3756 => 0.3903, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.91% (0.4016 => 0.4173, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.89% (1.3813 => 1.4350, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.89% (0.3293 => 0.3421, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.88% (0.4379 => 0.4549, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 3.88% (0.7506 => 0.7797, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.86% (13.2842 => 13.7970, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.81% (0.5637 => 0.5852, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.81% (1.3819 => 1.4346, std. dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.74% (0.2914 => 0.3023, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.72% (1.4563 => 1.5105, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.70% (0.3246 => 0.3366, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.68% (7.2180 => 7.4834, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 3.65% (3.8646 => 4.0056, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 3.64% (1.1061 => 1.1464, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.63% (1.1364 => 1.1776, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.58% (1.3245 => 1.3719, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 3.53% (0.2945 => 0.3049, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.52% (0.3868 => 0.4004, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.42% (0.7460 => 0.7715, std. dev.: 0.0055) MultiSource/Applications/treecc/treecc: 3.38% (1.9270 => 1.9922, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.24% (1.0594 => 1.0937, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 3.07% (1.2292 => 1.2669, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.93% (0.3755 => 0.3865, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.81% (3.6692 => 3.7724, std. dev.: 0.0118) MultiSource/Applications/siod/siod: 2.63% (2.1791 => 2.2365, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.55% (4.9865 => 5.1139, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.51% (14.8535 => 15.2258, std. dev.: 0.0137) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (6.5754 => 6.7394, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.46% (4.3801 => 4.4880, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.34% (4.4433 => 4.5473, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.28% (1.1333 => 1.1591, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.22% (0.6135 => 0.6271, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.04% (3.1889 => 3.2539, std. dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: 1.98% (16.2614 => 16.5828, std. dev.: 0.0247) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (0.8698 => 0.8864, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.86% (14.5298 => 14.8003, std. dev.: 0.0171) MultiSource/Applications/SIBsim4/SIBsim4: 1.45% (1.2749 => 1.2934, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.1007 => 2.1231, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 25.14% (1.8175 => 2.2744, std. dev.: 0.0206) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.41% (2.0200 => 2.1899, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 7.74% (1.2998 => 1.4004, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6994, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7320, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6797, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.50% (1.7688 => 1.8307, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.81% (1.5089 => 1.5362, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (3.6469 => 3.7033, std. dev.: 0.0082) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (1.9290 => 1.9556, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.63% (0.4657 => 0.4162, std. dev.: 0.0119) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.95% (22.5627 => 20.9941, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.8818 => 0.8575, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.85% (0.0997 => 0.0839, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2308 => 1.1015, std. dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.12% (20.3410 => 18.4861, std. dev.: 0.0695) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3180, std. dev.: 0.0173) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.68% (2.6470 => 2.5497, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9127, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5914, std. dev.: 0.0187) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.01% (6.6320 => 6.4990, std. dev.: 0.0052) MultiSource/Applications/spiff/spiff: -1.79% (3.0263 => 2.9721, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9984, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.52% (6.3560 => 6.2594, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7947, std. dev.: 0.0106) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1476, std. dev.: 0.0544) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2390, std. dev.: 0.0087) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2233, std. dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2597, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 13 23:54:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 01:54:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120714065443.1ECB72A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2056?compare_to=2053&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2056, Order: 160218, Start Time: 2012-07-14 05:36:22, End Time: 2012-07-14 06:54:51 To: 2053, Order: 160210, Start Time: 2012-07-14 02:05:32, End Time: 2012-07-14 03:23:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (62 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (792 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.28% (1.1029 => 1.1170, std. dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.81% (10.3673 => 13.6651, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/trivial-interface: 13.01% (0.3473 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.70% (0.3497 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.68% (0.3516 => 0.3962, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.62% (0.3543 => 0.3990, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.59% (0.3543 => 0.3989, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.52% (0.3561 => 0.4007, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.09% (1.1194 => 1.2547, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 12.07% (0.3694 => 0.4140, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.53% (0.3886 => 0.4334, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3927 => 0.4375, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.68% (2.2022 => 2.3934, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.85% (1.7609 => 1.8991, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.19% (0.5925 => 0.6351, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.15% (0.6030 => 0.6461, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.42% (0.7326 => 0.7796, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.46% (10.4361 => 11.0058, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.16% (0.3177 => 0.3341, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.4879 => 0.5120, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 4.91% (0.3282 => 0.3443, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.78% (7.0540 => 7.3913, std. dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 3.55% (0.7433 => 0.7697, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.44% (0.8172 => 0.8453, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.36% (0.4615 => 0.4770, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.19% (4.9449 => 5.1027, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.98% (0.5569 => 0.5735, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.71% (5.0018 => 5.1372, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.66% (8.1363 => 8.3526, std. dev.: 0.0069) MultiSource/Applications/Burg/burg: 2.57% (1.1642 => 1.1941, std. dev.: 0.0048) MultiSource/Applications/spiff/spiff: 2.46% (0.7835 => 0.8028, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (14.3668 => 14.7188, std. dev.: 0.0162) MultiSource/Applications/hbd/hbd: 2.38% (1.5603 => 1.5975, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.38% (2.0665 => 2.1157, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.31% (4.2646 => 4.3631, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.31% (0.4636 => 0.4743, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.21% (9.4845 => 9.6942, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.17% (0.5860 => 0.5987, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.81% (1.1861 => 1.2076, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.81% (2.0273 => 2.0639, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.80% (0.8067 => 0.8212, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 1.79% (5.7591 => 5.8623, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 1.74% (3.3354 => 3.3936, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.56% (1.3050 => 1.3254, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.52% (1.5415 => 1.5649, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.49% (3.8723 => 3.9299, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 1.45% (1.2842 => 1.3028, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.24% (0.9765 => 0.9886, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.20% (1.4186 => 1.4356, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.19% (17.1811 => 17.3857, std. dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7466, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.20% (26.0924 => 26.6666, std. dev.: 0.0151) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (1.5086 => 1.5363, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.39% (2.6546 => 2.6916, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2424, std. dev.: 0.0298) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1257, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.82% (5.2763 => 3.1753, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.88% (5.3855 => 3.7223, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.61% (5.3526 => 3.7142, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.58% (2.9384 => 2.5688, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -10.45% (22.1758 => 19.8584, std. dev.: 0.0143) SingleSource/UnitTests/Vector/constpool: -5.20% (54.1659 => 51.3517, std. dev.: 0.0275) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.65% (3.8922 => 3.7891, std. dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.72% (1.2373 => 1.1170, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.34% (19.9488 => 18.4848, std. dev.: 0.0520) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9150, std. dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6859, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0841, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.07% (1.4460 => 1.4305, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 02:32:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 04:32:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120714093220.932C42A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2057?compare_to=2054&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2057, Order: 160218, Start Time: 2012-07-14 06:46:34, End Time: 2012-07-14 09:32:29 To: 2054, Order: 160210, Start Time: 2012-07-14 03:35:26, End Time: 2012-07-14 06:18:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (49 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (843 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.04% (1.6228 => 1.6397, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.07% (54.1891 => 54.7697, std. dev.: 0.1043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 31.57% (0.3792 => 0.4989, std. dev.: 0.0354) SingleSource/UnitTests/ObjC/exceptions-2: 13.61% (0.3446 => 0.3915, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.60% (0.3442 => 0.3910, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.59% (0.3465 => 0.3936, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.56% (0.3496 => 0.3970, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.50% (0.3488 => 0.3959, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 13.47% (0.3460 => 0.3926, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.15% (0.3650 => 0.4130, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 13.01% (0.3643 => 0.4117, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.65% (0.3724 => 0.4195, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 7.54% (0.5826 => 0.6265, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.32% (0.5889 => 0.6320, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.42% (0.1620 => 0.1724, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 6.14% (0.7171 => 0.7611, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.97% (0.5900 => 0.6193, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.95% (0.5026 => 0.5275, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.83% (3.5627 => 3.7347, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.81% (0.4994 => 0.5234, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.70% (1.6211 => 1.6973, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.29% (0.4361 => 0.4548, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: 4.24% (0.4029 => 0.4200, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.2866 => 0.2984, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.10% (0.5000 => 0.5205, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (1.3152 => 1.3691, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.01% (2.7292 => 2.8386, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.90% (4.2109 => 4.3751, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.84% (0.3930 => 0.4081, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.49% (1.9694 => 2.0381, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.29% (1.9966 => 2.0623, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.22% (0.9909 => 1.0228, std. dev.: 0.0057) MultiSource/Applications/d/make_dparser: 3.12% (1.0781 => 1.1117, std. dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: 3.06% (23.5202 => 24.2399, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.98% (0.4658 => 0.4797, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.92% (1.5932 => 1.6397, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.90% (2.0673 => 2.1273, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.83% (0.3890 => 0.4000, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 2.79% (2.1013 => 2.1600, std. dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 2.75% (5.5417 => 5.6939, std. dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 2.62% (2.1653 => 2.2220, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.47% (4.4195 => 4.5285, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 2.43% (4.6177 => 4.7299, std. dev.: 0.0073) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.42% (0.4139 => 0.4239, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.40% (0.6634 => 0.6793, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 2.38% (1.8794 => 1.9241, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 2.30% (0.7875 => 0.8056, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.26% (1.4269 => 1.4591, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 2.24% (0.9697 => 0.9914, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 1.89% (0.5546 => 0.5651, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.72% (2.4764 => 2.3844, std. dev.: 0.0336) MultiSource/Applications/kimwitu++/kc: -1.53% (11.9555 => 11.7731, std. dev.: 0.0176) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 13:36:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 15:36:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120714203614.3A9822A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2058?compare_to=2055&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2058, Order: 160219, Start Time: 2012-07-14 19:22:34, End Time: 2012-07-14 20:36:23 To: 2055, Order: 160218, Start Time: 2012-07-14 05:36:40, End Time: 2012-07-14 06:50:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (125 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (729 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.07% (2.0176 => 2.3014, std. dev.: 0.0174) SingleSource/UnitTests/ObjC++/property-reference-object: 9.93% (0.5818 => 0.6396, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.81% (0.5748 => 0.6312, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.94% (0.3578 => 0.3898, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.87% (0.7061 => 0.7687, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 8.75% (0.3601 => 0.3916, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.74% (0.3663 => 0.3983, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.71% (0.3650 => 0.3968, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/for-in: 8.68% (0.3789 => 0.4118, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 8.67% (0.3646 => 0.3962, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-3: 8.53% (0.3623 => 0.3932, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.38% (0.3940 => 0.4270, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.37% (0.4003 => 0.4338, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.33% (0.3914 => 0.4240, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.05% (0.1986 => 0.2126, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.63% (1.3693 => 1.4601, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.24% (0.7038 => 0.7477, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.20% (0.7710 => 0.8188, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.01% (0.2596 => 0.2752, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.98% (0.5265 => 0.5580, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.81% (0.2721 => 0.2879, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 5.73% (0.4328 => 0.4576, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.62% (3.9660 => 4.1888, std. dev.: 0.0119) SingleSource/Regression/C++/ofstream_ctor: 5.29% (0.2781 => 0.2928, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.16% (0.2655 => 0.2792, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 5.12% (0.4062 => 0.4270, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.10% (0.2782 => 0.2924, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.06% (0.2607 => 0.2739, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.06% (0.2690 => 0.2826, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.03% (0.3022 => 0.3174, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.93% (0.6959 => 0.7302, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 4.91% (0.2628 => 0.2757, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.89% (0.2966 => 0.3111, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.86% (0.2760 => 0.2894, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.79% (0.3489 => 0.3656, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.78% (0.2761 => 0.2893, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.78% (0.3580 => 0.3751, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 4.77% (0.2726 => 0.2856, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.77% (0.2937 => 0.3077, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.74% (0.2765 => 0.2896, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.74% (1.9828 => 2.0767, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.67% (0.2696 => 0.2822, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3899 => 0.4080, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 4.56% (16.6129 => 17.3708, std. dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (0.3485 => 0.3640, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.44% (0.2925 => 0.3055, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 4.41% (0.3107 => 0.3244, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.38% (13.8202 => 14.4258, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.38% (0.5577 => 0.5821, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.36% (0.9199 => 0.9600, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 4.35% (0.3149 => 0.3286, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.20% (13.2842 => 13.8428, std. dev.: 0.2098) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.20% (1.2193 => 1.2705, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 4.14% (0.3453 => 0.3596, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (0.3756 => 0.3911, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.10% (0.3192 => 0.3323, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.10% (0.7506 => 0.7814, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: 4.02% (0.2988 => 0.3108, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.01% (0.4016 => 0.4177, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.96% (0.3534 => 0.3674, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.95% (0.4379 => 0.4552, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 3.95% (0.3293 => 0.3423, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.92% (0.4390 => 0.4562, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 3.91% (3.8646 => 4.0157, std. dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.87% (0.5637 => 0.5855, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.77% (1.3813 => 1.4334, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.77% (1.1061 => 1.1478, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.77% (7.2180 => 7.4900, std. dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.74% (0.2914 => 0.3023, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.69% (1.1364 => 1.1783, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 3.67% (0.3868 => 0.4010, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.67% (0.3246 => 0.3365, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.66% (1.3245 => 1.3730, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 3.59% (1.9270 => 1.9961, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 3.50% (0.2945 => 0.3048, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.46% (1.0594 => 1.0961, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.30% (0.7460 => 0.7706, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.16% (1.2292 => 1.2680, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.06% (3.6692 => 3.7813, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.80% (4.9865 => 5.1261, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.80% (0.3755 => 0.3860, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.78% (6.5754 => 6.7585, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/football/football: 2.77% (0.8310 => 0.8540, std. dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 2.73% (14.8535 => 15.2592, std. dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.63% (4.3801 => 4.4954, std. dev.: 0.0120) MultiSource/Applications/siod/siod: 2.61% (2.1791 => 2.2359, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.46% (0.6135 => 0.6286, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.44% (4.4433 => 4.5518, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.35% (1.1333 => 1.1599, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.33% (3.1889 => 3.2633, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 2.15% (14.5298 => 14.8419, std. dev.: 0.0147) MultiSource/Applications/sqlite3/sqlite3: 2.15% (16.2614 => 16.6106, std. dev.: 0.0300) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.05% (0.8698 => 0.8876, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.83% (1.2749 => 1.2982, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.63% (1.8175 => 2.2651, std. dev.: 0.0515) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1918, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.15% (0.9996 => 1.0811, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.19% (1.2998 => 1.3933, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9229, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 3.73% (7.4271 => 7.7039, std. dev.: 0.0203) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6793, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1895, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5346, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (3.6469 => 3.7087, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9578, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1963, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.79% (22.5627 => 21.0314, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.34% (0.8818 => 0.8612, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.45% (0.0997 => 0.0843, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1105, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.66% (20.3410 => 18.5796, std. dev.: 0.0341) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.79% (1.3780 => 1.3120, std. dev.: 0.0065) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5502, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.19% (1.9762 => 1.9131, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.8259 => 8.5735, std. dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5100, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -1.76% (3.0263 => 2.9731, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2556, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9982, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1142, std. dev.: 0.0142) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7951, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.50% (0.9692 => 0.9547, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.49% (2.5254 => 2.4878, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8650, std. dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2426, std. dev.: 0.0109) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2362, std. dev.: 0.0373) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2619, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 13:41:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 15:41:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120714204109.7EC922A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2059?compare_to=2056&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2059, Order: 160219, Start Time: 2012-07-14 19:22:42, End Time: 2012-07-14 20:41:18 To: 2056, Order: 160218, Start Time: 2012-07-14 05:36:22, End Time: 2012-07-14 06:54:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (65 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (789 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.59% (13.6651 => 14.1557, std. dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.54% (10.3673 => 14.1557, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 12.84% (0.3473 => 0.3919, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.56% (0.3543 => 0.3988, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 12.50% (0.3497 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.45% (0.3543 => 0.3984, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 12.40% (0.3516 => 0.3952, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.33% (0.3561 => 0.4000, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.86% (1.1194 => 1.2522, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 11.44% (0.3828 => 0.4266, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3927 => 0.4375, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.37% (0.3886 => 0.4328, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.06% (2.2022 => 2.4017, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.34% (1.7609 => 1.9077, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 8.10% (0.1432 => 0.1548, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.99% (0.5925 => 0.6339, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 6.95% (0.6030 => 0.6449, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.15% (0.2065 => 0.2192, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 5.76% (0.7326 => 0.7748, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 5.45% (10.4361 => 11.0047, std. dev.: 0.0354) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.21% (7.0540 => 7.4218, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/oourafft: 5.15% (0.3282 => 0.3451, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.4879 => 0.5121, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 4.06% (0.7433 => 0.7735, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.52% (0.8172 => 0.8460, std. dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.27% (0.4615 => 0.4766, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.27% (5.0018 => 5.1653, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5569 => 0.5750, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.21% (4.9449 => 5.1036, std. dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.12% (8.1363 => 8.3905, std. dev.: 0.0104) MultiSource/Applications/hbd/hbd: 3.04% (1.5603 => 1.6078, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (14.3668 => 14.7958, std. dev.: 0.0069) MultiSource/Benchmarks/McCat/18-imp/imp: 2.92% (0.3423 => 0.3523, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.87% (0.7835 => 0.8060, std. dev.: 0.0069) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.76% (4.2646 => 4.3825, std. dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (9.4845 => 9.7412, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.66% (0.5860 => 0.6016, std. dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 2.54% (5.7591 => 5.9052, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 2.37% (0.4299 => 0.4401, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.34% (1.1861 => 1.2139, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.31% (2.0665 => 2.1143, std. dev.: 0.0034) MultiSource/Applications/d/make_dparser: 2.29% (3.3354 => 3.4119, std. dev.: 0.0056) MultiSource/Applications/Burg/burg: 2.19% (1.1642 => 1.1897, std. dev.: 0.0088) MultiSource/Applications/treecc/treecc: 2.11% (2.0273 => 2.0700, std. dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 2.01% (17.1811 => 17.5261, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.99% (1.3050 => 1.3310, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 1.95% (3.8723 => 3.9478, std. dev.: 0.0136) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.90% (1.5415 => 1.5708, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.86% (0.6450 => 0.6570, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.68% (0.9765 => 0.9929, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.66% (1.4186 => 1.4422, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 1.61% (0.6456 => 0.6560, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.57% (1.2842 => 1.3044, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.09% (2.2024 => 2.2265, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.80% (1.1145 => 1.1903, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.16% (3.6395 => 3.7545, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.13% (26.0924 => 26.6479, std. dev.: 0.0242) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.81% (1.5086 => 1.5359, std. dev.: 0.0035) MultiSource/Applications/minisat/minisat: 1.47% (9.1159 => 9.2497, std. dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4462, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6898, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.01% (5.2763 => 3.1652, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.67% (5.3855 => 3.7337, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.39% (5.3526 => 3.7261, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.09% (2.9384 => 2.5537, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -10.16% (22.1758 => 19.9220, std. dev.: 0.0573) SingleSource/UnitTests/Vector/constpool: -5.05% (54.1659 => 51.4312, std. dev.: 0.0363) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.07% (3.8922 => 3.8115, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.52% (1.2373 => 1.1071, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.84% (19.9488 => 18.5839, std. dev.: 0.0290) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (8.1563 => 7.9248, std. dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6920, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0850, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.05% (1.4460 => 1.4308, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 15:06:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 17:06:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120714220615.494F52A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2060?compare_to=2057&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2060, Order: 160219, Start Time: 2012-07-14 19:22:40, End Time: 2012-07-14 22:06:25 To: 2057, Order: 160218, Start Time: 2012-07-14 06:46:34, End Time: 2012-07-14 09:32:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (47 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (846 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.09% (125.3772 => 130.5047, std. dev.: 0.5923) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 29.40% (0.3792 => 0.4907, std. dev.: 0.0412) SingleSource/UnitTests/ObjC/exceptions-2: 13.35% (0.3446 => 0.3906, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.30% (0.3465 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.28% (0.3442 => 0.3899, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.24% (0.3460 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.19% (0.3488 => 0.3948, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 13.13% (0.3496 => 0.3955, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.12% (0.3469 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.79% (0.3650 => 0.4117, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.74% (0.3643 => 0.4107, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/parameter-passing: 12.27% (0.3724 => 0.4181, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.17% (0.5826 => 0.6244, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.93% (0.5889 => 0.6297, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.1620 => 0.1722, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 5.38% (0.7171 => 0.7557, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.64% (1.6211 => 1.6964, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.63% (3.5627 => 3.7275, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.25% (0.5900 => 0.6151, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.10% (0.5000 => 0.5205, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.06% (0.4361 => 0.4538, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.03% (1.3152 => 1.3682, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.96% (0.4994 => 0.5192, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.96% (0.5026 => 0.5225, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 3.94% (1.5932 => 1.6559, std. dev.: 0.0088) MultiSource/Applications/spiff/spiff: 3.92% (0.4029 => 0.4187, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.72% (0.3930 => 0.4076, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.62% (2.7292 => 2.8281, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 3.42% (4.2109 => 4.3550, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.12% (1.9694 => 2.0309, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.98% (1.9966 => 2.0560, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 2.90% (1.0781 => 1.1094, std. dev.: 0.0121) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.78% (0.3890 => 0.3998, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.75% (0.4658 => 0.4786, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 2.63% (2.1013 => 2.1565, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 2.62% (4.6177 => 4.7387, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 2.61% (0.9909 => 1.0168, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (1.8794 => 1.9283, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.60% (23.5202 => 24.1319, std. dev.: 0.0119) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (2.1653 => 2.2216, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (4.4195 => 4.5289, std. dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 2.43% (5.5417 => 5.6765, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.37% (2.0673 => 2.1162, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.18% (0.7875 => 0.8047, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.01% (0.9697 => 0.9892, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 1.88% (0.5546 => 0.5650, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.84% (1.4269 => 1.4532, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.60% (0.6634 => 0.6740, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.67% (11.9555 => 11.7564, std. dev.: 0.0103) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 15:17:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 17:17:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120714221747.34CAA2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2061?compare_to=2058&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2061, Order: 160220, Start Time: 2012-07-14 21:04:03, End Time: 2012-07-14 22:17:56 To: 2058, Order: 160219, Start Time: 2012-07-14 19:22:34, End Time: 2012-07-14 20:36:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (128 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.95% (54.8297 => 56.4498, std. dev.: 0.0242) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.20% (78.0727 => 79.7885, std. dev.: 0.3912) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.99% (2.0176 => 2.2999, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 9.97% (0.5818 => 0.6398, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.83% (0.5748 => 0.6313, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 9.23% (0.7061 => 0.7713, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.00% (0.3578 => 0.3900, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.72% (0.3623 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.72% (0.3646 => 0.3964, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.72% (0.3601 => 0.3915, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.63% (0.3663 => 0.3979, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.60% (0.3650 => 0.3964, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.50% (0.3789 => 0.4111, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.41% (0.3914 => 0.4243, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.32% (0.3940 => 0.4268, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.32% (0.4003 => 0.4336, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1986 => 0.2127, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.28% (1.3693 => 1.4553, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.16% (0.7710 => 0.8185, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 6.07% (0.7038 => 0.7465, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.89% (0.2596 => 0.2749, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.81% (0.5265 => 0.5571, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 5.68% (0.4328 => 0.4574, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.66% (0.2721 => 0.2875, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.57% (3.9660 => 4.1871, std. dev.: 0.0043) SingleSource/Regression/C++/ofstream_ctor: 5.36% (0.2781 => 0.2930, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.26% (0.3022 => 0.3181, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2782 => 0.2928, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.14% (0.2607 => 0.2741, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.13% (0.2690 => 0.2828, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.10% (0.4062 => 0.4269, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.07% (0.2760 => 0.2900, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.94% (0.6959 => 0.7303, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.93% (0.2655 => 0.2786, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.90% (0.3899 => 0.4090, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.86% (0.3580 => 0.3754, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.82% (0.2966 => 0.3109, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.81% (0.2765 => 0.2898, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.80% (0.2937 => 0.3078, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.79% (0.3489 => 0.3656, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.77% (0.2726 => 0.2856, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.75% (0.2696 => 0.2824, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.75% (1.9828 => 2.0769, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.74% (0.2761 => 0.2892, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.72% (1.2193 => 1.2768, std. dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: 4.60% (16.6129 => 17.3770, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ary: 4.51% (0.3107 => 0.3247, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (0.3149 => 0.3288, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.38% (13.8202 => 14.4254, std. dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.34% (0.9199 => 0.9598, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 4.32% (0.3453 => 0.3602, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.18% (0.4016 => 0.4184, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.17% (0.2925 => 0.3047, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.15% (0.3756 => 0.3912, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.14% (0.3192 => 0.3324, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.10% (13.2842 => 13.8283, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 4.08% (0.2988 => 0.3110, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.02% (0.7506 => 0.7808, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 3.99% (0.3534 => 0.3675, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.98% (0.3293 => 0.3424, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.94% (0.5577 => 0.5797, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.88% (0.4379 => 0.4549, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.87% (0.4390 => 0.4560, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.81% (0.5637 => 0.5852, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.79% (1.3245 => 1.3747, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.75% (7.2180 => 7.4885, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.71% (1.4563 => 1.5103, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.70% (0.3246 => 0.3366, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.65% (1.1061 => 1.1465, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.65% (1.1364 => 1.1779, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.63% (3.8646 => 4.0050, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.60% (1.3819 => 1.4317, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.59% (1.3813 => 1.4309, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.57% (0.2914 => 0.3018, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.57% (0.3868 => 0.4006, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.50% (0.2945 => 0.3048, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.48% (1.9270 => 1.9941, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.46% (0.7460 => 0.7718, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.35% (1.0594 => 1.0949, std. dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 3.16% (1.2292 => 1.2680, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.03% (3.6692 => 3.7802, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3755 => 0.3861, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (6.5754 => 6.7567, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.74% (14.8535 => 15.2607, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8310 => 0.8535, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.64% (4.3801 => 4.4959, std. dev.: 0.0111) MultiSource/Applications/siod/siod: 2.60% (2.1791 => 2.2358, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.57% (4.9865 => 5.1145, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.43% (4.4433 => 4.5512, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.31% (0.6135 => 0.6277, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.29% (1.1333 => 1.1592, std. dev.: 0.0041) MultiSource/Applications/d/make_dparser: 2.24% (3.1889 => 3.2603, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.17% (16.2614 => 16.6149, std. dev.: 0.0114) MultiSource/Applications/ClamAV/clamscan: 2.08% (14.5298 => 14.8321, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.94% (0.8698 => 0.8867, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.2749 => 1.2970, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.09% (2.1007 => 2.1237, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.81% (0.4846 => 0.6969, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 24.74% (1.8175 => 2.2672, std. dev.: 0.0211) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1918, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.69% (1.2998 => 1.3868, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.10% (7.4271 => 7.7317, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9201, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6787, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.50% (1.7688 => 1.8307, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9742, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5354, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.53% (3.6469 => 3.7026, std. dev.: 0.0075) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.20% (1.9290 => 1.9522, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.84% (22.5627 => 21.0191, std. dev.: 0.0144) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.23% (0.8818 => 0.8621, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1126, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.83% (20.3410 => 18.5446, std. dev.: 0.0550) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.42% (1.3780 => 1.3033, std. dev.: 0.0072) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.28% (1.9762 => 1.9113, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5924, std. dev.: 0.0228) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5100, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -1.79% (3.0263 => 2.9722, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2532, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.56% (2.5254 => 2.4860, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7947, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.39% (0.8342 => 0.8226, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1506, std. dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2395, std. dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2518, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8706, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2255, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.15% (0.9692 => 0.9581, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 15:27:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 17:27:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120714222706.53E282A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2062?compare_to=2059&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2062, Order: 160220, Start Time: 2012-07-14 21:09:02, End Time: 2012-07-14 22:27:16 To: 2059, Order: 160219, Start Time: 2012-07-14 19:22:42, End Time: 2012-07-14 20:41:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (66 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (788 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.06% (54.9482 => 56.0811, std. dev.: 0.2473) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.05% (1.5443 => 1.5281, std. dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.50% (10.3673 => 14.1517, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/trivial-interface: 12.81% (0.3473 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.58% (0.3497 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.53% (0.3543 => 0.3987, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.44% (0.3561 => 0.4004, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3516 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.42% (0.3543 => 0.3983, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2529, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.48% (0.3886 => 0.4332, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.43% (0.3927 => 0.4376, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.06% (2.2022 => 2.4018, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 8.45% (0.1432 => 0.1553, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.32% (1.7609 => 1.9074, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 7.11% (0.5925 => 0.6346, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.00% (0.6030 => 0.6452, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.73% (0.7326 => 0.7746, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.47% (10.4361 => 11.0071, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.32% (7.0540 => 7.4290, std. dev.: 0.0096) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.3177 => 0.3343, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 5.21% (0.3282 => 0.3453, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.98% (0.4879 => 0.5122, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.7433 => 0.7756, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.46% (0.8172 => 0.8455, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.40% (0.4615 => 0.4772, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.27% (0.5569 => 0.5751, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.25% (5.0018 => 5.1645, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (4.9449 => 5.1041, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.10% (8.1363 => 8.3888, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: 3.04% (0.7835 => 0.8073, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 2.98% (0.3423 => 0.3525, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.90% (14.3668 => 14.7829, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.81% (4.2646 => 4.3845, std. dev.: 0.0096) MultiSource/Applications/hbd/hbd: 2.78% (1.5603 => 1.6036, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.73% (0.5860 => 0.6020, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (9.4845 => 9.7418, std. dev.: 0.0111) MultiSource/Applications/oggenc/oggenc: 2.56% (5.7591 => 5.9064, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 2.47% (0.4299 => 0.4405, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.40% (2.0665 => 2.1161, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.37% (1.1642 => 1.1918, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.34% (3.3354 => 3.4133, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.33% (1.1861 => 1.2137, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.23% (2.0273 => 2.0726, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.10% (3.8723 => 3.9537, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.08% (1.3050 => 1.3321, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.03% (1.5415 => 1.5728, std. dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: 1.93% (17.1811 => 17.5119, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.83% (0.6450 => 0.6568, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.73% (0.9765 => 0.9934, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 1.69% (0.6456 => 0.6565, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.66% (1.4186 => 1.4421, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.64% (1.2842 => 1.3052, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.09% (2.2024 => 2.2265, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.26% (3.6395 => 3.7581, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 2.31% (26.0924 => 26.6941, std. dev.: 0.0181) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.25% (1.0313 => 1.0545, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (1.5086 => 1.5370, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2386, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6899, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.93% (5.2763 => 3.1695, std. dev.: 0.0154) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.66% (5.3855 => 3.7344, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.40% (5.3526 => 3.7255, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.19% (2.9384 => 2.5507, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -10.13% (22.1758 => 19.9285, std. dev.: 0.0204) SingleSource/UnitTests/Vector/constpool: -5.03% (54.1659 => 51.4426, std. dev.: 0.0297) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.99% (3.8922 => 3.8148, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.00% (1.2373 => 1.1136, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.17% (19.9488 => 18.5186, std. dev.: 0.0326) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9126, std. dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6861, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0861, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.02% (1.4460 => 1.4312, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 16:59:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 18:59:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120714235913.1FB2A2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2063?compare_to=2061&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2063, Order: 160221, Start Time: 2012-07-14 22:45:38, End Time: 2012-07-14 23:59:22 To: 2061, Order: 160220, Start Time: 2012-07-14 21:04:03, End Time: 2012-07-14 22:17:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (129 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.46% (2.2672 => 2.3457, std. dev.: 0.0220) SingleSource/Benchmarks/Misc/mandel-2: 1.77% (1.3868 => 1.4114, std. dev.: 0.0087) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.88% (2.0176 => 2.2977, std. dev.: 0.0103) SingleSource/UnitTests/ObjC++/property-reference-object: 9.88% (0.5818 => 0.6393, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.81% (0.7061 => 0.7754, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.76% (0.5748 => 0.6309, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.92% (0.3578 => 0.3897, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 8.74% (0.3663 => 0.3983, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 8.69% (0.3601 => 0.3914, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3646 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.61% (0.3623 => 0.3935, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.58% (0.3650 => 0.3963, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.46% (0.3914 => 0.4245, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.45% (0.3789 => 0.4109, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.27% (0.4003 => 0.4334, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 8.15% (0.3940 => 0.4261, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.28% (0.3130 => 0.3358, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.25% (0.1986 => 0.2130, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 6.53% (1.3693 => 1.4587, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.27% (0.7038 => 0.7479, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.2596 => 0.2756, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.08% (0.7710 => 0.8179, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.93% (0.5265 => 0.5577, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.84% (0.2721 => 0.2880, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.66% (3.9660 => 4.1905, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash2: 5.57% (0.4328 => 0.4569, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.18% (0.2781 => 0.2925, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.16% (0.6959 => 0.7318, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.03% (0.2782 => 0.2922, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.00% (0.4062 => 0.4265, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 4.95% (0.2607 => 0.2736, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.94% (0.2690 => 0.2823, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.80% (0.3580 => 0.3752, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.78% (0.2655 => 0.2782, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.74% (0.2761 => 0.2892, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.70% (0.3489 => 0.3653, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.69% (0.2966 => 0.3105, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.68% (0.2628 => 0.2751, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.67% (1.9828 => 2.0754, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.67% (0.3899 => 0.4081, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.67% (0.2765 => 0.2894, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.66% (0.2937 => 0.3074, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.60% (0.2696 => 0.2820, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.57% (0.9199 => 0.9619, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 4.57% (0.2760 => 0.2886, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.52% (13.8202 => 14.4452, std. dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 4.50% (16.6129 => 17.3604, std. dev.: 0.0273) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3485 => 0.3641, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.44% (0.3107 => 0.3245, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.38% (0.5577 => 0.5821, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 4.35% (0.3149 => 0.3286, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.34% (0.2925 => 0.3052, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.28% (0.7506 => 0.7827, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.20% (1.2193 => 1.2705, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.19% (13.2842 => 13.8411, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3453 => 0.3593, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.04% (0.4379 => 0.4556, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.04% (0.3192 => 0.3321, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.03% (1.3245 => 1.3779, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.02% (1.3819 => 1.4374, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 3.98% (0.2988 => 0.3107, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.98% (1.3813 => 1.4363, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 3.98% (0.3293 => 0.3424, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.96% (0.4390 => 0.4564, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 3.96% (0.3534 => 0.3674, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.94% (0.3756 => 0.3904, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.91% (0.4016 => 0.4173, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.83% (0.5637 => 0.5853, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 3.82% (1.1061 => 1.1484, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.81% (7.2180 => 7.4928, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.80% (1.4563 => 1.5117, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.77% (1.1364 => 1.1792, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.76% (0.3246 => 0.3368, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3868 => 0.4012, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.71% (3.8646 => 4.0079, std. dev.: 0.0136) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.71% (0.2914 => 0.3022, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.68% (1.9270 => 1.9980, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.57% (0.7460 => 0.7726, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.49% (1.0594 => 1.0964, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 3.43% (0.2945 => 0.3046, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.12% (3.6692 => 3.7836, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 3.10% (1.2292 => 1.2673, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.92% (0.8310 => 0.8553, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (6.5754 => 6.7664, std. dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 2.90% (14.8535 => 15.2849, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.77% (4.3801 => 4.5013, std. dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.76% (4.9865 => 5.1243, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3755 => 0.3858, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.69% (2.1791 => 2.2378, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.62% (4.4433 => 4.5599, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 2.53% (0.4113 => 0.4217, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.1333 => 1.1616, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.46% (0.6135 => 0.6286, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.33% (16.2614 => 16.6398, std. dev.: 0.0054) MultiSource/Applications/d/make_dparser: 2.31% (3.1889 => 3.2627, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 2.25% (14.5298 => 14.8567, std. dev.: 0.0193) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.98% (0.8698 => 0.8870, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.91% (1.2749 => 1.2992, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.69% (0.6283 => 0.6389, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 1.31% (4.6629 => 4.7241, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (1.5188 => 1.5348, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (8.4961 => 8.5817, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 29.06% (1.8175 => 2.3457, std. dev.: 0.0220) SingleSource/Benchmarks/Misc/mandel-2: 8.59% (1.2998 => 1.4114, std. dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.24% (2.0200 => 2.1864, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6988, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7295, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.76% (12.4560 => 12.9238, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0310 => 1.0567, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.49% (3.6469 => 3.7011, std. dev.: 0.0064) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.10% (0.4657 => 0.4140, std. dev.: 0.0106) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.79% (22.5627 => 21.0312, std. dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.91% (0.2670 => 0.2539, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.71% (0.8818 => 0.8667, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.75% (0.0997 => 0.0840, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.05% (1.2308 => 1.1071, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.48% (20.3410 => 18.6166, std. dev.: 0.0630) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.55% (1.3780 => 1.3153, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9129, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6022, std. dev.: 0.0170) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4472, std. dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5099, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: -1.77% (3.0263 => 2.9727, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.62% (26.5159 => 26.0867, std. dev.: 0.0307) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2532, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7948, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8633, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2176, std. dev.: 0.0389) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2392, std. dev.: 0.0239) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2578, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 17:12:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 19:12:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120715001259.836BD2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2064?compare_to=2062&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2064, Order: 160221, Start Time: 2012-07-14 22:55:00, End Time: 2012-07-15 00:13:09 To: 2062, Order: 160220, Start Time: 2012-07-14 21:09:02, End Time: 2012-07-14 22:27:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (61 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (793 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.17% (79.0437 => 79.9665, std. dev.: 0.3388) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.72% (14.1517 => 13.7663, std. dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.79% (10.3673 => 13.7663, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 12.99% (0.3473 => 0.3924, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.77% (0.3516 => 0.3965, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.70% (0.3497 => 0.3941, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.67% (0.3543 => 0.3992, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.62% (0.3543 => 0.3990, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.52% (0.3561 => 0.4007, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.15% (0.3694 => 0.4143, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 11.76% (0.3886 => 0.4343, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.73% (0.3828 => 0.4277, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.59% (0.3927 => 0.4382, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.42% (1.1194 => 1.2472, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.17% (2.2022 => 2.3822, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.03% (1.7609 => 1.9023, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.17% (0.5925 => 0.6350, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.05% (0.6030 => 0.6455, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.76% (0.7326 => 0.7748, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.18% (10.4361 => 10.9766, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.3177 => 0.3336, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.88% (0.4879 => 0.5117, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.73% (7.0540 => 7.3878, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.71% (0.7433 => 0.7709, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.32% (0.8172 => 0.8443, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.16% (0.5569 => 0.5745, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.14% (0.4615 => 0.4760, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.88% (5.0018 => 5.1459, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.87% (4.9449 => 5.0868, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.72% (8.1363 => 8.3578, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 2.59% (0.7835 => 0.8038, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 2.54% (9.4845 => 9.7251, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 2.48% (1.5603 => 1.5990, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.43% (4.2646 => 4.3682, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (14.3668 => 14.7140, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.25% (0.5860 => 0.5992, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.14% (5.7591 => 5.8824, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.07% (0.8067 => 0.8234, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.91% (1.1861 => 1.2087, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.87% (2.0665 => 2.1052, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 1.86% (1.1642 => 1.1859, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.78% (2.0273 => 2.0633, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.75% (0.6450 => 0.6563, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 1.72% (3.3354 => 3.3928, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.69% (1.3050 => 1.3271, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.62% (3.8723 => 3.9352, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.56% (1.5415 => 1.5656, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.41% (0.9765 => 0.9903, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.30% (1.4186 => 1.4370, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.23% (1.2842 => 1.3000, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.21% (17.1811 => 17.3884, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (3.6395 => 3.7599, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0560, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.21% (26.0924 => 26.6683, std. dev.: 0.0345) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (1.5086 => 1.5372, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2313, std. dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6882, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1259, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.09% (5.2763 => 3.1608, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.00% (5.3855 => 3.7162, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.65% (5.3526 => 3.7119, std. dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.28% (2.9384 => 2.5481, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -10.49% (22.1758 => 19.8504, std. dev.: 0.0081) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3285, std. dev.: 0.0225) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.40% (3.8922 => 3.7988, std. dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2373 => 1.1164, std. dev.: 0.0182) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.48% (19.9488 => 18.4572, std. dev.: 0.0970) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.88% (8.1563 => 7.9210, std. dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6927, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0867, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: -1.08% (1.4460 => 1.4304, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 18:17:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 20:17:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120715011725.B4E0D2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2065?compare_to=2060&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2065, Order: 160221, Start Time: 2012-07-14 22:34:20, End Time: 2012-07-15 01:17:34 To: 2060, Order: 160219, Start Time: 2012-07-14 19:22:40, End Time: 2012-07-14 22:06:25 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (46 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (846 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.84% (0.3446 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.82% (0.3460 => 0.3938, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3465 => 0.3942, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/trivial-interface: 13.74% (0.3442 => 0.3915, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 13.70% (0.3496 => 0.3975, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.65% (0.3488 => 0.3964, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.64% (0.3469 => 0.3942, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/property: 13.23% (0.3650 => 0.4133, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.12% (0.3643 => 0.4121, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.73% (0.3724 => 0.4198, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.42% (0.5826 => 0.6258, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.17% (0.5889 => 0.6311, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.91% (0.7171 => 0.7595, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.73% (1.6211 => 1.6977, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.72% (3.5627 => 3.7309, std. dev.: 0.0074) MultiSource/Applications/spiff/spiff: 4.27% (0.4029 => 0.4201, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.24% (0.4361 => 0.4546, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.18% (1.3152 => 1.3702, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.14% (0.5900 => 0.6144, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.00% (0.4994 => 0.5194, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.88% (0.5026 => 0.5221, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.84% (0.5000 => 0.5192, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.81% (2.7292 => 2.8333, std. dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.74% (0.3930 => 0.4077, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 3.52% (4.2109 => 4.3590, std. dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 3.51% (1.5932 => 1.6492, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.21% (1.9694 => 2.0326, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.98% (1.9966 => 2.0561, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.92% (1.0781 => 1.1096, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.85% (0.3890 => 0.4001, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.68% (0.4658 => 0.4783, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.64% (23.5202 => 24.1412, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (4.4195 => 4.5333, std. dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: 2.55% (0.9909 => 1.0162, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.50% (2.1013 => 2.1539, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 2.50% (0.9697 => 0.9939, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.48% (2.0673 => 2.1186, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 2.48% (2.1653 => 2.2190, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 2.42% (4.6177 => 4.7293, std. dev.: 0.0116) MultiSource/Applications/Burg/burg: 2.36% (0.5546 => 0.5677, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.35% (1.8794 => 1.9236, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 2.31% (0.7875 => 0.8057, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.28% (5.5417 => 5.6679, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 2.13% (0.6634 => 0.6775, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 1.84% (1.4269 => 1.4532, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.05% (2.8036 => 2.8329, std. dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.30% (2.4764 => 2.3946, std. dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: -1.80% (11.9555 => 11.7404, std. dev.: 0.0182) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 18:40:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 20:40:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120715014042.071A52A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2066?compare_to=2063&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2066, Order: 160222, Start Time: 2012-07-15 00:27:06, End Time: 2012-07-15 01:40:50 To: 2063, Order: 160221, Start Time: 2012-07-14 22:45:38, End Time: 2012-07-14 23:59:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (133 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (719 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.29% (2.0754 => 2.1021, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -3.17% (2.3457 => 2.2713, std. dev.: 0.0139) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.02% (2.0176 => 2.3004, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.30% (0.5818 => 0.6417, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 10.18% (0.5748 => 0.6333, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.11% (0.7061 => 0.7775, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 9.73% (0.3578 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.53% (0.3601 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.37% (0.3650 => 0.3992, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.35% (0.3646 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.31% (0.3663 => 0.4004, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 9.30% (0.3623 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.26% (0.3789 => 0.4140, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.07% (0.3914 => 0.4269, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.02% (0.4003 => 0.4364, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.98% (0.3940 => 0.4294, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.35% (0.3130 => 0.3360, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.30% (0.1986 => 0.2131, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.03% (1.3693 => 1.4655, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.62% (0.2781 => 0.2965, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.35% (0.3022 => 0.3214, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.29% (0.2607 => 0.2771, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.28% (0.2690 => 0.2859, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.28% (0.4062 => 0.4317, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.27% (0.2966 => 0.3152, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.27% (0.7038 => 0.7479, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.20% (0.7710 => 0.8188, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2760 => 0.2931, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.2596 => 0.2756, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.16% (0.2726 => 0.2894, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.13% (0.5265 => 0.5588, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2628 => 0.2789, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2761 => 0.2930, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.08% (0.2765 => 0.2933, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.02% (1.9828 => 2.1021, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.99% (0.2937 => 0.3113, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.97% (0.2696 => 0.2857, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.81% (3.9660 => 4.1963, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.79% (0.3107 => 0.3287, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.79% (0.3489 => 0.3691, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.78% (0.3580 => 0.3787, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.78% (0.3149 => 0.3331, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.64% (0.3899 => 0.4119, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.63% (0.6959 => 0.7351, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.56% (0.4390 => 0.4634, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (0.3485 => 0.3678, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.51% (0.2721 => 0.2871, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.39% (0.3453 => 0.3639, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.36% (0.3192 => 0.3363, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.15% (0.3534 => 0.3716, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.10% (0.3293 => 0.3461, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (0.3756 => 0.3947, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.05% (0.4016 => 0.4219, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.88% (16.6129 => 17.4239, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/moments: 4.78% (0.3868 => 0.4053, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.72% (0.9199 => 0.9633, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.69% (13.8202 => 14.4681, std. dev.: 0.0154) MultiSource/Benchmarks/McCat/09-vor/vor: 4.55% (0.2925 => 0.3058, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.41% (1.2193 => 1.2731, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.33% (13.2842 => 13.8589, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: 4.32% (0.7506 => 0.7830, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.30% (0.5577 => 0.5817, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 4.12% (1.2292 => 1.2798, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.03% (0.5637 => 0.5864, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.97% (0.4379 => 0.4553, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.92% (3.8646 => 4.0162, std. dev.: 0.0091) MultiSource/Applications/Burg/burg: 3.91% (1.1061 => 1.1494, std. dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.91% (0.2914 => 0.3028, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.89% (1.3245 => 1.3760, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.87% (7.2180 => 7.4976, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.4563 => 1.5127, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.85% (0.3246 => 0.3371, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.85% (1.1364 => 1.1801, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.80% (1.3813 => 1.4338, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.76% (1.3819 => 1.4338, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.75% (0.3755 => 0.3896, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.75% (1.9270 => 1.9993, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.0594 => 1.0976, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.57% (0.7460 => 0.7726, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 3.20% (0.3220 => 0.3323, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.10% (4.9865 => 5.1410, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.03% (3.6692 => 3.7805, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 2.96% (0.8310 => 0.8556, std. dev.: 0.0092) MultiSource/Applications/siod/siod: 2.96% (2.1791 => 2.2436, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.83% (4.3801 => 4.5039, std. dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 2.79% (14.8535 => 15.2682, std. dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 2.77% (6.5754 => 6.7574, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.69% (0.8698 => 0.8932, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.69% (0.6135 => 0.6300, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.66% (4.4433 => 4.5617, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 2.55% (0.4113 => 0.4218, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.52% (1.1333 => 1.1619, std. dev.: 0.0107) MultiSource/Applications/d/make_dparser: 2.33% (3.1889 => 3.2633, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 2.30% (14.5298 => 14.8639, std. dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: 2.24% (16.2614 => 16.6259, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.4791 => 0.4897, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.98% (1.2749 => 1.3001, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.88% (0.6283 => 0.6401, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (2.1007 => 2.1313, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.18% (1.5188 => 1.5367, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 1.05% (4.6629 => 4.7119, std. dev.: 0.0148) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (8.4961 => 8.5818, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.97% (1.8175 => 2.2713, std. dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.30% (2.0200 => 2.1877, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.52% (1.2998 => 1.3975, std. dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.44% (1.5824 => 1.7002, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (4.5947 => 4.8136, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7353, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6786, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0172) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1916, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5352, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6469 => 3.7090, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9575, std. dev.: 0.0077) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.91% (0.4657 => 0.4149, std. dev.: 0.0191) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.54% (22.5627 => 21.0868, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3511 => 0.3399, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.18% (0.8818 => 0.8626, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.28% (1.2308 => 1.1043, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.94% (20.3410 => 18.5235, std. dev.: 0.0569) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std. dev.: 0.0140) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.24% (1.9762 => 1.9121, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5940, std. dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: -2.52% (2.5089 => 2.4457, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.01% (6.6320 => 6.4986, std. dev.: 0.0054) MultiSource/Applications/spiff/spiff: -1.77% (3.0263 => 2.9728, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2564, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7952, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.51% (2.5254 => 2.4873, std. dev.: 0.0014) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1234, std. dev.: 0.0177) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2409, std. dev.: 0.0248) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2251, std. dev.: 0.0415) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2541, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 18:58:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 20:58:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120715015847.7F7D92A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2067?compare_to=2064&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2067, Order: 160222, Start Time: 2012-07-15 00:40:51, End Time: 2012-07-15 01:58:57 To: 2064, Order: 160221, Start Time: 2012-07-14 22:55:00, End Time: 2012-07-15 00:13:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (58 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (796 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.85% (54.9655 => 56.5312, std. dev.: 0.0277) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.28% (13.7663 => 13.3149, std. dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.43% (10.3673 => 13.3149, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: 12.12% (0.3473 => 0.3894, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.87% (0.3497 => 0.3912, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.83% (0.3516 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.83% (0.3543 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.74% (0.3543 => 0.3959, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.71% (0.3561 => 0.3978, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.38% (1.1194 => 1.2468, std. dev.: 0.0148) SingleSource/UnitTests/ObjC/for-in: 11.32% (0.3694 => 0.4112, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.08% (0.3828 => 0.4252, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.87% (0.3927 => 0.4354, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.86% (0.3886 => 0.4308, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.68% (2.2022 => 2.3713, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.59% (1.7609 => 1.8945, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 6.98% (0.1432 => 0.1532, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.45% (0.5925 => 0.6307, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.33% (0.6030 => 0.6412, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.47% (0.2065 => 0.2178, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.06% (0.7326 => 0.7697, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.66% (10.4361 => 10.9226, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.50% (0.3177 => 0.3320, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.25% (7.0540 => 7.3537, std. dev.: 0.0180) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.16% (0.4879 => 0.5082, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 4.08% (0.3282 => 0.3416, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.48% (0.7433 => 0.7692, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.11% (0.8172 => 0.8426, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.07% (0.5569 => 0.5740, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.80% (0.4615 => 0.4744, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.54% (5.0018 => 5.1290, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (4.9449 => 5.0702, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.30% (8.1363 => 8.3236, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 2.30% (0.7835 => 0.8015, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (14.3668 => 14.6628, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.05% (0.5860 => 0.5980, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.04% (4.2646 => 4.3518, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 1.96% (9.4845 => 9.6704, std. dev.: 0.0074) MultiSource/Applications/hbd/hbd: 1.86% (1.5603 => 1.5893, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 1.86% (5.7591 => 5.8661, std. dev.: 0.0131) MultiSource/Applications/Burg/burg: 1.67% (1.1642 => 1.1837, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.67% (1.1861 => 1.2059, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.58% (2.0665 => 2.0992, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 1.51% (2.0273 => 2.0580, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.50% (0.8067 => 0.8188, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 1.49% (3.3354 => 3.3850, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.39% (1.3050 => 1.3232, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.32% (1.5415 => 1.5619, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.28% (3.8723 => 3.9217, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.27% (0.9765 => 0.9889, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.05% (17.1811 => 17.3617, std. dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.80% (1.1145 => 1.1903, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.13% (3.6395 => 3.7534, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.10% (1.5086 => 1.5403, std. dev.: 0.0077) MultiSource/Applications/lua/lua: 2.08% (26.0924 => 26.6339, std. dev.: 0.0452) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4472, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6897, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.31% (9.1159 => 9.2354, std. dev.: 0.0160) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.27% (5.2763 => 3.1514, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.23% (5.3855 => 3.7035, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.93% (5.3526 => 3.6968, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.41% (2.9384 => 2.5444, std. dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: -10.60% (22.1758 => 19.8246, std. dev.: 0.0096) SingleSource/UnitTests/Vector/constpool: -5.01% (54.1659 => 51.4503, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.54% (3.8922 => 3.7934, std. dev.: 0.0151) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.63% (0.0998 => 0.0842, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.11% (1.2373 => 1.1122, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.97% (19.9488 => 18.5580, std. dev.: 0.0410) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9156, std. dev.: 0.0068) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6926, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0859, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.06% (1.4460 => 1.4307, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 20:22:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 22:22:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120715032215.E831B2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2068?compare_to=2066&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2068, Order: 160227, Start Time: 2012-07-15 02:08:43, End Time: 2012-07-15 03:22:24 To: 2066, Order: 160222, Start Time: 2012-07-15 00:27:06, End Time: 2012-07-15 01:40:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (130 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.13% (1.4655 => 1.4821, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.90% (2.0176 => 2.2980, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 10.33% (0.5818 => 0.6419, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.30% (0.5748 => 0.6340, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 9.79% (0.7061 => 0.7752, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 9.73% (0.3578 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3601 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.56% (0.3650 => 0.3999, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 9.49% (0.3646 => 0.3992, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.39% (0.3663 => 0.4007, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.36% (0.3623 => 0.3962, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.29% (0.3789 => 0.4141, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.20% (0.3914 => 0.4274, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.19% (0.4003 => 0.4371, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 8.96% (0.3940 => 0.4293, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 8.24% (1.3693 => 1.4821, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.05% (0.2781 => 0.2977, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.75% (0.4062 => 0.4336, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (0.4328 => 0.4617, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.60% (0.7710 => 0.8219, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hello: 6.44% (0.2607 => 0.2775, std. dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 6.44% (0.7038 => 0.7491, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.43% (0.2782 => 0.2961, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.36% (0.2690 => 0.2861, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.33% (0.2655 => 0.2823, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2628 => 0.2793, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.24% (0.2596 => 0.2758, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.22% (0.3022 => 0.3210, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.22% (0.2765 => 0.2937, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2761 => 0.2932, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.16% (0.2760 => 0.2930, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.2937 => 0.3117, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.12% (0.5265 => 0.5587, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.10% (0.2966 => 0.3147, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.08% (1.9828 => 2.1034, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.93% (0.2696 => 0.2856, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.90% (0.3489 => 0.3695, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.3107 => 0.3290, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3580 => 0.3788, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (3.9660 => 4.1954, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 5.78% (0.3149 => 0.3331, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.67% (0.3899 => 0.4120, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.65% (0.4390 => 0.4638, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3485 => 0.3679, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.56% (0.3453 => 0.3645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.51% (0.3192 => 0.3368, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.38% (0.3293 => 0.3470, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.35% (0.6959 => 0.7331, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.33% (0.2721 => 0.2866, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.20% (0.4016 => 0.4225, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.18% (0.3534 => 0.3717, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.14% (0.3756 => 0.3949, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.94% (0.3868 => 0.4059, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.78% (16.6129 => 17.4070, std. dev.: 0.0128) MultiSource/Applications/SPASS/SPASS: 4.61% (13.8202 => 14.4574, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.48% (0.9199 => 0.9611, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.40% (1.2193 => 1.2729, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.39% (13.2842 => 13.8680, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 4.15% (1.2292 => 1.2802, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.13% (0.7506 => 0.7816, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.12% (0.5577 => 0.5807, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.99% (7.2180 => 7.5060, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.97% (0.4379 => 0.4553, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.96% (1.4563 => 1.5140, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.94% (0.5637 => 0.5859, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.93% (1.3245 => 1.3766, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.91% (0.3246 => 0.3373, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.78% (1.1061 => 1.1479, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.77% (0.2914 => 0.3024, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.75% (0.3755 => 0.3896, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.75% (3.8646 => 4.0094, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.73% (1.1364 => 1.1788, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.68% (1.3813 => 1.4321, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.68% (1.3819 => 1.4327, std. dev.: 0.0070) MultiSource/Applications/treecc/treecc: 3.66% (1.9270 => 1.9975, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.45% (1.0594 => 1.0959, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.42% (0.7460 => 0.7715, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 3.20% (0.3220 => 0.3323, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.04% (3.6692 => 3.7808, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.91% (4.9865 => 5.1316, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.91% (4.3801 => 4.5074, std. dev.: 0.0130) MultiSource/Applications/siod/siod: 2.85% (2.1791 => 2.2413, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 2.77% (6.5754 => 6.7577, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 2.76% (14.8535 => 15.2635, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.75% (4.4433 => 4.5653, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 2.67% (0.4113 => 0.4223, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.67% (0.8698 => 0.8930, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.51% (0.6135 => 0.6289, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.1333 => 1.1616, std. dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: 2.33% (16.2614 => 16.6403, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.29% (3.1889 => 3.2619, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 2.24% (14.5298 => 14.8554, std. dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.88% (0.6283 => 0.6401, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.85% (1.2749 => 1.2985, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.21% (2.1007 => 2.1262, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (8.4961 => 8.5830, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.94% (1.8175 => 2.2890, std. dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.31% (2.0200 => 2.1878, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6990, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.02% (1.2998 => 1.3910, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.80% (7.4271 => 7.7091, std. dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6789, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.50% (1.7688 => 1.8307, std. dev.: 0.0184) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0310 => 1.0562, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.45% (3.6469 => 3.6996, std. dev.: 0.0083) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1965, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.17% (1.9290 => 1.9516, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.66% (22.5627 => 21.0611, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.21% (0.8818 => 0.8623, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.67% (1.2308 => 1.0995, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.82% (20.3410 => 18.5474, std. dev.: 0.0112) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3075, std. dev.: 0.0097) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.18% (1.9762 => 1.9134, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5848, std. dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5099, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: -1.71% (3.0263 => 2.9746, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2563, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7951, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.39% (0.8342 => 0.8226, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1499, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.33% (9.3358 => 9.2114, std. dev.: 0.0430) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.3305 => 7.2438, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2608, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 20:44:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 22:44:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120715034433.898AF2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2069?compare_to=2067&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2069, Order: 160227, Start Time: 2012-07-15 02:26:35, End Time: 2012-07-15 03:44:43 To: 2067, Order: 160222, Start Time: 2012-07-15 00:40:51, End Time: 2012-07-15 01:58:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (59 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.83% (13.3149 => 13.6921, std. dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.07% (10.3673 => 13.6921, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 11.95% (0.3473 => 0.3888, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 11.61% (0.3497 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.56% (1.1194 => 1.2488, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-3: 11.55% (0.3516 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.54% (0.3543 => 0.3952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.49% (0.3561 => 0.3970, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.07% (0.3694 => 0.4103, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.55% (0.3886 => 0.4296, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.54% (0.3927 => 0.4341, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.64% (2.2022 => 2.3704, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.46% (1.7609 => 1.8922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.99% (0.5925 => 0.6280, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.94% (0.6030 => 0.6388, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.52% (0.2065 => 0.2179, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.45% (0.3177 => 0.3350, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 5.30% (0.7326 => 0.7714, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.57% (7.0540 => 7.3766, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.4879 => 0.5096, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.44% (10.4361 => 10.8993, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/oourafft: 4.08% (0.3282 => 0.3416, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 3.87% (0.7433 => 0.7721, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.17% (0.8172 => 0.8431, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5569 => 0.5733, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.84% (0.4615 => 0.4746, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (5.0018 => 5.1365, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.69% (4.9449 => 5.0780, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 2.60% (1.5603 => 1.6009, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: 2.57% (0.7835 => 0.8036, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (14.3668 => 14.7146, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.41% (8.1363 => 8.3326, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.27% (2.0665 => 2.1134, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.10% (4.2646 => 4.3541, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 2.08% (9.4845 => 9.6822, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5860 => 0.5982, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 1.77% (1.1642 => 1.1848, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.76% (1.1861 => 1.2070, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.70% (2.0273 => 2.0617, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.68% (3.3354 => 3.3915, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.55% (1.3050 => 1.3252, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.52% (0.8067 => 0.8190, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 1.47% (3.8723 => 3.9292, std. dev.: 0.0125) MultiSource/Applications/oggenc/oggenc: 1.46% (5.7591 => 5.8432, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.36% (1.5415 => 1.5624, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 1.31% (1.2842 => 1.3010, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.19% (17.1811 => 17.3861, std. dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.19% (0.9765 => 0.9881, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.13% (1.4186 => 1.4346, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9743, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7560, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.20% (26.0924 => 26.6655, std. dev.: 0.0186) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5366, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4472, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.36% (2.6546 => 2.6908, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2377, std. dev.: 0.0412) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.93% (5.2763 => 3.1696, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.40% (5.3855 => 3.6946, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.13% (5.3526 => 3.6864, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.96% (2.9384 => 2.5576, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -10.60% (22.1758 => 19.8247, std. dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: -5.20% (54.1659 => 51.3517, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.50% (3.8922 => 3.7950, std. dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.71% (1.2373 => 1.1048, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.16% (19.9488 => 18.5205, std. dev.: 0.0671) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (8.1563 => 7.9171, std. dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6843, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0839, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.01% (1.4460 => 1.4314, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 21:28:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 14 Jul 2012 23:28:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120715042839.2122D2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2070?compare_to=2065&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2070, Order: 160226, Start Time: 2012-07-15 01:45:37, End Time: 2012-07-15 04:28:49 To: 2065, Order: 160221, Start Time: 2012-07-14 22:34:20, End Time: 2012-07-15 01:17:34 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (71 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 949 (822 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.84% (2.3946 => 2.4626, std. dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.76% (2.0576 => 2.0939, std. dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.80% (1.6492 => 1.6195, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 13.07% (0.3442 => 0.3892, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.02% (0.3488 => 0.3942, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-2: 12.97% (0.3446 => 0.3893, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.96% (0.3465 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.95% (0.3460 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.93% (0.3496 => 0.3948, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 12.77% (0.3469 => 0.3912, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.52% (0.3650 => 0.4107, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.38% (0.3643 => 0.4094, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.08% (0.3724 => 0.4174, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 7.05% (0.5826 => 0.6237, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.59% (0.5889 => 0.6277, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.33% (0.7171 => 0.7553, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.90% (3.5627 => 3.7372, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.89% (1.6211 => 1.7004, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.38% (0.4361 => 0.4552, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.18% (0.5026 => 0.5236, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.14% (1.3152 => 1.3697, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.05% (0.3362 => 0.3498, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.02% (0.4029 => 0.4191, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.01% (2.7292 => 2.8387, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.93% (0.5900 => 0.6132, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.90% (0.4994 => 0.5189, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.89% (0.3060 => 0.3179, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.79% (0.3930 => 0.4079, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: 3.78% (0.2725 => 0.2828, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.75% (0.2750 => 0.2853, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.69% (0.2738 => 0.2839, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.69% (0.2875 => 0.2981, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 3.68% (0.2714 => 0.2814, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.68% (4.2109 => 4.3658, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.58% (0.2792 => 0.2892, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.55% (0.2813 => 0.2913, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.50% (2.0673 => 2.1396, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.48% (1.9694 => 2.0380, std. dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 3.46% (0.3004 => 0.3108, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.46% (0.9909 => 1.0252, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 3.42% (0.3096 => 0.3202, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.41% (0.3258 => 0.3369, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.37% (0.3267 => 0.3377, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.32% (0.5000 => 0.5166, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.32% (0.3195 => 0.3301, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.30% (0.3124 => 0.3227, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3317 => 0.3423, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.19% (0.9697 => 1.0006, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.17% (0.3282 => 0.3386, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 3.13% (1.0781 => 1.1118, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.12% (1.9966 => 2.0589, std. dev.: 0.0095) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (2.1013 => 2.1659, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/moments: 3.02% (0.3678 => 0.3789, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.02% (0.3348 => 0.3449, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.98% (0.3890 => 0.4006, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3477 => 0.3580, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 2.95% (0.3726 => 0.3836, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.95% (0.3625 => 0.3732, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (2.1653 => 2.2259, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.66% (0.4658 => 0.4782, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.66% (4.4195 => 4.5369, std. dev.: 0.0110) MultiSource/Applications/JM/lencod/lencod: 2.64% (4.6177 => 4.7396, std. dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 2.60% (23.5202 => 24.1315, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/hash2: 2.56% (0.4251 => 0.4360, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.52% (5.5417 => 5.6816, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/gs/gs: 2.44% (1.8794 => 1.9252, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.23% (0.7875 => 0.8051, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.18% (0.5546 => 0.5667, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 2.14% (1.4269 => 1.4574, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.93% (0.6435 => 0.6559, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.72% (0.6634 => 0.6748, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 1.65% (1.5932 => 1.6195, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.2122 => 0.2247, std. dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.70% (11.9555 => 11.7520, std. dev.: 0.0225) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 22:21:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 00:21:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120715052142.1CBA12A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2071?compare_to=2068&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2071, Order: 160228, Start Time: 2012-07-15 04:08:10, End Time: 2012-07-15 05:21:50 To: 2068, Order: 160227, Start Time: 2012-07-15 02:08:43, End Time: 2012-07-15 03:22:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.16% (1.0995 => 1.1122, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.44% (1.4821 => 1.4607, std. dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.18% (2.0176 => 2.3036, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 10.19% (0.5818 => 0.6411, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 10.06% (0.5748 => 0.6326, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.66% (0.7061 => 0.7743, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 9.61% (0.3578 => 0.3922, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-2: 9.33% (0.3601 => 0.3937, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.30% (0.3623 => 0.3960, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.26% (0.3650 => 0.3988, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.25% (0.3663 => 0.4002, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.24% (0.3646 => 0.3983, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.11% (0.3789 => 0.4134, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.94% (0.3914 => 0.4264, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.92% (0.4003 => 0.4360, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.91% (0.3940 => 0.4291, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.25% (0.1986 => 0.2130, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.67% (1.3693 => 1.4607, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.50% (0.7710 => 0.8211, std. dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 6.42% (0.7038 => 0.7490, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.4062 => 0.4320, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.26% (0.4328 => 0.4599, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.22% (0.2782 => 0.2955, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2596 => 0.2754, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.08% (0.2781 => 0.2950, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.06% (0.3022 => 0.3205, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.02% (0.5265 => 0.5582, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 5.87% (0.2607 => 0.2760, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.80% (0.2690 => 0.2846, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.76% (0.2655 => 0.2808, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.73% (3.9660 => 4.1933, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/methcall: 5.72% (0.2761 => 0.2919, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.70% (0.2966 => 0.3135, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.68% (0.2765 => 0.2922, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.67% (0.2628 => 0.2777, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.65% (0.2760 => 0.2916, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.65% (0.2937 => 0.3103, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.59% (0.3489 => 0.3684, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.56% (1.9828 => 2.0930, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.49% (0.2696 => 0.2844, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.44% (0.3107 => 0.3276, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.40% (0.2721 => 0.2868, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.39% (0.3899 => 0.4109, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.34% (0.3580 => 0.3771, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.30% (0.3149 => 0.3316, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.25% (0.3485 => 0.3668, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.19% (0.4390 => 0.4618, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 5.11% (0.3192 => 0.3355, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.10% (0.6959 => 0.7314, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.98% (0.4016 => 0.4216, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.95% (0.3293 => 0.3456, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 4.84% (16.6129 => 17.4165, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.2988 => 0.3131, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.67% (0.3534 => 0.3699, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.52% (0.3868 => 0.4043, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.50% (0.9199 => 0.9613, std. dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: 4.43% (13.8202 => 14.4330, std. dev.: 0.0194) MultiSource/Benchmarks/McCat/09-vor/vor: 4.41% (0.2925 => 0.3054, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.27% (0.5577 => 0.5815, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.24% (0.2945 => 0.3070, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.21% (1.2193 => 1.2706, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.18% (13.2842 => 13.8393, std. dev.: 0.0082) MultiSource/Applications/spiff/spiff: 4.06% (0.7506 => 0.7811, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.5637 => 0.5863, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.89% (1.4563 => 1.5130, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.89% (1.3245 => 1.3760, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.88% (0.2914 => 0.3027, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.84% (0.4379 => 0.4547, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.79% (1.2292 => 1.2758, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.74% (1.3813 => 1.4329, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.73% (1.1364 => 1.1788, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.73% (7.2180 => 7.4872, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 3.69% (1.1061 => 1.1469, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.68% (3.8646 => 4.0068, std. dev.: 0.0083) MultiSource/Applications/treecc/treecc: 3.68% (1.9270 => 1.9979, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.52% (1.3819 => 1.4305, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.42% (0.7460 => 0.7715, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.40% (1.0594 => 1.0954, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.38% (0.3755 => 0.3882, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.04% (3.6692 => 3.7807, std. dev.: 0.0098) MultiSource/Applications/siod/siod: 2.93% (2.1791 => 2.2429, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.79% (4.3801 => 4.5025, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.75% (4.9865 => 5.1234, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.68% (4.4433 => 4.5624, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (6.5754 => 6.7498, std. dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 2.60% (14.8535 => 15.2397, std. dev.: 0.0143) MultiSource/Benchmarks/McCat/05-eks/eks: 2.53% (0.4113 => 0.4217, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.47% (1.1333 => 1.1613, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.46% (0.6135 => 0.6286, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.43% (0.8698 => 0.8909, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.15% (3.1889 => 3.2576, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 2.04% (14.5298 => 14.8260, std. dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: 1.97% (16.2614 => 16.5813, std. dev.: 0.0091) MultiSource/Applications/SIBsim4/SIBsim4: 1.64% (1.2749 => 1.2958, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.33% (2.1007 => 2.1287, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.29% (1.8175 => 2.2771, std. dev.: 0.0540) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1908, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9996 => 1.0783, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 7.64% (1.2998 => 1.3991, std. dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.23% (7.4271 => 7.7411, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6775, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8294, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4805, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0560, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5339, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (3.6469 => 3.7036, std. dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9576, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1964, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.73% (22.5627 => 21.0443, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.21% (0.8818 => 0.8623, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.64% (1.2308 => 1.1122, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.69% (20.3410 => 18.5739, std. dev.: 0.0391) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3096, std. dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.67% (2.6470 => 2.5499, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9125, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6053, std. dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5035, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: -1.86% (3.0263 => 2.9700, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2537, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7945, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8593, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4902, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1690, std. dev.: 0.0171) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2403, std. dev.: 0.0109) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2239, std. dev.: 0.0113) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2535, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8496, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 14 22:30:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 00:30:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120715053021.DDF522A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2072?compare_to=2069&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2072, Order: 160228, Start Time: 2012-07-15 04:12:25, End Time: 2012-07-15 05:30:31 To: 2069, Order: 160227, Start Time: 2012-07-15 02:26:35, End Time: 2012-07-15 03:44:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (59 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.34% (13.6921 => 14.0122, std. dev.: 0.0099) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.16% (10.3673 => 14.0122, std. dev.: 0.0099) SingleSource/UnitTests/ObjC/trivial-interface: 12.18% (0.3473 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3497 => 0.3913, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 11.83% (0.3516 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.77% (0.3543 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.40% (0.3694 => 0.4115, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.35% (1.1194 => 1.2465, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.95% (0.3828 => 0.4247, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.86% (0.3886 => 0.4308, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.70% (0.3927 => 0.4347, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.80% (2.2022 => 2.3739, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.47% (1.7609 => 1.8925, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5925 => 0.6290, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.6030 => 0.6395, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.47% (0.2065 => 0.2178, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.95% (0.7326 => 0.7689, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.3177 => 0.3327, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.64% (10.4361 => 10.9202, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.32% (0.4879 => 0.5090, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.11% (7.0540 => 7.3441, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 4.08% (0.3282 => 0.3416, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.58% (0.7433 => 0.7699, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.96% (5.0018 => 5.1500, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.89% (0.8172 => 0.8408, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.82% (0.4615 => 0.4745, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.78% (0.5569 => 0.5724, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.66% (4.9449 => 5.0766, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.60% (14.3668 => 14.7397, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.50% (8.1363 => 8.3396, std. dev.: 0.0043) MultiSource/Applications/hbd/hbd: 2.38% (1.5603 => 1.5974, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.34% (0.7835 => 0.8018, std. dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.26% (4.2646 => 4.3610, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.18% (0.5860 => 0.5988, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.08% (9.4845 => 9.6822, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 1.86% (3.3354 => 3.3973, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.85% (2.0665 => 2.1048, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.80% (1.1861 => 1.2075, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 1.77% (5.7591 => 5.8612, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 1.71% (2.0273 => 2.0619, std. dev.: 0.0058) MultiSource/Applications/Burg/burg: 1.61% (1.1642 => 1.1830, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.61% (0.8067 => 0.8197, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.56% (1.3050 => 1.3253, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.48% (17.1811 => 17.4358, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.47% (1.5415 => 1.5641, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.44% (3.8723 => 3.9279, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.22% (0.9765 => 0.9884, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.14% (1.2842 => 1.2988, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.12% (1.4186 => 1.4345, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9743, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7515, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.93% (26.0924 => 26.5957, std. dev.: 0.0352) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2398, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.20% (2.6546 => 2.6864, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.20% (5.2763 => 3.1551, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.38% (5.3855 => 3.6957, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.16% (5.3526 => 3.6845, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.58% (2.9384 => 2.5394, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.58% (22.1758 => 19.8291, std. dev.: 0.0094) SingleSource/UnitTests/Vector/constpool: -5.18% (54.1659 => 51.3613, std. dev.: 0.0610) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.56% (3.8922 => 3.7924, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.62% (1.2373 => 1.1059, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.65% (19.9488 => 18.6226, std. dev.: 0.0303) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (8.1563 => 7.9248, std. dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6896, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0860, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3526, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.09% (1.4460 => 1.4303, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 00:41:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 02:41:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120715074149.807802A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2073?compare_to=2070&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2073, Order: 160228, Start Time: 2012-07-15 04:56:31, End Time: 2012-07-15 07:41:59 To: 2070, Order: 160226, Start Time: 2012-07-15 01:45:37, End Time: 2012-07-15 04:28:49 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (79 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (814 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 13.28% (0.3442 => 0.3899, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.26% (0.3446 => 0.3903, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 13.19% (0.3465 => 0.3922, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.18% (0.3460 => 0.3916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.10% (0.3488 => 0.3945, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 13.07% (0.3496 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.94% (0.3469 => 0.3918, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 12.71% (0.3650 => 0.4114, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.57% (0.3643 => 0.4101, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3724 => 0.4179, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.14% (0.5826 => 0.6242, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.76% (0.5889 => 0.6287, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.48% (0.1620 => 0.1725, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.30% (0.7171 => 0.7551, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.85% (1.6211 => 1.6997, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.85% (3.5627 => 3.7354, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.40% (0.4361 => 0.4553, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (0.4994 => 0.5211, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.33% (0.2725 => 0.2843, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.31% (0.2714 => 0.2831, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.29% (0.5900 => 0.6153, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 4.27% (0.4029 => 0.4201, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2875 => 0.2997, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.24% (0.2738 => 0.2854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2750 => 0.2865, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 4.03% (0.2803 => 0.2916, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 3.97% (0.3096 => 0.3219, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.97% (1.3152 => 1.3674, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 3.92% (4.2109 => 4.3759, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/methcall: 3.91% (0.2813 => 0.2923, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.91% (2.7292 => 2.8359, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.90% (2.0673 => 2.1479, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 3.90% (0.9909 => 1.0295, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.87% (0.2792 => 0.2900, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.86% (0.2823 => 0.2932, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.84% (0.3930 => 0.4081, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 3.83% (0.3004 => 0.3119, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.2780 => 0.2886, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.78% (0.2911 => 0.3021, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.78% (0.3258 => 0.3381, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 3.77% (0.2811 => 0.2917, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.75% (0.9697 => 1.0061, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 3.73% (0.3267 => 0.3389, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.72% (0.3195 => 0.3314, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.72% (0.5026 => 0.5213, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.64% (0.5000 => 0.5182, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.60% (0.3362 => 0.3483, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.59% (0.3124 => 0.3236, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.56% (0.3317 => 0.3435, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.50% (0.3060 => 0.3167, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.43% (1.9694 => 2.0369, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/moments: 3.37% (0.3678 => 0.3802, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.37% (0.3625 => 0.3747, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.35% (0.3348 => 0.3460, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.29% (0.3282 => 0.3390, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.27% (0.3726 => 0.3848, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.27% (1.9966 => 2.0619, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.22% (0.3690 => 0.3809, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.22% (0.3477 => 0.3589, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 3.18% (1.0781 => 1.1124, std. dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 3.07% (23.5202 => 24.2433, std. dev.: 0.0281) SingleSource/Benchmarks/Shootout-C++/hash: 3.04% (0.4146 => 0.4272, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 2.94% (4.6177 => 4.7536, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.94% (0.4251 => 0.4376, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.93% (2.1013 => 2.1628, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.86% (0.4658 => 0.4791, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.3981 => 0.4091, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 2.74% (2.1653 => 2.2247, std. dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.3845 => 0.3950, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.72% (4.4195 => 4.5398, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.56% (0.3903 => 0.4003, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 2.42% (1.8794 => 1.9249, std. dev.: 0.0114) MultiSource/Applications/SPASS/SPASS: 2.38% (5.5417 => 5.6734, std. dev.: 0.0104) MultiSource/Applications/treecc/treecc: 2.34% (0.7875 => 0.8059, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.29% (0.5012 => 0.5127, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.6435 => 0.6582, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 1.97% (1.4269 => 1.4550, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 1.96% (1.5932 => 1.6244, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.86% (0.5546 => 0.5649, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.61% (11.9555 => 11.7634, std. dev.: 0.0122) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 03:26:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 05:26:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120715102603.9358C2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2074?compare_to=2071&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2074, Order: 160229, Start Time: 2012-07-15 09:12:17, End Time: 2012-07-15 10:26:12 To: 2071, Order: 160228, Start Time: 2012-07-15 04:08:10, End Time: 2012-07-15 05:21:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (127 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.73% (54.2876 => 56.3128, std. dev.: 0.1126) SingleSource/Benchmarks/Misc/fbench: 2.96% (2.2771 => 2.3445, std. dev.: 0.0160) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.21% (2.0176 => 2.3044, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 10.04% (0.5818 => 0.6402, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.99% (0.5748 => 0.6322, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.45% (0.3578 => 0.3916, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.18% (0.3650 => 0.3985, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 9.16% (0.3601 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.04% (0.7061 => 0.7699, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 9.00% (0.3646 => 0.3974, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.98% (0.3663 => 0.3992, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.92% (0.3623 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.87% (0.3789 => 0.4125, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.81% (0.3914 => 0.4259, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.69% (0.4003 => 0.4351, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.58% (0.3940 => 0.4278, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.35% (1.3693 => 1.4700, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2781 => 0.2960, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.40% (0.4328 => 0.4605, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.16% (0.7710 => 0.8185, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 6.14% (0.7038 => 0.7470, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.07% (0.2782 => 0.2951, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.96% (0.4062 => 0.4304, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.94% (0.5265 => 0.5578, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 5.87% (0.2607 => 0.2760, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2761 => 0.2923, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.86% (0.2596 => 0.2748, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 5.80% (0.2690 => 0.2846, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.76% (0.3022 => 0.3196, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.71% (0.2628 => 0.2778, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.70% (0.3489 => 0.3688, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.64% (3.9660 => 4.1897, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2966 => 0.3132, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.58% (0.2937 => 0.3101, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.58% (0.2726 => 0.2878, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2765 => 0.2919, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2696 => 0.2846, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.53% (1.9828 => 2.0924, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.48% (0.2721 => 0.2870, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.36% (0.3899 => 0.4108, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.3107 => 0.3271, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.25% (0.3580 => 0.3768, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.20% (0.3192 => 0.3358, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.95% (0.3293 => 0.3456, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 4.92% (0.3453 => 0.3623, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.90% (0.6959 => 0.7300, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (0.3756 => 0.3938, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2988 => 0.3132, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.72% (0.4390 => 0.4597, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 4.67% (0.3534 => 0.3699, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 4.58% (13.8202 => 14.4525, std. dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 4.55% (16.6129 => 17.3682, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/moments: 4.50% (0.3868 => 0.4042, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.44% (13.2842 => 13.8741, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.41% (0.9199 => 0.9605, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.23% (1.2193 => 1.2709, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.05% (0.5577 => 0.5803, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.97% (0.4379 => 0.4553, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.97% (0.7506 => 0.7804, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.94% (0.5637 => 0.5859, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.88% (1.3813 => 1.4349, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.88% (7.2180 => 7.4977, std. dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.85% (1.3245 => 1.3755, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.74% (0.2914 => 0.3023, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.74% (1.4563 => 1.5107, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.73% (1.3819 => 1.4335, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.70% (0.3246 => 0.3366, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.70% (1.1364 => 1.1784, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.69% (1.2292 => 1.2745, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.63% (1.1061 => 1.1462, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 3.62% (3.8646 => 4.0044, std. dev.: 0.0076) MultiSource/Applications/treecc/treecc: 3.44% (1.9270 => 1.9933, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.38% (0.3755 => 0.3882, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.36% (0.7460 => 0.7711, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.32% (1.0594 => 1.0946, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (3.6692 => 3.7772, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.83% (4.9865 => 5.1275, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8310 => 0.8543, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.76% (4.3801 => 4.5012, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (6.5754 => 6.7571, std. dev.: 0.0077) MultiSource/Applications/siod/siod: 2.68% (2.1791 => 2.2375, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 2.64% (14.8535 => 15.2460, std. dev.: 0.0176) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.62% (4.4433 => 4.5598, std. dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.56% (0.6135 => 0.6292, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.37% (1.1333 => 1.1602, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.35% (0.8698 => 0.8902, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.25% (3.1889 => 3.2608, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.21% (14.5298 => 14.8507, std. dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 2.17% (16.2614 => 16.6149, std. dev.: 0.0239) MultiSource/Applications/SIBsim4/SIBsim4: 1.96% (1.2749 => 1.2999, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.67% (0.6283 => 0.6388, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 29.00% (1.8175 => 2.3445, std. dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.29% (2.0200 => 2.1874, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.7000, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: 7.10% (1.2998 => 1.3921, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7312, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8291, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1894, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (1.5089 => 1.5377, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.89% (3.6469 => 3.7159, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9571, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.5627 => 21.0505, std. dev.: 0.0229) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.03% (0.8818 => 0.8639, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.95% (0.0997 => 0.0828, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2308 => 1.1041, std. dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.80% (20.3410 => 18.5505, std. dev.: 0.0639) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.38% (1.3780 => 1.3039, std. dev.: 0.0123) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9128, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5889, std. dev.: 0.0130) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5028, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: -1.77% (3.0263 => 2.9726, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2586, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7953, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4888, std. dev.: 0.0008) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1366, std. dev.: 0.0458) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2166, std. dev.: 0.0281) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2401, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2530, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 03:31:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 05:31:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120715103106.A0A892A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2075?compare_to=2072&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2075, Order: 160229, Start Time: 2012-07-15 09:12:29, End Time: 2012-07-15 10:31:15 To: 2072, Order: 160228, Start Time: 2012-07-15 04:12:25, End Time: 2012-07-15 05:30:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (57 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (798 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (0.8408 => 0.8536, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.32% (14.0122 => 13.6865, std. dev.: 0.0117) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.02% (10.3673 => 13.6865, std. dev.: 0.0117) SingleSource/UnitTests/ObjC/trivial-interface: 12.15% (0.3473 => 0.3895, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: 11.78% (0.3497 => 0.3909, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.77% (0.3543 => 0.3960, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 11.75% (0.3516 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.74% (0.3543 => 0.3959, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.60% (0.3561 => 0.3974, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2484, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 11.32% (0.3694 => 0.4112, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.84% (0.3828 => 0.4243, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.74% (1.7609 => 1.8972, std. dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.40% (2.2022 => 2.3652, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5925 => 0.6293, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.15% (0.6030 => 0.6401, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.33% (0.2065 => 0.2175, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 5.00% (0.7326 => 0.7692, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.51% (0.4879 => 0.5099, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 4.50% (10.4361 => 10.9062, std. dev.: 0.0129) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.45% (0.8172 => 0.8536, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.30% (7.0540 => 7.3574, std. dev.: 0.0116) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.84% (0.3121 => 0.3241, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 3.81% (0.3282 => 0.3407, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.67% (0.7433 => 0.7706, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.47% (0.5569 => 0.5762, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 2.91% (0.7835 => 0.8063, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.79% (4.9449 => 5.0828, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.73% (0.4615 => 0.4741, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.71% (5.0018 => 5.1371, std. dev.: 0.0073) MultiSource/Applications/hbd/hbd: 2.51% (1.5603 => 1.5994, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (14.3668 => 14.7138, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.38% (4.2646 => 4.3660, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.34% (8.1363 => 8.3267, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.07% (2.0665 => 2.1092, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.06% (1.1861 => 1.2105, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.96% (9.4845 => 9.6701, std. dev.: 0.0121) MultiSource/Applications/Burg/burg: 1.92% (1.1642 => 1.1865, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.84% (1.4186 => 1.4447, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 1.68% (2.0273 => 2.0614, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.67% (1.5415 => 1.5672, std. dev.: 0.0085) MultiSource/Applications/d/make_dparser: 1.60% (3.3354 => 3.3887, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.48% (1.3050 => 1.3243, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 1.46% (5.7591 => 5.8429, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 1.45% (3.8723 => 3.9286, std. dev.: 0.0125) MultiSource/Applications/hexxagon/hexxagon: 1.35% (1.2842 => 1.3015, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.21% (0.9765 => 0.9883, std. dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.15% (17.1811 => 17.3785, std. dev.: 0.0165) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.77% (1.1145 => 1.1900, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.26% (3.6395 => 3.7582, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.13% (26.0924 => 26.6491, std. dev.: 0.0131) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (1.5086 => 1.5381, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6877, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1274, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.97% (5.2763 => 3.1676, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.43% (5.3855 => 3.6928, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.08% (5.3526 => 3.6891, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.93% (2.9384 => 2.5584, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -10.64% (22.1758 => 19.8156, std. dev.: 0.0491) SingleSource/UnitTests/Vector/constpool: -4.84% (54.1659 => 51.5443, std. dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.53% (3.8922 => 3.7937, std. dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.43% (1.2373 => 1.0959, std. dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.51% (19.9488 => 18.6494, std. dev.: 0.0320) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9207, std. dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6805, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0861, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 04:55:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 06:55:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120715115529.7CE5E2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2076?compare_to=2073&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2076, Order: 160229, Start Time: 2012-07-15 09:12:20, End Time: 2012-07-15 11:55:39 To: 2073, Order: 160228, Start Time: 2012-07-15 04:56:31, End Time: 2012-07-15 07:41:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (78 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (815 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.72% (2.4022 => 2.4676, std. dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.03% (54.2849 => 54.8454, std. dev.: 0.0420) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.09% (0.3446 => 0.3897, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.07% (0.3465 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.07% (0.3488 => 0.3944, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 13.04% (0.3442 => 0.3891, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.03% (0.3460 => 0.3911, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.99% (0.3496 => 0.3950, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 12.86% (0.3469 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.54% (0.3643 => 0.4100, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.52% (0.3650 => 0.4107, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.03% (0.3724 => 0.4172, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 7.09% (0.5826 => 0.6239, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.76% (0.5889 => 0.6287, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.1620 => 0.1722, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 5.34% (0.7171 => 0.7554, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.81% (1.6211 => 1.6991, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.74% (3.5627 => 3.7314, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.40% (0.2729 => 0.2849, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.31% (0.2714 => 0.2831, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2875 => 0.2998, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2725 => 0.2841, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.24% (0.4361 => 0.4546, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.13% (0.2738 => 0.2851, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 4.07% (0.3096 => 0.3222, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.07% (0.5900 => 0.6140, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 4.03% (0.2803 => 0.2916, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.93% (0.2750 => 0.2858, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.90% (0.4029 => 0.4186, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.88% (0.9909 => 1.0293, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.84% (0.3930 => 0.4081, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (1.3152 => 1.3657, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.82% (0.4994 => 0.5185, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.78% (2.7292 => 2.8324, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 3.77% (0.2813 => 0.2919, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.77% (2.0673 => 2.1452, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 3.74% (0.3258 => 0.3380, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.74% (0.2780 => 0.2884, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.72% (0.2792 => 0.2896, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.70% (0.5026 => 0.5212, std. dev.: 0.0052) SingleSource/Regression/C++/ofstream_ctor: 3.70% (0.3004 => 0.3115, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 3.64% (0.3267 => 0.3386, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.2911 => 0.3017, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 3.63% (0.2811 => 0.2913, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.58% (4.2109 => 4.3617, std. dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.57% (0.3195 => 0.3309, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.46% (0.3060 => 0.3166, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.46% (0.3124 => 0.3232, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.44% (0.3317 => 0.3431, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.41% (1.9694 => 2.0366, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 3.37% (0.3678 => 0.3802, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3362 => 0.3475, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.35% (0.3282 => 0.3392, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.29% (0.3348 => 0.3458, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.26% (0.5000 => 0.5163, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.23% (1.9966 => 2.0610, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (0.3625 => 0.3740, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.17% (0.3726 => 0.3844, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.14% (1.0781 => 1.1120, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: 3.11% (0.3477 => 0.3585, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.09% (0.3690 => 0.3804, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.03% (0.9697 => 0.9991, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.92% (0.4146 => 0.4267, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 2.82% (0.4251 => 0.4371, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.79% (0.4658 => 0.4788, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (0.3890 => 0.3997, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 2.73% (4.6177 => 4.7438, std. dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: 2.72% (2.1653 => 2.2241, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.71% (4.4195 => 4.5393, std. dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 2.70% (23.5202 => 24.1560, std. dev.: 0.0378) MultiSource/Benchmarks/mafft/pairlocalalign: 2.65% (2.1013 => 2.1569, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.59% (0.3981 => 0.4084, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.33% (1.8794 => 1.9232, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.14% (0.6435 => 0.6573, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.13% (0.5012 => 0.5119, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.11% (5.5417 => 5.6585, std. dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 2.05% (1.5932 => 1.6258, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 2.04% (0.7875 => 0.8036, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.89% (1.4269 => 1.4539, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.24% (2.8036 => 2.8385, std. dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.59% (11.9555 => 11.7655, std. dev.: 0.0156) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 07:15:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 09:15:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120715141507.E7C922A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2077?compare_to=2074&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2077, Order: 160230, Start Time: 2012-07-15 13:01:43, End Time: 2012-07-15 14:15:16 To: 2074, Order: 160229, Start Time: 2012-07-15 09:12:17, End Time: 2012-07-15 10:26:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (130 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (723 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.15% (2.0176 => 2.3030, std. dev.: 0.0178) SingleSource/UnitTests/ObjC++/property-reference-object: 10.02% (0.5818 => 0.6401, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.97% (0.5748 => 0.6321, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.50% (0.3578 => 0.3918, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 9.08% (0.3601 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.02% (0.3646 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.01% (0.3650 => 0.3979, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.01% (0.7061 => 0.7697, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.92% (0.3623 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.90% (0.3663 => 0.3989, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.87% (0.3789 => 0.4125, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.74% (0.3914 => 0.4256, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.72% (0.4003 => 0.4352, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.58% (0.3940 => 0.4278, std. dev.: 0.0056) MultiSource/Applications/hbd/hbd: 7.38% (1.3693 => 1.4703, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.15% (0.1986 => 0.2128, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (0.4328 => 0.4607, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.34% (0.7038 => 0.7484, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.05% (0.2628 => 0.2787, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.04% (0.2781 => 0.2949, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.03% (0.7710 => 0.8175, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.01% (0.2596 => 0.2752, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.93% (0.2782 => 0.2947, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 5.89% (0.2937 => 0.3110, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.87% (0.2726 => 0.2886, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.87% (0.5265 => 0.5574, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.87% (0.2607 => 0.2760, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.81% (0.4062 => 0.4298, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.80% (0.2655 => 0.2809, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.76% (0.2690 => 0.2845, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.76% (0.3022 => 0.3196, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.75% (0.2765 => 0.2924, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.66% (0.2966 => 0.3134, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.60% (0.3107 => 0.3281, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.60% (3.9660 => 4.1880, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.57% (1.9828 => 2.0932, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2696 => 0.2846, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3489 => 0.3683, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.51% (0.2721 => 0.2871, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.36% (0.3580 => 0.3772, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.33% (0.3899 => 0.4107, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.30% (0.3149 => 0.3316, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.11% (0.3485 => 0.3663, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.98% (0.3192 => 0.3351, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 4.92% (0.3453 => 0.3623, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.90% (0.3534 => 0.3707, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.87% (0.6959 => 0.7298, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.2988 => 0.3131, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 4.75% (16.6129 => 17.4014, std. dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/lists: 4.71% (0.3293 => 0.3448, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.4016 => 0.4205, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3756 => 0.3932, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.67% (0.4390 => 0.4595, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.52% (0.9199 => 0.9615, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.44% (0.2925 => 0.3055, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.41% (13.8202 => 14.4301, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (13.2842 => 13.8659, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/moments: 4.29% (0.3868 => 0.4034, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.24% (1.2193 => 1.2710, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.14% (0.7506 => 0.7817, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.02% (0.5577 => 0.5801, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.95% (0.4379 => 0.4552, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.92% (0.5637 => 0.5858, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.88% (0.3246 => 0.3372, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.81% (1.4563 => 1.5118, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.80% (1.3813 => 1.4338, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.74% (7.2180 => 7.4882, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 3.72% (3.8646 => 4.0084, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.71% (1.1364 => 1.1786, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.71% (1.3819 => 1.4332, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (1.3245 => 1.3736, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.71% (0.2914 => 0.3022, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.70% (0.3755 => 0.3894, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.68% (1.2292 => 1.2744, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.66% (1.1061 => 1.1466, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.48% (1.9270 => 1.9941, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.32% (1.0594 => 1.0946, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.31% (0.7460 => 0.7707, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.96% (3.6692 => 3.7779, std. dev.: 0.0103) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.84% (4.9865 => 5.1281, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/football/football: 2.73% (0.8310 => 0.8537, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.73% (4.3801 => 4.4996, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 2.71% (14.8535 => 15.2564, std. dev.: 0.0117) MultiSource/Applications/siod/siod: 2.70% (2.1791 => 2.2380, std. dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: 2.68% (6.5754 => 6.7516, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.57% (4.4433 => 4.5576, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.44% (0.6135 => 0.6285, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 2.43% (0.4113 => 0.4213, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.37% (0.8698 => 0.8904, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.32% (1.1333 => 1.1596, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 2.23% (16.2614 => 16.6247, std. dev.: 0.0056) MultiSource/Applications/d/make_dparser: 2.22% (3.1889 => 3.2598, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.12% (14.5298 => 14.8383, std. dev.: 0.0178) MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (1.2749 => 1.2977, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.69% (0.6283 => 0.6389, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.28% (2.1007 => 2.1276, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.58% (1.8175 => 2.2643, std. dev.: 0.0462) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1934, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.01% (0.9996 => 1.0797, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: 7.53% (1.2998 => 1.3977, std. dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (4.5947 => 4.8136, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.02% (7.4271 => 7.7258, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6787, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1915, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.74% (3.6469 => 3.7102, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5343, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.13% (0.4657 => 0.3999, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.71% (22.5627 => 21.0489, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.09% (0.8818 => 0.8634, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.67% (1.2308 => 1.1118, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.15% (20.3410 => 18.4790, std. dev.: 0.0289) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.38% (1.3780 => 1.3177, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9126, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5827, std. dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.5089 => 2.4478, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5008, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.71% (3.0263 => 2.9744, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9982, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7954, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: -1.50% (6.3560 => 6.2608, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1258, std. dev.: 0.0202) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4896, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.35% (0.8342 => 0.8229, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2162, std. dev.: 0.0367) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2486, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std. dev.: 0.0183) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2404, std. dev.: 0.0243) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 07:20:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 09:20:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120715142030.75E092A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2078?compare_to=2075&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2078, Order: 160230, Start Time: 2012-07-15 13:02:09, End Time: 2012-07-15 14:20:41 To: 2075, Order: 160229, Start Time: 2012-07-15 09:12:29, End Time: 2012-07-15 10:31:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (61 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (794 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.22% (54.7476 => 56.5102, std. dev.: 0.0805) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.07% (10.3673 => 13.6919, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 12.21% (0.3473 => 0.3897, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3497 => 0.3913, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.85% (0.3561 => 0.3983, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.83% (0.3543 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.83% (0.3543 => 0.3962, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 11.80% (0.3516 => 0.3931, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.60% (1.1194 => 1.2493, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.40% (0.3694 => 0.4115, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.95% (0.3828 => 0.4247, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.86% (0.3886 => 0.4308, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.80% (0.3927 => 0.4351, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.2065 => 0.2223, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.59% (1.7609 => 1.8945, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.47% (2.2022 => 2.3668, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 6.19% (0.5925 => 0.6292, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.19% (0.6030 => 0.6403, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.73% (0.7326 => 0.7746, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.97% (0.3177 => 0.3335, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.74% (0.8172 => 0.8559, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.51% (0.4879 => 0.5099, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 4.40% (10.4361 => 10.8950, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.31% (7.0540 => 7.3581, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.88% (0.2758 => 0.2865, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 3.78% (0.3282 => 0.3406, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.72% (0.3121 => 0.3237, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 3.59% (0.7433 => 0.7700, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.47% (0.4615 => 0.4775, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.41% (0.5569 => 0.5759, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 2.96% (0.7835 => 0.8067, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.91% (5.0018 => 5.1472, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.89% (4.9449 => 5.0880, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.52% (14.3668 => 14.7294, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.52% (8.1363 => 8.3415, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 2.42% (1.5603 => 1.5980, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.29% (4.2646 => 4.3621, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.20% (0.5860 => 0.5989, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.20% (0.4636 => 0.4738, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 2.13% (9.4845 => 9.6865, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.00% (2.0665 => 2.1078, std. dev.: 0.0158) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.98% (1.5415 => 1.5720, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.87% (0.8067 => 0.8218, std. dev.: 0.0049) MultiSource/Applications/treecc/treecc: 1.82% (2.0273 => 2.0642, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.75% (1.1642 => 1.1846, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.66% (3.3354 => 3.3908, std. dev.: 0.0139) MultiSource/Applications/lua/lua: 1.66% (3.8723 => 3.9366, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.65% (1.3050 => 1.3265, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.57% (0.6450 => 0.6551, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 1.47% (5.7591 => 5.8440, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 1.40% (1.2842 => 1.3022, std. dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 1.32% (17.1811 => 17.4081, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.24% (0.9765 => 0.9886, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.82% (1.1145 => 1.1905, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7555, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.23% (26.0924 => 26.6751, std. dev.: 0.0149) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.98% (1.5086 => 1.5385, std. dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2453, std. dev.: 0.0294) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.19% (2.6546 => 2.6862, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.96% (5.2763 => 3.1679, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.45% (5.3855 => 3.6915, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.10% (5.3526 => 3.6880, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.93% (2.9384 => 2.5585, std. dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: -10.68% (22.1758 => 19.8083, std. dev.: 0.0303) SingleSource/UnitTests/Vector/constpool: -4.86% (54.1659 => 51.5336, std. dev.: 0.0267) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.61% (3.8922 => 3.7906, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.76% (1.2373 => 1.1042, std. dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.97% (19.9488 => 18.5590, std. dev.: 0.0490) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (8.1563 => 7.9243, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6869, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0866, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 08:44:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 10:44:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120715154436.91BB52A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2079?compare_to=2076&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2079, Order: 160230, Start Time: 2012-07-15 13:01:47, End Time: 2012-07-15 15:44:46 To: 2076, Order: 160229, Start Time: 2012-07-15 09:12:20, End Time: 2012-07-15 11:55:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (76 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (817 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.12% (0.3446 => 0.3898, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.10% (0.3465 => 0.3919, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.03% (0.3460 => 0.3911, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.02% (0.3442 => 0.3890, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.01% (0.3496 => 0.3951, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.99% (0.3488 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.91% (0.3469 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.63% (0.3650 => 0.4111, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.52% (0.3643 => 0.4099, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.14% (0.3724 => 0.4176, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.02% (0.5826 => 0.6235, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.79% (0.5889 => 0.6289, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.1620 => 0.1722, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.34% (0.7171 => 0.7554, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.75% (3.5627 => 3.7321, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.68% (1.6211 => 1.6970, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.27% (0.2738 => 0.2855, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.24% (0.5900 => 0.6150, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 4.22% (0.2725 => 0.2840, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.21% (0.2729 => 0.2844, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.17% (0.2875 => 0.2995, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.17% (0.4361 => 0.4543, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 4.13% (0.2714 => 0.2826, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.09% (0.3792 => 0.3947, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wc: 3.97% (0.3096 => 0.3219, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.96% (0.2803 => 0.2914, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.92% (1.3152 => 1.3667, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 3.82% (0.2750 => 0.2855, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.82% (0.3930 => 0.4080, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.76% (0.9909 => 1.0282, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.76% (2.0673 => 2.1451, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.72% (0.4029 => 0.4179, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.72% (2.7292 => 2.8306, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 3.68% (0.2823 => 0.2927, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.66% (0.4994 => 0.5177, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.63% (0.3004 => 0.3113, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.63% (0.2813 => 0.2915, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.62% (0.2792 => 0.2893, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.59% (0.2811 => 0.2912, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.58% (0.5026 => 0.5206, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.57% (0.2911 => 0.3015, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.56% (4.2109 => 4.3606, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (0.3195 => 0.3308, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.53% (0.3258 => 0.3373, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.42% (0.3362 => 0.3477, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.39% (0.3124 => 0.3230, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.39% (1.9694 => 2.0362, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.37% (0.3060 => 0.3163, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.36% (0.5000 => 0.5168, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 3.35% (0.3317 => 0.3428, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.20% (0.3282 => 0.3387, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.20% (0.3348 => 0.3455, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.19% (1.9966 => 2.0603, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.17% (0.3726 => 0.3844, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.3625 => 0.3738, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.11% (0.3477 => 0.3585, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 3.10% (0.9697 => 0.9998, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/moments: 3.10% (0.3678 => 0.3792, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.09% (0.3690 => 0.3804, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 3.02% (1.0781 => 1.1107, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.97% (0.4146 => 0.4269, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.77% (4.4195 => 4.5421, std. dev.: 0.0108) MultiSource/Applications/JM/ldecod/ldecod: 2.73% (2.1653 => 2.2244, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.73% (0.4251 => 0.4367, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.73% (0.4658 => 0.4785, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 2.70% (23.5202 => 24.1554, std. dev.: 0.0129) MultiSource/Applications/JM/lencod/lencod: 2.69% (4.6177 => 4.7421, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 2.58% (2.1013 => 2.1555, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.54% (0.3981 => 0.4082, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.25% (1.8794 => 1.9217, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 2.08% (5.5417 => 5.6571, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 2.08% (0.5012 => 0.5116, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.07% (0.7875 => 0.8038, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 2.05% (1.5932 => 1.6259, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.99% (0.6435 => 0.6563, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.87% (1.4269 => 1.4536, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.77% (11.9555 => 11.7434, std. dev.: 0.0141) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 08:56:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 10:56:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120715155615.56D972A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2080?compare_to=2077&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2080, Order: 160231, Start Time: 2012-07-15 14:42:52, End Time: 2012-07-15 15:56:25 To: 2077, Order: 160230, Start Time: 2012-07-15 13:01:43, End Time: 2012-07-15 14:15:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (129 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.14% (54.7738 => 56.4955, std. dev.: 0.0790) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.11% (2.0176 => 2.3023, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.19% (0.5818 => 0.6411, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.09% (0.5748 => 0.6328, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.12% (0.7061 => 0.7705, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 8.72% (0.3578 => 0.3890, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3601 => 0.3906, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: 8.35% (0.3663 => 0.3969, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.34% (0.3646 => 0.3950, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.34% (0.3623 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.27% (0.3650 => 0.3952, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 8.26% (0.3789 => 0.4102, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.10% (0.3914 => 0.4231, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.02% (0.4003 => 0.4324, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.99% (0.3940 => 0.4255, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.54% (1.3693 => 1.4726, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.75% (0.1986 => 0.2120, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.24% (0.4328 => 0.4598, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.18% (0.7038 => 0.7473, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.4062 => 0.4303, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.85% (0.7710 => 0.8161, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.82% (0.2782 => 0.2944, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.81% (0.5265 => 0.5571, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hello: 5.79% (0.2607 => 0.2758, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2726 => 0.2883, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.76% (0.3022 => 0.3196, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.75% (0.2765 => 0.2924, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.74% (0.2596 => 0.2745, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.62% (0.2937 => 0.3102, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.44% (1.9828 => 2.0907, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/except: 5.40% (0.2760 => 0.2909, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.39% (3.9660 => 4.1799, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.37% (0.2721 => 0.2867, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2696 => 0.2839, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.28% (0.3580 => 0.3769, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.23% (0.3899 => 0.4103, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.21% (0.3149 => 0.3313, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.96% (0.3485 => 0.3658, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3192 => 0.3346, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.81% (0.3453 => 0.3619, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.71% (0.6959 => 0.7287, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 4.64% (0.3534 => 0.3698, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.62% (0.2988 => 0.3126, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.58% (0.4016 => 0.4200, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3293 => 0.3443, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.53% (0.4390 => 0.4589, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.47% (0.3756 => 0.3924, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.45% (16.6129 => 17.3525, std. dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/objinst: 4.45% (0.2945 => 0.3076, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.44% (0.2925 => 0.3055, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.32% (0.9199 => 0.9596, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.27% (13.8202 => 14.4110, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/moments: 4.19% (0.3868 => 0.4030, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.18% (13.2842 => 13.8393, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.08% (1.2193 => 1.2691, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.78% (0.5577 => 0.5788, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.75% (0.4379 => 0.4543, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.74% (0.5637 => 0.5848, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.73% (1.2292 => 1.2750, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 3.68% (0.7506 => 0.7782, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.64% (1.3813 => 1.4316, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.60% (0.3246 => 0.3363, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.60% (1.3245 => 1.3722, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.58% (1.4563 => 1.5085, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.58% (1.1364 => 1.1771, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3755 => 0.3886, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.49% (3.8646 => 3.9993, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.47% (1.3819 => 1.4298, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.47% (0.2914 => 0.3015, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.42% (1.1061 => 1.1439, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.41% (7.2180 => 7.4642, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 3.32% (1.0594 => 1.0946, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.20% (1.9270 => 1.9887, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.11% (0.7460 => 0.7692, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.83% (4.9865 => 5.1277, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.73% (3.6692 => 3.7693, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.68% (4.3801 => 4.4976, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8310 => 0.8525, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.51% (2.1791 => 2.2339, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.51% (6.5754 => 6.7402, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 2.49% (14.8535 => 15.2235, std. dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.38% (0.8698 => 0.8905, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.37% (4.4433 => 4.5487, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.25% (0.6135 => 0.6273, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.18% (16.2614 => 16.6161, std. dev.: 0.0185) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.17% (1.1333 => 1.1579, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.09% (3.1889 => 3.2554, std. dev.: 0.0183) MultiSource/Applications/ClamAV/clamscan: 2.06% (14.5298 => 14.8293, std. dev.: 0.0096) MultiSource/Applications/SIBsim4/SIBsim4: 1.71% (1.2749 => 1.2967, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.26% (2.1007 => 2.1271, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.01% (1.5188 => 1.5342, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 26.38% (1.8175 => 2.2969, std. dev.: 0.0206) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.55% (2.0200 => 2.1928, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.27% (0.9996 => 1.0823, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel-2: 7.71% (1.2998 => 1.4000, std. dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (2.5629 => 2.7293, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7187, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9216, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6791, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.41% (1.7688 => 1.8291, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4807, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1894, std. dev.: 0.0012) MultiSource/Benchmarks/llubenchmark/llu: 1.69% (3.7731 => 3.8367, std. dev.: 0.0177) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.61% (3.6469 => 3.7056, std. dev.: 0.0073) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.23% (1.9290 => 1.9528, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.71% (0.4657 => 0.3972, std. dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.72% (22.5627 => 21.0475, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.20% (0.8818 => 0.8624, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.65% (0.0997 => 0.0831, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -9.68% (1.2308 => 1.1117, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.92% (20.3410 => 18.5260, std. dev.: 0.0277) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.19% (1.3780 => 1.3065, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.24% (1.9762 => 1.9122, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5935, std. dev.: 0.0181) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5006, std. dev.: 0.0077) MultiSource/Applications/spiff/spiff: -1.72% (3.0263 => 2.9743, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2577, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7949, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8584, std. dev.: 0.0042) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1182, std. dev.: 0.0404) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.34% (9.3358 => 9.2110, std. dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.29% (0.9692 => 0.9567, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2397, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2598, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 09:06:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 11:06:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120715160651.408F52A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2081?compare_to=2078&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2081, Order: 160231, Start Time: 2012-07-15 14:48:36, End Time: 2012-07-15 16:07:01 To: 2078, Order: 160230, Start Time: 2012-07-15 13:02:09, End Time: 2012-07-15 14:20:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (794 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.83% (10.3673 => 13.6670, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.39% (1.1194 => 1.2469, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/trivial-interface: 11.37% (0.3473 => 0.3868, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.15% (0.3543 => 0.3938, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: 11.12% (0.3497 => 0.3886, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3543 => 0.3937, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3516 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3561 => 0.3951, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.34% (0.3828 => 0.4224, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.19% (0.3927 => 0.4327, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/property: 10.16% (0.3886 => 0.4281, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.03% (1.7609 => 1.9023, std. dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.92% (2.2022 => 2.3766, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.37% (0.6030 => 0.6414, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.35% (0.5925 => 0.6301, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 5.73% (0.7326 => 0.7746, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.18% (0.2065 => 0.2172, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.3177 => 0.3333, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.60% (7.0540 => 7.3787, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.57% (0.4879 => 0.5102, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.48% (10.4361 => 10.9036, std. dev.: 0.0172) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.37% (0.8172 => 0.8529, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 4.36% (0.3282 => 0.3425, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 3.96% (0.7433 => 0.7727, std. dev.: 0.0045) MultiSource/Applications/hbd/hbd: 3.22% (1.5603 => 1.6105, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.11% (0.5569 => 0.5742, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.81% (5.0018 => 5.1425, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.75% (4.9449 => 5.0807, std. dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.69% (0.4615 => 0.4739, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 2.67% (0.7835 => 0.8044, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (14.3668 => 14.7258, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.43% (8.1363 => 8.3343, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.39% (0.4636 => 0.4747, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.32% (0.5860 => 0.5996, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.22% (2.0665 => 2.1123, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.17% (4.2646 => 4.3570, std. dev.: 0.0138) MultiSource/Benchmarks/mafft/pairlocalalign: 2.16% (9.4845 => 9.6889, std. dev.: 0.0240) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.75% (1.1861 => 1.2069, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.72% (1.5415 => 1.5680, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 1.67% (2.0273 => 2.0612, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 1.67% (3.3354 => 3.3911, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.61% (0.8067 => 0.8197, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.54% (3.8723 => 3.9321, std. dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 1.54% (5.7591 => 5.8479, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.53% (1.3050 => 1.3250, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.36% (1.2842 => 1.3017, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.28% (17.1811 => 17.4008, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.28% (1.4186 => 1.4367, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.08% (0.9765 => 0.9870, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7516, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.13% (26.0924 => 26.6471, std. dev.: 0.0159) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (1.5086 => 1.5381, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2404, std. dev.: 0.0141) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6885, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.05% (5.2763 => 3.1631, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.16% (5.3855 => 3.7074, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.80% (5.3526 => 3.7038, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.17% (2.9384 => 2.5514, std. dev.: 0.0162) MultiSource/Applications/ClamAV/clamscan: -10.53% (22.1758 => 19.8397, std. dev.: 0.0347) SingleSource/UnitTests/Vector/constpool: -5.00% (54.1659 => 51.4582, std. dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.44% (3.8922 => 3.7971, std. dev.: 0.0174) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.53% (1.2373 => 1.1070, std. dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.22% (19.9488 => 18.5082, std. dev.: 0.0894) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9156, std. dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6890, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.05% (1.4460 => 1.4308, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 10:37:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 12:37:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120715173743.930132A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2082?compare_to=2080&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2082, Order: 160232, Start Time: 2012-07-15 16:24:12, End Time: 2012-07-15 17:37:53 To: 2080, Order: 160231, Start Time: 2012-07-15 14:42:52, End Time: 2012-07-15 15:56:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (127 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.10% (2.0176 => 2.3021, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 10.40% (0.5818 => 0.6423, std. dev.: 0.0042) SingleSource/UnitTests/ObjC++/Hello: 10.23% (0.5748 => 0.6336, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 9.15% (0.7061 => 0.7707, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 8.89% (0.3578 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.72% (0.3601 => 0.3915, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.49% (0.3650 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.48% (0.3646 => 0.3955, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3623 => 0.3926, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.33% (0.3663 => 0.3968, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.22% (0.4003 => 0.4332, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.99% (0.3940 => 0.4255, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.55% (1.3693 => 1.4727, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1986 => 0.2122, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.47% (0.4328 => 0.4608, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.32% (0.7038 => 0.7483, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.08% (0.7710 => 0.8179, std. dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 6.08% (0.2781 => 0.2950, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.02% (0.2690 => 0.2852, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.97% (0.2782 => 0.2948, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.86% (0.2596 => 0.2748, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.83% (0.2607 => 0.2759, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.79% (0.4062 => 0.4297, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.77% (0.5265 => 0.5569, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.76% (0.2655 => 0.2808, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.75% (0.2937 => 0.3106, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3022 => 0.3195, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.72% (0.2726 => 0.2882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.71% (0.2628 => 0.2778, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.67% (0.3489 => 0.3687, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.66% (0.2966 => 0.3134, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.61% (0.2761 => 0.2916, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.60% (0.2696 => 0.2847, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.53% (1.9828 => 2.0924, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.51% (0.2721 => 0.2871, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2765 => 0.2917, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.40% (3.9660 => 4.1801, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.34% (0.3580 => 0.3771, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.23% (0.3899 => 0.4103, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.16% (0.3485 => 0.3665, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.94% (0.6959 => 0.7303, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 4.92% (0.3192 => 0.3349, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.89% (0.3453 => 0.3622, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.75% (0.3534 => 0.3702, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2988 => 0.3130, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3756 => 0.3932, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.66% (0.4016 => 0.4203, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3293 => 0.3446, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.58% (0.4390 => 0.4591, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.50% (16.6129 => 17.3610, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.37% (0.9199 => 0.9601, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.2945 => 0.3072, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.27% (13.8202 => 14.4099, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/09-vor/vor: 4.21% (0.2925 => 0.3048, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.20% (13.2842 => 13.8427, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.02% (1.2193 => 1.2683, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.5577 => 0.5795, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.73% (1.2292 => 1.2751, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.71% (0.5637 => 0.5846, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.68% (0.7506 => 0.7782, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.68% (1.3245 => 1.3732, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.67% (0.3246 => 0.3365, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.66% (1.3813 => 1.4318, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.63% (0.4379 => 0.4538, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.60% (3.8646 => 4.0036, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.53% (1.3819 => 1.4307, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.53% (1.1364 => 1.1765, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.51% (1.4563 => 1.5074, std. dev.: 0.0040) MultiSource/Applications/Burg/burg: 3.51% (1.1061 => 1.1449, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.47% (0.2914 => 0.3015, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.46% (7.2180 => 7.4674, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.38% (0.3755 => 0.3882, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.34% (1.9270 => 1.9913, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.0594 => 1.0942, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.27% (0.7460 => 0.7704, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.85% (4.9865 => 5.1284, std. dev.: 0.0210) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (3.6692 => 3.7712, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.62% (2.1791 => 2.2361, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.59% (4.3801 => 4.4937, std. dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (6.5754 => 6.7430, std. dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 2.52% (14.8535 => 15.2271, std. dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.39% (0.8698 => 0.8906, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.39% (4.4433 => 4.5493, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.27% (0.6135 => 0.6274, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.17% (16.2614 => 16.6144, std. dev.: 0.0169) MultiSource/Applications/d/make_dparser: 2.12% (3.1889 => 3.2564, std. dev.: 0.0130) MultiSource/Applications/ClamAV/clamscan: 2.08% (14.5298 => 14.8323, std. dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 1.75% (1.2749 => 1.2972, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (0.6283 => 0.6391, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.23% (2.1007 => 2.1265, std. dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.08% (1.8175 => 2.2733, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/mandel-2: 8.56% (1.2998 => 1.4110, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.40% (2.0200 => 2.1896, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.12% (0.9996 => 1.0808, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.18% (7.4271 => 7.7376, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9200, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6794, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5089 => 1.5332, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.49% (3.6469 => 3.7012, std. dev.: 0.0072) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.69% (0.4657 => 0.3973, std. dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.73% (22.5627 => 21.0452, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.23% (0.8818 => 0.8621, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.16% (1.2308 => 1.1058, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.04% (20.3410 => 18.5012, std. dev.: 0.1004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.25% (1.3780 => 1.3194, std. dev.: 0.0073) SingleSource/UnitTests/Vector/multiplies: -3.60% (2.6470 => 2.5518, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9126, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5955, std. dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4474, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5013, std. dev.: 0.0075) MultiSource/Applications/spiff/spiff: -1.80% (3.0263 => 2.9719, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2513, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7945, std. dev.: 0.0014) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1251, std. dev.: 0.0369) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4888, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.39% (0.8342 => 0.8226, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.34% (9.3358 => 9.2108, std. dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.29% (0.9692 => 0.9567, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2414, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2562, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 10:53:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 12:53:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120715175302.4D2752A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2083?compare_to=2081&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2083, Order: 160232, Start Time: 2012-07-15 16:34:50, End Time: 2012-07-15 17:53:12 To: 2081, Order: 160231, Start Time: 2012-07-15 14:48:36, End Time: 2012-07-15 16:07:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (791 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.89% (10.3673 => 13.6731, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/trivial-interface: 11.46% (0.3473 => 0.3871, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.40% (1.1194 => 1.2470, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 11.18% (0.3497 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.09% (0.3543 => 0.3936, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.06% (0.3516 => 0.3905, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.04% (0.3543 => 0.3934, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3828 => 0.4221, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.16% (0.3886 => 0.4281, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.13% (0.3927 => 0.4325, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.05% (1.7609 => 1.9026, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.97% (2.2022 => 2.3777, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops: 6.98% (0.1432 => 0.1532, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.48% (0.6030 => 0.6421, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 6.41% (0.5925 => 0.6305, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 5.76% (0.7326 => 0.7748, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.28% (0.2065 => 0.2174, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.97% (0.3177 => 0.3335, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.66% (7.0540 => 7.3829, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.53% (0.4879 => 0.5100, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.53% (10.4361 => 10.9088, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/oourafft: 4.11% (0.3282 => 0.3417, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.89% (0.8172 => 0.8490, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 3.89% (0.7433 => 0.7722, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.21% (0.4615 => 0.4763, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.92% (1.5603 => 1.6058, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.90% (0.4103 => 0.4222, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.86% (0.5569 => 0.5728, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.85% (5.0018 => 5.1444, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.84% (4.9449 => 5.0851, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (14.3668 => 14.7355, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: 2.46% (0.7835 => 0.8028, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.46% (0.4636 => 0.4750, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.38% (8.1363 => 8.3298, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.37% (2.0665 => 2.1154, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.34% (0.5860 => 0.5997, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.22% (4.2646 => 4.3591, std. dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 2.18% (9.4845 => 9.6911, std. dev.: 0.0187) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.87% (1.5415 => 1.5704, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.80% (1.1861 => 1.2074, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 1.80% (1.1642 => 1.1851, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.79% (3.3354 => 3.3952, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.72% (0.8067 => 0.8206, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 1.70% (2.0273 => 2.0618, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.61% (0.6450 => 0.6554, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 1.58% (3.8723 => 3.9335, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.52% (1.3050 => 1.3249, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.51% (5.7591 => 5.8458, std. dev.: 0.0155) MultiSource/Applications/hexxagon/hexxagon: 1.49% (1.2842 => 1.3033, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.33% (17.1811 => 17.4101, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.32% (1.4186 => 1.4373, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.27% (0.9765 => 0.9889, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9742, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.81% (1.1145 => 1.1904, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7492, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.17% (26.0924 => 26.6593, std. dev.: 0.0407) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5086 => 1.5353, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4462, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.36% (2.6546 => 2.6908, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2365, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.09% (5.2763 => 3.1611, std. dev.: 0.0160) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.18% (5.3855 => 3.7062, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7037, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.13% (2.9384 => 2.5526, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.58% (22.1758 => 19.8291, std. dev.: 0.0315) SingleSource/UnitTests/Vector/constpool: -4.98% (54.1659 => 51.4679, std. dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.38% (3.8922 => 3.7997, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2373 => 1.1105, std. dev.: 0.0353) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.01% (19.9488 => 18.5510, std. dev.: 0.0593) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9204, std. dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6858, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0859, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.15% (1.4460 => 1.4293, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 11:55:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 13:55:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120715185509.2632D2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2084?compare_to=2079&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2084, Order: 160232, Start Time: 2012-07-15 16:12:18, End Time: 2012-07-15 18:55:19 To: 2079, Order: 160230, Start Time: 2012-07-15 13:01:47, End Time: 2012-07-15 15:44:46 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (64 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (829 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.04% (2.0405 => 2.1026, std. dev.: 0.0238) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3460 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.53% (0.3465 => 0.3899, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.52% (0.3442 => 0.3873, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.48% (0.3446 => 0.3876, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.44% (0.3496 => 0.3931, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.41% (0.3488 => 0.3921, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.40% (0.3469 => 0.3899, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.11% (0.3650 => 0.4092, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.05% (0.3643 => 0.4082, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/parameter-passing: 11.71% (0.3724 => 0.4160, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.43% (0.5826 => 0.6259, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.10% (0.5889 => 0.6307, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.49% (0.7171 => 0.7565, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.27% (1.6211 => 1.6903, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.25% (3.5627 => 3.7142, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.15% (0.5900 => 0.6145, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.00% (0.2875 => 0.2990, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.98% (0.2738 => 0.2847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2725 => 0.2833, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.92% (0.2729 => 0.2836, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.82% (0.2803 => 0.2910, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.78% (0.3096 => 0.3213, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.75% (0.2750 => 0.2853, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.74% (0.4361 => 0.4524, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.62% (2.0673 => 2.1421, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.57% (1.3152 => 1.3621, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.56% (0.9909 => 1.0262, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 3.45% (0.4029 => 0.4168, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.44% (0.4994 => 0.5166, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.41% (0.3258 => 0.3369, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.37% (0.3267 => 0.3377, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (0.5026 => 0.5195, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.35% (0.3195 => 0.3302, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.33% (0.9697 => 1.0020, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.21% (0.3930 => 0.4056, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3317 => 0.3423, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.19% (4.2109 => 4.3454, std. dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.18% (2.7292 => 2.8160, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.14% (0.5000 => 0.5157, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.12% (0.3362 => 0.3467, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.08% (0.3348 => 0.3451, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.01% (0.3625 => 0.3734, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.99% (0.3678 => 0.3788, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3477 => 0.3580, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 2.95% (0.3726 => 0.3836, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.93% (0.3690 => 0.3798, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.90% (1.9694 => 2.0265, std. dev.: 0.0071) MultiSource/Applications/d/make_dparser: 2.79% (1.0781 => 1.1082, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (1.9966 => 2.0504, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 2.65% (0.4146 => 0.4256, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.54% (0.4251 => 0.4359, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.41% (4.4195 => 4.5262, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.39% (23.5202 => 24.0832, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.38% (0.4658 => 0.4769, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 2.28% (2.1653 => 2.2147, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 2.28% (2.1013 => 2.1492, std. dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 2.26% (4.6177 => 4.7220, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.08% (1.8794 => 1.9185, std. dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 2.07% (1.5932 => 1.6261, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.6435 => 0.6553, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 1.78% (5.5417 => 5.6402, std. dev.: 0.0050) MultiSource/Applications/treecc/treecc: 1.77% (0.7875 => 0.8014, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.51% (1.4269 => 1.4485, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.07% (0.2122 => 0.2272, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.99% (11.9555 => 11.7171, std. dev.: 0.0174) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 14:43:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 16:43:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120715214341.4419B2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2085?compare_to=2082&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2085, Order: 160233, Start Time: 2012-07-15 20:30:12, End Time: 2012-07-15 21:43:50 To: 2082, Order: 160232, Start Time: 2012-07-15 16:24:12, End Time: 2012-07-15 17:37:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.82% (54.4189 => 56.5002, std. dev.: 0.0217) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.16% (2.0176 => 2.3033, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: 10.40% (0.5748 => 0.6346, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 10.19% (0.5818 => 0.6411, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 9.02% (0.7061 => 0.7698, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 8.92% (0.3578 => 0.3897, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.52% (0.3650 => 0.3961, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.44% (0.3601 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.42% (0.3646 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.33% (0.3663 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3623 => 0.3923, std. dev.: 0.0076) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.20% (0.3914 => 0.4235, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.07% (0.4003 => 0.4326, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.56% (1.3693 => 1.4728, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.90% (0.1986 => 0.2123, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.31% (0.4328 => 0.4601, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.19% (0.7038 => 0.7474, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.17% (0.7710 => 0.8186, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2655 => 0.2813, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.93% (0.2781 => 0.2946, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.86% (0.4062 => 0.4300, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.86% (0.3022 => 0.3199, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.82% (0.2596 => 0.2747, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.75% (0.2782 => 0.2942, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.74% (0.5265 => 0.5567, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2607 => 0.2754, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2765 => 0.2919, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.49% (3.9660 => 4.1837, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.47% (0.3489 => 0.3680, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.43% (0.2761 => 0.2911, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.42% (0.3580 => 0.3774, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.41% (0.3899 => 0.4110, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.41% (1.9828 => 2.0900, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.40% (0.2721 => 0.2868, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.91% (0.3485 => 0.3656, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.73% (0.3192 => 0.3343, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.71% (0.6959 => 0.7287, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.65% (0.4390 => 0.4594, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 4.62% (0.2988 => 0.3126, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3756 => 0.3929, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.59% (0.3293 => 0.3444, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.56% (0.4016 => 0.4199, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.56% (0.3534 => 0.3695, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.50% (16.6129 => 17.3613, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.32% (0.9199 => 0.9596, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.28% (13.8202 => 14.4115, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: 4.24% (0.3868 => 0.4032, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.22% (13.2842 => 13.8454, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2945 => 0.3066, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.10% (0.2925 => 0.3045, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.09% (1.2193 => 1.2692, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.87% (0.5637 => 0.5855, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.71% (0.5577 => 0.5784, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.71% (1.3813 => 1.4325, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.70% (0.3246 => 0.3366, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.65% (0.4379 => 0.4539, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 3.64% (1.2292 => 1.2740, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 3.64% (0.7506 => 0.7779, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.57% (1.3245 => 1.3718, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.56% (1.1364 => 1.1769, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.56% (1.4563 => 1.5082, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.55% (1.3819 => 1.4309, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.51% (3.8646 => 4.0003, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3755 => 0.3886, std. dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.2914 => 0.3014, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.43% (1.1061 => 1.1440, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.40% (7.2180 => 7.4634, std. dev.: 0.0054) MultiSource/Applications/treecc/treecc: 3.29% (1.9270 => 1.9904, std. dev.: 0.0140) MultiSource/Benchmarks/nbench/nbench: 3.19% (1.0594 => 1.0932, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.19% (0.7460 => 0.7698, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.95% (3.6692 => 3.7773, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.87% (4.9865 => 5.1294, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8310 => 0.8535, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.56% (4.3801 => 4.4921, std. dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (6.5754 => 6.7393, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 2.49% (2.1791 => 2.2334, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 2.49% (14.8535 => 15.2227, std. dev.: 0.0145) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.41% (4.4433 => 4.5505, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.36% (0.8698 => 0.8903, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6135 => 0.6272, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.17% (16.2614 => 16.6150, std. dev.: 0.0286) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.14% (1.1333 => 1.1575, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.02% (14.5298 => 14.8239, std. dev.: 0.0124) MultiSource/Applications/d/make_dparser: 2.02% (3.1889 => 3.2533, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (1.2749 => 1.2977, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.78% (0.6283 => 0.6395, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.19% (2.1007 => 2.1258, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.03% (1.8175 => 2.2725, std. dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.40% (2.0200 => 2.1897, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 8.00% (1.2998 => 1.4038, std. dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.06% (7.4271 => 7.7285, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9194, std. dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6799, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4806, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1898, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5334, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.53% (3.6469 => 3.7026, std. dev.: 0.0062) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (1.9290 => 1.9552, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.73% (0.4657 => 0.3971, std. dev.: 0.0094) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.72% (22.5627 => 21.0476, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.17% (0.8818 => 0.8627, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.55% (0.0997 => 0.0842, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.10% (1.2308 => 1.1065, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.65% (20.3410 => 18.5814, std. dev.: 0.0198) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3133, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9126, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5923, std. dev.: 0.0131) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5021, std. dev.: 0.0057) MultiSource/Applications/spiff/spiff: -1.75% (3.0263 => 2.9733, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2527, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.56% (0.6589 => 0.6486, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7946, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4887, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0015) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1617, std. dev.: 0.0244) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2181, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8690, std. dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2517, std. dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -1.17% (7.3305 => 7.2448, std. dev.: 0.0295) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8457, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 14:48:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 16:48:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120715214836.B6B802A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2086?compare_to=2083&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2086, Order: 160233, Start Time: 2012-07-15 20:30:26, End Time: 2012-07-15 21:48:47 To: 2083, Order: 160232, Start Time: 2012-07-15 16:34:50, End Time: 2012-07-15 17:53:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (60 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.44% (78.4815 => 79.6151, std. dev.: 0.3602) SingleSource/Benchmarks/Misc/fbench: 1.15% (2.2779 => 2.3042, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/lowercase: 1.11% (7.9595 => 8.0477, std. dev.: 0.0122) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.82% (10.3673 => 13.6660, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: 11.49% (0.3473 => 0.3872, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.39% (1.1194 => 1.2469, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.23% (0.3543 => 0.3941, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.15% (0.3497 => 0.3887, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.06% (0.3516 => 0.3905, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.04% (0.3543 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.90% (0.3561 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.24% (0.3927 => 0.4329, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.21% (0.3828 => 0.4219, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.19% (0.3886 => 0.4282, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.02% (1.7609 => 1.9021, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.91% (2.2022 => 2.3764, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.45% (0.5925 => 0.6307, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 6.35% (0.6030 => 0.6413, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 5.69% (0.7326 => 0.7743, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.28% (0.2065 => 0.2174, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.69% (7.0540 => 7.3850, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.66% (0.3177 => 0.3325, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.49% (0.4879 => 0.5098, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.47% (10.4361 => 10.9030, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/oourafft: 4.11% (0.3282 => 0.3417, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 3.91% (0.7433 => 0.7724, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.03% (0.8172 => 0.8420, std. dev.: 0.0040) MultiSource/Applications/hbd/hbd: 2.98% (1.5603 => 1.6068, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.88% (0.4615 => 0.4748, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.77% (5.0018 => 5.1405, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.73% (0.5569 => 0.5721, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.65% (4.9449 => 5.0759, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.46% (14.3668 => 14.7209, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.36% (8.1363 => 8.3284, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.34% (2.0665 => 2.1148, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.30% (0.5860 => 0.5995, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.22% (4.2646 => 4.3594, std. dev.: 0.0054) MultiSource/Applications/spiff/spiff: 2.20% (0.7835 => 0.8007, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 2.12% (9.4845 => 9.6859, std. dev.: 0.0056) MultiSource/Applications/Burg/burg: 1.82% (1.1642 => 1.1854, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.77% (1.1861 => 1.2071, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.70% (2.0273 => 2.0618, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 1.65% (3.8723 => 3.9362, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.62% (0.8067 => 0.8198, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.59% (3.3354 => 3.3883, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.54% (1.5415 => 1.5653, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.52% (1.3050 => 1.3249, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 1.51% (5.7591 => 5.8458, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.46% (1.2842 => 1.3029, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.33% (1.4186 => 1.4374, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.32% (17.1811 => 17.4084, std. dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.30% (0.9765 => 0.9892, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (3.6395 => 3.7598, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.23% (26.0924 => 26.6755, std. dev.: 0.0137) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (1.5086 => 1.5362, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2412, std. dev.: 0.0284) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6895, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 1.19% (2.2771 => 2.3042, std. dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1255, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.11% (5.2763 => 3.1600, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.06% (5.3855 => 3.7129, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.87% (5.3526 => 3.7004, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.24% (2.9384 => 2.5494, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -10.61% (22.1758 => 19.8236, std. dev.: 0.0095) SingleSource/UnitTests/Vector/constpool: -4.97% (54.1659 => 51.4721, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.45% (3.8922 => 3.7968, std. dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.09% (1.2373 => 1.1124, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.08% (19.9488 => 18.5370, std. dev.: 0.0633) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9126, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6917, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0842, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 16:12:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 18:12:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120715231259.1002F2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2087?compare_to=2084&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2087, Order: 160233, Start Time: 2012-07-15 20:30:07, End Time: 2012-07-15 23:13:09 To: 2084, Order: 160232, Start Time: 2012-07-15 16:12:18, End Time: 2012-07-15 18:55:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (66 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (827 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.33% (54.0912 => 54.8084, std. dev.: 0.0390) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3460 => 0.3896, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.59% (0.3446 => 0.3880, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 12.59% (0.3496 => 0.3936, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.57% (0.3469 => 0.3905, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 12.55% (0.3465 => 0.3900, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.55% (0.3442 => 0.3874, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.41% (0.3488 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.22% (0.3650 => 0.4096, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.00% (0.3643 => 0.4080, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.63% (0.3724 => 0.4157, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.48% (0.5826 => 0.6262, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.20% (0.5889 => 0.6313, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.58% (0.7171 => 0.7571, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.30% (1.6211 => 1.6908, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.29% (3.5627 => 3.7155, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2725 => 0.2841, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.16% (0.2714 => 0.2827, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.99% (0.2729 => 0.2838, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.96% (0.2803 => 0.2914, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.91% (0.2738 => 0.2845, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.90% (0.4361 => 0.4531, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.84% (0.3096 => 0.3215, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.80% (0.5900 => 0.6124, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 3.78% (0.2750 => 0.2854, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.62% (2.0673 => 2.1422, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.62% (0.9909 => 1.0268, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.2866 => 0.2969, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.56% (0.4994 => 0.5172, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 3.56% (0.2811 => 0.2911, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.55% (0.4029 => 0.4172, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 3.50% (0.3004 => 0.3109, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.47% (0.3317 => 0.3432, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.46% (1.3152 => 1.3607, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary3: 3.46% (0.3267 => 0.3380, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.41% (0.9697 => 1.0028, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3195 => 0.3304, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.33% (0.3124 => 0.3228, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.28% (0.5026 => 0.5191, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.23% (0.3930 => 0.4057, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 3.21% (4.2109 => 4.3462, std. dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.15% (2.7292 => 2.8152, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.12% (0.5000 => 0.5156, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.01% (0.3690 => 0.3801, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.01% (0.3625 => 0.3734, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.01% (0.3726 => 0.3838, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 2.99% (0.3678 => 0.3788, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3477 => 0.3580, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (1.9694 => 2.0262, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 2.79% (1.0781 => 1.1082, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.70% (1.9966 => 2.0506, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 2.65% (0.4146 => 0.4256, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.60% (0.3845 => 0.3945, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 2.52% (0.4251 => 0.4358, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.47% (0.4658 => 0.4773, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (4.4195 => 4.5265, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 2.41% (23.5202 => 24.0859, std. dev.: 0.0128) MultiSource/Applications/JM/lencod/lencod: 2.32% (4.6177 => 4.7249, std. dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: 2.32% (2.1653 => 2.2155, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 2.25% (2.1013 => 2.1485, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 2.02% (1.8794 => 1.9174, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 1.97% (1.5932 => 1.6246, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (0.6435 => 0.6558, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 1.81% (5.5417 => 5.6419, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 1.78% (0.7875 => 0.8015, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 1.63% (1.4269 => 1.4501, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.35% (2.8036 => 2.8415, std. dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.92% (11.9555 => 11.7261, std. dev.: 0.0174) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 16:24:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 18:24:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120715232453.2A89D2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2088?compare_to=2085&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2088, Order: 160236, Start Time: 2012-07-15 22:11:25, End Time: 2012-07-15 23:25:03 To: 2085, Order: 160233, Start Time: 2012-07-15 20:30:12, End Time: 2012-07-15 21:43:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (129 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.38% (80.3679 => 78.4561, std. dev.: 0.6741) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.58% (2.0176 => 2.2916, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.85% (0.5818 => 0.6391, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.69% (0.5748 => 0.6305, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3578 => 0.3887, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.58% (0.7061 => 0.7667, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-2: 8.44% (0.3601 => 0.3905, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3623 => 0.3926, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.36% (0.3650 => 0.3955, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.34% (0.3646 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.33% (0.3914 => 0.4240, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.33% (0.3663 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.26% (0.3789 => 0.4102, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.19% (0.4003 => 0.4331, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.99% (0.3940 => 0.4255, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.87% (1.3693 => 1.4771, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1986 => 0.2122, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.58% (0.2781 => 0.2964, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (0.4328 => 0.4612, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2782 => 0.2962, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.37% (0.7038 => 0.7486, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 6.18% (0.2607 => 0.2768, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2690 => 0.2856, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.16% (0.7710 => 0.8185, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 6.16% (0.2761 => 0.2931, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.09% (0.3022 => 0.3206, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.06% (0.2655 => 0.2816, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.05% (0.2726 => 0.2891, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.01% (0.2628 => 0.2786, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.01% (0.4062 => 0.4306, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.97% (0.2765 => 0.2930, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.95% (1.9828 => 2.1008, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: 5.94% (0.2760 => 0.2924, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.92% (0.2937 => 0.3111, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.90% (0.2966 => 0.3141, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.77% (0.5265 => 0.5569, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.76% (0.3489 => 0.3690, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.74% (0.2596 => 0.2745, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.71% (0.2696 => 0.2850, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3107 => 0.3283, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.65% (0.3149 => 0.3327, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.46% (0.3899 => 0.4112, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.42% (0.4390 => 0.4628, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.42% (0.3580 => 0.3774, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 5.39% (0.3453 => 0.3639, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.38% (3.9660 => 4.1793, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 5.36% (0.3192 => 0.3363, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.34% (0.3485 => 0.3671, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.2721 => 0.2865, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.12% (0.2988 => 0.3141, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.10% (0.3293 => 0.3461, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.03% (0.4016 => 0.4218, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.74% (0.6959 => 0.7289, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.52% (0.2945 => 0.3078, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.36% (0.9199 => 0.9600, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 4.36% (16.6129 => 17.3365, std. dev.: 0.0203) MultiSource/Benchmarks/McCat/09-vor/vor: 4.21% (0.2925 => 0.3048, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.18% (13.8202 => 14.3981, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.16% (13.2842 => 13.8367, std. dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.94% (1.2193 => 1.2674, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.92% (1.2292 => 1.2774, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.89% (0.5577 => 0.5794, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.76% (0.5637 => 0.5849, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.74% (0.7506 => 0.7787, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.67% (0.3246 => 0.3365, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.66% (1.3245 => 1.3730, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 3.63% (3.8646 => 4.0048, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.61% (0.4379 => 0.4537, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.58% (1.3813 => 1.4308, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3755 => 0.3888, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.53% (0.2914 => 0.3017, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.52% (1.1061 => 1.1450, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.50% (7.2180 => 7.4704, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.50% (1.4563 => 1.5072, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.48% (1.1364 => 1.1759, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.47% (1.3819 => 1.4299, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.32% (1.9270 => 1.9910, std. dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.0594 => 1.0929, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.10% (0.7460 => 0.7691, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.81% (4.9865 => 5.1267, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.73% (3.6692 => 3.7692, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8310 => 0.8528, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.57% (4.3801 => 4.4925, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.56% (2.1791 => 2.2349, std. dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: 2.53% (6.5754 => 6.7419, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.47% (0.8698 => 0.8913, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.46% (14.8535 => 15.2192, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.41% (4.4433 => 4.5503, std. dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.25% (0.6135 => 0.6273, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.17% (1.1333 => 1.1579, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.11% (16.2614 => 16.6049, std. dev.: 0.0164) MultiSource/Applications/d/make_dparser: 1.96% (3.1889 => 3.2514, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.95% (14.5298 => 14.8134, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.80% (0.6283 => 0.6396, std. dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 1.67% (1.2749 => 1.2962, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.1007 => 2.1231, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.78% (1.8175 => 2.2679, std. dev.: 0.0337) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1930, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 8.22% (1.2998 => 1.4066, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.18% (7.4271 => 7.7373, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8320, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1891, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6469 => 3.7088, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5089 => 1.5328, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9588, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1940, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.87% (22.5627 => 21.0127, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.37% (0.8818 => 0.8609, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.15% (0.0997 => 0.0836, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1105, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (20.3410 => 18.6361, std. dev.: 0.0179) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std. dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9128, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5907, std. dev.: 0.0171) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5060, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: -1.73% (3.0263 => 2.9739, std. dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2554, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9980, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7949, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.51% (2.5254 => 2.4872, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.39% (0.8342 => 0.8226, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1683, std. dev.: 0.0128) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2405, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2220, std. dev.: 0.0174) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2597, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 16:34:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 18:34:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120715233436.3DED52A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2089?compare_to=2086&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2089, Order: 160236, Start Time: 2012-07-15 22:16:33, End Time: 2012-07-15 23:34:46 To: 2086, Order: 160233, Start Time: 2012-07-15 20:30:26, End Time: 2012-07-15 21:48:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (58 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (797 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.29% (55.7904 => 56.5098, std. dev.: 0.0377) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.27% (13.6660 => 13.3553, std. dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.82% (10.3673 => 13.3553, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 11.63% (0.3473 => 0.3877, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 11.24% (0.3497 => 0.3890, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.21% (1.1194 => 1.2449, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 11.09% (0.3516 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3561 => 0.3955, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.06% (0.3543 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3694 => 0.4089, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.42% (0.3828 => 0.4227, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.19% (0.3886 => 0.4282, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.11% (0.3927 => 0.4324, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.59% (1.7609 => 1.8946, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.56% (2.2022 => 2.3686, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 5.92% (0.6030 => 0.6387, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.91% (0.5925 => 0.6275, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.33% (0.2065 => 0.2175, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.12% (0.7326 => 0.7701, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.47% (0.3177 => 0.3319, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.45% (7.0540 => 7.3676, std. dev.: 0.0300) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.28% (0.4879 => 0.5088, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.22% (10.4361 => 10.8762, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/oourafft: 3.78% (0.3282 => 0.3406, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 3.51% (0.7433 => 0.7694, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.85% (0.8172 => 0.8405, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 2.68% (1.5603 => 1.6021, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.65% (4.9449 => 5.0757, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.64% (5.0018 => 5.1339, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.62% (0.4615 => 0.4736, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.60% (0.5569 => 0.5714, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.26% (0.4636 => 0.4741, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.20% (8.1363 => 8.3152, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 2.17% (0.7835 => 0.8005, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (14.3668 => 14.6782, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (2.0665 => 2.1105, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.00% (4.2646 => 4.3500, std. dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 1.90% (9.4845 => 9.6648, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.88% (0.5860 => 0.5970, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.64% (1.1861 => 1.2055, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.50% (0.8067 => 0.8188, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 1.48% (3.3354 => 3.3848, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 1.46% (5.7591 => 5.8431, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 1.45% (2.0273 => 2.0566, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.37% (1.3050 => 1.3229, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.28% (3.8723 => 3.9220, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.27% (1.5415 => 1.5611, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.21% (1.2842 => 1.2998, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.09% (17.1811 => 17.3684, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.02% (1.4186 => 1.4331, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7548, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.23% (26.0924 => 26.6746, std. dev.: 0.0117) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (1.5086 => 1.5407, std. dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2432, std. dev.: 0.0373) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.23% (2.6546 => 2.6872, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.28% (5.2763 => 3.1511, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.28% (5.3855 => 3.7009, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.98% (5.3526 => 3.6945, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.36% (2.9384 => 2.5459, std. dev.: 0.0079) MultiSource/Applications/ClamAV/clamscan: -10.63% (22.1758 => 19.8178, std. dev.: 0.0300) SingleSource/UnitTests/Vector/constpool: -4.91% (54.1659 => 51.5081, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.62% (3.8922 => 3.7901, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.58% (1.2373 => 1.1064, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.02% (19.9488 => 18.5475, std. dev.: 0.0488) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9153, std. dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6848, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: -1.97% (10.2830 => 10.0801, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 18:15:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 20:15:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120716011526.107EA2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2090?compare_to=2088&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2090, Order: 160238, Start Time: 2012-07-16 00:01:55, End Time: 2012-07-16 01:15:35 To: 2088, Order: 160236, Start Time: 2012-07-15 22:11:25, End Time: 2012-07-15 23:25:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (128 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.54% (2.0176 => 2.2908, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 9.76% (0.5818 => 0.6386, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.64% (0.5748 => 0.6302, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.96% (0.7061 => 0.7694, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 8.66% (0.3578 => 0.3888, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3601 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.34% (0.3646 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.33% (0.3663 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.30% (0.3650 => 0.3953, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.20% (0.3623 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.18% (0.3789 => 0.4099, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.10% (0.3914 => 0.4231, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/parameter-passing: 8.02% (0.4003 => 0.4324, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.89% (0.3940 => 0.4251, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.84% (1.3693 => 1.4767, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.80% (0.1986 => 0.2121, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4328 => 0.4610, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.38% (0.7038 => 0.7487, std. dev.: 0.0054) SingleSource/Regression/C++/ofstream_ctor: 6.29% (0.2781 => 0.2956, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.18% (0.2655 => 0.2819, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.15% (0.2782 => 0.2953, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.06% (0.2607 => 0.2765, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.06% (0.2690 => 0.2853, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.98% (0.2726 => 0.2889, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.97% (0.2628 => 0.2785, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.96% (0.4062 => 0.4304, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.96% (0.3022 => 0.3202, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.92% (0.2937 => 0.3111, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.90% (0.2761 => 0.2924, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.90% (0.2765 => 0.2928, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.85% (1.9828 => 2.0987, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/except: 5.83% (0.2760 => 0.2921, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.83% (0.2966 => 0.3139, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.82% (0.2696 => 0.2853, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.81% (0.7710 => 0.8158, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.79% (0.3489 => 0.3691, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.78% (0.2596 => 0.2746, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3107 => 0.3283, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.66% (0.5265 => 0.5563, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.65% (0.3149 => 0.3327, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.46% (0.3899 => 0.4112, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.45% (0.3580 => 0.3775, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.40% (0.4390 => 0.4627, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.31% (3.9660 => 4.1766, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.26% (0.2721 => 0.2864, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.22% (0.3485 => 0.3667, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.88% (0.4016 => 0.4212, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.71% (0.6959 => 0.7287, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.71% (0.3756 => 0.3933, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.3868 => 0.4047, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 4.48% (0.2945 => 0.3077, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.34% (0.9199 => 0.9598, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.32% (16.6129 => 17.3312, std. dev.: 0.0175) MultiSource/Applications/SPASS/SPASS: 4.14% (13.8202 => 14.3927, std. dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.11% (13.2842 => 13.8308, std. dev.: 0.0146) MultiSource/Benchmarks/McCat/09-vor/vor: 4.07% (0.2925 => 0.3044, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.01% (1.2193 => 1.2682, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.90% (1.2292 => 1.2771, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.84% (0.5577 => 0.5791, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.80% (0.5637 => 0.5851, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.79% (0.4379 => 0.4545, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.73% (0.7506 => 0.7786, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3755 => 0.3890, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.58% (1.3245 => 1.3719, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.57% (0.3246 => 0.3362, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.52% (1.3813 => 1.4299, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.50% (1.4563 => 1.5072, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 3.49% (3.8646 => 3.9993, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.47% (1.3819 => 1.4298, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.45% (1.1364 => 1.1756, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 3.42% (1.1061 => 1.1439, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.41% (7.2180 => 7.4640, std. dev.: 0.0072) MultiSource/Applications/treecc/treecc: 3.35% (1.9270 => 1.9915, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 3.22% (1.0594 => 1.0935, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.19% (0.7460 => 0.7698, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.74% (4.9865 => 5.1231, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.68% (3.6692 => 3.7677, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.51% (4.3801 => 4.4901, std. dev.: 0.0109) MultiSource/Applications/siod/siod: 2.47% (2.1791 => 2.2330, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 2.46% (6.5754 => 6.7373, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.46% (0.8698 => 0.8912, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.42% (14.8535 => 15.2126, std. dev.: 0.0156) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.39% (4.4433 => 4.5493, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.33% (0.6135 => 0.6278, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.12% (1.1333 => 1.1573, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.07% (16.2614 => 16.5973, std. dev.: 0.0166) MultiSource/Applications/d/make_dparser: 1.99% (3.1889 => 3.2523, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 1.94% (14.5298 => 14.8117, std. dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 1.66% (1.2749 => 1.2960, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.14% (2.1007 => 2.1247, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.40% (1.8175 => 2.2792, std. dev.: 0.0454) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1917, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.24% (0.9996 => 1.0820, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.89% (1.2998 => 1.3894, std. dev.: 0.0171) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.24% (7.4271 => 7.7422, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9212, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8319, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4789, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0310 => 1.0562, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1914, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5345, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.44% (3.6469 => 3.6995, std. dev.: 0.0072) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1964, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.73% (0.4657 => 0.3971, std. dev.: 0.0184) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.85% (22.5627 => 21.0167, std. dev.: 0.0182) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.46% (0.8818 => 0.8601, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2308 => 1.1037, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.41% (20.3410 => 18.4273, std. dev.: 0.1109) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5501, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9126, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5850, std. dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5055, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: -1.78% (3.0263 => 2.9725, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7943, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: -1.50% (6.3560 => 6.2607, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8630, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.38% (2.5254 => 2.4906, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1703, std. dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2397, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2566, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2370, std. dev.: 0.0107) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 18:20:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 20:20:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120716012044.868CF2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2091?compare_to=2089&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2091, Order: 160238, Start Time: 2012-07-16 00:02:43, End Time: 2012-07-16 01:20:55 To: 2089, Order: 160236, Start Time: 2012-07-15 22:16:33, End Time: 2012-07-15 23:34:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.79% (10.3673 => 13.3519, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/trivial-interface: 11.46% (0.3473 => 0.3871, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.28% (1.1194 => 1.2457, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 11.18% (0.3497 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3543 => 0.3938, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 11.12% (0.3543 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.06% (0.3516 => 0.3905, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3561 => 0.3953, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.19% (0.3886 => 0.4282, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.16% (0.3927 => 0.4326, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.62% (1.7609 => 1.8951, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.48% (2.2022 => 2.3670, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference-object: 5.99% (0.6030 => 0.6391, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.91% (0.5925 => 0.6275, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.23% (0.2065 => 0.2173, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 5.23% (0.7326 => 0.7709, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.44% (0.3177 => 0.3318, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.43% (7.0540 => 7.3663, std. dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: 4.25% (10.4361 => 10.8795, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.24% (0.4879 => 0.5086, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 3.87% (0.3282 => 0.3409, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 3.48% (0.7433 => 0.7692, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.07% (0.8172 => 0.8423, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.82% (0.4615 => 0.4745, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.71% (0.5569 => 0.5720, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.63% (5.0018 => 5.1332, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.58% (4.9449 => 5.0724, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 2.55% (1.5603 => 1.6001, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 2.22% (0.7835 => 0.8009, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.19% (8.1363 => 8.3147, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (14.3668 => 14.6783, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.16% (0.4636 => 0.4736, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.12% (2.0665 => 2.1103, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 2.03% (9.4845 => 9.6774, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.02% (4.2646 => 4.3507, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.83% (0.5860 => 0.5967, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.61% (0.8067 => 0.8197, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.59% (1.1861 => 1.2050, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.53% (2.0273 => 2.0584, std. dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 1.44% (5.7591 => 5.8422, std. dev.: 0.0116) MultiSource/Applications/d/make_dparser: 1.44% (3.3354 => 3.3835, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.39% (1.5415 => 1.5630, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.32% (3.8723 => 3.9234, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.31% (1.3050 => 1.3221, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 1.20% (1.2842 => 1.2996, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.04% (0.9765 => 0.9867, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.04% (1.4186 => 1.4333, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.03% (17.1811 => 17.3588, std. dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7596, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.37% (1.0313 => 1.0557, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (1.5086 => 1.5389, std. dev.: 0.0094) MultiSource/Applications/lua/lua: 1.79% (26.0924 => 26.5586, std. dev.: 0.0543) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2410, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6887, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.23% (5.2763 => 3.1539, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.25% (5.3855 => 3.7023, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.95% (5.3526 => 3.6958, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.35% (2.9384 => 2.5461, std. dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: -10.62% (22.1758 => 19.8217, std. dev.: 0.0056) SingleSource/UnitTests/Vector/constpool: -4.93% (54.1659 => 51.4931, std. dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.60% (3.8922 => 3.7909, std. dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.09% (1.2373 => 1.1125, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.31% (19.9488 => 18.4908, std. dev.: 0.0786) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9130, std. dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6904, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0847, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3526, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.03% (1.4460 => 1.4311, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 19:24:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 21:24:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120716022412.A56F12A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2092?compare_to=2087&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2092, Order: 160236, Start Time: 2012-07-15 23:40:44, End Time: 2012-07-16 02:24:23 To: 2087, Order: 160233, Start Time: 2012-07-15 20:30:07, End Time: 2012-07-15 23:13:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (73 on baseline) Performance Improvements: 1 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (819 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.34% (2.4562 => 2.3987, std. dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.04% (0.3465 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.97% (0.3446 => 0.3893, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.96% (0.3496 => 0.3949, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-3: 12.89% (0.3460 => 0.3906, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 12.89% (0.3469 => 0.3916, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.87% (0.3442 => 0.3885, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.82% (0.3488 => 0.3935, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.55% (0.3650 => 0.4108, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.35% (0.3643 => 0.4093, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.98% (0.3724 => 0.4170, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.72% (0.5826 => 0.6276, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.54% (0.5889 => 0.6333, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.1620 => 0.1722, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.87% (0.7171 => 0.7592, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.58% (3.5627 => 3.7257, std. dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.51% (1.6211 => 1.6942, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2725 => 0.2841, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.16% (0.2738 => 0.2852, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.14% (0.2875 => 0.2994, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.13% (0.2714 => 0.2826, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.08% (0.4361 => 0.4539, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.03% (0.2729 => 0.2839, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.95% (0.5900 => 0.6133, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.92% (1.3152 => 1.3667, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 3.91% (0.3096 => 0.3217, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.89% (0.2803 => 0.2912, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.80% (0.4029 => 0.4182, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.79% (0.9909 => 1.0285, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.75% (0.2750 => 0.2853, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.69% (0.2792 => 0.2895, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.65% (2.0673 => 2.1427, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 3.63% (0.2780 => 0.2881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.61% (0.3267 => 0.3385, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.60% (0.3004 => 0.3112, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.59% (0.3258 => 0.3375, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.59% (0.2813 => 0.2914, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.58% (0.2823 => 0.2924, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.56% (0.5026 => 0.5205, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.54% (0.3930 => 0.4069, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.53% (2.7292 => 2.8255, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.52% (0.4994 => 0.5170, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.48% (4.2109 => 4.3574, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.44% (0.3195 => 0.3305, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.38% (0.5000 => 0.5169, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.38% (0.3317 => 0.3429, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.37% (0.9697 => 1.0024, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3362 => 0.3475, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.33% (0.3124 => 0.3228, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.26% (0.3625 => 0.3743, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (1.9694 => 2.0328, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.17% (0.3690 => 0.3807, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.13% (0.3678 => 0.3793, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.11% (0.3348 => 0.3452, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 3.09% (0.3726 => 0.3841, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.08% (0.3282 => 0.3383, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 3.05% (1.0781 => 1.1110, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.02% (1.9966 => 2.0568, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 2.85% (0.4146 => 0.4264, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.63% (0.4251 => 0.4363, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.62% (0.4658 => 0.4780, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (4.4195 => 4.5321, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.54% (0.3981 => 0.4082, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 2.52% (23.5202 => 24.1139, std. dev.: 0.0139) MultiSource/Benchmarks/MallocBench/gs/gs: 2.42% (1.8794 => 1.9249, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 2.36% (2.1653 => 2.2163, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 2.35% (4.6177 => 4.7260, std. dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: 2.32% (2.1013 => 2.1500, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.28% (5.5417 => 5.6683, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.10% (1.4269 => 1.4569, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.05% (0.6435 => 0.6567, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 2.02% (1.5932 => 1.6254, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.92% (0.7875 => 0.8026, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.88% (0.6634 => 0.6759, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.14% (2.4764 => 2.3987, std. dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: -1.71% (11.9555 => 11.7512, std. dev.: 0.0107) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 19:57:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 21:57:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120716025700.A1EAE2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2093?compare_to=2090&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2093, Order: 160245, Start Time: 2012-07-16 01:43:22, End Time: 2012-07-16 02:57:10 To: 2090, Order: 160238, Start Time: 2012-07-16 00:01:55, End Time: 2012-07-16 01:15:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (132 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (721 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.66% (77.9353 => 80.7905, std. dev.: 0.2240) SingleSource/Benchmarks/Misc/mandel-2: 1.40% (1.3894 => 1.4089, std. dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.71% (2.0176 => 2.2942, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.92% (0.5818 => 0.6395, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.86% (0.5748 => 0.6315, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.08% (0.3578 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.08% (0.7061 => 0.7702, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.96% (0.3650 => 0.3977, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 8.75% (0.3601 => 0.3916, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.67% (0.3646 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.62% (0.4003 => 0.4348, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 8.60% (0.3663 => 0.3978, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.56% (0.3914 => 0.4249, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.56% (0.3623 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.50% (0.3789 => 0.4111, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.25% (0.3940 => 0.4265, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.53% (1.3693 => 1.4724, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.25% (0.1986 => 0.2130, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (0.4328 => 0.4633, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.94% (0.2781 => 0.2974, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.77% (0.2628 => 0.2806, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.76% (0.2782 => 0.2970, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.75% (0.2607 => 0.2783, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.75% (0.3022 => 0.3226, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.75% (0.7038 => 0.7513, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 6.73% (0.2690 => 0.2871, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.69% (0.2765 => 0.2950, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2937 => 0.3133, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.67% (0.2655 => 0.2832, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 6.62% (0.4062 => 0.4331, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.60% (0.2726 => 0.2906, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.56% (0.2760 => 0.2941, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.45% (1.9828 => 2.1106, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.42% (0.2696 => 0.2869, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.2966 => 0.3156, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.37% (0.3107 => 0.3305, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.28% (0.3899 => 0.4144, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.19% (0.3149 => 0.3344, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.12% (0.3580 => 0.3799, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.11% (0.7710 => 0.8181, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.10% (0.3489 => 0.3702, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2596 => 0.2754, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.03% (0.3485 => 0.3695, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3453 => 0.3661, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.93% (0.5265 => 0.5577, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3192 => 0.3380, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.64% (3.9660 => 4.1895, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 5.60% (0.3534 => 0.3732, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.60% (0.4016 => 0.4241, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.59% (0.2988 => 0.3155, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.51% (0.2721 => 0.2871, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (0.3756 => 0.3962, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 5.47% (0.3293 => 0.3473, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (0.2945 => 0.3099, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/moments: 5.14% (0.3868 => 0.4067, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.13% (0.6959 => 0.7316, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.08% (0.4390 => 0.4613, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.82% (16.6129 => 17.4131, std. dev.: 0.0063) MultiSource/Benchmarks/McCat/09-vor/vor: 4.58% (0.2925 => 0.3059, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.58% (0.9199 => 0.9620, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.57% (13.8202 => 14.4514, std. dev.: 0.0121) MultiSource/Applications/hexxagon/hexxagon: 4.40% (1.2292 => 1.2833, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.25% (1.2193 => 1.2711, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.21% (0.5577 => 0.5812, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.21% (0.7506 => 0.7822, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.17% (13.2842 => 13.8380, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.07% (0.3755 => 0.3908, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.07% (1.1061 => 1.1511, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.96% (1.4563 => 1.5139, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.94% (0.3246 => 0.3374, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.90% (0.5637 => 0.5857, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.88% (1.3245 => 1.3759, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.86% (3.8646 => 4.0139, std. dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.86% (0.4379 => 0.4548, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.81% (0.2914 => 0.3025, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.71% (7.2180 => 7.4856, std. dev.: 0.0079) MultiSource/Applications/treecc/treecc: 3.71% (1.9270 => 1.9984, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.62% (1.1364 => 1.1775, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.60% (1.3819 => 1.4316, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.48% (1.3813 => 1.4294, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.38% (0.7460 => 0.7712, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.0594 => 1.0951, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (4.9865 => 5.1507, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 3.02% (2.1791 => 2.2449, std. dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.01% (0.8698 => 0.8960, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (3.6692 => 3.7740, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 2.83% (0.8310 => 0.8545, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.80% (4.3801 => 4.5027, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 2.68% (6.5754 => 6.7519, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.64% (0.6135 => 0.6297, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.57% (14.8535 => 15.2347, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.53% (4.4433 => 4.5559, std. dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.44% (1.1333 => 1.1610, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 2.43% (0.4113 => 0.4213, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.31% (3.1889 => 3.2625, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 2.27% (16.2614 => 16.6300, std. dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (0.4791 => 0.4898, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.18% (14.5298 => 14.8461, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.88% (0.6283 => 0.6401, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.75% (1.2749 => 1.2972, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.33% (2.1007 => 2.1286, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2690, std. dev.: 0.0456) SingleSource/Benchmarks/Misc/mandel-2: 8.39% (1.2998 => 1.4089, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.28% (2.0200 => 2.1873, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7324, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9214, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6789, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4804, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1890, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (1.5089 => 1.5353, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.42% (3.6469 => 3.6987, std. dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.78% (0.4657 => 0.4155, std. dev.: 0.0184) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.53% (22.5627 => 21.0901, std. dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.40% (0.8818 => 0.8606, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.44% (0.0997 => 0.0853, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -9.83% (1.2308 => 1.1098, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.86% (20.3410 => 18.5379, std. dev.: 0.0516) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3126, std. dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9830, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9128, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5889, std. dev.: 0.0136) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5051, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3305 => 7.2005, std. dev.: 0.0180) MultiSource/Applications/spiff/spiff: -1.77% (3.0263 => 2.9728, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2539, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9980, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7939, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.47% (0.9692 => 0.9550, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1499, std. dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2296, std. dev.: 0.0250) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2577, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 20:06:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 22:06:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120716030654.C811D2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2094?compare_to=2091&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2094, Order: 160245, Start Time: 2012-07-16 01:48:54, End Time: 2012-07-16 03:07:05 To: 2091, Order: 160238, Start Time: 2012-07-16 00:02:43, End Time: 2012-07-16 01:20:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (60 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (794 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.06% (13.3519 => 13.6263, std. dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.44% (10.3673 => 13.6263, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/trivial-interface: 12.01% (0.3473 => 0.3890, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.70% (0.3497 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.69% (0.3516 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.63% (0.3543 => 0.3955, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.63% (0.3543 => 0.3955, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.63% (0.3561 => 0.3975, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.41% (1.1194 => 1.2471, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3694 => 0.4107, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.79% (0.3828 => 0.4241, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.70% (0.3927 => 0.4347, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.54% (2.2022 => 2.3902, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.98% (1.7609 => 1.9014, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.50% (0.6030 => 0.6422, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.46% (0.5925 => 0.6308, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.64% (0.7326 => 0.7739, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.18% (0.2065 => 0.2172, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.60% (0.3177 => 0.3323, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.59% (7.0540 => 7.3778, std. dev.: 0.0220) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.47% (0.4879 => 0.5097, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 4.42% (0.3282 => 0.3427, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.42% (10.4361 => 10.8971, std. dev.: 0.0101) MultiSource/Applications/lambda-0_1_3/lambda: 3.51% (0.7433 => 0.7694, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.89% (0.5569 => 0.5730, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.80% (0.4615 => 0.4744, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.79% (0.8172 => 0.8400, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.68% (5.0018 => 5.1357, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.66% (4.9449 => 5.0765, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 2.62% (9.4845 => 9.7328, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 2.53% (1.5603 => 1.5998, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.33% (8.1363 => 8.3260, std. dev.: 0.0053) MultiSource/Applications/spiff/spiff: 2.31% (0.7835 => 0.8016, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.30% (0.5860 => 0.5995, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (14.3668 => 14.6955, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.22% (4.2646 => 4.3591, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.95% (2.0665 => 2.1068, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.78% (1.1861 => 1.2072, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.77% (1.1642 => 1.1848, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.68% (2.0273 => 2.0614, std. dev.: 0.0064) MultiSource/Applications/d/make_dparser: 1.68% (3.3354 => 3.3914, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.61% (0.8067 => 0.8197, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.58% (1.3050 => 1.3256, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.49% (3.8723 => 3.9301, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.48% (1.5415 => 1.5643, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 1.37% (5.7591 => 5.8378, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.27% (0.9765 => 0.9889, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.21% (17.1811 => 17.3896, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.18% (1.4186 => 1.4354, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.18% (1.2842 => 1.2994, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.32% (3.6395 => 3.7604, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.34% (1.0313 => 1.0554, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.20% (26.0924 => 26.6657, std. dev.: 0.0159) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5086 => 1.5354, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4472, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2416, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.13% (2.6546 => 2.6847, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.23% (5.2763 => 3.1535, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.04% (5.3855 => 3.7139, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.73% (5.3526 => 3.7077, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.45% (2.9384 => 2.5431, std. dev.: 0.0215) MultiSource/Applications/ClamAV/clamscan: -10.54% (22.1758 => 19.8393, std. dev.: 0.0128) SingleSource/UnitTests/Vector/constpool: -4.99% (54.1659 => 51.4637, std. dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.33% (3.8922 => 3.8016, std. dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.56% (1.2373 => 1.1066, std. dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.81% (19.9488 => 18.5901, std. dev.: 0.0247) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.91% (8.1563 => 7.9187, std. dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6910, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -1.98% (10.2830 => 10.0791, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: -1.07% (1.4460 => 1.4305, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 21:38:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 23:38:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120716043816.186152A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2095?compare_to=2093&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2095, Order: 160246, Start Time: 2012-07-16 03:24:44, End Time: 2012-07-16 04:38:25 To: 2093, Order: 160245, Start Time: 2012-07-16 01:43:22, End Time: 2012-07-16 02:57:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (127 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.29% (2.0176 => 2.2858, std. dev.: 0.0149) SingleSource/UnitTests/ObjC++/property-reference-object: 9.75% (0.5818 => 0.6385, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 9.62% (0.5748 => 0.6301, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 9.06% (0.7061 => 0.7701, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.94% (0.3578 => 0.3898, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.66% (0.3601 => 0.3913, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.61% (0.3646 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.58% (0.3650 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.54% (0.3663 => 0.3976, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.50% (0.3623 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.45% (0.3789 => 0.4109, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.35% (0.3914 => 0.4241, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.24% (0.4003 => 0.4333, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.15% (0.3940 => 0.4261, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.69% (1.3693 => 1.4746, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.90% (0.1986 => 0.2123, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (0.4328 => 0.4616, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.54% (0.2781 => 0.2963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.25% (0.2782 => 0.2956, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.21% (0.2607 => 0.2769, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2690 => 0.2857, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.20% (0.4062 => 0.4314, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.18% (0.2655 => 0.2819, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.07% (0.7038 => 0.7465, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.2937 => 0.3115, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2761 => 0.2928, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.02% (0.3022 => 0.3204, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.01% (0.2760 => 0.2926, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.01% (0.2628 => 0.2786, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.98% (0.2726 => 0.2889, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.97% (0.2966 => 0.3143, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.94% (1.9828 => 2.1006, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.93% (0.2765 => 0.2929, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.86% (0.2696 => 0.2854, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.81% (0.5265 => 0.5571, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.79% (0.3489 => 0.3691, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.78% (0.2596 => 0.2746, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.76% (0.7710 => 0.8154, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.3107 => 0.3284, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.67% (0.3899 => 0.4120, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.65% (0.3149 => 0.3327, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.39% (0.3192 => 0.3364, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.31% (0.3485 => 0.3670, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.24% (0.3453 => 0.3634, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.23% (3.9660 => 4.1736, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.18% (0.2721 => 0.2862, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.09% (0.2988 => 0.3140, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.08% (0.4016 => 0.4220, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 5.04% (0.3293 => 0.3459, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.95% (0.3534 => 0.3709, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.90% (0.3756 => 0.3940, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.78% (0.3868 => 0.4053, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.76% (0.4390 => 0.4599, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.56% (0.6959 => 0.7276, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 4.55% (0.2945 => 0.3079, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.30% (16.6129 => 17.3275, std. dev.: 0.0239) MultiSource/Applications/SPASS/SPASS: 4.23% (13.8202 => 14.4049, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 4.17% (0.2925 => 0.3047, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.13% (0.9199 => 0.9579, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.06% (13.2842 => 13.8236, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.06% (1.2193 => 1.2688, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.97% (0.7506 => 0.7804, std. dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 3.96% (1.2292 => 1.2779, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.89% (0.5577 => 0.5794, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.62% (0.5637 => 0.5841, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3755 => 0.3890, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.57% (1.3245 => 1.3718, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.54% (0.3246 => 0.3361, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.54% (0.4379 => 0.4534, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.53% (1.3819 => 1.4307, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.48% (1.1364 => 1.1759, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.47% (1.3813 => 1.4292, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.47% (1.4563 => 1.5068, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.46% (3.8646 => 3.9984, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.46% (7.2180 => 7.4677, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 3.34% (1.9270 => 1.9914, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 3.29% (1.1061 => 1.1425, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.12% (0.7460 => 0.7693, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.0594 => 1.0915, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.86% (4.9865 => 5.1290, std. dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.58% (3.6692 => 3.7639, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/football/football: 2.52% (0.8310 => 0.8519, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.51% (0.8698 => 0.8916, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.47% (2.1791 => 2.2330, std. dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 2.46% (6.5754 => 6.7371, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.42% (4.3801 => 4.4863, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.37% (14.8535 => 15.2055, std. dev.: 0.0111) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.31% (4.4433 => 4.5458, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6135 => 0.6272, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.10% (16.2614 => 16.6029, std. dev.: 0.0317) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.07% (1.1333 => 1.1568, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.98% (14.5298 => 14.8175, std. dev.: 0.0149) MultiSource/Applications/d/make_dparser: 1.93% (3.1889 => 3.2503, std. dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 1.55% (1.2749 => 1.2946, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.02% (2.1007 => 2.1221, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.77% (0.4846 => 0.6967, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2609, std. dev.: 0.0415) SingleSource/Benchmarks/Misc/mandel-2: 8.50% (1.2998 => 1.4103, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1902, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.99% (0.9996 => 1.0795, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.13% (7.4271 => 7.7341, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.37% (1.7688 => 1.8284, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4805, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6469 => 3.7090, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5336, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0040) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1963, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.81% (0.4657 => 0.4014, std. dev.: 0.0121) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.84% (22.5627 => 21.0193, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.44% (0.8818 => 0.8603, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.57% (1.2308 => 1.1130, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.64% (20.3410 => 18.5827, std. dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3079, std. dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.18% (1.9762 => 1.9133, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6046, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.47% (0.4867 => 0.4747, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5025, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -1.71% (3.0263 => 2.9744, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7943, std. dev.: 0.0023) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1206, std. dev.: 0.0130) SingleSource/Benchmarks/Shootout/lists: -1.49% (6.3560 => 6.2613, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4889, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2395, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2544, std. dev.: 0.0039) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2306, std. dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 21:53:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 15 Jul 2012 23:53:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120716045302.76B812A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2096?compare_to=2094&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2096, Order: 160246, Start Time: 2012-07-16 03:34:54, End Time: 2012-07-16 04:53:12 To: 2094, Order: 160245, Start Time: 2012-07-16 01:48:54, End Time: 2012-07-16 03:07:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (795 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.47% (10.3673 => 13.6298, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/trivial-interface: 11.98% (0.3473 => 0.3889, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 11.70% (0.3497 => 0.3906, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.69% (0.3516 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.69% (0.3543 => 0.3957, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.57% (0.3561 => 0.3973, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.35% (1.1194 => 1.2465, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.21% (0.3694 => 0.4108, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.73% (0.3886 => 0.4303, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.60% (2.2022 => 2.3915, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.10% (1.7609 => 1.9036, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.07% (0.2065 => 0.2211, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 6.45% (0.6030 => 0.6419, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 6.45% (0.5925 => 0.6307, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 5.81% (0.7326 => 0.7752, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.3177 => 0.3327, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.68% (7.0540 => 7.3840, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/oourafft: 4.54% (0.3282 => 0.3431, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.45% (10.4361 => 10.9007, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.4879 => 0.5096, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 3.58% (0.7433 => 0.7699, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.54% (0.8172 => 0.8461, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.93% (0.4615 => 0.4750, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.86% (0.5569 => 0.5728, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (4.9449 => 5.0837, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.78% (5.0018 => 5.1409, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 2.43% (9.4845 => 9.7150, std. dev.: 0.0095) MultiSource/Applications/hbd/hbd: 2.40% (1.5603 => 1.5977, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.39% (8.1363 => 8.3305, std. dev.: 0.0055) MultiSource/Applications/spiff/spiff: 2.37% (0.7835 => 0.8021, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (14.3668 => 14.6951, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.25% (4.2646 => 4.3605, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.95% (2.0665 => 2.1069, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.87% (0.8067 => 0.8218, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.85% (1.1861 => 1.2081, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 1.77% (2.0273 => 2.0632, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 1.76% (1.1642 => 1.1847, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 1.74% (3.3354 => 3.3935, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.69% (1.5415 => 1.5676, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.62% (1.3050 => 1.3262, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.58% (3.8723 => 3.9334, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.42% (1.4186 => 1.4387, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 1.37% (5.7591 => 5.8379, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.30% (17.1811 => 17.4047, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 1.24% (1.2842 => 1.3001, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.21% (0.9765 => 0.9883, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7472, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.08% (26.0924 => 26.6357, std. dev.: 0.0363) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.08% (1.5086 => 1.5400, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4462, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2381, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6899, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1277, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.16% (5.2763 => 3.1574, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.06% (5.3855 => 3.7127, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.80% (5.3526 => 3.7039, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.38% (2.9384 => 2.5452, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.53% (22.1758 => 19.8403, std. dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: -5.04% (54.1659 => 51.4375, std. dev.: 0.0372) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.29% (3.8922 => 3.8032, std. dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.81% (1.2373 => 1.1035, std. dev.: 0.0216) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.10% (19.9488 => 18.5324, std. dev.: 0.0754) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (8.1563 => 7.9197, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6921, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3526, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: -1.05% (1.4460 => 1.4308, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 22:34:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 00:34:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120716053455.6E2942A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2097?compare_to=2092&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2097, Order: 160246, Start Time: 2012-07-16 02:51:58, End Time: 2012-07-16 05:35:06 To: 2092, Order: 160236, Start Time: 2012-07-15 23:40:44, End Time: 2012-07-16 02:24:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (79 on baseline) Performance Improvements: 1 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (813 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 7.15% (0.2239 => 0.2399, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.08% (2.2989 => 2.2740, std. dev.: 0.0093) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.46% (0.3446 => 0.3910, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.39% (0.3465 => 0.3929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.31% (0.3442 => 0.3900, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.21% (0.3460 => 0.3917, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.13% (0.3488 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.10% (0.3496 => 0.3954, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3469 => 0.3923, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.77% (0.3650 => 0.4116, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.71% (0.3643 => 0.4106, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.33% (0.3724 => 0.4183, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.60% (0.3792 => 0.4118, std. dev.: 0.0080) SingleSource/UnitTests/ObjC++/Hello: 7.47% (0.5826 => 0.6261, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.13% (0.5889 => 0.6309, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.1620 => 0.1722, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.79% (0.7171 => 0.7586, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.05% (3.5627 => 3.7425, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.98% (1.6211 => 1.7018, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.59% (0.4361 => 0.4561, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (2.7292 => 2.8458, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.21% (0.2875 => 0.2996, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.16% (0.2738 => 0.2852, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.13% (1.3152 => 1.3695, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 4.13% (0.2714 => 0.2826, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.05% (0.5900 => 0.6139, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.05% (0.4029 => 0.4192, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.97% (0.3930 => 0.4086, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.93% (0.2823 => 0.2934, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.92% (0.5026 => 0.5223, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.89% (0.2803 => 0.2912, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.81% (0.3096 => 0.3214, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 3.77% (0.2813 => 0.2919, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.76% (4.2109 => 4.3693, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.76% (0.2792 => 0.2897, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.75% (0.3124 => 0.3241, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.74% (0.2780 => 0.2884, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.74% (2.0673 => 2.1446, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 3.73% (0.3004 => 0.3116, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.71% (0.2911 => 0.3019, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.70% (0.4994 => 0.5179, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 3.64% (0.3267 => 0.3386, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.63% (0.3195 => 0.3311, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.62% (0.3258 => 0.3376, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.61% (0.9909 => 1.0267, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.51% (0.3362 => 0.3480, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.47% (0.3282 => 0.3396, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.46% (0.3060 => 0.3166, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.46% (0.5000 => 0.5173, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 3.43% (1.0781 => 1.1151, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary2: 3.38% (0.3317 => 0.3429, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.34% (1.9966 => 2.0633, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.31% (1.9694 => 2.0346, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (0.3348 => 0.3456, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.22% (0.3690 => 0.3809, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.22% (0.3726 => 0.3846, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.21% (0.3678 => 0.3796, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.16% (0.3477 => 0.3587, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.06% (0.3890 => 0.4009, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 3.02% (0.9697 => 0.9990, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 3.01% (0.4146 => 0.4271, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 3.01% (2.1013 => 2.1646, std. dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: 3.00% (23.5202 => 24.2259, std. dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: 2.98% (5.5417 => 5.7070, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.92% (0.4658 => 0.4794, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.92% (0.4251 => 0.4375, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.91% (2.1653 => 2.2283, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 2.89% (4.6177 => 4.7512, std. dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.83% (0.3845 => 0.3954, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.83% (4.4195 => 4.5444, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.79% (0.3981 => 0.4092, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.59% (0.3903 => 0.4004, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.43% (1.8794 => 1.9251, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 2.34% (1.4269 => 1.4603, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.31% (0.5012 => 0.5128, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.30% (0.7875 => 0.8056, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.24% (0.6435 => 0.6579, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.10% (0.6634 => 0.6773, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 1.97% (0.5546 => 0.5655, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 1.59% (1.5932 => 1.6186, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.48% (2.4764 => 2.3901, std. dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: -1.36% (11.9555 => 11.7930, std. dev.: 0.0129) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 23:19:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 01:19:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120716061948.D47402A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2098?compare_to=2095&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2098, Order: 160247, Start Time: 2012-07-16 05:06:09, End Time: 2012-07-16 06:19:58 To: 2095, Order: 160246, Start Time: 2012-07-16 03:24:44, End Time: 2012-07-16 04:38:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (127 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (726 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.27% (2.0176 => 2.2853, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.56% (0.5818 => 0.6374, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.46% (0.5748 => 0.6292, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.94% (0.3578 => 0.3898, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference: 8.92% (0.7061 => 0.7691, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.66% (0.3601 => 0.3913, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.63% (0.3650 => 0.3965, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 8.58% (0.3646 => 0.3959, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: 8.49% (0.3663 => 0.3974, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.47% (0.3623 => 0.3930, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.45% (0.3789 => 0.4109, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.35% (0.3914 => 0.4241, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.27% (0.4003 => 0.4334, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.17% (0.3940 => 0.4262, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.77% (1.3693 => 1.4757, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1986 => 0.2127, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.74% (0.3130 => 0.3341, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (0.4328 => 0.4613, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2781 => 0.2962, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.25% (0.2607 => 0.2770, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.22% (0.7038 => 0.7476, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.22% (0.2782 => 0.2955, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.21% (0.2655 => 0.2820, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.11% (0.4062 => 0.4310, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2690 => 0.2854, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.09% (0.3022 => 0.3206, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.02% (0.2726 => 0.2890, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.01% (0.2628 => 0.2786, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.00% (0.2765 => 0.2931, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2761 => 0.2926, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.94% (0.2760 => 0.2924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.86% (0.2696 => 0.2854, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.83% (0.2966 => 0.3139, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.83% (1.9828 => 2.0984, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.82% (0.7710 => 0.8159, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary: 5.79% (0.3107 => 0.3287, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.79% (0.3489 => 0.3691, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.74% (0.5265 => 0.5567, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.70% (0.2596 => 0.2744, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.70% (0.3580 => 0.3784, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.69% (0.3899 => 0.4121, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.65% (0.3149 => 0.3327, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.49% (0.4390 => 0.4631, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3192 => 0.3362, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.31% (3.9660 => 4.1765, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 5.30% (0.3453 => 0.3636, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.2721 => 0.2865, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.28% (0.3485 => 0.3669, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.05% (0.2988 => 0.3139, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.98% (0.3293 => 0.3457, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.93% (0.4016 => 0.4214, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.90% (0.3534 => 0.3707, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (0.3756 => 0.3939, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/moments: 4.68% (0.3868 => 0.4049, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.61% (0.6959 => 0.7280, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 4.53% (16.6129 => 17.3658, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.24% (0.9199 => 0.9589, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 4.22% (13.8202 => 14.4031, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.15% (1.2193 => 1.2699, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.14% (0.2925 => 0.3046, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.04% (13.2842 => 13.8212, std. dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 3.94% (1.2292 => 1.2776, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.86% (0.5577 => 0.5792, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.76% (0.5637 => 0.5849, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 3.65% (0.7506 => 0.7780, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.65% (0.3755 => 0.3892, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.64% (0.3246 => 0.3364, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.62% (1.3245 => 1.3724, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 3.62% (1.1061 => 1.1461, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.61% (0.4379 => 0.4537, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (3.8646 => 4.0031, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.55% (1.3819 => 1.4310, std. dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.47% (0.2914 => 0.3015, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.46% (1.1364 => 1.1757, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.44% (7.2180 => 7.4665, std. dev.: 0.0130) MultiSource/Applications/treecc/treecc: 3.44% (1.9270 => 1.9932, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.40% (1.4563 => 1.5058, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.37% (1.3813 => 1.4278, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.12% (1.0594 => 1.0925, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.10% (0.7460 => 0.7691, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.93% (4.9865 => 5.1328, std. dev.: 0.0300) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (3.6692 => 3.7650, std. dev.: 0.0061) MultiSource/Applications/siod/siod: 2.59% (2.1791 => 2.2356, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 2.54% (0.8310 => 0.8521, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.52% (4.3801 => 4.4904, std. dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: 2.50% (14.8535 => 15.2248, std. dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.49% (0.8698 => 0.8915, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (6.5754 => 6.7358, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.30% (4.4433 => 4.5456, std. dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.25% (0.6135 => 0.6273, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.17% (16.2614 => 16.6137, std. dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.10% (1.1333 => 1.1571, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.09% (3.1889 => 3.2557, std. dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 2.02% (14.5298 => 14.8238, std. dev.: 0.0097) MultiSource/Applications/SIBsim4/SIBsim4: 1.61% (1.2749 => 1.2954, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.11% (2.1007 => 2.1241, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 27.21% (1.8175 => 2.3121, std. dev.: 0.0290) SingleSource/Benchmarks/Misc/mandel-2: 8.92% (1.2998 => 1.4157, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.41% (2.0200 => 2.1898, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.55% (1.0895 => 1.1718, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.05% (7.4271 => 7.7276, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6798, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4803, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9773, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1909, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5340, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.53% (3.6469 => 3.7027, std. dev.: 0.0054) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.79% (22.5627 => 21.0301, std. dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.44% (0.8818 => 0.8603, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.23% (1.2308 => 1.1049, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.53% (20.3410 => 18.6064, std. dev.: 0.0162) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.33% (1.3780 => 1.3045, std. dev.: 0.0137) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9123, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5961, std. dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5055, std. dev.: 0.0062) MultiSource/Applications/spiff/spiff: -1.82% (3.0263 => 2.9713, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2505, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7957, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1165, std. dev.: 0.0487) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.48% (2.5254 => 2.4879, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.39% (0.8342 => 0.8226, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2142, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2425, std. dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2579, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0150) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 15 23:39:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 01:39:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120716063902.BB2572A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2099?compare_to=2096&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2099, Order: 160247, Start Time: 2012-07-16 05:20:59, End Time: 2012-07-16 06:39:11 To: 2096, Order: 160246, Start Time: 2012-07-16 03:34:54, End Time: 2012-07-16 04:53:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (794 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.51% (10.3673 => 13.6341, std. dev.: 0.0133) SingleSource/UnitTests/ObjC/trivial-interface: 11.98% (0.3473 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.88% (0.3543 => 0.3964, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.75% (0.3516 => 0.3929, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 11.72% (0.3497 => 0.3907, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3543 => 0.3956, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.54% (0.3561 => 0.3972, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.42% (1.1194 => 1.2472, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3694 => 0.4107, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: 10.97% (0.3828 => 0.4248, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.75% (0.3927 => 0.4349, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.57% (2.2022 => 2.3910, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.02% (1.7609 => 1.9021, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.50% (0.5925 => 0.6310, std. dev.: 0.0085) SingleSource/UnitTests/ObjC++/property-reference-object: 6.45% (0.6030 => 0.6419, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.79% (0.7326 => 0.7750, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.2065 => 0.2169, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.69% (0.3177 => 0.3326, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.65% (7.0540 => 7.3822, std. dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.51% (0.4879 => 0.5099, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.3282 => 0.3429, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.47% (10.4361 => 10.9031, std. dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 3.59% (0.7433 => 0.7700, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.12% (0.8172 => 0.8427, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.80% (0.4615 => 0.4744, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.78% (0.5569 => 0.5724, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.69% (4.9449 => 5.0780, std. dev.: 0.0085) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (5.0018 => 5.1363, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 2.49% (9.4845 => 9.7209, std. dev.: 0.0076) MultiSource/Applications/hbd/hbd: 2.44% (1.5603 => 1.5984, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.41% (8.1363 => 8.3327, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: 2.40% (0.7835 => 0.8023, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.32% (0.5860 => 0.5996, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.29% (0.4636 => 0.4742, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.23% (4.2646 => 4.3597, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (14.3668 => 14.6868, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.87% (2.0665 => 2.1052, std. dev.: 0.0038) MultiSource/Applications/Burg/burg: 1.86% (1.1642 => 1.1859, std. dev.: 0.0061) MultiSource/Applications/treecc/treecc: 1.84% (2.0273 => 2.0647, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.80% (1.1861 => 1.2074, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.77% (0.8067 => 0.8210, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.69% (3.3354 => 3.3918, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.58% (1.3050 => 1.3256, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.46% (3.8723 => 3.9290, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.46% (1.5415 => 1.5640, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 1.29% (5.7591 => 5.8335, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.29% (1.4186 => 1.4369, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.23% (17.1811 => 17.3922, std. dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: 1.19% (1.2842 => 1.2995, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9742, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7554, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.07% (26.0924 => 26.6332, std. dev.: 0.0390) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5086 => 1.5360, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4473, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6885, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2305, std. dev.: 0.0140) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1257, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.21% (5.2763 => 3.1546, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.04% (5.3855 => 3.7141, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.76% (5.3526 => 3.7062, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.49% (2.9384 => 2.5420, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -10.55% (22.1758 => 19.8368, std. dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -5.05% (54.1659 => 51.4326, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.30% (3.8922 => 3.8026, std. dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.71% (1.2373 => 1.1171, std. dev.: 0.0185) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.44% (19.9488 => 18.4655, std. dev.: 0.0944) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9207, std. dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6928, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0842, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: -1.08% (1.4460 => 1.4304, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 01:46:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 03:46:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120716084625.5FFB82A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2100?compare_to=2098&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2100, Order: 160248, Start Time: 2012-07-16 07:32:39, End Time: 2012-07-16 08:46:34 To: 2098, Order: 160247, Start Time: 2012-07-16 05:06:09, End Time: 2012-07-16 06:19:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (131 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (723 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.30% (1.3045 => 1.3215, std. dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.09% (2.0176 => 2.3019, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.40% (0.5818 => 0.6365, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.31% (0.5748 => 0.6283, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.28% (0.7061 => 0.7646, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: 8.19% (0.3578 => 0.3871, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.94% (0.3601 => 0.3887, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.91% (1.3693 => 1.4776, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: 7.84% (0.3646 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.84% (0.3650 => 0.3936, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 7.78% (0.3663 => 0.3948, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3623 => 0.3904, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.68% (0.3789 => 0.4080, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.4003 => 0.4309, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.61% (0.3914 => 0.4212, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.46% (0.3940 => 0.4234, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.70% (0.1986 => 0.2119, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.68% (0.7038 => 0.7508, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4328 => 0.4610, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.35% (0.3022 => 0.3214, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2781 => 0.2957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.29% (0.2655 => 0.2822, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.25% (0.4062 => 0.4316, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.02% (0.2690 => 0.2852, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.02% (0.2607 => 0.2764, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.00% (0.2765 => 0.2931, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.98% (0.2726 => 0.2889, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.2937 => 0.3112, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.90% (0.2966 => 0.3141, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.89% (0.2596 => 0.2749, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.86% (0.7710 => 0.8162, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.85% (0.5265 => 0.5573, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.85% (0.3899 => 0.4127, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.83% (0.2761 => 0.2922, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.76% (0.2760 => 0.2919, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.74% (1.9828 => 2.0967, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.73% (0.3489 => 0.3689, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.73% (0.3107 => 0.3285, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.64% (0.2696 => 0.2848, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.59% (0.3580 => 0.3780, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.53% (0.3149 => 0.3323, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.47% (3.9660 => 4.1830, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 5.36% (0.3453 => 0.3638, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.33% (0.2721 => 0.2866, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3192 => 0.3362, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.25% (0.3485 => 0.3668, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.08% (0.4016 => 0.4220, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.02% (0.2988 => 0.3138, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 5.01% (0.3293 => 0.3458, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.93% (0.6959 => 0.7302, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.93% (0.3756 => 0.3941, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.90% (0.3534 => 0.3707, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.75% (16.6129 => 17.4018, std. dev.: 0.0148) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.69% (0.4390 => 0.4596, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 4.60% (0.3868 => 0.4046, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.51% (0.9199 => 0.9614, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 4.51% (13.8202 => 14.4429, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/objinst: 4.45% (0.2945 => 0.3076, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.23% (1.2193 => 1.2709, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 4.17% (0.2925 => 0.3047, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.02% (0.5577 => 0.5801, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.98% (13.2842 => 13.8132, std. dev.: 0.0178) MultiSource/Applications/spiff/spiff: 3.89% (0.7506 => 0.7798, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.88% (1.2292 => 1.2769, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.85% (0.3246 => 0.3371, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.78% (1.3245 => 1.3745, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 3.76% (3.8646 => 4.0100, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.76% (0.5637 => 0.5849, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.71% (0.2914 => 0.3022, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.68% (0.4379 => 0.4540, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (1.4563 => 1.5091, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 3.63% (1.1061 => 1.1462, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 3.60% (1.9270 => 1.9963, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3755 => 0.3890, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.59% (1.1364 => 1.1772, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.44% (1.3819 => 1.4295, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.42% (7.2180 => 7.4646, std. dev.: 0.0088) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.34% (0.7460 => 0.7709, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 3.31% (1.0594 => 1.0945, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.27% (1.3813 => 1.4264, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.26% (4.9865 => 5.1492, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 3.09% (2.1791 => 2.2464, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.84% (3.6692 => 3.7734, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.61% (0.8698 => 0.8925, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.59% (6.5754 => 6.7454, std. dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 2.53% (14.8535 => 15.2300, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (4.3801 => 4.4907, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.46% (0.6135 => 0.6286, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.39% (4.4433 => 4.5493, std. dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 2.23% (16.2614 => 16.6235, std. dev.: 0.0252) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.22% (1.1333 => 1.1585, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.13% (0.4791 => 0.4893, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.04% (3.1889 => 3.2541, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 2.01% (14.5298 => 14.8221, std. dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.97% (0.6283 => 0.6407, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.2749 => 1.2969, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.42% (2.1007 => 2.1305, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2633, std. dev.: 0.0498) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1916, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: 7.35% (1.2998 => 1.3954, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.14% (7.4271 => 7.7348, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6789, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8303, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.96% (4.1080 => 4.1887, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.51% (3.6469 => 3.7018, std. dev.: 0.0073) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.42% (22.5627 => 21.1139, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.85% (0.3511 => 0.3411, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1127, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (20.3410 => 18.6508, std. dev.: 0.0595) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4002, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.10% (1.3780 => 1.3215, std. dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9127, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5910, std. dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/dry: -2.43% (2.5089 => 2.4479, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.32% (0.4867 => 0.4754, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.84% (3.0263 => 2.9707, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5108, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2527, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9980, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7946, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0008) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1397, std. dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2222, std. dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2425, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2591, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 01:48:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 03:48:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120716084826.9BD2B2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2101?compare_to=2097&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2101, Order: 160247, Start Time: 2012-07-16 06:02:56, End Time: 2012-07-16 08:48:35 To: 2097, Order: 160246, Start Time: 2012-07-16 02:51:58, End Time: 2012-07-16 05:35:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (57 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (835 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.16% (2.8204 => 2.8530, std. dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.29% (0.3446 => 0.3904, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.28% (0.3465 => 0.3925, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 13.22% (0.3442 => 0.3897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.22% (0.3488 => 0.3949, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 13.22% (0.3496 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.17% (0.3469 => 0.3926, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/property: 12.85% (0.3650 => 0.4119, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.82% (0.3643 => 0.4110, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3724 => 0.4184, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.52% (0.5826 => 0.6264, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 7.25% (0.5889 => 0.6316, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.42% (0.1620 => 0.1724, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.80% (0.7171 => 0.7587, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.22% (1.6211 => 1.7058, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.00% (3.5627 => 3.7410, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.61% (0.4361 => 0.4562, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.25% (2.7292 => 2.8451, std. dev.: 0.0045) MultiSource/Applications/spiff/spiff: 4.22% (0.4029 => 0.4199, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.19% (0.5900 => 0.6147, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2725 => 0.2838, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (1.3152 => 1.3684, std. dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 3.98% (4.2109 => 4.3784, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.94% (0.5026 => 0.5224, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.89% (0.3930 => 0.4083, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.79% (2.0673 => 2.1456, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.75% (0.3124 => 0.3241, std. dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 3.70% (0.3004 => 0.3115, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.2911 => 0.3017, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.62% (0.4994 => 0.5175, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 3.62% (1.0781 => 1.1171, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.57% (0.3195 => 0.3309, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.56% (0.2866 => 0.2968, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.54% (0.3362 => 0.3481, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.50% (1.9694 => 2.0383, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.44% (0.5000 => 0.5172, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.37% (0.9697 => 1.0024, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.33% (0.3060 => 0.3162, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.29% (0.3282 => 0.3390, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.27% (1.9966 => 2.0618, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.05% (0.4658 => 0.4800, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 3.03% (2.1013 => 2.1649, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 3.00% (5.5417 => 5.7082, std. dev.: 0.0080) MultiSource/Benchmarks/Bullet/bullet: 2.98% (23.5202 => 24.2210, std. dev.: 0.0173) MultiSource/Applications/JM/ldecod/ldecod: 2.97% (2.1653 => 2.2297, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.93% (0.3890 => 0.4004, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 2.89% (4.6177 => 4.7510, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.85% (4.4195 => 4.5454, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.81% (0.3845 => 0.3953, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.70% (1.8794 => 1.9302, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.64% (0.3903 => 0.4006, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.49% (0.7875 => 0.8071, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.47% (0.6435 => 0.6594, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 2.40% (1.4269 => 1.4611, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.13% (0.5546 => 0.5664, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 1.68% (1.5932 => 1.6199, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.76% (2.8036 => 2.8530, std. dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.26% (2.4764 => 2.3956, std. dev.: 0.0190) MultiSource/Applications/kimwitu++/kc: -1.26% (11.9555 => 11.8052, std. dev.: 0.0121) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 01:50:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 03:50:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120716085042.5EAA02A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2102?compare_to=2099&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2102, Order: 160248, Start Time: 2012-07-16 07:32:18, End Time: 2012-07-16 08:50:51 To: 2099, Order: 160247, Start Time: 2012-07-16 05:20:59, End Time: 2012-07-16 06:39:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (52 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (801 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.46% (41.9236 => 42.5341, std. dev.: 0.0189) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.07% (18.4655 => 18.6636, std. dev.: 0.0504) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.56% (13.6341 => 13.1491, std. dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.83% (10.3673 => 13.1491, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3473 => 0.3869, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.34% (1.1194 => 1.2463, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 11.10% (0.3497 => 0.3885, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.06% (0.3543 => 0.3935, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 11.06% (0.3516 => 0.3905, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.98% (0.3543 => 0.3932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3561 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3828 => 0.4221, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.16% (0.3886 => 0.4281, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.11% (0.3927 => 0.4324, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.20% (2.2022 => 2.3827, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.51% (1.7609 => 1.8931, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: 7.26% (0.1432 => 0.1536, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.07% (0.6030 => 0.6396, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.06% (0.5925 => 0.6284, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.28% (0.2065 => 0.2174, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 4.82% (0.7326 => 0.7679, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.34% (7.0540 => 7.3599, std. dev.: 0.0189) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.28% (0.3177 => 0.3313, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.4879 => 0.5080, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 4.11% (0.3282 => 0.3417, std. dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 4.11% (10.4361 => 10.8652, std. dev.: 0.0079) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.89% (0.8172 => 0.8490, std. dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 3.44% (0.7433 => 0.7689, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.66% (0.5569 => 0.5717, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.60% (0.4615 => 0.4735, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.56% (5.0018 => 5.1299, std. dev.: 0.0064) MultiSource/Applications/spiff/spiff: 2.55% (0.7835 => 0.8035, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.45% (4.9449 => 5.0661, std. dev.: 0.0092) MultiSource/Applications/hbd/hbd: 2.24% (1.5603 => 1.5953, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.19% (8.1363 => 8.3145, std. dev.: 0.0167) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.12% (4.2646 => 4.3548, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.03% (14.3668 => 14.6579, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.97% (2.0665 => 2.1072, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.87% (9.4845 => 9.6622, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.51% (1.1861 => 1.2040, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 1.46% (2.0273 => 2.0568, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 1.35% (3.3354 => 3.3803, std. dev.: 0.0154) MultiSource/Applications/hexxagon/hexxagon: 1.28% (1.2842 => 1.3007, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.27% (1.5415 => 1.5611, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.26% (1.3050 => 1.3214, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 1.03% (5.7591 => 5.8187, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.80% (1.1145 => 1.1903, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7461, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0313 => 1.0566, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.14% (26.0924 => 26.6504, std. dev.: 0.0112) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6896, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2277, std. dev.: 0.0134) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.23% (5.2763 => 3.1538, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.25% (5.3855 => 3.7027, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.00% (5.3526 => 3.6935, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.43% (2.9384 => 2.5439, std. dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: -10.65% (22.1758 => 19.8142, std. dev.: 0.0352) SingleSource/UnitTests/Vector/constpool: -5.03% (54.1659 => 51.4401, std. dev.: 0.0455) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.79% (3.8922 => 3.7835, std. dev.: 0.0154) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.26% (0.8101 => 0.7999, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.30% (1.2373 => 1.1098, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.44% (19.9488 => 18.6636, std. dev.: 0.0504) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.86% (8.1563 => 7.9230, std. dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6820, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0853, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: -1.10% (1.4460 => 1.4301, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 03:27:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 05:27:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120716102758.020362A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2103?compare_to=2100&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2103, Order: 160252, Start Time: 2012-07-16 09:14:22, End Time: 2012-07-16 10:28:06 To: 2100, Order: 160248, Start Time: 2012-07-16 07:32:39, End Time: 2012-07-16 08:46:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (131 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (725 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.18% (54.6566 => 56.3939, std. dev.: 0.0816) SingleSource/Benchmarks/Misc/mandel-2: 1.01% (1.3954 => 1.4095, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (18.6508 => 18.3954, std. dev.: 0.0968) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.10% (2.0176 => 2.3020, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.11% (0.5818 => 0.6348, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5748 => 0.6270, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.23% (0.7061 => 0.7642, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 7.71% (0.3578 => 0.3854, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.67% (1.3693 => 1.4743, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.42% (0.3650 => 0.3921, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.38% (0.3130 => 0.3361, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.33% (0.3601 => 0.3865, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 7.32% (0.3646 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.31% (0.3914 => 0.4200, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.26% (0.3663 => 0.3929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.24% (0.4003 => 0.4293, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.23% (0.3789 => 0.4063, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.20% (0.3623 => 0.3884, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.08% (0.3940 => 0.4219, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.61% (0.7038 => 0.7503, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.1986 => 0.2113, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash: 6.13% (0.4062 => 0.4311, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.04% (0.2781 => 0.2949, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.96% (0.3022 => 0.3202, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.93% (0.2596 => 0.2750, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.90% (0.2782 => 0.2946, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.80% (0.2655 => 0.2809, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.77% (0.5265 => 0.5569, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.73% (0.7710 => 0.8152, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.72% (0.2761 => 0.2919, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.71% (0.2628 => 0.2778, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.62% (0.2721 => 0.2874, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.58% (1.9828 => 2.0935, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 5.58% (0.2760 => 0.2914, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.54% (3.9660 => 4.1859, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.51% (0.3899 => 0.4114, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.47% (0.3580 => 0.3776, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.47% (0.3489 => 0.3680, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.32% (0.6959 => 0.7329, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 5.30% (0.3149 => 0.3316, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.24% (0.3453 => 0.3634, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.14% (0.3192 => 0.3356, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.08% (0.3485 => 0.3662, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.98% (0.3293 => 0.3457, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.91% (0.4016 => 0.4213, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2988 => 0.3130, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.75% (16.6129 => 17.4021, std. dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/lists1: 4.73% (0.3534 => 0.3701, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3756 => 0.3932, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.62% (0.4390 => 0.4593, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 4.52% (13.8202 => 14.4445, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.2945 => 0.3075, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.38% (0.2925 => 0.3053, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.36% (0.9199 => 0.9600, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.23% (1.2193 => 1.2709, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.12% (13.2842 => 13.8320, std. dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.94% (0.5577 => 0.5797, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.86% (0.7506 => 0.7796, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.86% (0.4379 => 0.4548, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 3.86% (3.8646 => 4.0136, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (1.3245 => 1.3753, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3246 => 0.3369, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.77% (0.2914 => 0.3024, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.74% (0.5637 => 0.5848, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.72% (1.2292 => 1.2749, std. dev.: 0.0103) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.71% (1.1364 => 1.1786, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.71% (1.4563 => 1.5103, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.64% (1.1061 => 1.1464, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.60% (1.3819 => 1.4317, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.59% (1.9270 => 1.9961, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.54% (7.2180 => 7.4738, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.51% (1.3813 => 1.4298, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.48% (1.0594 => 1.0963, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.23% (0.7460 => 0.7701, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.22% (4.9865 => 5.1471, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.98% (3.6692 => 3.7785, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 2.92% (2.1791 => 2.2427, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 2.88% (0.8310 => 0.8549, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (4.3801 => 4.4969, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (6.5754 => 6.7486, std. dev.: 0.0186) MultiSource/Applications/JM/lencod/lencod: 2.58% (14.8535 => 15.2360, std. dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.53% (0.8698 => 0.8918, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.46% (4.4433 => 4.5528, std. dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.43% (0.6135 => 0.6284, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.31% (16.2614 => 16.6378, std. dev.: 0.0159) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.22% (1.1333 => 1.1585, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.19% (14.5298 => 14.8486, std. dev.: 0.0104) MultiSource/Applications/d/make_dparser: 2.18% (3.1889 => 3.2583, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.88% (1.2749 => 1.2989, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6283 => 0.6400, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (2.1007 => 2.1324, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.07% (1.5188 => 1.5350, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (3.2742 => 3.3088, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.38% (1.8175 => 2.2787, std. dev.: 0.0360) SingleSource/Benchmarks/Misc/mandel-2: 8.44% (1.2998 => 1.4095, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.31% (2.0200 => 2.1879, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.06% (7.4271 => 7.7290, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6787, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.51% (2.8606 => 2.9611, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (1.5089 => 1.5365, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.79% (3.6469 => 3.7122, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1940, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.53% (22.5627 => 21.0901, std. dev.: 0.0204) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.21% (0.8818 => 0.8623, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.79% (1.2308 => 1.1103, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.56% (20.3410 => 18.3954, std. dev.: 0.0968) SingleSource/Benchmarks/Misc/flops-3: -6.28% (2.4152 => 2.2636, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.18% (0.3139 => 0.2945, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.38% (1.3780 => 1.3038, std. dev.: 0.0121) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9126, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5966, std. dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5088, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -1.81% (3.0263 => 2.9715, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2528, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7954, std. dev.: 0.0018) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1246, std. dev.: 0.0188) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8623, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2409, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2606, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 03:37:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 05:37:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120716103711.324412A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2104?compare_to=2102&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2104, Order: 160252, Start Time: 2012-07-16 09:18:58, End Time: 2012-07-16 10:37:20 To: 2102, Order: 160248, Start Time: 2012-07-16 07:32:18, End Time: 2012-07-16 08:50:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (799 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.46% (10.3673 => 13.2140, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.37% (1.1194 => 1.2467, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 10.74% (0.3473 => 0.3846, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.47% (0.3497 => 0.3863, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.42% (0.3561 => 0.3932, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-4: 10.41% (0.3543 => 0.3912, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: 9.69% (0.3828 => 0.4199, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: 9.50% (0.3927 => 0.4300, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.50% (0.3886 => 0.4255, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.43% (2.2022 => 2.3879, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.59% (1.7609 => 1.8945, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 5.60% (0.5925 => 0.6257, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 5.57% (0.6030 => 0.6366, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.89% (0.2065 => 0.2166, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 4.46% (0.7326 => 0.7653, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.38% (7.0540 => 7.3630, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 4.36% (0.3282 => 0.3425, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.34% (0.3177 => 0.3315, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.4879 => 0.5087, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 4.08% (10.4361 => 10.8623, std. dev.: 0.0132) MultiSource/Applications/lambda-0_1_3/lambda: 3.27% (0.7433 => 0.7676, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.21% (0.8172 => 0.8434, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (0.4615 => 0.4734, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.53% (0.5569 => 0.5710, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.44% (5.0018 => 5.1238, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.39% (4.9449 => 5.0629, std. dev.: 0.0078) MultiSource/Applications/hbd/hbd: 2.11% (1.5603 => 1.5932, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.07% (8.1363 => 8.3049, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 2.07% (0.7835 => 0.7997, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.00% (0.5860 => 0.5977, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (14.3668 => 14.6507, std. dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 1.93% (9.4845 => 9.6675, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.88% (4.2646 => 4.3448, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.61% (2.0665 => 2.0997, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.49% (0.8067 => 0.8187, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 1.47% (2.0273 => 2.0572, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 1.43% (1.1642 => 1.1808, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.42% (1.1861 => 1.2029, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 1.32% (3.3354 => 3.3794, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.29% (1.3050 => 1.3218, std. dev.: 0.0033) MultiSource/Applications/lua/lua: 1.20% (3.8723 => 3.9187, std. dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7591 => 5.8223, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7515, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.23% (1.0313 => 1.0543, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.18% (26.0924 => 26.6614, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.97% (1.5086 => 1.5383, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4474, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2423, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.22% (2.6546 => 2.6870, std. dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.37% (5.2763 => 3.1460, std. dev.: 0.0123) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.24% (5.3855 => 3.7033, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.94% (5.3526 => 3.6967, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.43% (2.9384 => 2.5439, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -10.78% (22.1758 => 19.7857, std. dev.: 0.0239) SingleSource/UnitTests/Vector/constpool: -5.09% (54.1659 => 51.4083, std. dev.: 0.0436) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.72% (3.8922 => 3.7862, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.35% (0.8101 => 0.7992, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.53% (0.0998 => 0.0843, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2373 => 1.1108, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.78% (19.9488 => 18.5953, std. dev.: 0.0804) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9149, std. dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6863, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: -1.98% (10.2830 => 10.0792, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 04:59:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 06:59:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120716115945.291842A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2105?compare_to=2101&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2105, Order: 160252, Start Time: 2012-07-16 09:16:32, End Time: 2012-07-16 11:59:57 To: 2101, Order: 160247, Start Time: 2012-07-16 06:02:56, End Time: 2012-07-16 08:48:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (46 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (846 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3488 => 0.3919, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: 12.32% (0.3442 => 0.3866, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.25% (0.3446 => 0.3868, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3460 => 0.3883, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.16% (0.3496 => 0.3921, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 12.15% (0.3465 => 0.3886, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.05% (0.3469 => 0.3887, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.81% (0.3650 => 0.4081, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.72% (0.3643 => 0.4070, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3724 => 0.4145, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.04% (0.5826 => 0.6236, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.64% (0.5889 => 0.6280, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.22% (0.7171 => 0.7545, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.00% (1.6211 => 1.7021, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.74% (3.5627 => 3.7315, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (0.5026 => 0.5241, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.24% (0.4361 => 0.4546, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.04% (1.3152 => 1.3683, std. dev.: 0.0047) MultiSource/Applications/spiff/spiff: 4.00% (0.4029 => 0.4190, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.78% (0.4994 => 0.5183, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.69% (0.3930 => 0.4075, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.68% (2.7292 => 2.8297, std. dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: 3.64% (4.2109 => 4.3643, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.42% (0.5000 => 0.5171, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.28% (1.9694 => 2.0339, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.13% (0.9909 => 1.0219, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.12% (1.9966 => 2.0588, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 3.07% (1.0781 => 1.1112, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.02% (2.0673 => 2.1297, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (0.3890 => 0.4003, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 2.82% (2.1013 => 2.1606, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.81% (0.4658 => 0.4789, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (4.4195 => 4.5387, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 2.64% (4.6177 => 4.7394, std. dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (2.1653 => 2.2222, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 2.62% (0.9697 => 0.9951, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4146 => 0.4252, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.54% (5.5417 => 5.6824, std. dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 2.52% (23.5202 => 24.1139, std. dev.: 0.0115) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (1.8794 => 1.9255, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 2.08% (1.4269 => 1.4566, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.02% (0.7875 => 0.8034, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.6435 => 0.6553, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 1.81% (1.5932 => 1.6221, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 1.80% (0.5546 => 0.5646, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.10% (2.4764 => 2.4243, std. dev.: 0.0157) MultiSource/Applications/kimwitu++/kc: -1.63% (11.9555 => 11.7606, std. dev.: 0.0090) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 05:09:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 07:09:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120716120928.1BE3F2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2106?compare_to=2103&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2106, Order: 160256, Start Time: 2012-07-16 10:55:56, End Time: 2012-07-16 12:09:37 To: 2103, Order: 160252, Start Time: 2012-07-16 09:14:22, End Time: 2012-07-16 10:28:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (132 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (722 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: 1.01% (18.3954 => 18.5818, std. dev.: 0.0386) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.09% (2.0176 => 2.3018, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.18% (0.5818 => 0.6352, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.01% (0.5748 => 0.6266, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.20% (0.7061 => 0.7640, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 7.84% (1.3693 => 1.4766, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 7.63% (0.3578 => 0.3851, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 7.39% (0.3601 => 0.3867, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.32% (0.3650 => 0.3917, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.27% (0.3646 => 0.3911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.23% (0.3663 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.23% (0.3789 => 0.4063, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.20% (0.3623 => 0.3884, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.19% (0.4003 => 0.4291, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.13% (0.3914 => 0.4193, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.03% (0.3940 => 0.4217, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1986 => 0.2122, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.56% (0.7038 => 0.7500, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 6.31% (0.4328 => 0.4601, std. dev.: 0.0080) SingleSource/Regression/C++/ofstream_ctor: 6.04% (0.2781 => 0.2949, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4062 => 0.4307, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.99% (0.3022 => 0.3203, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.93% (0.2782 => 0.2947, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.89% (0.2596 => 0.2749, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.87% (0.5265 => 0.5574, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.82% (0.2628 => 0.2781, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.79% (0.2607 => 0.2758, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.78% (0.7710 => 0.8156, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2726 => 0.2883, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.76% (0.2761 => 0.2920, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3899 => 0.4123, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.72% (0.2937 => 0.3105, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.68% (3.9660 => 4.1914, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2966 => 0.3132, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.59% (0.3580 => 0.3780, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.59% (0.2721 => 0.2873, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.54% (1.9828 => 2.0927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3489 => 0.3682, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.38% (0.2696 => 0.2841, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.3149 => 0.3318, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.20% (0.3192 => 0.3358, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.13% (0.6959 => 0.7316, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.11% (0.3485 => 0.3663, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.03% (0.4016 => 0.4218, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.98% (0.3293 => 0.3457, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.87% (0.3534 => 0.3706, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.83% (16.6129 => 17.4147, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2988 => 0.3130, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.63% (0.3756 => 0.3930, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 4.56% (13.8202 => 14.4510, std. dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.53% (0.4390 => 0.4589, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 4.45% (0.2945 => 0.3076, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.45% (0.3868 => 0.4040, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.42% (0.9199 => 0.9606, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.34% (0.2925 => 0.3052, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.21% (1.2193 => 1.2706, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.10% (13.2842 => 13.8293, std. dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.02% (0.5577 => 0.5801, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.88% (0.4379 => 0.4549, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.88% (0.3246 => 0.3372, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.88% (3.8646 => 4.0144, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 3.87% (1.2292 => 1.2768, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (1.3245 => 1.3754, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.80% (0.7506 => 0.7791, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 3.76% (1.1061 => 1.1477, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.76% (0.5637 => 0.5849, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.72% (1.4563 => 1.5105, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.66% (1.1364 => 1.1780, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.65% (1.3819 => 1.4323, std. dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.64% (0.2914 => 0.3020, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.60% (1.9270 => 1.9963, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.57% (1.3813 => 1.4306, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.48% (7.2180 => 7.4694, std. dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 3.44% (1.0594 => 1.0958, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.38% (0.3755 => 0.3882, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.27% (4.9865 => 5.1497, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.18% (0.7460 => 0.7697, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 3.15% (2.1791 => 2.2477, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.05% (3.6692 => 3.7811, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 2.97% (0.8310 => 0.8557, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.57% (6.5754 => 6.7443, std. dev.: 0.0195) MultiSource/Applications/JM/lencod/lencod: 2.57% (14.8535 => 15.2346, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.56% (4.3801 => 4.4923, std. dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.51% (0.6135 => 0.6289, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.47% (4.4433 => 4.5529, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.29% (1.1333 => 1.1593, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.28% (16.2614 => 16.6325, std. dev.: 0.0138) MultiSource/Applications/d/make_dparser: 2.20% (3.1889 => 3.2591, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 2.16% (14.5298 => 14.8436, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.13% (0.4791 => 0.4893, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.94% (0.6283 => 0.6405, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.76% (1.2749 => 1.2974, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.54% (2.1007 => 2.1330, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.10% (1.5188 => 1.5355, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (3.2742 => 3.3090, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.01% (1.8175 => 2.2721, std. dev.: 0.0540) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.28% (2.0200 => 2.1873, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.48% (1.0895 => 1.1710, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.38% (1.5824 => 1.6992, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.30% (1.2998 => 1.3947, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.97% (7.4271 => 7.7217, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9867, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6782, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.39% (1.7688 => 1.8288, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5354, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (3.6469 => 3.7087, std. dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.26% (1.9290 => 1.9534, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.94% (0.4657 => 0.4008, std. dev.: 0.0114) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.51% (22.5627 => 21.0935, std. dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.18% (0.8818 => 0.8626, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.45% (0.0997 => 0.0843, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.96% (1.2308 => 1.0959, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.65% (20.3410 => 18.5818, std. dev.: 0.0386) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.86% (1.3780 => 1.3110, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5503, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9127, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5811, std. dev.: 0.0143) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5033, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: -1.83% (3.0263 => 2.9709, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.67% (26.5159 => 26.0727, std. dev.: 0.0557) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9982, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2575, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7951, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8613, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2167, std. dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2428, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2545, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 05:23:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 07:23:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120716122324.74E852A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2107?compare_to=2104&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2107, Order: 160257, Start Time: 2012-07-16 11:05:18, End Time: 2012-07-16 12:23:36 To: 2104, Order: 160252, Start Time: 2012-07-16 09:18:58, End Time: 2012-07-16 10:37:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (56 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (797 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.70% (77.9592 => 80.0624, std. dev.: 0.3733) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.59% (55.0729 => 56.4986, std. dev.: 0.0824) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.34% (10.3673 => 13.2022, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.29% (1.1194 => 1.2458, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.68% (0.3473 => 0.3844, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.50% (0.3561 => 0.3935, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3497 => 0.3862, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.39% (0.3543 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.39% (0.3543 => 0.3911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3516 => 0.3881, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.61% (0.3828 => 0.4196, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.57% (0.3886 => 0.4258, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.42% (0.3927 => 0.4297, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.53% (2.2022 => 2.3901, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.71% (1.7609 => 1.8967, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 5.57% (0.6030 => 0.6366, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.49% (0.5925 => 0.6250, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.42% (0.7326 => 0.7650, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.39% (7.0540 => 7.3639, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/oourafft: 4.39% (0.3282 => 0.3426, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.28% (0.3177 => 0.3313, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.22% (0.4879 => 0.5085, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 4.10% (10.4361 => 10.8645, std. dev.: 0.0125) MultiSource/Applications/lambda-0_1_3/lambda: 3.30% (0.7433 => 0.7678, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.16% (0.8172 => 0.8430, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.95% (0.4615 => 0.4751, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.80% (0.5569 => 0.5725, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.63% (5.0018 => 5.1332, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.55% (4.9449 => 5.0712, std. dev.: 0.0056) MultiSource/Applications/spiff/spiff: 2.36% (0.7835 => 0.8020, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.32% (8.1363 => 8.3254, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.16% (1.5603 => 1.5940, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.11% (14.3668 => 14.6697, std. dev.: 0.0106) MultiSource/Benchmarks/mafft/pairlocalalign: 1.91% (9.4845 => 9.6656, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.90% (4.2646 => 4.3457, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.79% (0.5860 => 0.5965, std. dev.: 0.0040) MultiSource/Applications/Burg/burg: 1.72% (1.1642 => 1.1842, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.65% (2.0665 => 2.1007, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.62% (0.8067 => 0.8198, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.59% (2.0273 => 2.0595, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.54% (1.1861 => 1.2044, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 1.47% (3.3354 => 3.3845, std. dev.: 0.0133) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.47% (1.5415 => 1.5641, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 1.46% (3.8723 => 3.9289, std. dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7591 => 5.8307, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.18% (17.1811 => 17.3841, std. dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.16% (1.3050 => 1.3201, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.10% (2.6778 => 2.9750, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.80% (1.1145 => 1.1903, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7594, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0561, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.24% (26.0924 => 26.6767, std. dev.: 0.0161) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4474, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2380, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6898, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.34% (5.2763 => 3.1477, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.21% (5.3855 => 3.7049, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.87% (5.3526 => 3.7001, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.55% (2.9384 => 2.5402, std. dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: -10.79% (22.1758 => 19.7828, std. dev.: 0.0397) SingleSource/UnitTests/Vector/constpool: -4.90% (54.1659 => 51.5110, std. dev.: 0.0419) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.67% (3.8922 => 3.7884, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.32% (0.8101 => 0.7994, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.63% (0.0998 => 0.0842, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.25% (1.2373 => 1.0981, std. dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.82% (19.9488 => 18.5874, std. dev.: 0.0578) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.81% (8.1563 => 7.9269, std. dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.51% (32.5116 => 31.6948, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0864, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: -1.08% (1.4460 => 1.4304, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 06:50:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 08:50:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120716135054.7E4D22A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2108?compare_to=2106&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2108, Order: 160263, Start Time: 2012-07-16 12:37:24, End Time: 2012-07-16 13:51:06 To: 2106, Order: 160256, Start Time: 2012-07-16 10:55:56, End Time: 2012-07-16 12:09:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (129 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.03% (1.0959 => 1.1072, std. dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.66% (2.0176 => 2.2932, std. dev.: 0.0016) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.42% (0.1072 => 0.1173, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.20% (0.5818 => 0.6353, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.19% (0.5748 => 0.6276, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.19% (0.7061 => 0.7639, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.65% (1.3693 => 1.4740, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.63% (0.3578 => 0.3851, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.44% (0.3601 => 0.3869, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.42% (0.3650 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.38% (0.3646 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.32% (0.4003 => 0.4296, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.32% (0.3663 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.31% (0.3623 => 0.3888, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3789 => 0.4065, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.28% (0.3914 => 0.4199, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.13% (0.3940 => 0.4221, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.70% (0.1986 => 0.2119, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 6.46% (0.7038 => 0.7493, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.24% (0.4328 => 0.4598, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.99% (0.7710 => 0.8172, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 5.97% (0.2781 => 0.2947, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.93% (0.2596 => 0.2750, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.88% (0.4062 => 0.4301, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.82% (0.3022 => 0.3198, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.77% (0.5265 => 0.5569, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.72% (0.2782 => 0.2941, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2607 => 0.2754, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2760 => 0.2913, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.54% (0.2761 => 0.2914, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3489 => 0.3682, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.48% (0.2721 => 0.2870, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.46% (0.3899 => 0.4112, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.46% (1.9828 => 2.0910, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.45% (3.9660 => 4.1822, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.39% (0.3580 => 0.3773, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.3107 => 0.3274, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2696 => 0.2839, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3149 => 0.3314, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.18% (0.3453 => 0.3632, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.13% (0.6959 => 0.7316, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (0.3485 => 0.3655, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.86% (0.4016 => 0.4211, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.83% (0.3293 => 0.3452, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 4.69% (0.2988 => 0.3128, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.68% (16.6129 => 17.3899, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 4.64% (0.3534 => 0.3698, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3756 => 0.3929, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.47% (0.9199 => 0.9610, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.44% (0.4390 => 0.4585, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 4.41% (13.8202 => 14.4294, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/09-vor/vor: 4.27% (0.2925 => 0.3050, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 4.27% (0.3868 => 0.4033, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.08% (1.2193 => 1.2691, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.96% (13.2842 => 13.8107, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.5577 => 0.5793, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.86% (0.7506 => 0.7796, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 3.76% (3.8646 => 4.0101, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.75% (1.4563 => 1.5109, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (1.3245 => 1.3737, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.71% (0.5637 => 0.5846, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.70% (0.3246 => 0.3366, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.67% (1.2292 => 1.2743, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.65% (0.4379 => 0.4539, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.61% (1.3819 => 1.4318, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.53% (0.2914 => 0.3017, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.53% (1.9270 => 1.9950, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.51% (1.3813 => 1.4298, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.51% (1.1364 => 1.1763, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.50% (7.2180 => 7.4707, std. dev.: 0.0067) MultiSource/Applications/Burg/burg: 3.50% (1.1061 => 1.1448, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.30% (0.3755 => 0.3879, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.25% (1.0594 => 1.0938, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.22% (0.7460 => 0.7700, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.98% (4.9865 => 5.1350, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 2.80% (2.1791 => 2.2401, std. dev.: 0.0188) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.80% (3.6692 => 3.7719, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 2.74% (0.8310 => 0.8538, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.48% (6.5754 => 6.7384, std. dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.46% (4.3801 => 4.4879, std. dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 2.44% (14.8535 => 15.2152, std. dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.40% (0.6135 => 0.6282, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.39% (0.8698 => 0.8906, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.37% (4.4433 => 4.5486, std. dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 2.19% (16.2614 => 16.6179, std. dev.: 0.0237) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.18% (1.1333 => 1.1580, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 2.09% (3.1889 => 3.2555, std. dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 2.06% (14.5298 => 14.8295, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6283 => 0.6393, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.2749 => 1.2969, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.87% (1.8175 => 2.2696, std. dev.: 0.0401) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.44% (2.0200 => 2.1904, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: 7.92% (1.2998 => 1.4027, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9996 => 1.0781, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6988, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.20% (7.4271 => 7.7394, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6791, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8306, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4785, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9771, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1919, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.80% (3.6469 => 3.7127, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.46% (1.5089 => 1.5310, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.45% (0.4657 => 0.3984, std. dev.: 0.0106) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.74% (22.5627 => 21.0409, std. dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.52% (0.8818 => 0.8596, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.05% (0.0997 => 0.0847, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.04% (1.2308 => 1.1072, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.69% (20.3410 => 18.5736, std. dev.: 0.0726) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3082, std. dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.18% (1.9762 => 1.9134, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5947, std. dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5031, std. dev.: 0.0048) MultiSource/Applications/spiff/spiff: -1.76% (3.0263 => 2.9729, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9982, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2564, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7942, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1463, std. dev.: 0.0283) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2363, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2173, std. dev.: 0.0377) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8686, std. dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2525, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8494, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 07:09:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 09:09:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120716140937.57C072A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2109?compare_to=2107&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2109, Order: 160264, Start Time: 2012-07-16 12:51:30, End Time: 2012-07-16 14:09:48 To: 2107, Order: 160257, Start Time: 2012-07-16 11:05:18, End Time: 2012-07-16 12:23:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (60 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (794 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.93% (13.2022 => 13.4572, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.01% (3.7712 => 3.8471, std. dev.: 0.0264) SingleSource/Benchmarks/McGill/chomp: 1.68% (1.0981 => 1.1165, std. dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.80% (10.3673 => 13.4572, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.31% (1.1194 => 1.2460, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.94% (0.3473 => 0.3853, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.55% (0.3497 => 0.3866, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.50% (0.3543 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.50% (0.3543 => 0.3915, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 10.44% (0.3516 => 0.3883, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.67% (0.3828 => 0.4198, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.57% (0.3886 => 0.4258, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.55% (0.3927 => 0.4302, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.53% (2.2022 => 2.3900, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.62% (1.7609 => 1.8951, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.59% (0.5925 => 0.6256, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.54% (0.6030 => 0.6364, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.99% (0.2065 => 0.2168, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.57% (7.0540 => 7.3766, std. dev.: 0.0212) SingleSource/UnitTests/ObjC++/property-reference: 4.53% (0.7326 => 0.7658, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.49% (0.4879 => 0.5098, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.46% (10.4361 => 10.9012, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.44% (0.3177 => 0.3318, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 4.39% (0.3282 => 0.3426, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.55% (0.7433 => 0.7697, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.08% (0.8172 => 0.8424, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.66% (0.5569 => 0.5717, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.64% (0.4615 => 0.4737, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (4.9449 => 5.0735, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.53% (5.0018 => 5.1284, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 2.31% (1.5603 => 1.5963, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (14.3668 => 14.6787, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.17% (8.1363 => 8.3126, std. dev.: 0.0041) MultiSource/Applications/spiff/spiff: 2.13% (0.7835 => 0.8002, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.07% (4.2646 => 4.3530, std. dev.: 0.0176) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (9.4845 => 9.6810, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.88% (0.5860 => 0.5970, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (2.0665 => 2.1031, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.70% (0.8067 => 0.8204, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.64% (1.1861 => 1.2056, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.64% (2.0273 => 2.0605, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.54% (1.5415 => 1.5653, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.45% (3.3354 => 3.3838, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 1.36% (3.8723 => 3.9250, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.36% (1.3050 => 1.3227, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.22% (5.7591 => 5.8291, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.21% (17.1811 => 17.3897, std. dev.: 0.0100) MultiSource/Applications/hexxagon/hexxagon: 1.11% (1.2842 => 1.2984, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.07% (0.9765 => 0.9869, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.04% (1.4186 => 1.4334, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7499, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.29% (26.0924 => 26.6905, std. dev.: 0.0111) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (1.5086 => 1.5373, std. dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 1.83% (3.7781 => 3.8471, std. dev.: 0.0264) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2435, std. dev.: 0.0366) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6894, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.14% (5.2763 => 3.1586, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.10% (5.3855 => 3.7107, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.76% (5.3526 => 3.7061, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.46% (2.9384 => 2.5430, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -10.58% (22.1758 => 19.8303, std. dev.: 0.0271) SingleSource/UnitTests/Vector/constpool: -4.95% (54.1659 => 51.4835, std. dev.: 0.0399) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.52% (3.8922 => 3.7942, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1165, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.98% (19.9488 => 18.5554, std. dev.: 0.0228) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.97% (8.1563 => 7.9137, std. dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6859, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0844, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.06% (1.4460 => 1.4307, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 08:11:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 10:11:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120716151114.0577D2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2110?compare_to=2105&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2110, Order: 160263, Start Time: 2012-07-16 12:27:53, End Time: 2012-07-16 15:11:25 To: 2105, Order: 160252, Start Time: 2012-07-16 09:16:32, End Time: 2012-07-16 11:59:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (81 on baseline) Performance Improvements: 1 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (811 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.24% (2.4243 => 2.3943, std. dev.: 0.0068) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 15.08% (0.3792 => 0.4364, std. dev.: 0.0197) SingleSource/UnitTests/ObjC/for-in: 12.90% (0.3496 => 0.3947, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.81% (0.3465 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.77% (0.3446 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.73% (0.3442 => 0.3880, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.72% (0.3460 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.64% (0.3488 => 0.3929, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 12.63% (0.3469 => 0.3907, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.38% (0.3650 => 0.4102, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.19% (0.3643 => 0.4087, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3724 => 0.4164, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.35% (0.5826 => 0.6254, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.11% (0.5889 => 0.6308, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.1620 => 0.1726, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 5.65% (0.7171 => 0.7576, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.28% (1.6211 => 1.7067, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.06% (3.5627 => 3.7428, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.84% (0.4361 => 0.4572, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.68% (1.3152 => 1.3768, std. dev.: 0.0076) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.49% (0.5900 => 0.6165, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (0.5026 => 0.5251, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.36% (2.7292 => 2.8482, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.34% (0.3362 => 0.3508, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 4.32% (0.4029 => 0.4203, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.97% (0.3930 => 0.4086, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 3.96% (4.2109 => 4.3775, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.94% (0.2738 => 0.2846, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 3.93% (0.2725 => 0.2832, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.90% (0.4994 => 0.5189, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.90% (0.2875 => 0.2987, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.85% (0.2803 => 0.2911, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.81% (0.2729 => 0.2833, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.71% (0.3096 => 0.3211, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2750 => 0.2851, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.66% (0.9909 => 1.0272, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.2866 => 0.2970, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.62% (0.2792 => 0.2893, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 3.61% (0.2823 => 0.2925, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.58% (2.0673 => 2.1413, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (1.9694 => 2.0396, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.56% (0.5000 => 0.5178, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 3.55% (0.2813 => 0.2913, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.50% (0.2911 => 0.3013, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.47% (1.9966 => 2.0659, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 3.46% (0.3267 => 0.3380, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3195 => 0.3304, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 3.40% (0.3004 => 0.3106, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.38% (0.3258 => 0.3368, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.36% (0.3124 => 0.3229, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.30% (0.3060 => 0.3161, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.29% (0.3317 => 0.3426, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.26% (0.3890 => 0.4017, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 3.25% (0.3726 => 0.3847, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 3.22% (1.0781 => 1.1128, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (2.1013 => 2.1674, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.13% (0.4658 => 0.4804, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.11% (0.3348 => 0.3452, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 3.10% (0.3678 => 0.3792, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (0.3625 => 0.3737, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.07% (0.9697 => 0.9995, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3690 => 0.3803, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 3.05% (0.3477 => 0.3583, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.03% (4.6177 => 4.7578, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 2.97% (0.4146 => 0.4269, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.96% (4.4195 => 4.5503, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 2.88% (5.5417 => 5.7014, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 2.86% (23.5202 => 24.1918, std. dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (2.1653 => 2.2266, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 2.82% (0.4251 => 0.4371, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.3903 => 0.4013, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (1.8794 => 1.9297, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.61% (0.3981 => 0.4085, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.51% (0.4139 => 0.4243, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.49% (0.5012 => 0.5137, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.45% (1.4269 => 1.4618, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.30% (0.7875 => 0.8056, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.24% (0.6435 => 0.6579, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.15% (0.5546 => 0.5665, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.02% (0.6634 => 0.6768, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.32% (2.4764 => 2.3943, std. dev.: 0.0068) MultiSource/Applications/kimwitu++/kc: -1.41% (11.9555 => 11.7867, std. dev.: 0.0104) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 08:32:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 10:32:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120716153235.E310F2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2111?compare_to=2108&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2111, Order: 160268, Start Time: 2012-07-16 14:19:04, End Time: 2012-07-16 15:32:46 To: 2108, Order: 160263, Start Time: 2012-07-16 12:37:24, End Time: 2012-07-16 13:51:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (130 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (724 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.34% (54.6454 => 56.4699, std. dev.: 0.0500) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.70% (2.0176 => 2.2940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.26% (0.5818 => 0.6357, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.10% (0.5748 => 0.6271, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.20% (0.7061 => 0.7640, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.88% (0.3578 => 0.3860, std. dev.: 0.0052) MultiSource/Applications/hbd/hbd: 7.62% (1.3693 => 1.4737, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 7.53% (0.3601 => 0.3872, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.52% (0.4003 => 0.4304, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.45% (0.3650 => 0.3922, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 7.43% (0.3646 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.40% (0.3663 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.37% (0.3623 => 0.3890, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: 7.33% (0.3914 => 0.4201, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3789 => 0.4065, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.11% (0.3940 => 0.4220, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.75% (0.1986 => 0.2120, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.46% (0.5265 => 0.5605, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.45% (0.7038 => 0.7492, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4328 => 0.4596, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4062 => 0.4307, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.89% (0.2596 => 0.2749, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.86% (0.2781 => 0.2944, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3022 => 0.3197, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.79% (0.2782 => 0.2943, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.78% (0.7710 => 0.8156, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/random: 5.76% (0.2690 => 0.2845, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.72% (0.2607 => 0.2756, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.68% (0.2765 => 0.2922, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.65% (0.2761 => 0.2917, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.59% (0.2628 => 0.2775, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 5.54% (0.2726 => 0.2877, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.49% (0.3899 => 0.4113, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.47% (0.3489 => 0.3680, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.47% (0.2760 => 0.2911, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.45% (3.9660 => 4.1821, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.41% (1.9828 => 2.0901, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.33% (0.2721 => 0.2866, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.32% (0.6959 => 0.7329, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.21% (0.3149 => 0.3313, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.05% (0.3485 => 0.3661, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.04% (0.3192 => 0.3353, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.04% (0.3453 => 0.3627, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.75% (0.3534 => 0.3702, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.63% (16.6129 => 17.3821, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.62% (0.9199 => 0.9624, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 4.62% (0.2988 => 0.3126, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 4.47% (13.8202 => 14.4376, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.37% (0.4390 => 0.4582, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.2945 => 0.3072, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.29% (0.3868 => 0.4034, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.21% (0.2925 => 0.3048, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.17% (1.2193 => 1.2701, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.08% (1.1061 => 1.1512, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.07% (0.5577 => 0.5804, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.02% (13.2842 => 13.8184, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.93% (1.3245 => 1.3765, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.92% (0.7506 => 0.7800, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.90% (0.5637 => 0.5857, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.82% (0.3246 => 0.3370, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.78% (3.8646 => 4.0106, std. dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.71% (0.2914 => 0.3022, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.68% (0.4379 => 0.4540, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.65% (1.2292 => 1.2741, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.63% (1.3813 => 1.4315, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.61% (1.4563 => 1.5089, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.61% (1.3819 => 1.4318, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.54% (1.1364 => 1.1766, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 3.52% (1.9270 => 1.9949, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.46% (7.2180 => 7.4680, std. dev.: 0.0103) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.35% (0.7460 => 0.7710, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.33% (0.3755 => 0.3880, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.21% (1.0594 => 1.0934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.16% (4.9865 => 5.1439, std. dev.: 0.0151) MultiSource/Applications/siod/siod: 2.87% (2.1791 => 2.2417, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.77% (3.6692 => 3.7708, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 2.76% (0.8310 => 0.8539, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (4.3801 => 4.4885, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 2.46% (6.5754 => 6.7371, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.41% (0.8698 => 0.8908, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.38% (14.8535 => 15.2074, std. dev.: 0.0158) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.35% (4.4433 => 4.5475, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.30% (0.6135 => 0.6276, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.22% (1.1333 => 1.1585, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.17% (16.2614 => 16.6138, std. dev.: 0.0057) MultiSource/Applications/d/make_dparser: 2.13% (3.1889 => 3.2567, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 2.08% (14.5298 => 14.8316, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.70% (0.6283 => 0.6390, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.63% (1.2749 => 1.2957, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.33% (2.1007 => 2.1286, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.01% (1.8175 => 2.2720, std. dev.: 0.0525) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.24% (2.0200 => 2.1865, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 8.17% (1.2998 => 1.4060, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.00% (7.4271 => 7.7242, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6782, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.45% (1.7688 => 1.8298, std. dev.: 0.0188) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4787, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1907, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.76% (3.6469 => 3.7110, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5089 => 1.5325, std. dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5109, std. dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.20% (1.9290 => 1.9522, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.65% (22.5627 => 21.0615, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.46% (0.8818 => 0.8601, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.62% (1.0460 => 0.8617, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.27% (1.2308 => 1.1044, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.77% (20.3410 => 18.5579, std. dev.: 0.0839) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9127, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5873, std. dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4461, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5033, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: -1.75% (3.0263 => 2.9733, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.58% (0.6589 => 0.6485, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.52% (6.3560 => 6.2592, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7952, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1294, std. dev.: 0.0189) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8621, std. dev.: 0.0121) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.31% (9.3358 => 9.2137, std. dev.: 0.0252) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2408, std. dev.: 0.0265) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2561, std. dev.: 0.0052) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 08:55:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 10:55:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120716155554.4FC492A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2112?compare_to=2109&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2112, Order: 160268, Start Time: 2012-07-16 14:37:47, End Time: 2012-07-16 15:56:05 To: 2109, Order: 160264, Start Time: 2012-07-16 12:51:30, End Time: 2012-07-16 14:09:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (58 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (796 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.00% (54.8004 => 56.4462, std. dev.: 0.1153) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.56% (3.8471 => 3.7870, std. dev.: 0.0171) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.73% (10.3673 => 13.4491, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.48% (1.1194 => 1.2479, std. dev.: 0.0182) SingleSource/UnitTests/ObjC/trivial-interface: 10.77% (0.3473 => 0.3847, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.47% (0.3497 => 0.3863, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.41% (0.3543 => 0.3912, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3516 => 0.3882, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.99% (0.3694 => 0.4063, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.64% (0.3828 => 0.4197, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.52% (0.3886 => 0.4256, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 9.47% (0.3927 => 0.4299, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.53% (2.2022 => 2.3900, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.65% (1.7609 => 1.8956, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 5.54% (0.5925 => 0.6253, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.51% (0.6030 => 0.6362, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.94% (0.2065 => 0.2167, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.60% (7.0540 => 7.3784, std. dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference: 4.50% (0.7326 => 0.7656, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.47% (0.4879 => 0.5097, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.38% (0.3177 => 0.3316, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 4.32% (10.4361 => 10.8870, std. dev.: 0.0208) MultiSource/Applications/lambda-0_1_3/lambda: 3.51% (0.7433 => 0.7694, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.12% (0.4615 => 0.4759, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.73% (0.5569 => 0.5721, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.67% (0.8172 => 0.8390, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.55% (4.9449 => 5.0708, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.54% (5.0018 => 5.1287, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 2.29% (1.5603 => 1.5961, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (14.3668 => 14.6872, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 2.21% (9.4845 => 9.6944, std. dev.: 0.0058) MultiSource/Applications/spiff/spiff: 2.18% (0.7835 => 0.8006, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.16% (8.1363 => 8.3123, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.98% (4.2646 => 4.3491, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.95% (0.5860 => 0.5974, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (2.0665 => 2.1031, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.62% (1.5415 => 1.5665, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.58% (2.0273 => 2.0594, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 1.58% (3.3354 => 3.3881, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (1.1861 => 1.2046, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.55% (0.8067 => 0.8192, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 1.48% (1.1642 => 1.1814, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.46% (1.3050 => 1.3240, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.35% (3.8723 => 3.9246, std. dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 1.27% (5.7591 => 5.8322, std. dev.: 0.0145) MultiSource/Applications/sqlite3/sqlite3: 1.25% (17.1811 => 17.3959, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.02% (0.9765 => 0.9865, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.02% (1.4186 => 1.4330, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.81% (1.1145 => 1.1904, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7552, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.23% (26.0924 => 26.6738, std. dev.: 0.0429) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (1.5086 => 1.5388, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (2.6546 => 2.6920, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2370, std. dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.23% (5.2763 => 3.1538, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.13% (5.3855 => 3.7091, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.82% (5.3526 => 3.7028, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.36% (2.9384 => 2.5459, std. dev.: 0.0113) MultiSource/Applications/ClamAV/clamscan: -10.60% (22.1758 => 19.8246, std. dev.: 0.0293) SingleSource/UnitTests/Vector/constpool: -4.94% (54.1659 => 51.4920, std. dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.44% (3.8922 => 3.7971, std. dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.73% (0.0998 => 0.0841, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2373 => 1.1096, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.49% (19.9488 => 18.4543, std. dev.: 0.1383) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (8.1563 => 7.9168, std. dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.5116 => 31.6795, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0876, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.05% (1.4460 => 1.4308, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 10:14:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 12:14:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120716171452.31DDE2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2113?compare_to=2111&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2113, Order: 160277, Start Time: 2012-07-16 16:01:12, End Time: 2012-07-16 17:15:02 To: 2111, Order: 160268, Start Time: 2012-07-16 14:19:04, End Time: 2012-07-16 15:32:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (132 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (720 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.64% (2.0176 => 2.3129, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.70% (0.5818 => 0.6324, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.52% (0.5748 => 0.6238, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.47% (0.7061 => 0.7659, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 7.57% (0.3578 => 0.3849, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.29% (1.3693 => 1.4691, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 7.25% (0.3601 => 0.3862, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.24% (0.4003 => 0.4293, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.19% (0.3646 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.13% (0.3663 => 0.3924, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.07% (0.3789 => 0.4057, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.04% (0.3623 => 0.3878, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.00% (0.3914 => 0.4188, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 6.85% (0.3940 => 0.4210, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.45% (0.1986 => 0.2114, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 6.34% (0.7038 => 0.7484, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash: 6.11% (0.4062 => 0.4310, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.01% (0.2596 => 0.2752, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 5.94% (0.4328 => 0.4585, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.85% (0.5265 => 0.5573, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.84% (0.7710 => 0.8160, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.81% (0.2721 => 0.2879, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.73% (3.9660 => 4.1934, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2781 => 0.2933, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.32% (0.6959 => 0.7329, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.26% (0.3899 => 0.4104, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.18% (0.2607 => 0.2742, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.13% (0.2690 => 0.2828, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.11% (0.2760 => 0.2901, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.06% (0.3580 => 0.3761, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.04% (0.3489 => 0.3665, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.99% (0.2966 => 0.3114, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.99% (0.2726 => 0.2862, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.98% (1.9828 => 2.0816, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/wc: 4.94% (0.2937 => 0.3082, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.93% (0.2761 => 0.2897, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.92% (0.2765 => 0.2901, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 4.81% (13.8202 => 14.4856, std. dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.76% (0.3149 => 0.3299, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.76% (0.4390 => 0.4599, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.75% (16.6129 => 17.4020, std. dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/ary: 4.70% (0.3107 => 0.3253, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.68% (0.3485 => 0.3648, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.67% (0.9199 => 0.9629, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.61% (0.4016 => 0.4201, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.60% (0.3453 => 0.3612, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.45% (0.5577 => 0.5825, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.2193 => 1.2723, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.34% (0.3293 => 0.3436, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.32% (0.3192 => 0.3330, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.32% (0.2988 => 0.3117, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.30% (0.3534 => 0.3686, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.29% (0.3756 => 0.3917, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.27% (0.2925 => 0.3050, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.27% (13.2842 => 13.8518, std. dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/moments: 4.14% (0.3868 => 0.4028, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.5637 => 0.5863, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.00% (1.3245 => 1.3775, std. dev.: 0.0084) MultiSource/Applications/spiff/spiff: 4.00% (0.7506 => 0.7806, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.89% (1.4563 => 1.5129, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.88% (0.3246 => 0.3372, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.84% (1.3819 => 1.4349, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.83% (3.8646 => 4.0126, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.81% (0.4379 => 0.4546, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.78% (1.1061 => 1.1479, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.71% (1.1364 => 1.1786, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.2945 => 0.3054, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.69% (7.2180 => 7.4847, std. dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.67% (0.2914 => 0.3021, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.67% (1.0594 => 1.0983, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.66% (1.3813 => 1.4319, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 3.64% (1.9270 => 1.9971, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.54% (0.7460 => 0.7724, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.41% (1.2292 => 1.2711, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.33% (4.9865 => 5.1525, std. dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/football/football: 3.08% (0.8310 => 0.8566, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.03% (3.6692 => 3.7805, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 3.02% (6.5754 => 6.7741, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3755 => 0.3867, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.89% (2.1791 => 2.2421, std. dev.: 0.0097) MultiSource/Applications/JM/lencod/lencod: 2.81% (14.8535 => 15.2704, std. dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.79% (0.6135 => 0.6306, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.68% (4.4433 => 4.5622, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.66% (4.3801 => 4.4968, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 2.65% (0.4113 => 0.4222, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.59% (16.2614 => 16.6832, std. dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.58% (0.8698 => 0.8922, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.55% (0.4791 => 0.4913, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.36% (3.1889 => 3.2641, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.28% (1.1333 => 1.1591, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.16% (14.5298 => 14.8439, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.05% (0.6283 => 0.6412, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.98% (1.2749 => 1.3001, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (2.1007 => 2.1313, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.13% (3.2742 => 3.3112, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (8.4961 => 8.5824, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.66% (1.8175 => 2.2657, std. dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1930, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 7.53% (1.2998 => 1.3977, std. dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.00% (7.4271 => 7.7244, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6781, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4798, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1894, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.88% (3.6469 => 3.7156, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (1.5089 => 1.5350, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.24% (1.9290 => 1.9529, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.87% (0.4657 => 0.4011, std. dev.: 0.0114) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.36% (22.5627 => 21.1269, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.08% (0.8818 => 0.8635, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.90% (1.2308 => 1.1089, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.85% (20.3410 => 18.5401, std. dev.: 0.0797) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.25% (1.3780 => 1.3056, std. dev.: 0.0098) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9129, std. dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5899, std. dev.: 0.0232) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5060, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: -1.81% (3.0263 => 2.9715, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2581, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (28.2225 => 27.7919, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8580, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.5254 => 2.4876, std. dev.: 0.0014) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1234, std. dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2381, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.26% (0.9692 => 0.9570, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2271, std. dev.: 0.0114) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2560, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 10:42:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 12:42:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120716174251.DC66D2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2114?compare_to=2112&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2114, Order: 160281, Start Time: 2012-07-16 16:24:47, End Time: 2012-07-16 17:43:01 To: 2112, Order: 160268, Start Time: 2012-07-16 14:37:47, End Time: 2012-07-16 15:56:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (66 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 928 (788 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.49% (13.4491 => 14.0533, std. dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 1.98% (10.8870 => 11.1030, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.07% (1.8956 => 1.9159, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -5.35% (19.8246 => 18.7644, std. dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.55% (10.3673 => 14.0533, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.91% (1.1194 => 1.2527, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 11.14% (0.3473 => 0.3860, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3516 => 0.3903, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.87% (0.3543 => 0.3928, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.81% (0.3543 => 0.3926, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.76% (0.3561 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.08% (0.3828 => 0.4214, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.98% (0.3927 => 0.4319, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.06% (0.3817 => 0.4163, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.80% (1.7609 => 1.9159, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 8.52% (0.1432 => 0.1554, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.23% (2.2022 => 2.3834, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.39% (10.4361 => 11.1030, std. dev.: 0.0110) SingleSource/UnitTests/ObjC++/Hello: 6.04% (0.5925 => 0.6283, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.6030 => 0.6393, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.47% (0.2065 => 0.2178, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.23% (0.4879 => 0.5134, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 5.21% (0.3282 => 0.3453, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.16% (0.3177 => 0.3341, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.06% (7.0540 => 7.4111, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 4.95% (0.7326 => 0.7689, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 4.12% (0.7433 => 0.7739, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.27% (0.4615 => 0.4766, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.26% (0.8172 => 0.8438, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.18% (9.4845 => 9.7857, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.13% (5.0018 => 5.1584, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.10% (4.9449 => 5.0984, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.09% (0.5569 => 0.5741, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 2.74% (0.4299 => 0.4417, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.73% (8.1363 => 8.3588, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 2.73% (0.7835 => 0.8049, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.72% (1.5603 => 1.6028, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.62% (4.2646 => 4.3765, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.60% (14.3668 => 14.7407, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.58% (0.5860 => 0.6011, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.20% (5.7591 => 5.8856, std. dev.: 0.0118) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.18% (0.4636 => 0.4737, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.13% (0.8067 => 0.8239, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.07% (1.1861 => 1.2107, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.00% (1.1642 => 1.1875, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 1.98% (2.0273 => 2.0674, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.95% (1.3050 => 1.3304, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.92% (3.3354 => 3.3996, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.89% (1.5415 => 1.5706, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.75% (3.8723 => 3.9401, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.65% (2.0665 => 2.1006, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.64% (0.6450 => 0.6556, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.60% (0.9765 => 0.9921, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.52% (1.4186 => 1.4401, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.37% (17.1811 => 17.4166, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.32% (2.2024 => 2.2314, std. dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 1.21% (1.1840 => 1.1983, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.77% (1.1145 => 1.1900, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7478, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0561, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.30% (26.0924 => 26.6934, std. dev.: 0.0185) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5086 => 1.5353, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.46% (9.1159 => 9.2487, std. dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6883, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.88% (5.2763 => 3.1719, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.86% (5.3855 => 3.7235, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.25% (5.3526 => 3.7336, std. dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: -15.38% (22.1758 => 18.7644, std. dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.52% (2.9384 => 2.5411, std. dev.: 0.0134) SingleSource/UnitTests/Vector/constpool: -5.43% (54.1659 => 51.2221, std. dev.: 0.0288) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.87% (3.8922 => 3.8195, std. dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.53% (0.0998 => 0.0843, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.19% (1.2373 => 1.1112, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.76% (19.9488 => 18.6010, std. dev.: 0.0776) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9152, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.55% (32.5116 => 31.6815, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0853, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.02% (1.4460 => 1.4312, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 11:36:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 13:36:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120716183640.AC85E2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2115?compare_to=2110&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2115, Order: 160277, Start Time: 2012-07-16 15:53:18, End Time: 2012-07-16 18:36:51 To: 2110, Order: 160263, Start Time: 2012-07-16 12:27:53, End Time: 2012-07-16 15:11:25 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (47 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (846 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 20.04% (0.3792 => 0.4552, std. dev.: 0.0165) SingleSource/UnitTests/ObjC/exceptions-4: 12.35% (0.3465 => 0.3893, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.28% (0.3469 => 0.3895, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.27% (0.3496 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3460 => 0.3882, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.19% (0.3446 => 0.3866, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.09% (0.3442 => 0.3858, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.04% (0.3488 => 0.3908, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 11.73% (0.3650 => 0.4078, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.61% (0.3643 => 0.4066, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3724 => 0.4141, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.97% (0.5826 => 0.6232, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.71% (0.5889 => 0.6284, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.27% (0.7171 => 0.7549, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.88% (1.6211 => 1.7002, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.61% (0.4361 => 0.4562, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.57% (3.5627 => 3.7254, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.16% (0.5026 => 0.5235, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 4.10% (0.4029 => 0.4194, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.05% (0.5900 => 0.6139, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.73% (1.3152 => 1.3643, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.64% (0.4994 => 0.5176, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.51% (0.3930 => 0.4068, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.38% (2.7292 => 2.8214, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.28% (0.5000 => 0.5164, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 3.24% (4.2109 => 4.3474, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.24% (0.3890 => 0.4016, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (1.9694 => 2.0275, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.80% (1.9966 => 2.0526, std. dev.: 0.0053) MultiSource/Applications/d/make_dparser: 2.80% (1.0781 => 1.1083, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.75% (0.4658 => 0.4786, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.73% (0.9909 => 1.0180, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 2.63% (1.8794 => 1.9288, std. dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 2.60% (2.1013 => 2.1560, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.59% (2.0673 => 2.1209, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.51% (4.4195 => 4.5306, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.40% (4.6177 => 4.7285, std. dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (2.1653 => 2.2170, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 2.38% (5.5417 => 5.6735, std. dev.: 0.0130) MultiSource/Applications/hbd/hbd: 2.23% (0.9697 => 0.9913, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 2.09% (23.5202 => 24.0117, std. dev.: 0.0229) MultiSource/Applications/treecc/treecc: 1.98% (0.7875 => 0.8031, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.96% (1.4269 => 1.4548, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.88% (0.5546 => 0.5650, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.55% (0.6634 => 0.6737, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 1.07% (1.5932 => 1.6102, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.31% (2.0820 => 2.1092, std. dev.: 0.0105) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.74% (11.9555 => 11.7478, std. dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 11:57:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 13:57:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120716185716.316EF2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2116?compare_to=2113&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2116, Order: 160287, Start Time: 2012-07-16 17:43:41, End Time: 2012-07-16 18:57:26 To: 2113, Order: 160277, Start Time: 2012-07-16 16:01:12, End Time: 2012-07-16 17:15:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (131 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (722 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.11% (2.0176 => 2.3023, std. dev.: 0.0046) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.79% (0.1072 => 0.1177, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.39% (0.5818 => 0.6306, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.28% (0.5748 => 0.6224, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.20% (0.7061 => 0.7640, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 7.43% (0.3578 => 0.3844, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.22% (0.4003 => 0.4292, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 7.13% (0.3646 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.11% (0.3601 => 0.3857, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.02% (0.3663 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.96% (0.3650 => 0.3904, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.94% (0.3789 => 0.4052, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.93% (0.3623 => 0.3874, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 6.90% (0.3914 => 0.4184, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.78% (0.3940 => 0.4207, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.55% (0.1986 => 0.2116, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 6.51% (1.3693 => 1.4584, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 6.39% (0.7038 => 0.7488, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.12% (0.7710 => 0.8182, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.79% (0.5265 => 0.5570, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 5.79% (0.4062 => 0.4297, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.78% (0.2596 => 0.2746, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.66% (3.9660 => 4.1906, std. dev.: 0.0125) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.66% (0.2721 => 0.2875, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.61% (0.4328 => 0.4571, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.10% (0.6959 => 0.7314, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.3899 => 0.4094, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.96% (0.2781 => 0.2919, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.90% (0.3022 => 0.3170, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/except: 4.82% (0.2760 => 0.2893, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.82% (0.2782 => 0.2916, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.80% (0.3580 => 0.3752, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.79% (0.2607 => 0.2732, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.79% (0.2966 => 0.3108, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.78% (0.2761 => 0.2893, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.76% (0.3489 => 0.3655, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.72% (0.2690 => 0.2817, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.71% (0.2655 => 0.2780, std. dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: 4.71% (16.6129 => 17.3948, std. dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/strcat: 4.66% (0.2726 => 0.2853, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.64% (0.2628 => 0.2750, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 4.63% (0.2937 => 0.3073, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 4.62% (13.8202 => 14.4588, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/09-vor/vor: 4.62% (0.2925 => 0.3060, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.61% (1.9828 => 2.0743, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.56% (0.2765 => 0.2891, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.49% (0.4390 => 0.4587, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.48% (0.9199 => 0.9611, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.45% (0.2696 => 0.2816, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.44% (0.3107 => 0.3245, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (0.3149 => 0.3288, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.32% (0.5577 => 0.5818, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.28% (0.3485 => 0.3634, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.27% (13.2842 => 13.8518, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 4.23% (0.3192 => 0.3327, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.17% (0.3453 => 0.3597, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.15% (1.2193 => 1.2699, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.13% (0.3293 => 0.3429, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.03% (0.4016 => 0.4178, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.01% (1.1061 => 1.1504, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 3.98% (0.2988 => 0.3107, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.97% (1.3819 => 1.4368, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.96% (0.3534 => 0.3674, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.93% (1.3813 => 1.4356, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.89% (0.3756 => 0.3902, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.87% (1.3245 => 1.3757, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.85% (0.3246 => 0.3371, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.84% (0.4379 => 0.4547, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.83% (3.8646 => 4.0126, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.81% (0.5637 => 0.5852, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.3868 => 0.4015, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.76% (1.1364 => 1.1791, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.76% (0.7506 => 0.7788, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.74% (0.2914 => 0.3023, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.69% (1.4563 => 1.5101, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 3.63% (1.9270 => 1.9969, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.54% (7.2180 => 7.4734, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.51% (1.0594 => 1.0966, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (0.7460 => 0.7703, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.23% (4.9865 => 5.1478, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 3.13% (1.2292 => 1.2677, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 2.92% (0.8310 => 0.8553, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.92% (2.1791 => 2.2428, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.91% (3.6692 => 3.7761, std. dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 2.86% (6.5754 => 6.7637, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 2.82% (14.8535 => 15.2721, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3755 => 0.3857, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.63% (4.3801 => 4.4952, std. dev.: 0.0108) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.56% (4.4433 => 4.5571, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.51% (0.6135 => 0.6289, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 2.45% (3.1889 => 3.2671, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.30% (1.1333 => 1.1594, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.30% (16.2614 => 16.6347, std. dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.24% (0.8698 => 0.8893, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.15% (14.5298 => 14.8416, std. dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.11% (0.4791 => 0.4892, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.96% (0.6283 => 0.6406, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 1.95% (1.2749 => 1.2997, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.53% (2.1007 => 2.1329, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.2742 => 3.3081, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/fbench: 25.79% (1.8175 => 2.2862, std. dev.: 0.0394) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1912, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.91% (0.9996 => 1.0787, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 7.79% (1.2998 => 1.4010, std. dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.00% (7.4271 => 7.7245, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6786, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4806, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.05% (4.1080 => 4.1921, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.57% (3.6469 => 3.7043, std. dev.: 0.0057) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.16% (1.9290 => 1.9514, std. dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.34% (22.5627 => 21.1328, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.22% (0.3511 => 0.3398, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.26% (0.8818 => 0.8619, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.28% (1.2308 => 1.1043, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.03% (20.3410 => 18.5051, std. dev.: 0.0538) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3137, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.24% (1.9762 => 1.9122, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5990, std. dev.: 0.0142) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4464, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5023, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: -1.74% (3.0263 => 2.9737, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2582, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7975, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1301, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8608, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4903, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.31% (9.3358 => 9.2132, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.30% (0.9692 => 0.9566, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2373, std. dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2511, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 12:29:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 14:29:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120716192942.930AF2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2117?compare_to=2114&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2117, Order: 160290, Start Time: 2012-07-16 18:11:29, End Time: 2012-07-16 19:29:54 To: 2114, Order: 160281, Start Time: 2012-07-16 16:24:47, End Time: 2012-07-16 17:43:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (65 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (789 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.74% (10.3673 => 13.9694, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.67% (1.1194 => 1.2500, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.31% (0.3473 => 0.3831, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3516 => 0.3871, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.05% (0.3543 => 0.3899, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.05% (0.3543 => 0.3899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.04% (0.3497 => 0.3848, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.97% (0.3561 => 0.3916, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.66% (0.3694 => 0.4051, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.64% (0.3828 => 0.4197, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.47% (0.3927 => 0.4299, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.42% (0.3886 => 0.4252, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.04% (1.7609 => 1.9025, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.56% (2.2022 => 2.3687, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.92% (0.2065 => 0.2208, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.74% (10.4361 => 11.0355, std. dev.: 0.0084) SingleSource/UnitTests/ObjC++/Hello: 5.20% (0.5925 => 0.6233, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.10% (0.3177 => 0.3339, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.06% (0.6030 => 0.6335, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.94% (0.3282 => 0.3444, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.63% (0.7326 => 0.7665, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.56% (7.0540 => 7.3755, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.53% (0.4879 => 0.5100, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 4.13% (0.7433 => 0.7740, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.68% (0.4615 => 0.4785, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.07% (0.8172 => 0.8423, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.02% (4.9449 => 5.0941, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5569 => 0.5736, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.82% (5.0018 => 5.1431, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 2.81% (0.4299 => 0.4420, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 2.81% (9.4845 => 9.7512, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.54% (8.1363 => 8.3433, std. dev.: 0.0073) MultiSource/Applications/spiff/spiff: 2.51% (0.7835 => 0.8032, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.51% (0.5860 => 0.6007, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (14.3668 => 14.7266, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.49% (4.2646 => 4.3706, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 2.39% (1.5603 => 1.5976, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 2.16% (1.1642 => 1.1893, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.08% (0.8067 => 0.8235, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.08% (1.5415 => 1.5735, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.03% (1.1861 => 1.2102, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.98% (3.8723 => 3.9490, std. dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: 1.93% (5.7591 => 5.8704, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 1.92% (2.0273 => 2.0663, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.92% (1.3050 => 1.3301, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 1.85% (3.3354 => 3.3970, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.75% (0.6450 => 0.6563, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.72% (0.9765 => 0.9933, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.63% (2.2024 => 2.2383, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.59% (1.4186 => 1.4412, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.32% (17.1811 => 17.4084, std. dev.: 0.0157) MultiSource/Benchmarks/nbench/nbench: 1.19% (1.1840 => 1.1981, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.19% (2.0665 => 2.0911, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.16% (1.5859 => 1.6043, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9743, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7505, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.06% (26.0924 => 26.6306, std. dev.: 0.0269) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (1.5086 => 1.5382, std. dev.: 0.0108) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4461, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2431, std. dev.: 0.0290) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6899, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.91% (5.2763 => 3.1707, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.42% (5.3855 => 3.6933, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.76% (5.3526 => 3.7061, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -15.38% (22.1758 => 18.7660, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.36% (2.9384 => 2.5457, std. dev.: 0.0081) SingleSource/UnitTests/Vector/constpool: -5.17% (54.1659 => 51.3634, std. dev.: 0.0456) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.71% (3.8922 => 3.8255, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.63% (0.0998 => 0.0842, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.79% (1.2373 => 1.1038, std. dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.86% (19.9488 => 18.5800, std. dev.: 0.0490) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (8.1563 => 7.9161, std. dev.: 0.0119) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6929, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0843, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.06% (1.3677 => 1.3532, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.02% (1.4460 => 1.4312, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 13:39:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 15:39:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120716203904.A645E2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2118?compare_to=2116&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2118, Order: 160305, Start Time: 2012-07-16 19:25:25, End Time: 2012-07-16 20:39:16 To: 2116, Order: 160287, Start Time: 2012-07-16 17:43:41, End Time: 2012-07-16 18:57:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (133 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (722 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.71% (2.0176 => 2.3143, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 8.92% (0.5818 => 0.6337, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.72% (0.5748 => 0.6249, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.65% (0.7061 => 0.7672, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.80% (0.3578 => 0.3857, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.64% (0.3650 => 0.3929, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-2: 7.58% (0.3601 => 0.3874, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.52% (0.3646 => 0.3920, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.48% (0.3130 => 0.3364, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 7.47% (0.3789 => 0.4072, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.45% (0.3663 => 0.3936, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.42% (0.3623 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.36% (0.3914 => 0.4202, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.32% (0.4003 => 0.4296, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.26% (0.3940 => 0.4226, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.95% (1.3693 => 1.4645, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (0.4328 => 0.4618, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.70% (0.1986 => 0.2119, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.44% (0.7038 => 0.7491, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 6.43% (0.4062 => 0.4323, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.29% (0.2781 => 0.2956, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.10% (0.2721 => 0.2887, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.07% (0.2782 => 0.2951, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.06% (0.2607 => 0.2765, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.04% (0.5265 => 0.5583, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.99% (0.2937 => 0.3113, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.93% (3.9660 => 4.2012, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2655 => 0.2812, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.91% (0.2690 => 0.2849, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.89% (0.2596 => 0.2749, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 5.86% (0.2628 => 0.2782, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.82% (0.3022 => 0.3198, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.79% (0.4390 => 0.4644, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.77% (0.7710 => 0.8155, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.77% (0.2966 => 0.3137, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.72% (0.2760 => 0.2918, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: 5.69% (0.2761 => 0.2918, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.64% (0.2696 => 0.2848, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.61% (1.9828 => 2.0940, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 5.58% (0.2726 => 0.2878, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2765 => 0.2917, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.44% (0.3899 => 0.4111, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.23% (0.6959 => 0.7323, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.11% (0.3485 => 0.3663, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.01% (0.3453 => 0.3626, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.01% (0.3534 => 0.3711, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.95% (0.3192 => 0.3350, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.80% (0.2914 => 0.3054, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (0.3756 => 0.3934, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.73% (0.4016 => 0.4206, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.69% (13.8202 => 14.4682, std. dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: 4.66% (16.6129 => 17.3872, std. dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/lists: 4.62% (0.3293 => 0.3445, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.59% (0.9199 => 0.9621, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.49% (1.2193 => 1.2740, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.47% (0.3868 => 0.4041, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.33% (13.2842 => 13.8597, std. dev.: 0.0208) MultiSource/Benchmarks/McCat/09-vor/vor: 4.31% (0.2925 => 0.3051, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.12% (0.5577 => 0.5807, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.11% (1.3245 => 1.3790, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.06% (0.7506 => 0.7811, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.04% (0.4379 => 0.4556, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.03% (1.3819 => 1.4376, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.98% (1.4563 => 1.5142, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.97% (1.0594 => 1.1015, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.97% (0.5637 => 0.5861, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.93% (1.3813 => 1.4356, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (1.1364 => 1.1808, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.2292 => 1.2763, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 3.81% (3.8646 => 4.0119, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3246 => 0.3369, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.72% (7.2180 => 7.4866, std. dev.: 0.0063) MultiSource/Applications/Burg/burg: 3.69% (1.1061 => 1.1469, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.63% (1.9270 => 1.9970, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3755 => 0.3888, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.28% (4.9865 => 5.1500, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 3.26% (0.3220 => 0.3325, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.24% (3.6692 => 3.7880, std. dev.: 0.0145) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.22% (0.7460 => 0.7700, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 3.18% (0.8310 => 0.8574, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (6.5754 => 6.7729, std. dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 2.95% (14.8535 => 15.2917, std. dev.: 0.0174) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.92% (4.3801 => 4.5079, std. dev.: 0.0039) MultiSource/Applications/siod/siod: 2.86% (2.1791 => 2.2415, std. dev.: 0.0175) MultiSource/Benchmarks/McCat/05-eks/eks: 2.82% (0.4113 => 0.4229, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.82% (4.4433 => 4.5686, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.80% (0.4791 => 0.4925, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.76% (0.8698 => 0.8938, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.38% (16.2614 => 16.6486, std. dev.: 0.0272) MultiSource/Applications/d/make_dparser: 2.36% (3.1889 => 3.2643, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.31% (0.6135 => 0.6277, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 2.28% (14.5298 => 14.8612, std. dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.23% (0.6283 => 0.6423, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.93% (1.2749 => 1.2995, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.48% (2.1007 => 2.1317, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (8.4961 => 8.6173, std. dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.36% (3.2742 => 3.3188, std. dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.22% (1.5188 => 1.5374, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.94% (1.8175 => 2.2707, std. dev.: 0.0466) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1912, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.13% (0.9996 => 1.0809, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: 6.85% (1.2998 => 1.3889, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (4.5947 => 4.8136, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.21% (7.4271 => 7.7395, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9217, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6801, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4798, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0310 => 1.0562, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5330, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9592, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.47% (3.6469 => 3.7006, std. dev.: 0.0065) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.45% (22.5627 => 21.1072, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.76% (0.2670 => 0.2543, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.02% (0.8818 => 0.8640, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.90% (1.2308 => 1.1090, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (20.3410 => 18.6190, std. dev.: 0.0408) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3136, std. dev.: 0.0091) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.24% (1.9762 => 1.9122, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5868, std. dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: -2.42% (2.5089 => 2.4481, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.11% (6.6320 => 6.4919, std. dev.: 0.0111) MultiSource/Applications/spiff/spiff: -1.80% (3.0263 => 2.9719, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2532, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.53% (0.9692 => 0.9544, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7966, std. dev.: 0.0014) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1232, std. dev.: 0.0303) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2419, std. dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2528, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/heapsort: -1.11% (3.9173 => 3.8740, std. dev.: 0.0140) MultiSource/Applications/minisat/minisat: -1.03% (9.3358 => 9.2394, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 14:16:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 16:16:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120716211602.D354B2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2119?compare_to=2117&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2119, Order: 160311, Start Time: 2012-07-16 19:58:04, End Time: 2012-07-16 21:16:14 To: 2117, Order: 160290, Start Time: 2012-07-16 18:11:29, End Time: 2012-07-16 19:29:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (64 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 928 (790 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 5.87% (18.7660 => 19.8677, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/power/power: 5.98% (1.1251 => 1.1924, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.44% (13.9694 => 13.4889, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: -1.65% (11.0355 => 10.8533, std. dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.11% (10.3673 => 13.4889, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 12.04% (0.3473 => 0.3891, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.85% (0.3543 => 0.3963, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 11.80% (0.3543 => 0.3961, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.72% (0.3497 => 0.3907, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.60% (0.3516 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.43% (0.3561 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.15% (0.3694 => 0.4106, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (1.1194 => 1.2441, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.80% (0.3927 => 0.4351, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.14% (2.2022 => 2.3815, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.52% (1.7609 => 1.8934, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.97% (0.1622 => 0.1735, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.19% (0.5925 => 0.6292, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.09% (0.6030 => 0.6397, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2065 => 0.2180, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.94% (0.3177 => 0.3334, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.94% (0.7326 => 0.7688, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/oourafft: 4.78% (0.3282 => 0.3439, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.76% (7.0540 => 7.3896, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.28% (0.4879 => 0.5088, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.14% (0.7433 => 0.7741, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 4.00% (10.4361 => 10.8533, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.51% (0.4615 => 0.4777, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.17% (0.8172 => 0.8431, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.14% (5.0018 => 5.1587, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.11% (4.9449 => 5.0989, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.09% (0.5569 => 0.5741, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.77% (14.3668 => 14.7645, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.63% (8.1363 => 8.3501, std. dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 2.62% (9.4845 => 9.7326, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.59% (4.2646 => 4.3749, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.57% (0.7835 => 0.8036, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 2.49% (0.4299 => 0.4406, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.45% (1.5603 => 1.5986, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.33% (1.1861 => 1.2137, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.15% (3.3354 => 3.4071, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.12% (5.7591 => 5.8811, std. dev.: 0.0048) MultiSource/Applications/treecc/treecc: 2.11% (2.0273 => 2.0701, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.99% (1.5415 => 1.5722, std. dev.: 0.0073) MultiSource/Applications/Burg/burg: 1.98% (1.1642 => 1.1873, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 1.93% (3.8723 => 3.9470, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.92% (1.3050 => 1.3301, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.89% (2.0665 => 2.1055, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.88% (0.8067 => 0.8219, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 1.63% (0.6456 => 0.6561, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.51% (17.1811 => 17.4399, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.50% (1.4186 => 1.4399, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.44% (0.9765 => 0.9906, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.37% (1.2842 => 1.3018, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.03% (2.2024 => 2.2250, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7519, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.15% (26.0924 => 26.6526, std. dev.: 0.0140) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (1.5086 => 1.5363, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.47% (9.1159 => 9.2497, std. dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.36% (2.6546 => 2.6906, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.51% (0.8651 => 0.1686, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.26% (5.2763 => 3.1522, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.27% (5.3855 => 3.7014, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.02% (5.3526 => 3.6923, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.32% (2.9384 => 2.5471, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -10.41% (22.1758 => 19.8677, std. dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -5.23% (54.1659 => 51.3334, std. dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.19% (3.8922 => 3.8071, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.94% (1.2373 => 1.1143, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.86% (19.9488 => 18.5805, std. dev.: 0.0341) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (8.1563 => 7.9199, std. dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6908, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0857, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: -1.11% (1.4460 => 1.4300, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 14:48:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 16:48:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120716214807.A74F22A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2120?compare_to=2115&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2120, Order: 160303, Start Time: 2012-07-16 19:04:51, End Time: 2012-07-16 21:48:18 To: 2115, Order: 160277, Start Time: 2012-07-16 15:53:18, End Time: 2012-07-16 18:36:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (45 on baseline) Performance Improvements: 1 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (847 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 6.43% (0.2256 => 0.2401, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.24% (2.4544 => 2.3995, std. dev.: 0.0120) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 11.47% (0.3460 => 0.3857, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.46% (0.3465 => 0.3862, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.42% (0.3442 => 0.3835, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.40% (0.3446 => 0.3839, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.38% (0.3488 => 0.3885, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.36% (0.3496 => 0.3893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.24% (0.3469 => 0.3859, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.15% (0.3650 => 0.4057, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.93% (0.3643 => 0.4041, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.53% (0.3724 => 0.4116, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5826 => 0.6185, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 5.89% (0.5889 => 0.6236, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.48% (0.7171 => 0.7492, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.97% (1.6211 => 1.6855, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.81% (3.5627 => 3.6986, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.73% (0.2738 => 0.2840, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.70% (0.4029 => 0.4178, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.64% (0.5026 => 0.5209, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.62% (0.4361 => 0.4519, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.46% (0.5900 => 0.6104, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.12% (0.4994 => 0.5150, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.07% (2.7292 => 2.8129, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.00% (0.5000 => 0.5150, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.98% (0.3930 => 0.4047, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 2.90% (4.2109 => 4.3332, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (0.3625 => 0.3730, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.89% (1.3152 => 1.3532, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.74% (2.0673 => 2.1240, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.68% (0.9909 => 1.0175, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.49% (1.9694 => 2.0184, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.33% (1.9966 => 2.0431, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.25% (0.4658 => 0.4763, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.22% (1.0781 => 1.1020, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 2.19% (23.5202 => 24.0359, std. dev.: 0.0070) MultiSource/Applications/hbd/hbd: 2.07% (0.9697 => 0.9898, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.02% (5.5417 => 5.6538, std. dev.: 0.0070) MultiSource/Applications/JM/ldecod/ldecod: 1.85% (2.1653 => 2.2054, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.84% (4.4195 => 4.5006, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.83% (4.6177 => 4.7023, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 1.73% (1.8794 => 1.9119, std. dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 1.72% (2.1013 => 2.1375, std. dev.: 0.0087) MultiSource/Applications/treecc/treecc: 1.56% (0.7875 => 0.7998, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.55% (0.6435 => 0.6535, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.37% (1.4269 => 1.4465, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.2122 => 0.2223, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.11% (2.4764 => 2.3995, std. dev.: 0.0120) MultiSource/Applications/kimwitu++/kc: -2.07% (11.9555 => 11.7076, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 15:20:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 17:20:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120716222046.345EE2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/2121?compare_to=2118&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2121, Order: 160315, Start Time: 2012-07-16 21:07:16, End Time: 2012-07-16 22:20:57 To: 2118, Order: 160305, Start Time: 2012-07-16 19:25:25, End Time: 2012-07-16 20:39:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (133 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 950 (720 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: 1.66% (3.1536 => 3.2059, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 1.39% (0.7421 => 0.7524, std. dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.64% (2.0176 => 2.2927, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5818 => 0.6360, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.12% (0.5748 => 0.6272, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.98% (0.7061 => 0.7695, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.50% (0.3578 => 0.3882, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.20% (0.3646 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.19% (0.3601 => 0.3896, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.11% (0.3663 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.10% (0.3789 => 0.4096, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.09% (0.3623 => 0.3916, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.05% (0.3650 => 0.3944, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.94% (0.3940 => 0.4253, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 7.87% (0.3914 => 0.4222, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.4003 => 0.4317, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.53% (1.3693 => 1.4724, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.55% (0.1986 => 0.2116, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.42% (0.4328 => 0.4606, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.33% (0.4062 => 0.4319, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.26% (0.2781 => 0.2955, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.05% (0.7038 => 0.7464, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.95% (0.2607 => 0.2762, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.86% (0.2782 => 0.2945, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.84% (0.2690 => 0.2847, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.82% (0.2937 => 0.3108, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3022 => 0.3197, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.78% (0.2628 => 0.2780, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.74% (0.2596 => 0.2745, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.72% (0.2761 => 0.2919, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.64% (0.7710 => 0.8145, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.58% (0.5265 => 0.5559, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.58% (1.9828 => 2.0934, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2696 => 0.2846, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.48% (3.9660 => 4.1834, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.45% (0.3580 => 0.3775, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.39% (0.2726 => 0.2873, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.39% (0.3899 => 0.4109, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.26% (0.2721 => 0.2864, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3149 => 0.3314, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.05% (0.3485 => 0.3661, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.02% (0.2988 => 0.3138, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.98% (0.3453 => 0.3625, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.95% (0.3192 => 0.3350, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3756 => 0.3932, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3293 => 0.3447, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.67% (0.6959 => 0.7284, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.63% (0.4016 => 0.4202, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.61% (0.3534 => 0.3697, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.58% (0.4390 => 0.4591, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.45% (0.9199 => 0.9608, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.37% (16.6129 => 17.3395, std. dev.: 0.0092) MultiSource/Applications/SPASS/SPASS: 4.28% (13.8202 => 14.4111, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.24% (1.2193 => 1.2710, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.04% (13.2842 => 13.8215, std. dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.02% (0.4379 => 0.4555, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.00% (0.2925 => 0.3042, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.81% (0.2914 => 0.3025, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.75% (0.5577 => 0.5786, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.74% (0.5637 => 0.5848, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.72% (1.3819 => 1.4333, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.69% (0.7506 => 0.7783, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.67% (1.3245 => 1.3731, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 3.65% (1.2292 => 1.2741, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.61% (1.3813 => 1.4312, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.54% (1.4563 => 1.5078, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.52% (1.0594 => 1.0967, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.51% (0.3246 => 0.3360, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3755 => 0.3886, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.48% (1.1364 => 1.1760, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.48% (7.2180 => 7.4689, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/gs/gs: 3.44% (3.8646 => 3.9975, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 3.32% (1.9270 => 1.9910, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.31% (1.1061 => 1.1427, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.00% (0.7460 => 0.7684, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.95% (4.9865 => 5.1335, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 2.90% (0.8310 => 0.8551, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.87% (3.6692 => 3.7745, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.86% (4.3801 => 4.5054, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.77% (4.4433 => 4.5663, std. dev.: 0.0139) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (6.5754 => 6.7530, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.62% (0.8698 => 0.8926, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.61% (14.8535 => 15.2413, std. dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.61% (0.4791 => 0.4916, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.47% (2.1791 => 2.2330, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.25% (1.1333 => 1.1588, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 2.02% (3.1889 => 3.2534, std. dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.00% (0.6135 => 0.6258, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.99% (16.2614 => 16.5844, std. dev.: 0.0209) MultiSource/Applications/ClamAV/clamscan: 1.92% (14.5298 => 14.8093, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.91% (0.6283 => 0.6403, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.83% (1.2749 => 1.2982, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.36% (2.1007 => 2.1292, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.03% (3.2742 => 3.3080, std. dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/fbench: 24.76% (1.8175 => 2.2676, std. dev.: 0.0178) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.36% (2.0200 => 2.1889, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.90% (0.9996 => 1.0786, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3802, std. dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (4.5947 => 4.8136, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.99% (7.4271 => 7.7236, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8313, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1896, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.91% (3.6469 => 3.7165, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.55% (4.5928 => 4.6638, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.26% (1.9290 => 1.9533, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 1.02% (3.1736 => 3.2059, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.5627 => 21.0513, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3511 => 0.3399, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.97% (0.8818 => 0.8644, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2308 => 1.1036, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.90% (20.3410 => 18.5302, std. dev.: 0.0444) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.90% (1.3780 => 1.3105, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9128, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5912, std. dev.: 0.0170) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5056, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: -1.82% (3.0263 => 2.9712, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2508, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9984, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.53% (2.5254 => 2.4867, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7949, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0037) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1572, std. dev.: 0.0166) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2500, std. dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2431, std. dev.: 0.0057) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2268, std. dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8045, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 16:02:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 18:02:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120716230215.4890E2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2122?compare_to=2119&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2122, Order: 160319, Start Time: 2012-07-16 21:44:14, End Time: 2012-07-16 23:02:19 To: 2119, Order: 160311, Start Time: 2012-07-16 19:58:04, End Time: 2012-07-16 21:16:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (63 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (791 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.35% (54.6842 => 56.5171, std. dev.: 0.0864) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1567 => 3.2148, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.90% (13.4889 => 13.0978, std. dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.34% (10.3673 => 13.0978, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.13% (1.1194 => 1.2552, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.37% (0.3473 => 0.3868, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.12% (0.3497 => 0.3886, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3516 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.95% (0.3543 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.95% (0.3543 => 0.3931, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.87% (0.3561 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.50% (0.3694 => 0.4082, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.19% (0.3886 => 0.4282, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.13% (0.3927 => 0.4325, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.69% (2.2022 => 2.3936, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.56% (1.7609 => 1.9116, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 5.39% (0.3282 => 0.3459, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.22% (0.6030 => 0.6345, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.22% (0.5925 => 0.6234, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.13% (0.2065 => 0.2171, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.98% (0.4879 => 0.5122, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.83% (7.0540 => 7.3944, std. dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference: 4.08% (0.7326 => 0.7625, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 3.75% (0.7433 => 0.7712, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.62% (0.4615 => 0.4782, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 3.60% (10.4361 => 10.8123, std. dev.: 0.0079) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.36% (5.0018 => 5.1699, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.27% (4.9449 => 5.1067, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.20% (0.3121 => 0.3221, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.08% (9.4845 => 9.7763, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 2.98% (0.4299 => 0.4427, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.97% (0.8172 => 0.8415, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.89% (0.5569 => 0.5730, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (14.3668 => 14.7689, std. dev.: 0.0054) MultiSource/Applications/spiff/spiff: 2.80% (0.7835 => 0.8054, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.56% (0.5860 => 0.6010, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.55% (8.1363 => 8.3435, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.48% (4.2646 => 4.3704, std. dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 2.26% (5.7591 => 5.8890, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 2.19% (2.0273 => 2.0716, std. dev.: 0.0067) MultiSource/Applications/hbd/hbd: 2.06% (1.5603 => 1.5924, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.01% (1.3050 => 1.3312, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.99% (3.8723 => 3.9494, std. dev.: 0.0034) MultiSource/Applications/d/make_dparser: 1.95% (3.3354 => 3.4003, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 1.91% (1.1642 => 1.1864, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.87% (0.8067 => 0.8218, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.66% (1.5415 => 1.5671, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.47% (17.1811 => 17.4340, std. dev.: 0.0433) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.38% (0.9765 => 0.9900, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.34% (2.0665 => 2.0941, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.10% (2.2024 => 2.2267, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.82% (1.1145 => 1.1905, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7541, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.21% (26.0924 => 26.6687, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.89% (1.5086 => 1.5371, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2148, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2361, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.29% (2.6546 => 2.6888, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.92% (5.2763 => 3.1698, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.83% (5.3855 => 3.7249, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.62% (5.3526 => 3.7139, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.85% (2.9384 => 2.5607, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -10.31% (22.1758 => 19.8893, std. dev.: 0.0162) SingleSource/UnitTests/Vector/constpool: -5.16% (54.1659 => 51.3684, std. dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.66% (3.8922 => 3.8277, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.85% (1.2373 => 1.1154, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.77% (19.9488 => 18.5973, std. dev.: 0.0283) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.91% (8.1563 => 7.9186, std. dev.: 0.0112) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6885, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0861, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.00% (1.4460 => 1.4315, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 17:02:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 19:02:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120717000233.55AE82A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2123?compare_to=2121&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2123, Order: 160323, Start Time: 2012-07-16 22:48:58, End Time: 2012-07-17 00:02:42 To: 2121, Order: 160315, Start Time: 2012-07-16 21:07:16, End Time: 2012-07-16 22:20:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (138 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (712 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.83% (2.0176 => 2.2967, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference-object: 8.77% (0.5818 => 0.6328, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 8.72% (0.3578 => 0.3890, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.65% (0.5748 => 0.6245, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 8.57% (0.7061 => 0.7666, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.55% (0.3650 => 0.3962, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 8.42% (0.3646 => 0.3953, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3601 => 0.3904, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3789 => 0.4104, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.30% (0.3663 => 0.3967, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.15% (0.3914 => 0.4233, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.4003 => 0.4328, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.65% (0.1986 => 0.2118, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.49% (1.3693 => 1.4582, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 6.18% (0.7038 => 0.7473, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.17% (0.4328 => 0.4595, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.13% (0.4062 => 0.4311, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.80% (0.7710 => 0.8157, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.78% (0.2596 => 0.2746, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.77% (3.9660 => 4.1948, std. dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 5.75% (0.2781 => 0.2941, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.60% (0.5265 => 0.5560, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.54% (0.2782 => 0.2936, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.51% (0.2721 => 0.2871, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.43% (0.3022 => 0.3186, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.42% (0.2655 => 0.2799, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 5.40% (0.2628 => 0.2770, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: 5.37% (0.2607 => 0.2747, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.33% (0.2760 => 0.2907, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2690 => 0.2833, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.31% (0.2937 => 0.3093, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.23% (0.3899 => 0.4103, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.18% (1.9828 => 2.0855, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.17% (0.4390 => 0.4617, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 5.10% (0.2726 => 0.2865, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2696 => 0.2833, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.04% (0.3192 => 0.3353, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 5.02% (0.3107 => 0.3263, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 4.89% (0.3149 => 0.3303, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.86% (0.6959 => 0.7297, std. dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.82% (0.3485 => 0.3653, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 4.69% (0.2988 => 0.3128, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 4.60% (0.3453 => 0.3612, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3293 => 0.3443, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.53% (13.8202 => 14.4464, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3534 => 0.3691, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.43% (0.4016 => 0.4194, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.38% (16.6129 => 17.3406, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.37% (1.2193 => 1.2726, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.37% (0.9199 => 0.9601, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.29% (0.4379 => 0.4567, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.23% (0.5577 => 0.5813, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.21% (0.2925 => 0.3048, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.19% (13.2842 => 13.8408, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/moments: 4.19% (0.3868 => 0.4030, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2945 => 0.3064, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.95% (1.0594 => 1.1012, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.88% (0.2914 => 0.3027, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.87% (1.3245 => 1.3757, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.82% (1.1364 => 1.1798, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.81% (0.5637 => 0.5852, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.78% (0.7506 => 0.7790, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.76% (1.3819 => 1.4339, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.74% (1.4563 => 1.5107, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.66% (1.3813 => 1.4319, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.64% (0.3246 => 0.3364, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.62% (7.2180 => 7.4792, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 3.61% (1.1061 => 1.1460, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 3.59% (3.8646 => 4.0033, std. dev.: 0.0131) MultiSource/Benchmarks/McCat/05-eks/eks: 3.57% (0.4113 => 0.4260, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.45% (1.2292 => 1.2716, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.43% (1.9270 => 1.9931, std. dev.: 0.0132) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (4.9865 => 5.1519, std. dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3755 => 0.3873, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.13% (3.6692 => 3.7839, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.11% (0.7460 => 0.7692, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 3.10% (0.8310 => 0.8568, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.09% (0.4791 => 0.4939, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.05% (4.3801 => 4.5135, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.94% (4.4433 => 4.5739, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 2.89% (6.5754 => 6.7656, std. dev.: 0.0087) MultiSource/Applications/JM/lencod/lencod: 2.79% (14.8535 => 15.2677, std. dev.: 0.0143) MultiSource/Applications/siod/siod: 2.76% (2.1791 => 2.2393, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.71% (0.8698 => 0.8934, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.42% (1.1333 => 1.1607, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6283 => 0.6428, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.27% (3.1889 => 3.2614, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.18% (0.6135 => 0.6269, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.17% (16.2614 => 16.6138, std. dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: 2.12% (14.5298 => 14.8381, std. dev.: 0.0072) MultiSource/Applications/SIBsim4/SIBsim4: 2.09% (1.2749 => 1.3016, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.70% (2.1007 => 2.1365, std. dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: 1.49% (8.4961 => 8.6228, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (3.2742 => 3.3202, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (1.5188 => 1.5379, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2690, std. dev.: 0.0516) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1908, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.20% (1.2998 => 1.3804, std. dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.18% (7.4271 => 7.7377, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9204, std. dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6781, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4785, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.28% (1.0310 => 1.0545, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5089 => 1.5332, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.58% (3.6469 => 3.7047, std. dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5928 => 4.6629, std. dev.: 0.0040) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops: 1.28% (9.0760 => 9.1925, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 1.24% (0.8239 => 0.8341, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.23% (3.1736 => 3.2127, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.14% (1.9290 => 1.9510, std. dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.87% (0.4657 => 0.4151, std. dev.: 0.0159) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.58% (22.5627 => 21.0788, std. dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.60% (0.8818 => 0.8677, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.88% (1.2308 => 1.0969, std. dev.: 0.0101) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.98% (20.3410 => 18.5137, std. dev.: 0.0542) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2638, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std. dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9129, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5851, std. dev.: 0.0086) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4474, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5017, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: -1.84% (3.0263 => 2.9705, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9984, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2578, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7953, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1450, std. dev.: 0.0213) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8661, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2186, std. dev.: 0.0385) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8044, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.15% (7.3305 => 7.2464, std. dev.: 0.0216) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2580, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8477, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 17:48:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 19:48:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120717004821.594702A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2124?compare_to=2122&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2124, Order: 160325, Start Time: 2012-07-16 23:30:25, End Time: 2012-07-17 00:48:32 To: 2122, Order: 160319, Start Time: 2012-07-16 21:44:14, End Time: 2012-07-16 23:02:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (67 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (787 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.38% (13.0978 => 12.9172, std. dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.60% (10.3673 => 12.9172, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.95% (1.1194 => 1.2532, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 11.49% (0.3473 => 0.3872, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.21% (0.3516 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3543 => 0.3938, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 11.06% (0.3543 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.64% (0.3694 => 0.4087, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.34% (0.3927 => 0.4333, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.27% (0.3886 => 0.4285, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.65% (1.7609 => 1.9133, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.48% (2.2022 => 2.3890, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 7.27% (0.1622 => 0.1740, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.42% (0.2065 => 0.2177, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 5.27% (0.5925 => 0.6237, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.22% (0.6030 => 0.6345, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 5.09% (0.3282 => 0.3449, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.84% (7.0540 => 7.3956, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.19% (0.7326 => 0.7633, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.81% (0.7433 => 0.7716, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.64% (0.4615 => 0.4783, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.26% (5.0018 => 5.1650, std. dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 3.21% (10.4361 => 10.7716, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.21% (4.9449 => 5.1036, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.10% (0.8172 => 0.8425, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 3.08% (9.4845 => 9.7768, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.05% (0.5569 => 0.5739, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 3.00% (0.4299 => 0.4428, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.79% (8.1363 => 8.3632, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.63% (0.5860 => 0.6014, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.60% (14.3668 => 14.7409, std. dev.: 0.0109) MultiSource/Applications/spiff/spiff: 2.59% (0.7835 => 0.8038, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.54% (4.2646 => 4.3728, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.25% (1.1861 => 1.2128, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.19% (1.5603 => 1.5944, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.16% (5.7591 => 5.8834, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.11% (0.8067 => 0.8237, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.03% (3.8723 => 3.9508, std. dev.: 0.0066) MultiSource/Applications/Burg/burg: 2.01% (1.1642 => 1.1876, std. dev.: 0.0068) MultiSource/Applications/treecc/treecc: 2.00% (2.0273 => 2.0679, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.00% (1.3050 => 1.3311, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 1.87% (3.3354 => 3.3979, std. dev.: 0.0133) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.65% (1.5415 => 1.5670, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.65% (1.4186 => 1.4420, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 1.56% (0.6456 => 0.6557, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.45% (2.0665 => 2.0964, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.42% (0.9765 => 0.9904, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.39% (17.1811 => 17.4207, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.21% (2.2024 => 2.2291, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.21% (1.1840 => 1.1983, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.07% (1.5859 => 1.6029, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7543, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5367, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 1.86% (26.0924 => 26.5769, std. dev.: 0.0704) SingleSource/Benchmarks/Shootout-C++/hash2: 1.74% (3.1578 => 3.2127, std. dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2414, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6897, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.90% (5.2763 => 3.1712, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.92% (5.3855 => 3.7205, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.72% (5.3526 => 3.7081, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.83% (2.9384 => 2.5613, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.37% (22.1758 => 19.8754, std. dev.: 0.0050) SingleSource/UnitTests/Vector/constpool: -5.11% (54.1659 => 51.4004, std. dev.: 0.0831) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.60% (3.8922 => 3.8300, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.53% (0.0998 => 0.0843, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.72% (1.2373 => 1.1170, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.39% (19.9488 => 18.6748, std. dev.: 0.0353) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.91% (8.1563 => 7.9193, std. dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6884, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0856, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: -1.09% (1.4460 => 1.4302, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 18:00:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 20:00:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120717010005.B03DB2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2125?compare_to=2120&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2125, Order: 160322, Start Time: 2012-07-16 22:16:43, End Time: 2012-07-17 01:00:17 To: 2120, Order: 160303, Start Time: 2012-07-16 19:04:51, End Time: 2012-07-16 21:48:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (44 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (848 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 6.46% (0.4087 => 0.4351, std. dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.49% (125.0664 => 130.6817, std. dev.: 0.4232) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 14.74% (0.3792 => 0.4351, std. dev.: 0.0092) SingleSource/UnitTests/ObjC/exceptions-2: 12.19% (0.3446 => 0.3866, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.15% (0.3465 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.14% (0.3442 => 0.3860, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.13% (0.3496 => 0.3920, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.08% (0.3460 => 0.3878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.07% (0.3488 => 0.3909, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 11.96% (0.3469 => 0.3884, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.67% (0.3650 => 0.4076, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.58% (0.3643 => 0.4065, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.25% (0.3724 => 0.4143, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5826 => 0.6182, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.65% (0.5889 => 0.6222, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.76% (1.6211 => 1.6982, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.47% (3.5627 => 3.7220, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 4.27% (0.7171 => 0.7477, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 4.24% (0.4029 => 0.4200, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.08% (0.4361 => 0.4539, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.97% (0.5900 => 0.6134, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.80% (0.5026 => 0.5217, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.72% (0.4994 => 0.5180, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.68% (1.3152 => 1.3636, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 3.50% (4.2109 => 4.3581, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.36% (0.3930 => 0.4062, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.27% (2.7292 => 2.8184, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.11% (1.9694 => 2.0306, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 3.06% (0.9909 => 1.0212, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.00% (0.5000 => 0.5150, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 2.94% (1.0781 => 1.1098, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 2.80% (0.9697 => 0.9969, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.73% (2.0673 => 2.1237, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.67% (1.9966 => 2.0500, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.49% (0.4658 => 0.4774, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (4.4195 => 4.5233, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 2.34% (2.1013 => 2.1504, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (2.1653 => 2.2148, std. dev.: 0.0115) MultiSource/Applications/SPASS/SPASS: 2.23% (5.5417 => 5.6654, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 2.22% (4.6177 => 4.7201, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.15% (0.7875 => 0.8044, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.11% (0.6634 => 0.6774, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 1.95% (1.8794 => 1.9160, std. dev.: 0.0072) MultiSource/Applications/lua/lua: 1.78% (1.4269 => 1.4523, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 1.66% (23.5202 => 23.9103, std. dev.: 0.0091) MultiSource/Applications/oggenc/oggenc: 1.21% (1.5932 => 1.6125, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.84% (2.4764 => 2.4060, std. dev.: 0.0259) MultiSource/Applications/kimwitu++/kc: -2.31% (11.9555 => 11.6798, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 18:45:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 20:45:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120717014537.A47FD2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2126?compare_to=2123&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2126, Order: 160329, Start Time: 2012-07-17 00:32:06, End Time: 2012-07-17 01:45:47 To: 2123, Order: 160323, Start Time: 2012-07-16 22:48:58, End Time: 2012-07-17 00:02:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (133 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (719 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.33% (54.2198 => 56.5649, std. dev.: 0.0886) SingleSource/Benchmarks/Misc/mandel-2: 2.01% (1.3804 => 1.4082, std. dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 1.52% (1.0969 => 1.1136, std. dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.49% (2.0176 => 2.2897, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference-object: 9.42% (0.5818 => 0.6366, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.29% (0.5748 => 0.6282, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.04% (0.7061 => 0.7699, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/trivial-interface: 8.89% (0.3578 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3646 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.58% (0.3650 => 0.3963, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3601 => 0.3909, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.45% (0.3623 => 0.3929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.44% (0.3663 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3789 => 0.4107, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.24% (0.4003 => 0.4333, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3914 => 0.4236, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.10% (0.3940 => 0.4259, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 6.97% (1.3693 => 1.4648, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.75% (0.1986 => 0.2120, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (0.4328 => 0.4614, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.55% (0.4062 => 0.4328, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.26% (0.2781 => 0.2955, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.17% (0.7710 => 0.8186, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2655 => 0.2817, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.07% (0.2782 => 0.2951, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.06% (0.2690 => 0.2853, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.02% (0.2607 => 0.2764, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.95% (0.7038 => 0.7457, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.89% (0.2937 => 0.3110, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.76% (0.2760 => 0.2919, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.74% (0.2596 => 0.2745, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.72% (0.5265 => 0.5566, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3022 => 0.3194, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.68% (0.2765 => 0.2922, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.65% (0.2761 => 0.2917, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.64% (0.2696 => 0.2848, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.63% (1.9828 => 2.0944, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.61% (0.2726 => 0.2879, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.60% (3.9660 => 4.1881, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.47% (0.3580 => 0.3776, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.46% (0.3899 => 0.4112, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.44% (0.3107 => 0.3276, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.34% (0.3149 => 0.3317, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.2721 => 0.2865, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.25% (0.3485 => 0.3668, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3453 => 0.3630, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.08% (0.3192 => 0.3354, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.05% (0.2988 => 0.3139, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.77% (0.3293 => 0.3450, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (0.3756 => 0.3934, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.74% (0.4390 => 0.4598, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.71% (0.6959 => 0.7287, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 4.52% (0.3868 => 0.4043, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.35% (0.2945 => 0.3073, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.35% (13.8202 => 14.4207, std. dev.: 0.0163) MultiSource/Applications/kimwitu++/kc: 4.33% (16.6129 => 17.3321, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.30% (0.9199 => 0.9595, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.24% (1.2193 => 1.2710, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.22% (0.4379 => 0.4564, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.03% (0.2925 => 0.3043, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.91% (0.2914 => 0.3028, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.89% (0.5577 => 0.5794, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.89% (13.2842 => 13.8007, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.85% (1.2292 => 1.2765, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.82% (1.4563 => 1.5120, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.80% (0.5637 => 0.5851, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.74% (1.1364 => 1.1789, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.72% (1.0594 => 1.0988, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.69% (1.3813 => 1.4323, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.3245 => 1.3734, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.69% (1.3819 => 1.4329, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 3.68% (0.7506 => 0.7782, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.67% (0.3246 => 0.3365, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.62% (0.3755 => 0.3891, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.52% (7.2180 => 7.4721, std. dev.: 0.0040) MultiSource/Applications/Burg/burg: 3.48% (1.1061 => 1.1446, std. dev.: 0.0051) MultiSource/Applications/treecc/treecc: 3.41% (1.9270 => 1.9927, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.40% (3.8646 => 3.9960, std. dev.: 0.0122) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4113 => 0.4247, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.12% (3.6692 => 3.7838, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.11% (0.4791 => 0.4940, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.11% (0.7460 => 0.7692, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.02% (0.8310 => 0.8561, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.91% (4.9865 => 5.1318, std. dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.87% (4.3801 => 4.5059, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.82% (0.8698 => 0.8943, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.73% (4.4433 => 4.5644, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 2.61% (6.5754 => 6.7470, std. dev.: 0.0040) MultiSource/Applications/siod/siod: 2.58% (2.1791 => 2.2354, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.54% (14.8535 => 15.2313, std. dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.35% (1.1333 => 1.1599, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.26% (0.6283 => 0.6425, std. dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 2.06% (16.2614 => 16.5967, std. dev.: 0.0270) MultiSource/Applications/ClamAV/clamscan: 1.99% (14.5298 => 14.8187, std. dev.: 0.0083) MultiSource/Applications/d/make_dparser: 1.95% (3.1889 => 3.2512, std. dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 1.83% (1.2749 => 1.2982, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (2.1007 => 2.1313, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.36% (8.4961 => 8.6117, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (3.2742 => 3.3139, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.10% (1.5188 => 1.5355, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.81% (0.4846 => 0.6969, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.58% (1.8175 => 2.2642, std. dev.: 0.0341) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.39% (2.0200 => 2.1894, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: 8.34% (1.2998 => 1.4082, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.42% (1.5824 => 1.6998, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7363, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6780, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4781, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.81% (3.6469 => 3.7130, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.47% (4.5928 => 4.6604, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9571, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.82% (22.5627 => 21.0239, std. dev.: 0.0197) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.36% (0.3511 => 0.3393, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.14% (0.8818 => 0.8629, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.52% (1.2308 => 1.1136, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.91% (20.3410 => 18.5290, std. dev.: 0.0391) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3155, std. dev.: 0.0078) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5504, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.19% (1.9762 => 1.9131, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5923, std. dev.: 0.0168) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4474, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5003, std. dev.: 0.0047) MultiSource/Applications/spiff/spiff: -1.83% (3.0263 => 2.9709, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2528, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.59% (26.5159 => 26.0932, std. dev.: 0.0255) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7945, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.39% (0.8342 => 0.8226, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2480, std. dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2431, std. dev.: 0.0076) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2266, std. dev.: 0.0329) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8043, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 19:34:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 21:34:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120717023444.1A10A2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2127?compare_to=2124&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2127, Order: 160332, Start Time: 2012-07-17 01:16:22, End Time: 2012-07-17 02:34:54 To: 2124, Order: 160325, Start Time: 2012-07-16 23:30:25, End Time: 2012-07-17 00:48:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (79 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (775 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.54% (12.9172 => 13.3741, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.19% (2.0964 => 2.1214, std. dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.00% (10.3673 => 13.3741, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 12.81% (0.3473 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.53% (0.3497 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.50% (0.3543 => 0.3986, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.46% (0.3516 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.42% (0.3543 => 0.3983, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.38% (0.3561 => 0.4002, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.94% (1.1194 => 1.2531, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.65% (0.3828 => 0.4274, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.48% (0.3886 => 0.4332, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.46% (0.3927 => 0.4377, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.91% (2.2022 => 2.3984, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.66% (1.7609 => 1.9134, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (0.1622 => 0.1737, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.34% (0.2065 => 0.2196, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 6.33% (0.5925 => 0.6300, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.32% (0.6030 => 0.6411, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.3177 => 0.3358, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 5.21% (0.3282 => 0.3453, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.15% (0.7326 => 0.7703, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.05% (7.0540 => 7.4101, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.4879 => 0.5123, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.10% (0.7433 => 0.7738, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.99% (0.4615 => 0.4799, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.77% (10.4361 => 10.8292, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.66% (0.8172 => 0.8471, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.52% (0.5569 => 0.5765, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.48% (4.9449 => 5.1172, std. dev.: 0.0106) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.44% (5.0018 => 5.1737, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 3.26% (9.4845 => 9.7933, std. dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.24% (0.3121 => 0.3222, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.15% (4.2646 => 4.3990, std. dev.: 0.0090) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.14% (0.7835 => 0.8081, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 3.11% (1.5603 => 1.6088, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 3.00% (0.4299 => 0.4428, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.00% (8.1363 => 8.3803, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.85% (0.3650 => 0.3754, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.75% (0.5860 => 0.6021, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.74% (0.3826 => 0.3931, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.71% (14.3668 => 14.7567, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.66% (2.0665 => 2.1214, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.58% (0.4103 => 0.4209, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.46% (2.0273 => 2.0772, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 2.45% (0.4289 => 0.4394, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.44% (0.4636 => 0.4749, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.41% (1.1861 => 1.2147, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.37% (1.3050 => 1.3359, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 2.23% (1.1642 => 1.1902, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.22% (0.8067 => 0.8246, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.6456 => 0.6599, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.11% (1.5415 => 1.5741, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.06% (0.5105 => 0.5210, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.05% (3.3354 => 3.4039, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 2.03% (3.8723 => 3.9508, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.01% (5.7591 => 5.8748, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.83% (1.4186 => 1.4446, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.81% (1.2842 => 1.3075, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.69% (0.6675 => 0.6788, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.60% (0.9765 => 0.9921, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.55% (0.6450 => 0.6550, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.42% (0.7115 => 0.7216, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.39% (1.1840 => 1.2005, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.38% (2.2024 => 2.2328, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.32% (17.1811 => 17.4073, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.13% (1.5859 => 1.6038, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.78% (1.1145 => 1.1901, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7473, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.21% (26.0924 => 26.6685, std. dev.: 0.0256) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (1.5086 => 1.5368, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 1.83% (3.1578 => 3.2157, std. dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/dry: 1.49% (2.4116 => 2.4476, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2296, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.17% (2.6546 => 2.6857, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.92% (5.2763 => 3.1701, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.93% (5.3855 => 3.7197, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.65% (5.3526 => 3.7122, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.04% (2.9384 => 2.5551, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -10.07% (22.1758 => 19.9417, std. dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3249, std. dev.: 0.0329) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.55% (3.8922 => 3.8317, std. dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.2373 => 1.1031, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.12% (19.9488 => 18.5294, std. dev.: 0.0666) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.78% (8.1563 => 7.9295, std. dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.53% (32.5116 => 31.6876, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0843, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: -1.10% (1.4460 => 1.4301, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 20:27:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 22:27:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120717032715.437C32A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2128?compare_to=2126&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2128, Order: 160334, Start Time: 2012-07-17 02:13:41, End Time: 2012-07-17 03:27:25 To: 2126, Order: 160329, Start Time: 2012-07-17 00:32:06, End Time: 2012-07-17 01:45:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (139 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (711 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.87% (77.9245 => 80.9410, std. dev.: 0.9512) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.29% (2.0176 => 2.3060, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 8.83% (0.5818 => 0.6332, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.65% (0.5748 => 0.6245, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.36% (0.3578 => 0.3877, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.06% (0.3646 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.03% (0.3650 => 0.3943, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 8.00% (0.3601 => 0.3889, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 8.00% (0.3789 => 0.4092, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.98% (0.3623 => 0.3912, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.94% (0.4003 => 0.4321, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.89% (0.3663 => 0.3952, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 7.87% (0.3914 => 0.4222, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.74% (0.3940 => 0.4245, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.73% (0.7061 => 0.7607, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.16% (1.3693 => 1.4673, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.80% (0.1986 => 0.2121, std. dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 6.32% (0.7038 => 0.7483, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4328 => 0.4596, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.97% (0.2596 => 0.2751, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.94% (0.5265 => 0.5578, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.94% (0.7710 => 0.8168, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.92% (0.2721 => 0.2882, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.92% (3.9660 => 4.2006, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash: 5.71% (0.4062 => 0.4294, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.36% (0.2782 => 0.2931, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.32% (0.2781 => 0.2929, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.26% (0.3022 => 0.3181, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.23% (0.6959 => 0.7323, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (1.9828 => 2.0857, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hello: 5.18% (0.2607 => 0.2742, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.16% (0.2655 => 0.2792, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.14% (0.2760 => 0.2902, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.13% (0.2690 => 0.2828, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (0.2628 => 0.2762, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.08% (0.3580 => 0.3762, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.07% (0.3489 => 0.3666, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.06% (0.2966 => 0.3116, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.03% (0.2726 => 0.2863, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.98% (0.3192 => 0.3351, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.97% (0.2937 => 0.3083, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 4.96% (0.2761 => 0.2898, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.95% (0.3899 => 0.4092, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.85% (0.2765 => 0.2899, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 4.80% (0.3107 => 0.3256, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 4.76% (0.3149 => 0.3299, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.72% (13.8202 => 14.4724, std. dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.68% (0.3485 => 0.3648, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3293 => 0.3447, std. dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: 4.63% (16.6129 => 17.3827, std. dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.56% (1.2193 => 1.2749, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/lists1: 4.56% (0.3534 => 0.3695, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.52% (0.2988 => 0.3123, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 4.46% (0.3453 => 0.3607, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.46% (0.9199 => 0.9609, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.33% (0.4016 => 0.4190, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.33% (1.0594 => 1.1053, std. dev.: 0.0100) MultiSource/Benchmarks/McCat/09-vor/vor: 4.27% (0.2925 => 0.3050, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.25% (0.5577 => 0.5814, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.25% (0.4379 => 0.4565, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.22% (13.2842 => 13.8453, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.22% (1.4563 => 1.5178, std. dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.21% (0.4390 => 0.4575, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (0.3756 => 0.3914, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.08% (0.2914 => 0.3033, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.08% (1.3245 => 1.3785, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.06% (0.3868 => 0.4025, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.05% (1.1364 => 1.1824, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.91% (1.3819 => 1.4360, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.89% (0.5637 => 0.5856, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.87% (1.3813 => 1.4347, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.85% (0.7506 => 0.7795, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.82% (0.3246 => 0.3370, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.79% (1.9270 => 2.0001, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.78% (1.1061 => 1.1479, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.2945 => 0.3055, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.68% (3.8646 => 4.0070, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.67% (7.2180 => 7.4830, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.49% (1.2292 => 1.2721, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.38% (0.4791 => 0.4953, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.38% (3.6692 => 3.7931, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/football/football: 3.37% (0.8310 => 0.8590, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.33% (0.4113 => 0.4250, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.28% (0.7460 => 0.7705, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.17% (0.3755 => 0.3874, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.10% (4.3801 => 4.5158, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.06% (4.9865 => 5.1393, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.01% (4.4433 => 4.5769, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 2.96% (6.5754 => 6.7700, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 2.95% (14.8535 => 15.2913, std. dev.: 0.0148) MultiSource/Applications/siod/siod: 2.91% (2.1791 => 2.2426, std. dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.71% (0.8698 => 0.8934, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.69% (1.1333 => 1.1638, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.63% (0.6283 => 0.6448, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.54% (0.6135 => 0.6291, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.43% (3.1889 => 3.2665, std. dev.: 0.0184) MultiSource/Applications/sqlite3/sqlite3: 2.37% (16.2614 => 16.6470, std. dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: 2.34% (14.5298 => 14.8692, std. dev.: 0.0112) MultiSource/Applications/SIBsim4/SIBsim4: 2.18% (1.2749 => 1.3027, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.92% (2.1007 => 2.1411, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (8.4961 => 8.6336, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.59% (3.2742 => 3.3263, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.47% (1.5188 => 1.5411, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 1.26% (4.6629 => 4.7218, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.12% (1.0313 => 1.0429, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.09% (1.8175 => 2.2736, std. dev.: 0.0197) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.42% (2.0200 => 2.1900, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.50% (1.0895 => 1.1712, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.34% (1.5824 => 1.6986, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.15% (1.2998 => 1.3797, std. dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.05% (7.4271 => 7.7277, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6782, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8296, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.04% (4.1080 => 4.1919, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.56% (3.6469 => 3.7039, std. dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5928 => 4.6635, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5089 => 1.5315, std. dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5105, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.24% (3.1736 => 3.2130, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.48% (0.4657 => 0.4076, std. dev.: 0.0134) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.43% (22.5627 => 21.1121, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.69% (0.8818 => 0.8669, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.62% (1.2308 => 1.1124, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (20.3410 => 18.6321, std. dev.: 0.0377) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3133, std. dev.: 0.0203) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9124, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4462, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4867 => 0.4748, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.42% (8.8259 => 8.6119, std. dev.: 0.0172) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.10% (6.6320 => 6.4929, std. dev.: 0.0097) MultiSource/Applications/spiff/spiff: -1.76% (3.0263 => 2.9730, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2475, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7954, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8618, std. dev.: 0.0023) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1461, std. dev.: 0.0348) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (0.8342 => 0.8228, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2130, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.31% (0.9692 => 0.9565, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2482, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -1.17% (7.3305 => 7.2450, std. dev.: 0.0076) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8046, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8489, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 21:11:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 23:11:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120717041130.2A6F62A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2129?compare_to=2125&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2129, Order: 160333, Start Time: 2012-07-17 01:28:20, End Time: 2012-07-17 04:11:41 To: 2125, Order: 160322, Start Time: 2012-07-16 22:16:43, End Time: 2012-07-17 01:00:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (840 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.15% (0.3446 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.13% (0.3465 => 0.3920, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3442 => 0.3893, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.09% (0.3460 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.04% (0.3496 => 0.3952, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.02% (0.3488 => 0.3942, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.00% (0.3469 => 0.3920, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/property: 12.58% (0.3650 => 0.4109, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.46% (0.3643 => 0.4097, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.03% (0.3724 => 0.4172, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.71% (0.5826 => 0.6217, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.38% (0.5889 => 0.6265, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.1620 => 0.1722, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.05% (0.7171 => 0.7533, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.86% (3.5627 => 3.7357, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.84% (1.6211 => 1.6995, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.52% (0.4029 => 0.4211, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.47% (0.4361 => 0.4556, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.44% (0.5900 => 0.6162, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.24% (0.5026 => 0.5239, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.14% (1.3152 => 1.3697, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.66% (0.3930 => 0.4074, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.66% (2.7292 => 2.8290, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.2866 => 0.2970, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.60% (0.4994 => 0.5174, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.56% (0.5000 => 0.5178, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 3.54% (4.2109 => 4.3601, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.30% (1.9694 => 2.0343, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 3.16% (0.9909 => 1.0222, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.16% (2.0673 => 2.1326, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.12% (0.3267 => 0.3369, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.04% (0.3317 => 0.3418, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.96% (1.9966 => 2.0557, std. dev.: 0.0052) MultiSource/Applications/d/make_dparser: 2.94% (1.0781 => 1.1098, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.86% (0.3845 => 0.3955, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.80% (0.3890 => 0.3999, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 2.80% (0.3678 => 0.3781, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.77% (0.4658 => 0.4787, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (0.3625 => 0.3725, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (2.1013 => 2.1583, std. dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 2.58% (5.5417 => 5.6848, std. dev.: 0.0121) MultiSource/Applications/hbd/hbd: 2.58% (0.9697 => 0.9947, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (4.4195 => 4.5333, std. dev.: 0.0129) MultiSource/Applications/JM/ldecod/ldecod: 2.48% (2.1653 => 2.2189, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 2.35% (1.8794 => 1.9236, std. dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: 2.35% (4.6177 => 4.7261, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 2.34% (23.5202 => 24.0706, std. dev.: 0.0153) MultiSource/Applications/treecc/treecc: 2.23% (0.7875 => 0.8051, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.07% (1.4269 => 1.4565, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.03% (0.6634 => 0.6769, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 1.82% (0.5546 => 0.5647, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.76% (0.6435 => 0.6548, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 1.26% (1.5932 => 1.6132, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.92% (11.9555 => 11.7256, std. dev.: 0.0139) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 21:21:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 16 Jul 2012 23:21:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120717042112.88F572A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2130?compare_to=2127&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2130, Order: 160334, Start Time: 2012-07-17 03:02:51, End Time: 2012-07-17 04:21:22 To: 2127, Order: 160332, Start Time: 2012-07-17 01:16:22, End Time: 2012-07-17 02:34:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (81 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (773 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.40% (0.8471 => 0.8590, std. dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.82% (10.3673 => 13.3555, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/trivial-interface: 13.07% (0.3473 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.78% (0.3497 => 0.3944, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3543 => 0.3994, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-3: 12.68% (0.3516 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3543 => 0.3992, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.58% (0.3561 => 0.4009, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.10% (0.3694 => 0.4141, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.83% (0.3828 => 0.4281, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.76% (0.3927 => 0.4389, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.63% (0.3886 => 0.4338, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.60% (1.1194 => 1.2492, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.83% (2.2022 => 2.3966, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.13% (1.7609 => 1.9041, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.15% (0.1622 => 0.1738, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.40% (0.5925 => 0.6304, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.34% (0.2065 => 0.2196, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.24% (0.6030 => 0.6406, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.57% (0.3177 => 0.3354, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 5.27% (0.3282 => 0.3455, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.12% (0.8172 => 0.8590, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.11% (0.7326 => 0.7700, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (7.0540 => 7.4011, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.90% (0.4879 => 0.5118, std. dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.13% (0.3121 => 0.3250, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.08% (0.7433 => 0.7736, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.03% (0.4615 => 0.4801, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.61% (0.5569 => 0.5770, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 3.51% (10.4361 => 10.8022, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.47% (4.9449 => 5.1167, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.42% (5.0018 => 5.1731, std. dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (9.4845 => 9.7985, std. dev.: 0.0065) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.15% (1.5603 => 1.6095, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 3.11% (0.7835 => 0.8079, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 3.09% (0.4299 => 0.4432, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.07% (8.1363 => 8.3860, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.92% (0.5860 => 0.6031, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.91% (4.2646 => 4.3886, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.88% (0.3650 => 0.3755, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.86% (2.0665 => 2.1256, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.85% (0.4103 => 0.4220, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.82% (0.3826 => 0.3934, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.77% (14.3668 => 14.7654, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3865 => 0.3970, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.59% (1.1861 => 1.2168, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.53% (0.4064 => 0.4167, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.48% (0.4636 => 0.4751, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 2.46% (2.0273 => 2.0772, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 2.40% (0.4620 => 0.4731, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.35% (1.5415 => 1.5778, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.35% (1.1642 => 1.1916, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.33% (1.3050 => 1.3354, std. dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 2.33% (5.7591 => 5.8932, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/bigfib: 2.29% (0.6456 => 0.6604, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.28% (0.8067 => 0.8251, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.21% (3.3354 => 3.4092, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.06% (3.8723 => 3.9521, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.98% (0.5105 => 0.5206, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.95% (1.2842 => 1.3092, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.85% (1.4186 => 1.4449, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.72% (0.9765 => 0.9933, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.71% (0.6450 => 0.6560, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.60% (0.6675 => 0.6782, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.46% (0.7115 => 0.7219, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.40% (1.1840 => 1.2006, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.40% (2.2024 => 2.2332, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.37% (17.1811 => 17.4160, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.27% (1.5859 => 1.6061, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7491, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.15% (26.0924 => 26.6533, std. dev.: 0.0502) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (1.5086 => 1.5369, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 1.60% (3.1578 => 3.2084, std. dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6903, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2368, std. dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.88% (5.2763 => 3.1721, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.15% (5.3855 => 3.7079, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.84% (5.3526 => 3.7019, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.32% (2.9384 => 2.5469, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -10.31% (22.1758 => 19.8905, std. dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3280, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.68% (3.8922 => 3.8268, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.13% (1.2373 => 1.1119, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.59% (19.9488 => 18.4337, std. dev.: 0.0877) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9206, std. dev.: 0.0070) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6860, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0855, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.07% (1.4460 => 1.4306, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 23:10:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 01:10:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120717061030.524252A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2131?compare_to=2128&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2131, Order: 160339, Start Time: 2012-07-17 04:56:49, End Time: 2012-07-17 06:10:39 To: 2128, Order: 160334, Start Time: 2012-07-17 02:13:41, End Time: 2012-07-17 03:27:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (136 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (715 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.20% (2.0176 => 2.3040, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.49% (0.5818 => 0.6312, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.33% (0.5748 => 0.6227, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.60% (0.3578 => 0.3850, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.42% (0.7061 => 0.7585, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: 7.40% (0.3623 => 0.3891, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.36% (0.3601 => 0.3866, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.32% (0.3650 => 0.3917, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 7.31% (0.3789 => 0.4066, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.30% (0.3646 => 0.3912, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.29% (0.3663 => 0.3930, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.28% (0.3130 => 0.3358, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.26% (0.3914 => 0.4198, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.18% (0.3940 => 0.4223, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.14% (0.4003 => 0.4289, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.46% (1.3693 => 1.4578, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.45% (0.1986 => 0.2114, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.21% (0.7038 => 0.7475, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.86% (0.2596 => 0.2748, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.79% (0.5265 => 0.5570, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.75% (3.9660 => 4.1940, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.73% (0.2721 => 0.2877, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.64% (0.4328 => 0.4572, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.49% (0.7710 => 0.8133, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 5.19% (0.4062 => 0.4273, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.10% (0.6959 => 0.7314, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 5.03% (0.2781 => 0.2921, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.82% (0.2782 => 0.2916, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.78% (0.2760 => 0.2892, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.77% (0.3022 => 0.3166, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.72% (0.2607 => 0.2730, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.69% (0.3580 => 0.3748, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.67% (0.2655 => 0.2779, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.65% (0.2690 => 0.2815, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.9828 => 2.0745, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.62% (0.9199 => 0.9624, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.62% (0.3899 => 0.4079, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 4.59% (0.2726 => 0.2851, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.59% (0.2966 => 0.3102, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 4.57% (0.2628 => 0.2748, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.56% (0.3489 => 0.3648, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.55% (13.8202 => 14.4493, std. dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.52% (0.2765 => 0.2890, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.49% (0.4390 => 0.4587, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.46% (0.2937 => 0.3068, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.43% (1.2193 => 1.2733, std. dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: 4.42% (16.6129 => 17.3480, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/methcall: 4.42% (0.2761 => 0.2883, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 4.42% (0.3192 => 0.3333, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (0.3149 => 0.3288, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.39% (0.3485 => 0.3638, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.35% (0.3107 => 0.3242, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.34% (0.2696 => 0.2813, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.25% (0.3293 => 0.3433, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.22% (0.2988 => 0.3114, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/sieve: 4.20% (0.3453 => 0.3598, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.18% (0.4379 => 0.4562, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.16% (13.2842 => 13.8371, std. dev.: 0.0323) MultiSource/Benchmarks/nbench/nbench: 4.13% (1.0594 => 1.1032, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.13% (0.4016 => 0.4182, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.03% (0.2925 => 0.3043, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.02% (0.3534 => 0.3676, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.5577 => 0.5799, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3756 => 0.3905, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.95% (0.2914 => 0.3029, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.94% (1.3245 => 1.3767, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.94% (0.5637 => 0.5859, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.89% (1.4563 => 1.5130, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.89% (1.3819 => 1.4356, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.88% (1.1364 => 1.1805, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.85% (0.3246 => 0.3371, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.82% (0.7506 => 0.7793, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.77% (0.3868 => 0.4014, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.76% (1.3813 => 1.4333, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: 3.59% (3.8646 => 4.0032, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 3.54% (1.9270 => 1.9953, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 3.50% (1.1061 => 1.1448, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.42% (7.2180 => 7.4652, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.34% (0.4791 => 0.4951, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (0.8310 => 0.8586, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.22% (0.7460 => 0.7700, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.20% (3.6692 => 3.7865, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 3.19% (0.4113 => 0.4244, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.04% (1.2292 => 1.2666, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.00% (4.3801 => 4.5116, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.96% (4.9865 => 5.1340, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.94% (6.5754 => 6.7684, std. dev.: 0.0101) MultiSource/Applications/JM/lencod/lencod: 2.86% (14.8535 => 15.2776, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.82% (4.4433 => 4.5686, std. dev.: 0.0040) MultiSource/Applications/siod/siod: 2.74% (2.1791 => 2.2388, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3755 => 0.3856, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.52% (1.1333 => 1.1619, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.52% (0.8698 => 0.8917, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 2.46% (1.2749 => 1.3063, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.44% (0.6135 => 0.6285, std. dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 2.40% (16.2614 => 16.6517, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.37% (0.6283 => 0.6432, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.30% (3.1889 => 3.2623, std. dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 2.17% (14.5298 => 14.8451, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.70% (2.1007 => 2.1365, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (8.4961 => 8.6263, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.49% (3.2742 => 3.3231, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.47% (1.5188 => 1.5411, std. dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: 1.19% (4.6629 => 4.7182, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/fbench: 25.46% (1.8175 => 2.2802, std. dev.: 0.0423) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1912, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.49% (1.0895 => 1.1711, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 7.02% (1.2998 => 1.3910, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.27% (7.4271 => 7.7441, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9196, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6790, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.05% (4.1080 => 4.1922, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (3.6469 => 3.7094, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (1.5089 => 1.5321, std. dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5928 => 4.6630, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1963, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.23% (3.1736 => 3.2127, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9663, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.03% (0.4657 => 0.3957, std. dev.: 0.0114) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.43% (22.5627 => 21.1108, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.77% (0.8818 => 0.8662, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.47% (1.2308 => 1.1143, std. dev.: 0.0268) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.98% (20.3410 => 18.5149, std. dev.: 0.0324) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.10% (1.3780 => 1.3077, std. dev.: 0.0086) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9123, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5986, std. dev.: 0.0129) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4473, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5072, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: -1.81% (3.0263 => 2.9715, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9980, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2576, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (28.2225 => 27.7923, std. dev.: 0.0026) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1217, std. dev.: 0.0353) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (0.8342 => 0.8227, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2157, std. dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2510, std. dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2407, std. dev.: 0.0107) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.15% (9.9194 => 9.8051, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 16 23:14:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 01:14:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120717061446.D91AB2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2132?compare_to=2130&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2132, Order: 160339, Start Time: 2012-07-17 04:56:45, End Time: 2012-07-17 06:14:58 To: 2130, Order: 160334, Start Time: 2012-07-17 03:02:51, End Time: 2012-07-17 04:21:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (79 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (776 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.66% (0.8590 => 0.8447, std. dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.79% (10.3673 => 13.3521, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 12.53% (0.3473 => 0.3908, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.19% (0.3543 => 0.3975, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.18% (0.3497 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.08% (0.3543 => 0.3971, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.05% (1.1194 => 1.2543, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 12.03% (0.3516 => 0.3939, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3561 => 0.3988, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.69% (0.3694 => 0.4126, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.21% (0.3828 => 0.4257, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.09% (0.3886 => 0.4317, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.08% (0.3927 => 0.4362, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.03% (2.2022 => 2.4010, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.65% (1.7609 => 1.9132, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.86% (0.3817 => 0.4117, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (0.1622 => 0.1737, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.14% (0.6030 => 0.6400, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5925 => 0.6287, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.96% (0.2065 => 0.2188, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.63% (0.3177 => 0.3356, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.16% (0.4879 => 0.5131, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 5.12% (0.3282 => 0.3450, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 4.97% (0.7326 => 0.7690, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.94% (7.0540 => 7.4022, std. dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.36% (0.4615 => 0.4816, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.18% (0.7433 => 0.7744, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.5569 => 0.5771, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 3.49% (10.4361 => 10.8001, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.43% (4.9449 => 5.1144, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.37% (5.0018 => 5.1706, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.37% (0.8172 => 0.8447, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 3.21% (9.4845 => 9.7890, std. dev.: 0.0160) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.20% (0.3121 => 0.3221, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 3.12% (1.5603 => 1.6090, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 2.98% (0.4299 => 0.4427, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.91% (8.1363 => 8.3732, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.87% (0.7835 => 0.8060, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.82% (0.5860 => 0.6025, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 2.80% (0.3603 => 0.3704, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.80% (4.2646 => 4.3839, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.79% (0.3650 => 0.3752, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.74% (0.3826 => 0.3931, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (14.3668 => 14.7598, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.71% (2.0665 => 2.1224, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3865 => 0.3969, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.56% (0.4103 => 0.4208, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.52% (0.4636 => 0.4753, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.1861 => 1.2157, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 2.49% (0.4289 => 0.4396, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 2.40% (5.7591 => 5.8974, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.36% (0.8067 => 0.8257, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.30% (1.5415 => 1.5769, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 2.28% (0.6456 => 0.6603, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.26% (1.3050 => 1.3345, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.25% (1.1642 => 1.1904, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 2.22% (2.0273 => 2.0724, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 2.10% (3.3354 => 3.4055, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.08% (0.5105 => 0.5211, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.04% (3.8723 => 3.9513, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.4186 => 1.4433, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.64% (0.9765 => 0.9925, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.58% (0.6450 => 0.6552, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.54% (0.6675 => 0.6778, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.40% (2.2024 => 2.2333, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.37% (1.1840 => 1.2002, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.35% (17.1811 => 17.4128, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.27% (1.5859 => 1.6060, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.79% (1.1145 => 1.1902, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.13% (3.6395 => 3.7533, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.24% (26.0924 => 26.6771, std. dev.: 0.0170) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (1.5086 => 1.5382, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 1.62% (3.1578 => 3.2088, std. dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4472, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2332, std. dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6885, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.79% (5.2763 => 3.1767, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.94% (5.3855 => 3.7192, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.64% (5.3526 => 3.7124, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.75% (2.9384 => 2.5638, std. dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: -10.08% (22.1758 => 19.9412, std. dev.: 0.0072) SingleSource/UnitTests/Vector/constpool: -5.20% (54.1659 => 51.3498, std. dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.58% (3.8922 => 3.8306, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.72% (1.2373 => 1.1047, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.79% (19.9488 => 18.5945, std. dev.: 0.0721) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9135, std. dev.: 0.0092) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.54% (32.5116 => 31.6852, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0834, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.06% (1.3677 => 1.3532, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 00:26:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 02:26:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120717072616.265C92A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2133?compare_to=2129&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2133, Order: 160334, Start Time: 2012-07-17 04:39:39, End Time: 2012-07-17 07:26:27 To: 2129, Order: 160333, Start Time: 2012-07-17 01:28:20, End Time: 2012-07-17 04:11:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (831 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 21.49% (0.3792 => 0.4607, std. dev.: 0.0292) SingleSource/UnitTests/ObjC/for-in: 13.53% (0.3496 => 0.3969, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 13.46% (0.3446 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.42% (0.3465 => 0.3930, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 13.36% (0.3442 => 0.3902, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.30% (0.3488 => 0.3952, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.20% (0.3469 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.93% (0.3650 => 0.4122, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: 12.74% (0.3643 => 0.4107, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.38% (0.3724 => 0.4185, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.66% (0.5826 => 0.6214, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.1620 => 0.1726, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 6.32% (0.5889 => 0.6261, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.16% (1.6211 => 1.7047, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.05% (3.5627 => 3.7426, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 4.91% (0.7171 => 0.7523, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.85% (0.5900 => 0.6186, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.71% (1.3152 => 1.3772, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.59% (0.4361 => 0.4561, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.55% (0.3930 => 0.4109, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.50% (0.5026 => 0.5252, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.49% (0.4994 => 0.5218, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.06% (2.7292 => 2.8401, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: 3.85% (0.2725 => 0.2830, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 3.80% (0.2714 => 0.2817, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.77% (0.2729 => 0.2832, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.76% (0.2875 => 0.2983, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.73% (0.2738 => 0.2840, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (0.4658 => 0.4830, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/random: 3.67% (0.2803 => 0.2906, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.64% (0.5000 => 0.5182, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.60% (1.9694 => 2.0402, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.56% (0.2866 => 0.2968, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 3.55% (0.3096 => 0.3206, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 3.46% (0.3004 => 0.3108, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.40% (2.0673 => 2.1376, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary: 3.38% (0.3258 => 0.3368, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.37% (0.3267 => 0.3377, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.32% (0.3195 => 0.3301, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.26% (0.3890 => 0.4017, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.26% (1.9966 => 2.0616, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.23% (0.3903 => 0.4029, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.22% (0.3845 => 0.3969, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.21% (0.3362 => 0.3470, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 3.21% (0.3678 => 0.3796, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.17% (0.3726 => 0.3844, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.17% (0.3317 => 0.3422, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (4.4195 => 4.5549, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.02% (2.1013 => 2.1647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.02% (0.3348 => 0.3449, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.01% (0.3625 => 0.3734, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.83% (23.5202 => 24.1860, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3690 => 0.3791, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.71% (0.4139 => 0.4251, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.70% (0.4146 => 0.4258, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 2.67% (1.8794 => 1.9295, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 2.63% (0.4251 => 0.4363, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.13% (0.5012 => 0.5119, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (0.6435 => 0.6558, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.06% (2.8036 => 2.8332, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.40% (2.4764 => 2.3921, std. dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: -1.73% (11.9555 => 11.7489, std. dev.: 0.0426) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 00:55:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 02:55:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120717075503.3824D3524028@llvm.org> http://llvm.org/perf/db_default/v4/nts/2134?compare_to=2131&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2134, Order: 160344, Start Time: 2012-07-17 06:38:40, End Time: 2012-07-17 07:55:13 To: 2131, Order: 160339, Start Time: 2012-07-17 04:56:49, End Time: 2012-07-17 06:10:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (127 on baseline) Performance Improvements: 3 (33 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (730 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: -2.69% (1.3063 => 1.2712, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -1.14% (1.8304 => 1.8095, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -1.09% (2.9715 => 2.9390, std. dev.: 0.0100) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.11% (2.0176 => 2.3225, std. dev.: 0.0387) SingleSource/UnitTests/ObjC++/property-reference: 9.23% (0.7061 => 0.7713, std. dev.: 0.0206) SingleSource/UnitTests/ObjC++/property-reference-object: 9.16% (0.5818 => 0.6351, std. dev.: 0.0089) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5748 => 0.6267, std. dev.: 0.0111) SingleSource/UnitTests/ObjC/trivial-interface: 8.97% (0.3578 => 0.3899, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/for-in: 8.71% (0.3789 => 0.4119, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-2: 8.69% (0.3601 => 0.3914, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3646 => 0.3961, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.58% (0.3650 => 0.3963, std. dev.: 0.0080) SingleSource/UnitTests/ObjC/exceptions-3: 8.47% (0.3623 => 0.3930, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/synchronized: 8.41% (0.3663 => 0.3971, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions: 8.41% (0.3914 => 0.4243, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/parameter-passing: 8.37% (0.4003 => 0.4338, std. dev.: 0.0087) SingleSource/UnitTests/ObjC/property: 8.17% (0.3940 => 0.4262, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.48% (0.3130 => 0.3364, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.38% (1.3693 => 1.4703, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.00% (0.1986 => 0.2125, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 6.72% (0.4062 => 0.4335, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 6.44% (0.7038 => 0.7491, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.34% (3.9660 => 4.2174, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.32% (0.2721 => 0.2893, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.31% (0.4328 => 0.4601, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.28% (0.7710 => 0.8194, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.2596 => 0.2756, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.13% (0.5265 => 0.5588, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.79% (0.2782 => 0.2943, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.59% (0.3022 => 0.3191, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hello: 5.52% (0.2607 => 0.2751, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.47% (0.6959 => 0.7340, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2690 => 0.2837, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 5.43% (0.2761 => 0.2911, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.33% (1.9828 => 2.0885, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.33% (0.2966 => 0.3124, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 5.28% (0.2937 => 0.3092, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.21% (0.2726 => 0.2868, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.21% (0.3899 => 0.4102, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 5.15% (0.2988 => 0.3142, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 5.14% (0.3149 => 0.3311, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4379 => 0.4604, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: 5.14% (0.3192 => 0.3356, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.13% (1.2193 => 1.2818, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2696 => 0.2833, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 5.04% (0.3453 => 0.3627, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 4.97% (13.8202 => 14.5076, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.86% (0.4016 => 0.4211, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 4.83% (0.3293 => 0.3452, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 4.79% (16.6129 => 17.4092, std. dev.: 0.0353) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.78% (0.9199 => 0.9639, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.70% (0.2914 => 0.3051, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.61% (0.5577 => 0.5834, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 4.58% (0.3868 => 0.4045, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: 4.53% (0.3534 => 0.3694, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 4.41% (0.2925 => 0.3054, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.41% (1.4563 => 1.5205, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.41% (1.0594 => 1.1061, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.37% (1.3245 => 1.3824, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.37% (13.2842 => 13.8643, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.30% (1.1364 => 1.1853, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.30% (1.3813 => 1.4407, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.30% (1.3819 => 1.4413, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.16% (0.3246 => 0.3381, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.12% (0.5637 => 0.5869, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.10% (0.7506 => 0.7814, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2945 => 0.3065, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.03% (0.7460 => 0.7761, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (0.8310 => 0.8642, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.99% (1.1061 => 1.1502, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 3.97% (3.8646 => 4.0181, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.93% (7.2180 => 7.5016, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 3.90% (1.9270 => 2.0021, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.80% (3.6692 => 3.8086, std. dev.: 0.0105) MultiSource/Applications/hexxagon/hexxagon: 3.76% (1.2292 => 1.2754, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.53% (0.4791 => 0.4960, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.50% (4.3801 => 4.5336, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.39% (4.4433 => 4.5941, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/18-imp/imp: 3.35% (0.3220 => 0.3328, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.23% (4.9865 => 5.1477, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.22% (0.3755 => 0.3876, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 3.12% (2.1791 => 2.2471, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.89% (0.8698 => 0.8949, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 2.87% (0.4113 => 0.4231, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.85% (1.1333 => 1.1656, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.74% (0.6283 => 0.6455, std. dev.: 0.0048) MultiSource/Applications/d/make_dparser: 2.69% (3.1889 => 3.2746, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.66% (6.5754 => 6.7500, std. dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 2.53% (14.8535 => 15.2299, std. dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 2.50% (16.2614 => 16.6686, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.48% (0.6135 => 0.6287, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 2.45% (14.5298 => 14.8865, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (3.2742 => 3.3510, std. dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.28% (2.1007 => 2.1487, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.06% (1.5188 => 1.5501, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.66% (0.6744 => 0.6856, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.28% (1.0313 => 1.0445, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 1.18% (4.6629 => 4.7180, std. dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.14% (0.9108 => 0.9212, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.90% (1.8175 => 2.2701, std. dev.: 0.0323) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.51% (2.0200 => 2.1920, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.51% (1.0895 => 1.1713, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (1.5824 => 1.6993, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: 6.90% (1.2998 => 1.3895, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.05% (7.4271 => 7.7277, std. dev.: 0.0071) MultiSource/Benchmarks/nbench/nbench: 3.89% (11.2619 => 11.7005, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.79% (12.4560 => 12.9278, std. dev.: 0.0304) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9772, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0310 => 1.0561, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.30% (1.7688 => 1.8095, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1898, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.63% (3.6469 => 3.7065, std. dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.07% (3.1736 => 3.2076, std. dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.31% (22.5627 => 21.1387, std. dev.: 0.3267) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.85% (0.0997 => 0.0839, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -9.72% (1.2308 => 1.1112, std. dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.26% (20.3410 => 18.4573, std. dev.: 0.0675) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.55% (1.3780 => 1.3153, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9125, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.88% (3.0263 => 2.9390, std. dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.8259 => 8.5725, std. dev.: 0.0142) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4475, std. dev.: 0.0138) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5003, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.88% (0.8342 => 0.8185, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.68% (6.3560 => 6.2490, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.54% (2.5254 => 2.4864, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.54% (26.5159 => 26.1083, std. dev.: 0.0290) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (28.2225 => 27.7967, std. dev.: 0.1463) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.35% (0.9692 => 0.9561, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8045, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2556, std. dev.: 0.0049) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2331, std. dev.: 0.0167) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 01:04:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 03:04:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120717080403.03B2D2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2135?compare_to=2132&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2135, Order: 160344, Start Time: 2012-07-17 06:42:58, End Time: 2012-07-17 08:04:13 To: 2132, Order: 160339, Start Time: 2012-07-17 04:56:45, End Time: 2012-07-17 06:14:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (49 on baseline) Performance Improvements: 2 (20 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (804 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/spiff/spiff: -1.20% (2.9570 => 2.9216, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.14% (1.8309 => 1.8101, std. dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.93% (10.3673 => 13.1594, std. dev.: 0.1317) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.99% (1.1194 => 1.2536, std. dev.: 0.0269) SingleSource/UnitTests/ObjC/trivial-interface: 11.11% (0.3473 => 0.3859, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3543 => 0.3927, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 10.78% (0.3497 => 0.3874, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.64% (0.3516 => 0.3890, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.61% (0.3543 => 0.3919, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.50% (0.3561 => 0.3935, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.29% (0.3694 => 0.4074, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.90% (0.3828 => 0.4207, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.86% (0.3886 => 0.4269, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.75% (0.3927 => 0.4310, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.74% (1.7609 => 1.9148, std. dev.: 0.0288) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.45% (2.2022 => 2.3882, std. dev.: 0.0389) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.53% (0.4879 => 0.5149, std. dev.: 0.0077) SingleSource/UnitTests/ObjC++/Hello: 5.30% (0.5925 => 0.6239, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 5.13% (0.7326 => 0.7702, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 5.12% (0.6030 => 0.6339, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 4.63% (0.3282 => 0.3434, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.36% (0.7433 => 0.7757, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (9.4845 => 9.8201, std. dev.: 0.0156) MultiSource/Applications/spiff/spiff: 3.52% (0.7835 => 0.8111, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 3.04% (1.5603 => 1.6078, std. dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: 2.78% (10.4361 => 10.7266, std. dev.: 0.0373) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.31% (0.4636 => 0.4743, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.17% (2.0273 => 2.0712, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 2.03% (3.3354 => 3.4031, std. dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 1.80% (5.7591 => 5.8628, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 1.73% (3.8723 => 3.9393, std. dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/bigfib: 1.67% (0.6456 => 0.6564, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 1.63% (17.1811 => 17.4604, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.49% (1.5859 => 1.6095, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.38% (2.2024 => 2.2329, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 1.05% (1.2842 => 1.2977, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.89% (1.1145 => 1.1913, std. dev.: 0.0062) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7474, std. dev.: 0.0083) MultiSource/Applications/lua/lua: 2.21% (26.0924 => 26.6698, std. dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.02% (1.0313 => 1.0521, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 1.70% (3.1578 => 3.2114, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.43% (11.6436 => 11.8096, std. dev.: 0.0172) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2322, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.21% (2.6546 => 2.6866, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.13% (1.3045 => 1.3193, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 1.11% (6.6465 => 6.7202, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1307, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.14% (5.2763 => 3.1586, std. dev.: 0.0325) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.02% (5.3855 => 3.7151, std. dev.: 0.0602) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.68% (5.3526 => 3.7102, std. dev.: 0.0503) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.10% (2.9384 => 2.5535, std. dev.: 0.0576) MultiSource/Applications/ClamAV/clamscan: -10.33% (22.1758 => 19.8856, std. dev.: 0.0502) SingleSource/UnitTests/Vector/constpool: -5.27% (54.1659 => 51.3098, std. dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.40% (3.8922 => 3.8379, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.23% (0.0998 => 0.0836, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -9.83% (1.2373 => 1.1157, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.97% (19.9488 => 18.5580, std. dev.: 0.0484) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.77% (8.1563 => 7.9301, std. dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.58% (32.5116 => 31.6738, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/salsa20: -1.97% (10.2830 => 10.0809, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.24% (1.8329 => 1.8101, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.02% (1.4460 => 1.4313, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 02:37:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 04:37:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120717093728.004ED2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2136?compare_to=2134&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2136, Order: 160350, Start Time: 2012-07-17 08:23:33, End Time: 2012-07-17 09:37:39 To: 2134, Order: 160344, Start Time: 2012-07-17 06:38:40, End Time: 2012-07-17 07:55:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (139 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (716 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 1.56% (31.5565 => 32.0495, std. dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.39% (55.7444 => 56.5211, std. dev.: 0.0539) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.30% (1.1713 => 1.0975, std. dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.31% (2.0176 => 2.3265, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.95% (0.5818 => 0.6339, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.80% (0.5748 => 0.6254, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.08% (0.3578 => 0.3867, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.89% (0.7061 => 0.7618, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-2: 7.86% (0.3601 => 0.3884, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.84% (0.3646 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.81% (0.3663 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.78% (0.3650 => 0.3934, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.76% (0.3130 => 0.3373, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.76% (0.3789 => 0.4083, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.70% (0.3623 => 0.3902, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.69% (0.3914 => 0.4215, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.64% (1.3693 => 1.4739, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: 7.57% (0.4003 => 0.4306, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.51% (0.3940 => 0.4236, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.65% (0.1986 => 0.2118, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 6.59% (0.7038 => 0.7502, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (3.9660 => 4.2218, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.38% (0.5265 => 0.5601, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash2: 6.33% (0.4328 => 0.4602, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.24% (0.2596 => 0.2758, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.20% (0.7710 => 0.8188, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.17% (0.2721 => 0.2889, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.93% (0.2781 => 0.2946, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.4062 => 0.4303, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 5.72% (0.2760 => 0.2918, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.72% (0.2782 => 0.2941, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.70% (0.2966 => 0.3135, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3022 => 0.3194, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.66% (1.9828 => 2.0951, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 5.65% (0.2761 => 0.2917, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2607 => 0.2754, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.59% (0.3580 => 0.3780, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.58% (0.2937 => 0.3101, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.46% (0.2655 => 0.2800, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.45% (0.6959 => 0.7338, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/fibo: 5.44% (0.2628 => 0.2771, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.4379 => 0.4616, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.3107 => 0.3275, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.39% (0.2765 => 0.2914, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.34% (0.3149 => 0.3317, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3489 => 0.3675, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.26% (0.3899 => 0.4104, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 5.22% (0.2988 => 0.3144, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.14% (1.2193 => 1.2820, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 5.04% (0.3192 => 0.3353, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.02% (0.3485 => 0.3660, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.01% (0.3453 => 0.3626, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.96% (13.8202 => 14.5051, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.92% (0.9199 => 0.9652, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.86% (0.4016 => 0.4211, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.76% (16.6129 => 17.4030, std. dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.72% (0.5577 => 0.5840, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.70% (0.2914 => 0.3051, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.69% (0.4390 => 0.4596, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.62% (1.3245 => 1.3857, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.58% (0.2925 => 0.3059, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (13.2842 => 13.8923, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 4.56% (0.3534 => 0.3695, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3293 => 0.3443, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.3868 => 0.4044, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.45% (1.1364 => 1.1870, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.41% (1.0594 => 1.1061, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.39% (1.4563 => 1.5203, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.36% (0.5637 => 0.5883, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.28% (1.3819 => 1.4410, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 4.28% (0.7506 => 0.7827, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.24% (0.2945 => 0.3070, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.18% (0.8310 => 0.8657, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.16% (1.3813 => 1.4388, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.13% (0.3246 => 0.3380, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.07% (7.2180 => 7.5115, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 4.03% (1.1061 => 1.1507, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 4.03% (3.8646 => 4.0202, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 3.92% (1.9270 => 2.0026, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.81% (1.2292 => 1.2760, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.72% (3.6692 => 3.8057, std. dev.: 0.0104) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.62% (0.7460 => 0.7730, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.48% (4.4433 => 4.5978, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 3.46% (2.1791 => 2.2546, std. dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: 3.44% (0.2995 => 0.3098, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3220 => 0.3329, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.38% (4.3801 => 4.5283, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.33% (0.3755 => 0.3880, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.32% (0.4791 => 0.4950, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.09% (4.9865 => 5.1406, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.91% (1.1333 => 1.1663, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.90% (0.8698 => 0.8950, std. dev.: 0.0058) MultiSource/Applications/d/make_dparser: 2.85% (3.1889 => 3.2797, std. dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 2.83% (16.2614 => 16.7224, std. dev.: 0.0145) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (6.5754 => 6.7593, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.79% (0.6283 => 0.6458, std. dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 2.78% (14.8535 => 15.2665, std. dev.: 0.0085) MultiSource/Benchmarks/McCat/05-eks/eks: 2.67% (0.4113 => 0.4223, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.59% (8.4961 => 8.7164, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.54% (0.6135 => 0.6291, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 2.42% (14.5298 => 14.8808, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (3.2742 => 3.3498, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.03% (1.5188 => 1.5496, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.78% (0.6744 => 0.6864, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.67% (0.9108 => 0.9260, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.45% (1.0313 => 1.0463, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 1.12% (4.6629 => 4.7152, std. dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.80% (1.8175 => 2.2682, std. dev.: 0.0485) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.56% (2.0200 => 2.1930, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: 7.59% (1.2998 => 1.3985, std. dev.: 0.0133) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.2619 => 11.7366, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.4271 => 7.7249, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.01% (1.9199 => 1.9776, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.28% (1.7688 => 1.8092, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.85% (31.4682 => 32.0495, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.62% (3.6469 => 3.7061, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5089 => 1.5325, std. dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.23% (3.1736 => 3.2126, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.28% (22.5627 => 21.1464, std. dev.: 0.0236) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.01% (1.2308 => 1.1076, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (20.3410 => 18.6351, std. dev.: 0.0188) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3148, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9830, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.18% (1.9762 => 1.9133, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: -2.71% (3.0263 => 2.9444, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4465, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.48% (8.8259 => 8.6066, std. dev.: 0.0115) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5040, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.73% (0.8342 => 0.8198, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2552, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9980, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8597, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4891, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.33% (9.3358 => 9.2119, std. dev.: 0.0319) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.27% (0.9692 => 0.9569, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2529, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.16% (7.3305 => 7.2454, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8043, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.05% (28.2225 => 27.9271, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8497, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 02:50:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 04:50:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120717095043.9BA412A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2137?compare_to=2135&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2137, Order: 160350, Start Time: 2012-07-17 08:32:33, End Time: 2012-07-17 09:50:55 To: 2135, Order: 160344, Start Time: 2012-07-17 06:42:58, End Time: 2012-07-17 08:04:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (73 on baseline) Performance Improvements: 3 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 926 (781 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.45% (13.1594 => 13.6140, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 1.60% (31.6738 => 32.1803, std. dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.57% (78.4857 => 79.7192, std. dev.: 0.4706) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.35% (0.4294 => 0.4193, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.17% (1.1913 => 1.1178, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.30% (26.6698 => 26.3235, std. dev.: 0.0150) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.32% (10.3673 => 13.6140, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 12.09% (0.3473 => 0.3893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.84% (0.3497 => 0.3911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.80% (0.3543 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.77% (0.3516 => 0.3930, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.71% (0.3561 => 0.3978, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.37% (1.1194 => 1.2467, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.29% (0.3694 => 0.4111, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.97% (0.3828 => 0.4248, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.75% (0.3927 => 0.4349, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.20% (2.2022 => 2.4047, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.29% (1.7609 => 1.9068, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.14% (0.1622 => 0.1754, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.18% (0.5925 => 0.6291, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.04% (0.6030 => 0.6394, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.81% (0.2065 => 0.2185, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.09% (7.0540 => 7.4134, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/oourafft: 5.06% (0.3282 => 0.3448, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.04% (0.3177 => 0.3337, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.00% (0.7326 => 0.7692, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.57% (0.4615 => 0.4826, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.35% (0.4879 => 0.5091, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 4.13% (0.7433 => 0.7740, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (4.9449 => 5.1219, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (9.4845 => 9.8204, std. dev.: 0.0111) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.54% (5.0018 => 5.1789, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.45% (0.8172 => 0.8454, std. dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.3121 => 0.3228, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 3.34% (10.4361 => 10.7851, std. dev.: 0.0077) MultiSource/Applications/hbd/hbd: 3.32% (1.5603 => 1.6121, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.18% (4.2646 => 4.4003, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.14% (0.5569 => 0.5744, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.02% (8.1363 => 8.3818, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.87% (0.5860 => 0.6028, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.85% (0.7835 => 0.8058, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (14.3668 => 14.7690, std. dev.: 0.0058) MultiSource/Applications/d/make_dparser: 2.49% (3.3354 => 3.4183, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.48% (0.4636 => 0.4751, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.43% (1.3050 => 1.3367, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 2.42% (0.4289 => 0.4393, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.40% (1.1861 => 1.2146, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.37% (0.8067 => 0.8258, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 2.23% (1.1642 => 1.1902, std. dev.: 0.0062) MultiSource/Applications/treecc/treecc: 2.21% (2.0273 => 2.0721, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.18% (0.6456 => 0.6597, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.17% (5.7591 => 5.8838, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.16% (2.0665 => 2.1112, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.12% (0.5105 => 0.5213, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.11% (1.5415 => 1.5741, std. dev.: 0.0047) MultiSource/Applications/lua/lua: 2.10% (3.8723 => 3.9537, std. dev.: 0.0155) MultiSource/Applications/sqlite3/sqlite3: 2.00% (17.1811 => 17.5254, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.84% (1.4186 => 1.4447, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: 1.77% (0.7115 => 0.7241, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.67% (0.9765 => 0.9928, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.63% (0.6675 => 0.6784, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.60% (1.5859 => 1.6113, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.49% (1.2842 => 1.3033, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 1.41% (0.8921 => 0.9047, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.26% (1.1840 => 1.1989, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.00% (3.6395 => 3.7486, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.94% (1.5086 => 1.5378, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.82% (3.1578 => 3.2153, std. dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: 1.41% (2.4116 => 2.4455, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2423, std. dev.: 0.0312) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6900, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.22% (11.6436 => 11.7862, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/oourafft: 1.06% (6.6465 => 6.7171, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.52% (5.2763 => 3.1383, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.95% (5.3855 => 3.7185, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.68% (5.3526 => 3.7103, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.68% (2.9384 => 2.5363, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -10.13% (22.1758 => 19.9286, std. dev.: 0.0281) SingleSource/UnitTests/Vector/constpool: -5.30% (54.1659 => 51.2943, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.33% (3.8922 => 3.8405, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.92% (1.2373 => 1.1146, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.34% (19.9488 => 18.6836, std. dev.: 0.0206) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9130, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0857, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.22% (1.8329 => 1.8105, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.02% (32.5116 => 32.1803, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 04:16:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 06:16:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120717111659.D1CF62A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2138?compare_to=2133&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2138, Order: 160350, Start Time: 2012-07-17 08:33:36, End Time: 2012-07-17 11:17:13 To: 2133, Order: 160334, Start Time: 2012-07-17 04:39:39, End Time: 2012-07-17 07:26:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (49 on baseline) Performance Improvements: 2 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 949 (843 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 10.07% (116.8448 => 128.6123, std. dev.: 1.2336) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.05% (1.3772 => 1.3628, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: -1.02% (1.0089 => 0.9986, std. dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.47% (0.3496 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.46% (0.3460 => 0.3891, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.45% (0.3446 => 0.3875, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.43% (0.3442 => 0.3870, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.41% (0.3465 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.33% (0.3488 => 0.3918, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 12.25% (0.3469 => 0.3894, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.05% (0.3650 => 0.4090, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.97% (0.3643 => 0.4079, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.63% (0.3724 => 0.4157, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.92% (0.5826 => 0.6229, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.62% (0.5889 => 0.6279, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.1620 => 0.1722, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.05% (0.7171 => 0.7533, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.68% (1.6211 => 1.6970, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.57% (3.5627 => 3.7255, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.27% (0.4361 => 0.4547, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.12% (0.5900 => 0.6143, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: 3.97% (0.4029 => 0.4189, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.72% (0.3930 => 0.4076, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.64% (0.4994 => 0.5176, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.62% (1.3152 => 1.3628, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.54% (0.5026 => 0.5204, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.48% (2.7292 => 2.8241, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 3.46% (4.2109 => 4.3567, std. dev.: 0.0094) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.44% (0.5000 => 0.5172, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.19% (2.0673 => 2.1332, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.11% (1.9694 => 2.0307, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.09% (0.3362 => 0.3466, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.08% (0.9909 => 1.0214, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.03% (1.0781 => 1.1108, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 2.98% (0.9697 => 0.9986, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.83% (1.9966 => 2.0531, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/moments: 2.80% (0.3678 => 0.3781, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.75% (0.4658 => 0.4786, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.66% (4.4195 => 4.5372, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.63% (5.5417 => 5.6877, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (0.3890 => 0.3991, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.54% (2.1013 => 2.1547, std. dev.: 0.0099) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (1.8794 => 1.9254, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.32% (23.5202 => 24.0657, std. dev.: 0.0191) MultiSource/Applications/JM/ldecod/ldecod: 2.28% (2.1653 => 2.2146, std. dev.: 0.0131) MultiSource/Applications/JM/lencod/lencod: 2.25% (4.6177 => 4.7215, std. dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 2.13% (1.5932 => 1.6272, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 2.06% (0.7875 => 0.8037, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.89% (0.5546 => 0.5651, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.86% (1.4269 => 1.4535, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.6435 => 0.6553, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.54% (0.6634 => 0.6736, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.85% (2.4764 => 2.3810, std. dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: -1.90% (11.9555 => 11.7284, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 04:19:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 06:19:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120717111919.442172A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2139?compare_to=2136&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2139, Order: 160358, Start Time: 2012-07-17 10:05:37, End Time: 2012-07-17 11:19:31 To: 2136, Order: 160350, Start Time: 2012-07-17 08:23:33, End Time: 2012-07-17 09:37:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (141 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (713 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.84% (2.0176 => 2.3171, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference-object: 9.40% (0.5818 => 0.6365, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.36% (0.5748 => 0.6286, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.96% (0.7061 => 0.7694, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 8.38% (0.3578 => 0.3878, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.23% (0.3646 => 0.3946, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.16% (0.3789 => 0.4098, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.11% (0.3601 => 0.3893, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.05% (0.3650 => 0.3944, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 8.03% (0.3663 => 0.3957, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-3: 7.98% (0.3623 => 0.3912, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.96% (1.3693 => 1.4783, std. dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions: 7.95% (0.3914 => 0.4225, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.4003 => 0.4318, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.77% (0.3940 => 0.4246, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.20% (0.1986 => 0.2129, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.98% (0.4328 => 0.4630, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.86% (0.7038 => 0.7521, std. dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.62% (3.9660 => 4.2287, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.57% (0.5265 => 0.5611, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.55% (0.7710 => 0.8215, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 6.40% (0.2781 => 0.2959, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.36% (0.2596 => 0.2761, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 6.33% (0.4062 => 0.4319, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.28% (0.2721 => 0.2892, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.24% (0.2726 => 0.2896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.18% (0.2782 => 0.2954, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.18% (0.2607 => 0.2768, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.16% (0.2760 => 0.2930, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.06% (1.9828 => 2.1030, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 6.05% (0.3107 => 0.3295, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.02% (0.3022 => 0.3204, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (0.3149 => 0.3338, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.97% (0.2628 => 0.2785, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.2937 => 0.3112, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2655 => 0.2813, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.95% (0.2690 => 0.2850, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.92% (0.3580 => 0.3792, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.90% (0.2966 => 0.3141, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.90% (0.2765 => 0.2928, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2761 => 0.2923, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.77% (0.3899 => 0.4124, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.75% (0.2696 => 0.2851, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.4379 => 0.4629, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.70% (0.3489 => 0.3688, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.66% (0.2988 => 0.3157, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.64% (0.3192 => 0.3372, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.52% (0.6959 => 0.7343, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.51% (0.3485 => 0.3677, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sieve: 5.33% (0.3453 => 0.3637, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.25% (0.3293 => 0.3466, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.25% (1.2193 => 1.2833, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.08% (0.9199 => 0.9666, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.06% (0.4390 => 0.4612, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.05% (0.4016 => 0.4219, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.04% (13.8202 => 14.5174, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/lists1: 5.04% (0.3534 => 0.3712, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.98% (0.3756 => 0.3943, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 4.87% (16.6129 => 17.4218, std. dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/moments: 4.76% (0.3868 => 0.4052, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.75% (0.5577 => 0.5842, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.63% (1.3245 => 1.3858, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.57% (13.2842 => 13.8916, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.55% (1.4563 => 1.5225, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.52% (1.3813 => 1.4438, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.52% (0.7506 => 0.7845, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.51% (0.5637 => 0.5891, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.47% (1.0594 => 1.1068, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.43% (1.1364 => 1.1867, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.39% (1.3819 => 1.4425, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 4.26% (3.8646 => 4.0294, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.25% (0.3246 => 0.3384, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 4.24% (0.8310 => 0.8662, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.21% (7.2180 => 7.5218, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.17% (1.1061 => 1.1522, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.11% (1.2292 => 1.2797, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 4.06% (1.9270 => 2.0052, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.93% (3.6692 => 3.8133, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.84% (0.4791 => 0.4975, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.77% (0.2995 => 0.3108, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.70% (0.7460 => 0.7736, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.70% (4.4433 => 4.6075, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.63% (0.3220 => 0.3337, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (4.3801 => 4.5391, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.41% (4.9865 => 5.1565, std. dev.: 0.0093) MultiSource/Benchmarks/McCat/05-eks/eks: 3.33% (0.4113 => 0.4250, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 3.31% (2.1791 => 2.2513, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.25% (0.8698 => 0.8981, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.18% (0.6283 => 0.6483, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.07% (1.1333 => 1.1681, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.87% (14.8535 => 15.2800, std. dev.: 0.0071) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (6.5754 => 6.7617, std. dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.80% (0.6135 => 0.6307, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 2.77% (3.1889 => 3.2772, std. dev.: 0.0114) MultiSource/Benchmarks/mafft/pairlocalalign: 2.70% (8.4961 => 8.7259, std. dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.69% (3.2742 => 3.3623, std. dev.: 0.0164) MultiSource/Applications/sqlite3/sqlite3: 2.59% (16.2614 => 16.6833, std. dev.: 0.0232) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.58% (2.1007 => 2.1550, std. dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: 2.52% (14.5298 => 14.8957, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.38% (1.5188 => 1.5549, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.99% (0.9108 => 0.9289, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 1.65% (0.6250 => 0.6353, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.47% (1.0313 => 1.0465, std. dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: 1.35% (4.6629 => 4.7257, std. dev.: 0.0073) MultiSource/Applications/lua/lua: 1.05% (3.7467 => 3.7862, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.68% (1.8175 => 2.2660, std. dev.: 0.0493) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1921, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: 8.50% (1.2998 => 1.4103, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (4.5947 => 4.8136, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.2619 => 11.7361, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 4.11% (7.4271 => 7.7324, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9228, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.41% (1.7688 => 1.8114, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.89% (31.4682 => 32.0625, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.78% (3.6469 => 3.7118, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/ffbench: 1.68% (0.8273 => 0.8412, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5342, std. dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9593, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.32% (3.1736 => 3.2155, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.03% (22.5627 => 21.2012, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1105, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.85% (20.3410 => 18.5411, std. dev.: 0.0657) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std. dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9130, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.71% (3.0263 => 2.9443, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5929, std. dev.: 0.0139) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5043, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.74% (0.8342 => 0.8197, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.68% (6.3560 => 6.2494, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0170) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2495, std. dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2423, std. dev.: 0.0087) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8046, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2372, std. dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: -1.05% (28.2225 => 27.9272, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 04:36:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 06:36:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120717113659.1DA5A2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2140?compare_to=2137&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2140, Order: 160358, Start Time: 2012-07-17 10:18:50, End Time: 2012-07-17 11:37:12 To: 2137, Order: 160350, Start Time: 2012-07-17 08:32:33, End Time: 2012-07-17 09:50:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (77 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (777 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.53% (55.3096 => 56.7095, std. dev.: 0.0396) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.18% (13.6140 => 13.3168, std. dev.: 0.0116) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.45% (10.3673 => 13.3168, std. dev.: 0.0116) SingleSource/UnitTests/ObjC/trivial-interface: 11.72% (0.3473 => 0.3880, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.49% (1.1194 => 1.2480, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.47% (0.3497 => 0.3898, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.43% (0.3543 => 0.3948, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-3: 11.38% (0.3516 => 0.3916, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.32% (0.3543 => 0.3944, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.20% (0.3561 => 0.3960, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.91% (0.3694 => 0.4097, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.63% (0.3828 => 0.4235, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.63% (0.3886 => 0.4299, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.01% (2.2022 => 2.4006, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.64% (1.7609 => 1.9131, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 8.26% (0.1622 => 0.1756, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 5.97% (0.6030 => 0.6390, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.92% (0.5925 => 0.6276, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.99% (7.0540 => 7.4061, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.4879 => 0.5120, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.90% (0.4615 => 0.4841, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.85% (0.7326 => 0.7681, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 4.78% (0.3282 => 0.3439, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.47% (0.7433 => 0.7765, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.98% (9.4845 => 9.8617, std. dev.: 0.0155) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.78% (0.3121 => 0.3239, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.60% (5.0018 => 5.1820, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (4.9449 => 5.1217, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.50% (0.8172 => 0.8458, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.47% (0.5569 => 0.5762, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 3.27% (0.3180 => 0.3284, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.20% (0.7835 => 0.8086, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3423 => 0.3532, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.15% (4.2646 => 4.3991, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 3.13% (10.4361 => 10.7623, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.12% (0.5860 => 0.6043, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.04% (8.1363 => 8.3837, std. dev.: 0.0053) MultiSource/Applications/hbd/hbd: 2.96% (1.5603 => 1.6065, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (14.3668 => 14.7619, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.71% (1.1861 => 1.2182, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.3050 => 1.3399, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.59% (0.8067 => 0.8276, std. dev.: 0.0062) MultiSource/Applications/Burg/burg: 2.51% (1.1642 => 1.1934, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.42% (2.0273 => 2.0764, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.41% (1.5415 => 1.5787, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.41% (0.5105 => 0.5228, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.40% (3.3354 => 3.4156, std. dev.: 0.0058) MultiSource/Applications/lua/lua: 2.39% (3.8723 => 3.9650, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.35% (0.4636 => 0.4745, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.18% (2.0665 => 2.1115, std. dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 2.15% (5.7591 => 5.8830, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.12% (1.4186 => 1.4487, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.2024 => 2.2491, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.07% (0.9765 => 0.9967, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.05% (0.6675 => 0.6812, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.01% (17.1811 => 17.5266, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.96% (1.5859 => 1.6170, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.77% (0.7115 => 0.7241, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.72% (0.6450 => 0.6561, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.56% (1.2842 => 1.3042, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 1.51% (0.8921 => 0.9056, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.39% (1.1840 => 1.2005, std. dev.: 0.0049) MultiSource/Applications/siod/siod: 1.36% (2.2969 => 2.3282, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7503, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (1.5086 => 1.5365, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 1.70% (3.1578 => 3.2115, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6882, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.22% (11.6436 => 11.7860, std. dev.: 0.0082) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2224, std. dev.: 0.0154) SingleSource/Benchmarks/Misc/oourafft: 1.10% (6.6465 => 6.7196, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.35% (5.2763 => 3.1471, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.93% (5.3855 => 3.7197, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.61% (5.3526 => 3.7142, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.68% (2.9384 => 2.5364, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.23% (22.1758 => 19.9080, std. dev.: 0.0163) SingleSource/UnitTests/Vector/constpool: -5.38% (54.1659 => 51.2493, std. dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.01% (3.8922 => 3.8530, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.70% (1.2373 => 1.1173, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.01% (19.9488 => 18.5504, std. dev.: 0.0485) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.83% (8.1563 => 7.9254, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8094, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.06% (32.5116 => 32.1684, std. dev.: 0.0098) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 06:01:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 08:01:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120717130122.77BCC2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2141?compare_to=2139&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2141, Order: 160361, Start Time: 2012-07-17 11:47:33, End Time: 2012-07-17 13:01:34 To: 2139, Order: 160358, Start Time: 2012-07-17 10:05:37, End Time: 2012-07-17 11:19:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (142 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (713 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.99% (2.0176 => 2.3200, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.81% (0.5818 => 0.6389, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.62% (0.5748 => 0.6301, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.32% (0.7061 => 0.7719, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 8.66% (0.3578 => 0.3888, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.50% (0.3601 => 0.3907, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.48% (0.3646 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.44% (0.3663 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.37% (0.3789 => 0.4106, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.36% (0.3650 => 0.3955, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.4003 => 0.4328, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 8.02% (0.3940 => 0.4256, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.97% (1.3693 => 1.4785, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.64% (0.3130 => 0.3369, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.05% (0.1986 => 0.2126, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.68% (0.7710 => 0.8225, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 6.56% (0.7038 => 0.7500, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 6.47% (0.4062 => 0.4325, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.44% (3.9660 => 4.2216, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3022 => 0.3215, std. dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2781 => 0.2957, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.21% (0.2721 => 0.2890, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.18% (0.2607 => 0.2768, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.2596 => 0.2756, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 6.12% (0.2760 => 0.2929, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.12% (0.5265 => 0.5587, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.11% (0.2782 => 0.2952, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.03% (0.2655 => 0.2815, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.01% (0.3580 => 0.3795, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/random: 5.99% (0.2690 => 0.2851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.97% (0.2628 => 0.2785, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.92% (0.3899 => 0.4130, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2761 => 0.2923, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.87% (0.2966 => 0.3140, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.86% (0.2765 => 0.2927, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.86% (0.2937 => 0.3109, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.80% (1.9828 => 2.0979, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 5.80% (0.2726 => 0.2884, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.73% (0.3489 => 0.3689, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.71% (0.2696 => 0.2850, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.63% (0.3107 => 0.3282, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.62% (0.3149 => 0.3326, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.56% (0.2988 => 0.3154, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.4379 => 0.4618, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (0.3485 => 0.3675, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.42% (0.3192 => 0.3365, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.33% (0.6959 => 0.7330, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 5.33% (0.3453 => 0.3637, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.03% (0.4016 => 0.4218, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.02% (1.2193 => 1.2805, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4390 => 0.4607, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.94% (0.9199 => 0.9653, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.93% (0.3756 => 0.3941, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.92% (0.3293 => 0.3455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.90% (0.3534 => 0.3707, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (1.4563 => 1.5275, std. dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 4.84% (13.8202 => 14.4894, std. dev.: 0.0120) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 4.78% (0.3868 => 0.4053, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.76% (16.6129 => 17.4044, std. dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.60% (0.7506 => 0.7851, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.58% (0.2925 => 0.3059, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.3245 => 1.3849, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.52% (0.2945 => 0.3078, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.0594 => 1.1072, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.50% (0.5577 => 0.5828, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.48% (1.3819 => 1.4438, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.44% (1.1364 => 1.1868, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.42% (13.2842 => 13.8714, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.29% (0.5637 => 0.5879, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.29% (1.3813 => 1.4405, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 4.10% (1.2292 => 1.2796, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.09% (7.2180 => 7.5134, std. dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 4.04% (3.8646 => 4.0206, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.04% (0.3246 => 0.3377, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 4.01% (1.1061 => 1.1505, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.93% (1.9270 => 2.0027, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.91% (0.8310 => 0.8635, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.69% (3.6692 => 3.8045, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.65% (0.3755 => 0.3892, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.65% (0.7460 => 0.7732, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (4.3801 => 4.5393, std. dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 3.61% (0.2995 => 0.3103, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (4.4433 => 4.5982, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3220 => 0.3330, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.40% (0.4791 => 0.4954, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.22% (4.9865 => 5.1473, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.09% (2.1791 => 2.2465, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.04% (0.8698 => 0.8962, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.84% (6.5754 => 6.7622, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 2.82% (14.8535 => 15.2718, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.80% (1.1333 => 1.1650, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.74% (3.1889 => 3.2762, std. dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.74% (0.6283 => 0.6455, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.63% (16.2614 => 16.6898, std. dev.: 0.0137) MultiSource/Benchmarks/mafft/pairlocalalign: 2.59% (8.4961 => 8.7164, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.35% (0.6135 => 0.6279, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 2.31% (14.5298 => 14.8656, std. dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.24% (3.2742 => 3.3475, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.14% (2.1007 => 2.1457, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.05% (1.5188 => 1.5500, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.76% (0.9108 => 0.9268, std. dev.: 0.0037) MultiSource/Applications/minisat/minisat: 1.63% (0.6744 => 0.6854, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.29% (1.0313 => 1.0446, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.82% (1.8175 => 2.2686, std. dev.: 0.0495) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.42% (2.0200 => 2.1901, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: 7.57% (1.2998 => 1.3982, std. dev.: 0.0116) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.2619 => 11.7353, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.85% (7.4271 => 7.7134, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.30% (1.7688 => 1.8095, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.27% (1.0310 => 1.0544, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.89% (31.4682 => 32.0629, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.84% (3.6469 => 3.7141, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5331, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.23% (3.1736 => 3.2127, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.10% (1.9290 => 1.9503, std. dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 1.01% (10.7476 => 10.8561, std. dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.28% (22.5627 => 21.1454, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.35% (0.0997 => 0.0834, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -9.71% (1.2308 => 1.1113, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.78% (20.3410 => 18.5558, std. dev.: 0.0686) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3107, std. dev.: 0.0071) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.18% (1.9762 => 1.9134, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.62% (3.0263 => 2.9470, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -2.52% (2.5089 => 2.4457, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6046, std. dev.: 0.0176) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5008, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.74% (0.8342 => 0.8197, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2522, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8616, std. dev.: 0.0176) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4902, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2360, std. dev.: 0.0038) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2233, std. dev.: 0.0349) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8046, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2584, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8471, std. dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (28.2225 => 27.9277, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 06:23:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 08:23:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120717132300.291832A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2142?compare_to=2140&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2142, Order: 160361, Start Time: 2012-07-17 12:04:56, End Time: 2012-07-17 13:23:13 To: 2140, Order: 160358, Start Time: 2012-07-17 10:18:50, End Time: 2012-07-17 11:37:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (70 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (785 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.12% (13.3168 => 13.7317, std. dev.: 0.0177) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.04% (7.4061 => 7.4831, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.42% (80.1193 => 81.2606, std. dev.: 0.1731) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.45% (10.3673 => 13.7317, std. dev.: 0.0177) SingleSource/UnitTests/ObjC/trivial-interface: 11.58% (0.3473 => 0.3875, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2483, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.10% (0.3497 => 0.3885, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.04% (0.3543 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.04% (0.3543 => 0.3934, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.04% (0.3516 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3561 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.64% (0.3694 => 0.4087, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3828 => 0.4223, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.16% (0.3927 => 0.4326, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.99% (2.2022 => 2.4223, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.23% (1.7609 => 1.9058, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: 7.95% (0.1622 => 0.1751, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5925 => 0.6287, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.08% (7.0540 => 7.4831, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 6.04% (0.6030 => 0.6394, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 5.45% (0.3282 => 0.3461, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.07% (0.3177 => 0.3338, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.87% (0.7326 => 0.7683, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.51% (0.4879 => 0.5099, std. dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.51% (0.4615 => 0.4823, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 4.25% (0.7433 => 0.7749, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (9.4845 => 9.8231, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.42% (4.9449 => 5.1139, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 3.39% (10.4361 => 10.7904, std. dev.: 0.0439) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.36% (5.0018 => 5.1700, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.27% (0.3121 => 0.3223, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.05% (0.5569 => 0.5739, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 3.03% (1.5603 => 1.6076, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.00% (0.8172 => 0.8417, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.91% (8.1363 => 8.3729, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.85% (0.5860 => 0.6027, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.80% (0.8067 => 0.8293, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.76% (14.3668 => 14.7630, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.75% (4.2646 => 4.3817, std. dev.: 0.0065) MultiSource/Applications/spiff/spiff: 2.72% (0.7835 => 0.8048, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.36% (1.1861 => 1.2141, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 2.33% (0.4289 => 0.4389, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.28% (2.0665 => 2.1136, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 2.24% (3.3354 => 3.4101, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.17% (1.3050 => 1.3333, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 2.14% (5.7591 => 5.8826, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 2.00% (3.8723 => 3.9498, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.6456 => 0.6585, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.98% (1.1642 => 1.1872, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 1.97% (2.0273 => 2.0672, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.88% (1.5415 => 1.5705, std. dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 1.85% (17.1811 => 17.4985, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.78% (1.4186 => 1.4438, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.75% (0.9765 => 0.9936, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (2.2024 => 2.2388, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.65% (1.5859 => 1.6121, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.57% (1.2842 => 1.3044, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.53% (0.7115 => 0.7224, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 1.18% (0.8921 => 0.9026, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7589, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (1.5086 => 1.5374, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 1.71% (3.1578 => 3.2117, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2380, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6892, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.22% (11.6436 => 11.7855, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: 1.11% (6.6465 => 6.7203, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1259, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.53% (5.2763 => 3.1380, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.34% (5.3855 => 3.7517, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.03% (5.3526 => 3.7452, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.54% (2.9384 => 2.5404, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -10.32% (22.1758 => 19.8876, std. dev.: 0.0086) SingleSource/UnitTests/Vector/constpool: -5.36% (54.1659 => 51.2637, std. dev.: 0.0256) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.38% (3.8922 => 3.8386, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.63% (0.0998 => 0.0842, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2373 => 1.1108, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.06% (19.9488 => 18.5399, std. dev.: 0.0706) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (8.1563 => 7.9201, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0856, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.21% (1.8329 => 1.8107, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 07:27:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 09:27:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120717142746.D2CD72A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2143?compare_to=2138&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2143, Order: 160361, Start Time: 2012-07-17 11:45:04, End Time: 2012-07-17 14:28:00 To: 2138, Order: 160350, Start Time: 2012-07-17 08:33:36, End Time: 2012-07-17 11:17:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (46 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 952 (846 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.32% (0.3465 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.30% (0.3496 => 0.3926, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3442 => 0.3865, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.28% (0.3460 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.28% (0.3446 => 0.3869, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.21% (0.3488 => 0.3914, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3469 => 0.3891, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.97% (0.3650 => 0.4087, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 11.75% (0.3643 => 0.4071, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3724 => 0.4146, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.11% (0.5826 => 0.6240, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.79% (0.5889 => 0.6289, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.1620 => 0.1722, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 5.20% (0.7171 => 0.7544, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.81% (1.6211 => 1.6991, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.78% (3.5627 => 3.7331, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.29% (0.4361 => 0.4548, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.20% (0.5900 => 0.6148, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.10% (0.5026 => 0.5232, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.87% (0.4029 => 0.4185, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.85% (0.3792 => 0.3938, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (1.3152 => 1.3657, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.69% (0.3930 => 0.4075, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.57% (2.7292 => 2.8265, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.52% (0.4994 => 0.5170, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.37% (1.9694 => 2.0358, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 3.35% (4.2109 => 4.3518, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.34% (0.5000 => 0.5167, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.10% (2.0673 => 2.1314, std. dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: 2.92% (0.9909 => 1.0198, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: 2.80% (0.3678 => 0.3781, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (0.3890 => 0.3997, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.74% (1.9966 => 2.0514, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.66% (0.4658 => 0.4782, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.59% (1.0781 => 1.1060, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.58% (2.1013 => 2.1555, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (4.4195 => 4.5227, std. dev.: 0.0053) MultiSource/Applications/hbd/hbd: 2.28% (0.9697 => 0.9918, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 2.19% (23.5202 => 24.0364, std. dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 2.18% (4.6177 => 4.7183, std. dev.: 0.0053) MultiSource/Applications/JM/ldecod/ldecod: 2.15% (2.1653 => 2.2119, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 2.13% (1.8794 => 1.9195, std. dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: 2.09% (5.5417 => 5.6577, std. dev.: 0.0125) MultiSource/Applications/treecc/treecc: 1.82% (0.7875 => 0.8018, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.60% (1.4269 => 1.4498, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 1.16% (1.5932 => 1.6117, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.67% (2.4764 => 2.3856, std. dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: -2.07% (11.9555 => 11.7082, std. dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 07:43:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 09:43:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120717144319.4079F2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2144?compare_to=2141&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2144, Order: 160362, Start Time: 2012-07-17 13:29:26, End Time: 2012-07-17 14:43:30 To: 2141, Order: 160361, Start Time: 2012-07-17 11:47:33, End Time: 2012-07-17 13:01:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (140 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (715 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.62% (54.5519 => 56.5256, std. dev.: 0.1321) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.05% (2.0176 => 2.3213, std. dev.: 0.0132) SingleSource/UnitTests/ObjC++/property-reference-object: 9.78% (0.5818 => 0.6387, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.73% (0.7061 => 0.7748, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 9.71% (0.5748 => 0.6306, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3578 => 0.3887, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.53% (0.3601 => 0.3908, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 8.39% (0.3646 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.33% (0.3650 => 0.3954, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3789 => 0.4104, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/synchronized: 8.30% (0.3663 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.12% (0.3914 => 0.4232, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.4003 => 0.4328, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.99% (0.3940 => 0.4255, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.97% (1.3693 => 1.4784, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.05% (0.1986 => 0.2126, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.94% (0.4062 => 0.4344, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (0.4328 => 0.4616, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.54% (0.7038 => 0.7498, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.46% (0.7710 => 0.8208, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 6.36% (0.2781 => 0.2958, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.35% (3.9660 => 4.2178, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.17% (0.2721 => 0.2889, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.16% (0.2760 => 0.2930, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.14% (0.2607 => 0.2767, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.12% (0.2596 => 0.2755, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.08% (0.5265 => 0.5585, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.06% (0.2655 => 0.2816, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.06% (0.3022 => 0.3205, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.01% (0.2628 => 0.2786, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.00% (0.2966 => 0.3144, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.97% (0.2765 => 0.2930, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.95% (0.2690 => 0.2850, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.95% (1.9828 => 2.1007, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.88% (0.3489 => 0.3694, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.87% (0.2726 => 0.2886, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2761 => 0.2923, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.87% (0.3580 => 0.3790, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.82% (0.2937 => 0.3108, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.76% (0.2988 => 0.3160, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.72% (0.3899 => 0.4122, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.71% (0.2696 => 0.2850, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.65% (0.3149 => 0.3327, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.63% (0.3107 => 0.3282, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4379 => 0.4622, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (0.3485 => 0.3678, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.39% (0.3192 => 0.3364, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.36% (0.3453 => 0.3638, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.26% (0.6959 => 0.7325, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.19% (0.4390 => 0.4618, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 5.13% (0.3293 => 0.3462, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.08% (0.4016 => 0.4220, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.99% (1.2193 => 1.2802, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.98% (0.3534 => 0.3710, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 4.91% (13.8202 => 14.4981, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.83% (0.9199 => 0.9643, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.82% (0.3756 => 0.3937, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.78% (0.3868 => 0.4053, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.70% (16.6129 => 17.3937, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.59% (0.5577 => 0.5833, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.50% (1.3813 => 1.4435, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.49% (13.2842 => 13.8809, std. dev.: 0.0072) MultiSource/Benchmarks/McCat/09-vor/vor: 4.48% (0.2925 => 0.3056, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.45% (1.3245 => 1.3835, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.45% (1.4563 => 1.5211, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.42% (1.3819 => 1.4430, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.36% (1.1364 => 1.1860, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.36% (0.5637 => 0.5883, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1048, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.26% (0.7506 => 0.7826, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.23% (1.1061 => 1.1529, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.10% (7.2180 => 7.5137, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 4.09% (1.2292 => 1.2795, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.97% (0.3246 => 0.3375, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 3.94% (0.8310 => 0.8637, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.90% (3.8646 => 4.0153, std. dev.: 0.0134) MultiSource/Applications/treecc/treecc: 3.87% (1.9270 => 2.0015, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.73% (0.3755 => 0.3895, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.69% (3.6692 => 3.8046, std. dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.54% (0.7460 => 0.7724, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.51% (4.3801 => 4.5338, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3220 => 0.3332, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.44% (0.4791 => 0.4956, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.44% (4.4433 => 4.5963, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 3.37% (0.2995 => 0.3096, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.19% (2.1791 => 2.2487, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.18% (4.9865 => 5.1453, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.05% (0.8698 => 0.8963, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 2.94% (0.4113 => 0.4234, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 2.92% (6.5754 => 6.7673, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.81% (1.1333 => 1.1652, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 2.71% (14.8535 => 15.2557, std. dev.: 0.0153) MultiSource/Applications/d/make_dparser: 2.70% (3.1889 => 3.2751, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.69% (0.6283 => 0.6452, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.62% (16.2614 => 16.6878, std. dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 2.61% (8.4961 => 8.7176, std. dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.36% (0.6135 => 0.6280, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 2.32% (14.5298 => 14.8669, std. dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.22% (3.2742 => 3.3468, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.19% (2.1007 => 2.1468, std. dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.12% (1.5188 => 1.5510, std. dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.83% (0.9108 => 0.9275, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.81% (0.6744 => 0.6866, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.21% (1.0313 => 1.0438, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.85% (1.8175 => 2.2692, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/mandel-2: 8.62% (1.2998 => 1.4119, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.27% (2.0200 => 2.1871, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0050) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.2619 => 11.7373, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 4.03% (7.4271 => 7.7261, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9191, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9772, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0310 => 1.0562, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.39% (1.7688 => 1.8110, std. dev.: 0.0156) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1905, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.93% (31.4682 => 32.0754, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5348, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.68% (3.6469 => 3.7081, std. dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1941, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: 1.25% (3.1736 => 3.2132, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1605, std. dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.68% (1.2308 => 1.0993, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.74% (20.3410 => 18.5625, std. dev.: 0.0595) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.00% (1.3780 => 1.3091, std. dev.: 0.0065) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9127, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.8259 => 8.5728, std. dev.: 0.0282) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9450, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.61% (0.4867 => 0.4740, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5041, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.73% (0.8342 => 0.8198, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2575, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (0.9692 => 0.9557, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4904, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2127, std. dev.: 0.0361) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8664, std. dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2384, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2528, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8044, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (28.2225 => 27.9302, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 08:09:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 10:09:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120717150900.8FC812A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2145?compare_to=2142&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2145, Order: 160362, Start Time: 2012-07-17 13:51:03, End Time: 2012-07-17 15:09:12 To: 2142, Order: 160361, Start Time: 2012-07-17 12:04:56, End Time: 2012-07-17 13:23:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (72 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (782 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.43% (81.2606 => 79.2825, std. dev.: 0.3530) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.70% (10.3673 => 13.7571, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.84% (1.1194 => 1.2519, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3473 => 0.3869, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.10% (0.3497 => 0.3885, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.04% (0.3543 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.01% (0.3543 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3516 => 0.3903, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.92% (0.3561 => 0.3950, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 10.61% (0.3694 => 0.4086, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.19% (0.3886 => 0.4282, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.16% (0.3927 => 0.4326, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.01% (2.2022 => 2.4226, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.21% (1.7609 => 1.9055, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 7.89% (0.1622 => 0.1750, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.10% (0.6030 => 0.6398, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.08% (0.5925 => 0.6285, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.75% (7.0540 => 7.4598, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 5.48% (0.3282 => 0.3462, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.07% (0.3177 => 0.3338, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.80% (0.7326 => 0.7678, std. dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.51% (0.4615 => 0.4823, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.49% (0.4879 => 0.5098, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.08% (0.7433 => 0.7736, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (9.4845 => 9.8273, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 3.43% (10.4361 => 10.7936, std. dev.: 0.0407) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3121 => 0.3227, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.0018 => 5.1707, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.35% (4.9449 => 5.1104, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.27% (0.8172 => 0.8439, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.03% (0.5569 => 0.5738, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.99% (1.5603 => 1.6070, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.86% (8.1363 => 8.3694, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 2.74% (0.7835 => 0.8050, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (14.3668 => 14.7604, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.73% (0.5860 => 0.6020, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.69% (4.2646 => 4.3795, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 2.47% (0.4289 => 0.4395, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.40% (2.0665 => 2.1160, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.36% (1.1861 => 1.2141, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.22% (1.3050 => 1.3340, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 2.19% (5.7591 => 5.8855, std. dev.: 0.0094) MultiSource/Applications/d/make_dparser: 2.14% (3.3354 => 3.4068, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.02% (0.8067 => 0.8230, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 2.00% (1.1642 => 1.1875, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.97% (2.0273 => 2.0673, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.97% (3.8723 => 3.9484, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.5415 => 1.5714, std. dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/bigfib: 1.91% (0.6456 => 0.6579, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.84% (17.1811 => 17.4970, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.66% (1.4186 => 1.4422, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.66% (2.2024 => 2.2390, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.63% (0.9765 => 0.9924, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (0.6675 => 0.6779, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.56% (1.2842 => 1.3042, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.47% (1.5859 => 1.6092, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.42% (0.7115 => 0.7216, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 1.15% (0.8921 => 0.9024, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.05% (1.1840 => 1.1964, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7572, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.35% (1.0313 => 1.0555, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.83% (3.1578 => 3.2157, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5086 => 1.5355, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2374, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6883, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 1.22% (11.6436 => 11.7855, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/oourafft: 1.11% (6.6465 => 6.7201, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.43% (5.2763 => 3.1429, std. dev.: 0.0120) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.46% (5.3855 => 3.7452, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.88% (5.3526 => 3.7531, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.55% (2.9384 => 2.5401, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -10.34% (22.1758 => 19.8838, std. dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: -5.33% (54.1659 => 51.2803, std. dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.37% (3.8922 => 3.8389, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2373 => 1.1062, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.25% (19.9488 => 18.5027, std. dev.: 0.0776) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.87% (8.1563 => 7.9224, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0870, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.30% (1.8329 => 1.8091, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.02% (32.5116 => 32.1813, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 10:04:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 12:04:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120717170426.9A8322A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2146?compare_to=2144&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2146, Order: 160364, Start Time: 2012-07-17 15:50:36, End Time: 2012-07-17 17:04:39 To: 2144, Order: 160362, Start Time: 2012-07-17 13:29:26, End Time: 2012-07-17 14:43:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (137 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (717 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.52% (79.2705 => 80.4739, std. dev.: 0.1728) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.95% (2.0176 => 2.3193, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.95% (0.5818 => 0.6339, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.73% (0.5748 => 0.6250, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.65% (0.7061 => 0.7672, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 7.91% (0.3578 => 0.3861, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.91% (1.3693 => 1.4776, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions-4: 7.79% (0.3646 => 0.3930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.72% (0.3601 => 0.3879, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.68% (0.3789 => 0.4080, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.67% (0.3663 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.59% (0.3650 => 0.3927, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3623 => 0.3896, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.4003 => 0.4303, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.31% (0.3940 => 0.4228, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1986 => 0.2127, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 7.04% (0.4062 => 0.4348, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.79% (0.4328 => 0.4622, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.78% (0.7038 => 0.7515, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.65% (0.7710 => 0.8223, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2781 => 0.2962, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.32% (0.2628 => 0.2794, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.29% (0.2782 => 0.2957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.25% (0.2607 => 0.2770, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.23% (3.9660 => 4.2130, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.21% (0.2655 => 0.2820, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.19% (0.3022 => 0.3209, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2690 => 0.2856, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.13% (0.2726 => 0.2893, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.12% (0.2760 => 0.2929, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.10% (0.5265 => 0.5586, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.2937 => 0.3115, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.04% (1.9828 => 2.1026, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.04% (0.2966 => 0.3145, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.97% (0.2765 => 0.2930, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2761 => 0.2925, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.93% (0.2596 => 0.2750, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.90% (0.3899 => 0.4129, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.89% (0.3580 => 0.3791, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.83% (0.3107 => 0.3288, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.79% (0.3489 => 0.3691, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.79% (0.2696 => 0.2852, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.78% (0.3149 => 0.3331, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.59% (0.2988 => 0.3155, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3485 => 0.3679, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.45% (0.3192 => 0.3366, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 5.44% (0.3453 => 0.3641, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.44% (0.4379 => 0.4617, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.6959 => 0.7322, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.10% (0.4016 => 0.4221, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.09% (0.3534 => 0.3714, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.06% (0.4390 => 0.4612, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 5.04% (0.3293 => 0.3459, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.96% (0.3868 => 0.4060, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.95% (0.3756 => 0.3942, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.89% (1.2193 => 1.2789, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.82% (0.9199 => 0.9642, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 4.80% (13.8202 => 14.4841, std. dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.79% (0.5577 => 0.5844, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.71% (16.6129 => 17.3958, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.2945 => 0.3083, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.56% (0.2914 => 0.3047, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.50% (13.2842 => 13.8825, std. dev.: 0.0115) MultiSource/Benchmarks/McCat/09-vor/vor: 4.44% (0.2925 => 0.3055, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.3245 => 1.3825, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.37% (1.4563 => 1.5200, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.28% (1.1364 => 1.1850, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.22% (1.3819 => 1.4402, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.19% (0.5637 => 0.5873, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.15% (1.0594 => 1.1034, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.13% (0.7506 => 0.7816, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.13% (1.3813 => 1.4383, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.12% (1.2292 => 1.2799, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.05% (7.2180 => 7.5100, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 3.98% (0.8310 => 0.8641, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.92% (3.8646 => 4.0159, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.91% (0.3246 => 0.3373, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.82% (1.1061 => 1.1484, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 3.74% (1.9270 => 1.9991, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.73% (0.3755 => 0.3895, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.49% (3.6692 => 3.7974, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (4.4433 => 4.5982, std. dev.: 0.0076) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.36% (0.7460 => 0.7711, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.34% (4.3801 => 4.5263, std. dev.: 0.0098) MultiSource/Benchmarks/McCat/18-imp/imp: 3.32% (0.3220 => 0.3327, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.32% (0.4791 => 0.4950, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.22% (4.9865 => 5.1473, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.09% (0.8698 => 0.8967, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 3.09% (2.1791 => 2.2464, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.77% (1.1333 => 1.1647, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (6.5754 => 6.7565, std. dev.: 0.0099) MultiSource/Applications/sqlite3/sqlite3: 2.68% (16.2614 => 16.6980, std. dev.: 0.0131) MultiSource/Applications/d/make_dparser: 2.64% (3.1889 => 3.2732, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.63% (0.6283 => 0.6448, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.56% (14.8535 => 15.2343, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.41% (0.6135 => 0.6283, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 2.37% (8.4961 => 8.6974, std. dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 2.26% (14.5298 => 14.8575, std. dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.08% (2.1007 => 2.1444, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.03% (3.2742 => 3.3407, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.95% (1.5188 => 1.5484, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.62% (0.6744 => 0.6853, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.50% (0.9108 => 0.9245, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.27% (1.0313 => 1.0444, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.64% (1.8175 => 2.2653, std. dev.: 0.0274) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1921, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: 7.83% (1.2998 => 1.4016, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.36% (1.5824 => 1.6989, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.2619 => 11.7369, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7351, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9774, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.28% (1.7688 => 1.8092, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.91% (31.4682 => 32.0702, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.72% (3.6469 => 3.7097, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5089 => 1.5335, std. dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5077, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1968, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.08% (1.9290 => 1.9499, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.29% (22.5627 => 21.1439, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.55% (0.0997 => 0.0842, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.12% (1.2308 => 1.1063, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.07% (20.3410 => 18.4961, std. dev.: 0.1222) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3130, std. dev.: 0.0099) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9124, std. dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5821, std. dev.: 0.0167) MultiSource/Applications/spiff/spiff: -2.76% (3.0263 => 2.9429, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4475, std. dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.32% (0.4867 => 0.4754, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5136, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.71% (0.8342 => 0.8199, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2517, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8576, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2204, std. dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2520, std. dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2433, std. dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.15% (9.9194 => 9.8049, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8471, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (28.2225 => 27.9285, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 10:08:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 12:08:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120717170851.10F392A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2147?compare_to=2145&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2147, Order: 160364, Start Time: 2012-07-17 15:50:47, End Time: 2012-07-17 17:09:02 To: 2145, Order: 160362, Start Time: 2012-07-17 13:51:03, End Time: 2012-07-17 15:09:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (68 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (786 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.92% (10.3673 => 13.7806, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.57% (1.1194 => 1.2489, std. dev.: 0.0168) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3473 => 0.3843, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.47% (0.3516 => 0.3884, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.35% (0.3497 => 0.3859, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.30% (0.3543 => 0.3908, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.30% (0.3543 => 0.3908, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 10.28% (0.3561 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.96% (0.3694 => 0.4062, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.79% (2.2022 => 2.4177, std. dev.: 0.0103) SingleSource/UnitTests/ObjC/property: 9.65% (0.3886 => 0.4261, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.61% (0.3828 => 0.4196, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.55% (0.3927 => 0.4302, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.89% (0.1622 => 0.1750, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.79% (1.7609 => 1.8980, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.83% (7.0540 => 7.4656, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/oourafft: 5.45% (0.3282 => 0.3461, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 5.40% (0.5925 => 0.6245, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.38% (0.2065 => 0.2176, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 5.37% (0.6030 => 0.6354, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.13% (0.3177 => 0.3340, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.4879 => 0.5096, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.38% (0.4615 => 0.4817, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 4.23% (0.7326 => 0.7636, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.09% (0.7433 => 0.7737, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 3.68% (10.4361 => 10.8205, std. dev.: 0.0137) MultiSource/Benchmarks/mafft/pairlocalalign: 3.58% (9.4845 => 9.8236, std. dev.: 0.0085) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.28% (5.0018 => 5.1657, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.25% (4.9449 => 5.1057, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.02% (0.8172 => 0.8419, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.98% (0.5569 => 0.5735, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 2.73% (0.7835 => 0.8049, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (4.2646 => 4.3803, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.71% (8.1363 => 8.3566, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.67% (1.5603 => 1.6020, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.62% (14.3668 => 14.7427, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.59% (0.5860 => 0.6012, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.40% (0.4289 => 0.4392, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.30% (1.1861 => 1.2134, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 2.26% (5.7591 => 5.8895, std. dev.: 0.0064) MultiSource/Applications/d/make_dparser: 2.13% (3.3354 => 3.4065, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.10% (1.3050 => 1.3324, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.01% (0.8067 => 0.8229, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.95% (2.0665 => 2.1067, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.92% (1.1642 => 1.1866, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 1.92% (3.8723 => 3.9467, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.90% (2.0273 => 2.0658, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 1.78% (0.6456 => 0.6571, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.77% (1.5415 => 1.5688, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.77% (17.1811 => 17.4844, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.65% (1.4186 => 1.4420, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.65% (1.5859 => 1.6120, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.58% (2.2024 => 2.2372, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.58% (0.9765 => 0.9919, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.45% (0.7115 => 0.7218, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.15% (0.8921 => 0.9024, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7523, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (1.5086 => 1.5356, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 1.76% (3.1578 => 3.2135, std. dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.29% (2.6546 => 2.6888, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2324, std. dev.: 0.0185) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7885, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/oourafft: 1.10% (6.6465 => 6.7194, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.37% (5.2763 => 3.1460, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.69% (5.3855 => 3.7329, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.43% (5.3526 => 3.7236, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.08% (2.9384 => 2.5541, std. dev.: 0.0188) MultiSource/Applications/ClamAV/clamscan: -10.45% (22.1758 => 19.8592, std. dev.: 0.0166) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3254, std. dev.: 0.0385) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.39% (3.8922 => 3.8380, std. dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2373 => 1.1108, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.19% (19.9488 => 18.5137, std. dev.: 0.0407) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.83% (8.1563 => 7.9255, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0852, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8097, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.01% (32.5116 => 32.1843, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 10:38:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 12:38:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120717173852.BE6932A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2148?compare_to=2143&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2148, Order: 160362, Start Time: 2012-07-17 14:55:43, End Time: 2012-07-17 17:39:05 To: 2143, Order: 160361, Start Time: 2012-07-17 11:45:04, End Time: 2012-07-17 14:28:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (47 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 949 (845 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 6.93% (0.2252 => 0.2408, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.32% (126.2531 => 131.7040, std. dev.: 0.2749) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.90% (53.8760 => 54.9004, std. dev.: 0.0493) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.35% (0.3465 => 0.3893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.32% (0.3442 => 0.3866, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3446 => 0.3870, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3460 => 0.3883, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.21% (0.3496 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.21% (0.3488 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.11% (0.3469 => 0.3889, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.89% (0.3650 => 0.4084, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.72% (0.3643 => 0.4070, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.39% (0.3724 => 0.4148, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.16% (0.5826 => 0.6243, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 6.76% (0.5889 => 0.6287, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.67% (0.3792 => 0.4007, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 5.29% (0.7171 => 0.7550, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.05% (1.6211 => 1.7030, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.83% (3.5627 => 3.7349, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.56% (0.4361 => 0.4560, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.24% (0.5900 => 0.6150, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 4.07% (0.4029 => 0.4193, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.06% (0.5026 => 0.5230, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.04% (1.3152 => 1.3683, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.86% (0.4994 => 0.5187, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.69% (0.3930 => 0.4075, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.56% (0.2866 => 0.2968, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.53% (2.7292 => 2.8256, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 3.41% (4.2109 => 4.3546, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.40% (0.5000 => 0.5170, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.06% (2.0673 => 2.1305, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.04% (1.9694 => 2.0293, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 3.01% (0.9909 => 1.0207, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.86% (1.9966 => 2.0538, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.80% (0.3890 => 0.3999, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.75% (0.4658 => 0.4786, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 2.67% (1.0781 => 1.1069, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.57% (2.1013 => 2.1552, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.49% (4.4195 => 4.5297, std. dev.: 0.0099) MultiSource/Applications/hbd/hbd: 2.41% (0.9697 => 0.9931, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (2.1653 => 2.2137, std. dev.: 0.0092) MultiSource/Benchmarks/MallocBench/gs/gs: 2.23% (1.8794 => 1.9214, std. dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 2.19% (23.5202 => 24.0363, std. dev.: 0.0121) MultiSource/Applications/JM/lencod/lencod: 2.19% (4.6177 => 4.7190, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.12% (5.5417 => 5.6591, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 1.87% (0.7875 => 0.8022, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 1.79% (0.6634 => 0.6753, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.75% (1.4269 => 1.4519, std. dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 1.15% (1.5932 => 1.6116, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.80% (2.4764 => 2.3824, std. dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: -2.04% (11.9555 => 11.7112, std. dev.: 0.0126) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 11:46:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 13:46:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120717184617.75A122A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2149?compare_to=2146&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2149, Order: 160369, Start Time: 2012-07-17 17:32:30, End Time: 2012-07-17 18:46:28 To: 2146, Order: 160364, Start Time: 2012-07-17 15:50:36, End Time: 2012-07-17 17:04:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (132 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 952 (720 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.12% (2.0176 => 2.3226, std. dev.: 0.0134) SingleSource/UnitTests/ObjC++/property-reference-object: 8.90% (0.5818 => 0.6336, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5748 => 0.6246, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.62% (0.7061 => 0.7670, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 7.57% (0.3578 => 0.3849, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.52% (0.3646 => 0.3920, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 7.50% (0.3789 => 0.4073, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.49% (1.3693 => 1.4719, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 7.44% (0.3601 => 0.3869, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.43% (0.3663 => 0.3935, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.40% (0.3650 => 0.3920, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 7.26% (0.3914 => 0.4198, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 7.23% (0.3623 => 0.3885, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.17% (0.4003 => 0.4290, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.03% (0.3940 => 0.4217, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.89% (0.4062 => 0.4342, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.82% (0.4328 => 0.4623, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.56% (0.7038 => 0.7500, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.50% (0.1986 => 0.2115, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.17% (0.2721 => 0.2889, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.16% (0.2726 => 0.2894, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.15% (0.2782 => 0.2953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.14% (0.2607 => 0.2767, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.13% (3.9660 => 4.2092, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.2937 => 0.3117, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.12% (0.3022 => 0.3207, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2655 => 0.2817, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.05% (0.2628 => 0.2787, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.02% (0.2690 => 0.2852, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.02% (0.7710 => 0.8174, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.01% (0.2596 => 0.2752, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.98% (0.2760 => 0.2925, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.97% (0.2966 => 0.3143, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.96% (0.5265 => 0.5579, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.92% (0.3899 => 0.4130, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.92% (0.3580 => 0.3792, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.90% (0.2761 => 0.2924, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.90% (1.9828 => 2.0997, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.88% (0.3489 => 0.3694, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.86% (0.3107 => 0.3289, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.81% (0.3149 => 0.3332, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.75% (0.2696 => 0.2851, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.71% (0.3485 => 0.3684, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.60% (0.6959 => 0.7349, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.42% (0.2988 => 0.3150, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 5.39% (0.3192 => 0.3364, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.36% (0.3453 => 0.3638, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.11% (0.3756 => 0.3948, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.09% (0.4379 => 0.4602, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.05% (0.4016 => 0.4219, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.01% (0.3293 => 0.3458, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4390 => 0.4607, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 4.83% (0.3868 => 0.4055, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.79% (13.8202 => 14.4819, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.75% (0.9199 => 0.9636, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.75% (1.2193 => 1.2772, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 4.74% (16.6129 => 17.4010, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.2945 => 0.3083, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.59% (0.5577 => 0.5833, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.48% (13.2842 => 13.8799, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.43% (1.3245 => 1.3832, std. dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.2914 => 0.3043, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.34% (0.2925 => 0.3052, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.20% (1.4563 => 1.5175, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 4.18% (0.8310 => 0.8657, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.14% (1.1364 => 1.1835, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.10% (1.3813 => 1.4380, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.09% (0.7506 => 0.7813, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.06% (1.3819 => 1.4380, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.06% (1.2292 => 1.2791, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.00% (1.0594 => 1.1018, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 3.97% (3.8646 => 4.0180, std. dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.90% (0.5637 => 0.5857, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.88% (0.3246 => 0.3372, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.86% (0.3755 => 0.3900, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.84% (7.2180 => 7.4951, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 3.79% (1.1061 => 1.1480, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 3.69% (1.9270 => 1.9981, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.50% (3.6692 => 3.7975, std. dev.: 0.0102) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.35% (0.7460 => 0.7710, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 3.29% (0.3220 => 0.3326, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 3.27% (2.1791 => 2.2503, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.13% (4.9865 => 5.1426, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.12% (4.3801 => 4.5167, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.02% (4.4433 => 4.5776, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.90% (0.4791 => 0.4930, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.89% (0.8698 => 0.8949, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.74% (1.1333 => 1.1644, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 2.57% (3.1889 => 3.2707, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 2.54% (6.5754 => 6.7425, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 2.43% (16.2614 => 16.6560, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.40% (0.6283 => 0.6434, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.40% (14.8535 => 15.2102, std. dev.: 0.0064) MultiSource/Applications/ClamAV/clamscan: 2.27% (14.5298 => 14.8590, std. dev.: 0.0115) MultiSource/Benchmarks/mafft/pairlocalalign: 2.18% (8.4961 => 8.6810, std. dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.17% (0.6135 => 0.6268, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.1007 => 2.1453, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (1.5188 => 1.5482, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (3.2742 => 3.3333, std. dev.: 0.0052) MultiSource/Applications/lemon/lemon: 1.25% (1.0313 => 1.0442, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.60% (1.8175 => 2.2646, std. dev.: 0.0321) SingleSource/Benchmarks/Misc/mandel-2: 8.19% (1.2998 => 1.4063, std. dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.09% (2.0200 => 2.1835, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6996, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.2619 => 11.7377, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.82% (7.4271 => 7.7110, std. dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4803, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0560, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.33% (1.7688 => 1.8101, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1894, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.85% (31.4682 => 32.0494, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.68% (3.6469 => 3.7083, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5336, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5072, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1943, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 1.30% (3.1736 => 3.2147, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.23% (22.5627 => 21.1579, std. dev.: 0.0139) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.88% (0.3511 => 0.3410, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.71% (0.8818 => 0.8667, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1126, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.78% (20.3410 => 18.5551, std. dev.: 0.0650) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.29% (1.3780 => 1.3189, std. dev.: 0.0188) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.18% (1.9762 => 1.9133, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.73% (3.0263 => 2.9436, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5977, std. dev.: 0.0135) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4461, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5098, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.75% (0.8342 => 0.8196, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2543, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9980, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.48% (2.5254 => 2.4880, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.45% (0.9692 => 0.9551, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.3305 => 7.2420, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8047, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2283, std. dev.: 0.0350) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2556, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.05% (28.2225 => 27.9264, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 11:56:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 13:56:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120717185614.CA3BC2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2150?compare_to=2147&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2150, Order: 160372, Start Time: 2012-07-17 17:38:18, End Time: 2012-07-17 18:56:27 To: 2147, Order: 160364, Start Time: 2012-07-17 15:50:47, End Time: 2012-07-17 17:09:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (70 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (784 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.73% (54.5712 => 56.6065, std. dev.: 0.0221) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.50% (13.7806 => 13.4354, std. dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.59% (10.3673 => 13.4354, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.89% (1.1194 => 1.2525, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.60% (0.3473 => 0.3876, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.30% (0.3497 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.23% (0.3516 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.18% (0.3543 => 0.3939, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3543 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.09% (0.3561 => 0.3956, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3927 => 0.4335, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.34% (0.3886 => 0.4288, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.72% (2.2022 => 2.4163, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.63% (0.1622 => 0.1762, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.08% (1.7609 => 1.9031, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.81% (7.0540 => 7.4638, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 5.65% (0.5925 => 0.6260, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.57% (0.6030 => 0.6366, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 5.39% (0.3282 => 0.3459, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.4879 => 0.5105, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 4.42% (0.7326 => 0.7650, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.31% (0.4615 => 0.4814, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.17% (0.5569 => 0.5801, std. dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 4.05% (0.7433 => 0.7734, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.74% (10.4361 => 10.8261, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 3.68% (9.4845 => 9.8335, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (5.0018 => 5.1764, std. dev.: 0.0095) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.43% (0.8172 => 0.8452, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.39% (4.9449 => 5.1123, std. dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.33% (0.3121 => 0.3225, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.14% (1.5603 => 1.6093, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.05% (14.3668 => 14.8054, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.99% (0.5860 => 0.6035, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.97% (8.1363 => 8.3776, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.93% (4.2646 => 4.3894, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 2.78% (0.7835 => 0.8053, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.36% (2.0665 => 2.1153, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.34% (1.3050 => 1.3356, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.30% (1.1861 => 1.2134, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.29% (0.4636 => 0.4742, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.26% (3.3354 => 3.4108, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.17% (0.8067 => 0.8242, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.12% (1.1642 => 1.1889, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 2.11% (17.1811 => 17.5443, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 1.99% (2.0273 => 2.0676, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 1.96% (3.8723 => 3.9481, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.84% (1.5415 => 1.5699, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.81% (5.7591 => 5.8636, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.78% (1.4186 => 1.4439, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.61% (1.2842 => 1.3049, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.61% (2.2024 => 2.2379, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.60% (0.9765 => 0.9921, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.54% (0.6675 => 0.6778, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.48% (0.7115 => 0.7220, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.48% (1.5859 => 1.6093, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 1.12% (0.8921 => 0.9021, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7553, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.36% (1.0313 => 1.0556, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2158, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5086 => 1.5351, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2375, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.21% (2.6546 => 2.6867, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 1.19% (11.6436 => 11.7823, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/oourafft: 1.03% (6.6465 => 6.7149, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.22% (5.2763 => 3.1543, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.70% (5.3855 => 3.7322, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.44% (5.3526 => 3.7235, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.19% (2.9384 => 2.5508, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -10.30% (22.1758 => 19.8906, std. dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: -5.22% (54.1659 => 51.3377, std. dev.: 0.1352) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.53% (3.8922 => 3.8328, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2373 => 1.1164, std. dev.: 0.0210) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.94% (19.9488 => 18.5635, std. dev.: 0.0381) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9206, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0857, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.21% (1.8329 => 1.8107, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.02% (32.5116 => 32.1812, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 13:28:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 15:28:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120717202819.4F1782A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2151?compare_to=2149&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2151, Order: 160384, Start Time: 2012-07-17 19:14:38, End Time: 2012-07-17 20:28:28 To: 2149, Order: 160369, Start Time: 2012-07-17 17:32:30, End Time: 2012-07-17 18:46:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (130 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (723 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.08% (4.6847 => 4.7354, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.19% (2.0997 => 2.0748, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.20% (56.6562 => 55.9790, std. dev.: 0.2583) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.33% (2.0176 => 2.3068, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.30% (0.5818 => 0.6301, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.23% (0.5748 => 0.6221, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 7.86% (0.7061 => 0.7616, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 7.52% (0.3578 => 0.3847, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.25% (0.3601 => 0.3862, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.19% (0.3646 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.15% (0.3650 => 0.3911, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.13% (0.3789 => 0.4059, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.07% (0.3663 => 0.3922, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.07% (0.3623 => 0.3879, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.03% (0.3914 => 0.4189, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.97% (0.4003 => 0.4282, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.95% (1.3693 => 1.4645, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.85% (0.3940 => 0.4210, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.1986 => 0.2113, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.28% (0.7038 => 0.7480, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.10% (0.2721 => 0.2887, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.06% (3.9660 => 4.2065, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash: 5.86% (0.4062 => 0.4300, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.82% (0.2596 => 0.2747, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.79% (0.5265 => 0.5570, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.77% (0.7710 => 0.8155, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 5.75% (0.4328 => 0.4577, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.12% (0.2655 => 0.2791, std. dev.: 0.0052) SingleSource/Regression/C++/ofstream_ctor: 5.11% (0.2781 => 0.2923, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.03% (0.2782 => 0.2922, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.01% (0.2937 => 0.3084, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.97% (0.6959 => 0.7305, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.92% (0.3899 => 0.4091, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 4.91% (0.2690 => 0.2822, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.90% (0.3022 => 0.3170, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.86% (0.2966 => 0.3110, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.85% (0.2765 => 0.2899, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.82% (0.4379 => 0.4590, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.80% (0.3580 => 0.3752, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.73% (0.3489 => 0.3654, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.71% (0.2696 => 0.2823, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.70% (1.2193 => 1.2766, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 4.68% (13.8202 => 14.4675, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/methcall: 4.67% (0.2761 => 0.2890, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.66% (0.2726 => 0.2853, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.65% (0.9199 => 0.9627, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.64% (1.9828 => 2.0748, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 4.54% (0.3149 => 0.3292, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 4.38% (0.2988 => 0.3119, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 4.38% (16.6129 => 17.3401, std. dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.32% (0.5577 => 0.5818, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.28% (0.4390 => 0.4578, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.28% (0.3485 => 0.3634, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.23% (0.3453 => 0.3599, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.17% (0.2925 => 0.3047, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.15% (1.3819 => 1.4393, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.15% (0.2914 => 0.3035, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.10% (13.2842 => 13.8294, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.10% (0.3756 => 0.3910, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.08% (1.3813 => 1.4377, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.06% (1.3245 => 1.3783, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.01% (1.1364 => 1.1820, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.01% (0.4016 => 0.4177, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.00% (1.4563 => 1.5146, std. dev.: 0.0071) MultiSource/Applications/spiff/spiff: 4.00% (0.7506 => 0.7806, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.96% (1.0594 => 1.1014, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.94% (0.5637 => 0.5859, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.88% (0.3246 => 0.3372, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3534 => 0.3670, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.71% (3.8646 => 4.0081, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 3.67% (0.3868 => 0.4010, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 3.67% (0.8310 => 0.8615, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.61% (1.9270 => 1.9966, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.55% (7.2180 => 7.4741, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 3.53% (1.1061 => 1.1451, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 3.50% (0.2945 => 0.3048, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.37% (3.6692 => 3.7927, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.32% (0.7460 => 0.7708, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.08% (1.2292 => 1.2670, std. dev.: 0.0107) MultiSource/Applications/siod/siod: 2.98% (2.1791 => 2.2441, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.98% (4.3801 => 4.5107, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.78% (4.4433 => 4.5670, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3755 => 0.3858, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.74% (4.9865 => 5.1231, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.67% (0.4791 => 0.4919, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.49% (3.1889 => 3.2684, std. dev.: 0.0167) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.46% (1.1333 => 1.1612, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.33% (0.8698 => 0.8901, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6283 => 0.6428, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.27% (16.2614 => 16.6305, std. dev.: 0.0203) MultiSource/Applications/JM/ldecod/ldecod: 2.26% (6.5754 => 6.7240, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 2.16% (14.8535 => 15.1738, std. dev.: 0.0112) MultiSource/Applications/ClamAV/clamscan: 2.06% (14.5298 => 14.8296, std. dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.99% (0.6135 => 0.6257, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.92% (8.4961 => 8.6590, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.85% (2.1007 => 2.1395, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.74% (1.5188 => 1.5452, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (3.2742 => 3.3301, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.55% (4.6629 => 4.7354, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.01% (1.0313 => 1.0417, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2589, std. dev.: 0.0609) SingleSource/Benchmarks/Misc/mandel-2: 8.52% (1.2998 => 1.4106, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.34% (2.0200 => 2.1884, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9996 => 1.0777, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.37% (1.5824 => 1.6991, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.2619 => 11.7366, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7303, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9213, std. dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4781, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.21% (1.7688 => 1.8079, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.88% (31.4682 => 32.0607, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.75% (3.6469 => 3.7107, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (1.9290 => 1.9573, std. dev.: 0.0074) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5073, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1943, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.26% (10.7476 => 10.8827, std. dev.: 0.0398) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: 1.15% (3.1736 => 3.2100, std. dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.61% (22.5627 => 21.0722, std. dev.: 0.0174) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.84% (0.6576 => 0.6455, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.59% (0.8818 => 0.8678, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.55% (0.0997 => 0.0832, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -10.21% (1.2308 => 1.1051, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.60% (20.3410 => 18.5914, std. dev.: 0.0467) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3068, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5502, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9130, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.75% (3.0263 => 2.9432, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6035, std. dev.: 0.0114) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4465, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4996, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.74% (0.8342 => 0.8197, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.47% (6.3560 => 6.2623, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (0.9692 => 0.9559, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8664, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2154, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2427, std. dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8043, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2601, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (28.2225 => 27.9288, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 13:42:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 15:42:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120717204224.6A8172A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2152?compare_to=2150&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2152, Order: 160385, Start Time: 2012-07-17 19:24:21, End Time: 2012-07-17 20:42:36 To: 2150, Order: 160372, Start Time: 2012-07-17 17:38:18, End Time: 2012-07-17 18:56:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (62 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (792 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.57% (79.3809 => 80.6311, std. dev.: 0.3530) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.85% (13.4354 => 13.1862, std. dev.: 0.0077) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.19% (10.3673 => 13.1862, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.69% (1.1194 => 1.2503, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.14% (0.3473 => 0.3825, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.96% (0.3543 => 0.3896, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 9.92% (0.3497 => 0.3844, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.87% (0.3516 => 0.3863, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 9.79% (0.3543 => 0.3890, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.72% (0.3561 => 0.3907, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.34% (0.3694 => 0.4039, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.25% (0.3828 => 0.4182, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.24% (2.2022 => 2.4056, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 9.12% (0.3927 => 0.4285, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.03% (0.3886 => 0.4237, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.08% (1.7609 => 1.9031, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (0.1622 => 0.1737, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.40% (7.0540 => 7.4350, std. dev.: 0.0138) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.3177 => 0.3342, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.18% (0.2065 => 0.2172, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 5.12% (0.3282 => 0.3450, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.98% (0.6030 => 0.6330, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 4.89% (0.5925 => 0.6215, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.4879 => 0.5107, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.23% (0.4615 => 0.4810, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.14% (0.7433 => 0.7741, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.98% (0.8172 => 0.8497, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 3.86% (0.7326 => 0.7609, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (9.4845 => 9.8075, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.19% (5.0018 => 5.1614, std. dev.: 0.0114) MultiSource/Applications/JM/ldecod/ldecod: 3.15% (10.4361 => 10.7651, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.12% (0.5569 => 0.5743, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.09% (4.9449 => 5.0979, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 2.81% (5.7591 => 5.9210, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.75% (0.5860 => 0.6021, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.71% (0.7835 => 0.8047, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.66% (4.2646 => 4.3782, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.64% (8.1363 => 8.3510, std. dev.: 0.0069) MultiSource/Applications/hbd/hbd: 2.54% (1.5603 => 1.5999, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.53% (14.3668 => 14.7303, std. dev.: 0.0179) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.28% (1.1861 => 1.2131, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.28% (3.3354 => 3.4113, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.13% (1.3050 => 1.3328, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 1.98% (1.1642 => 1.1872, std. dev.: 0.0067) MultiSource/Applications/treecc/treecc: 1.92% (2.0273 => 2.0663, std. dev.: 0.0073) MultiSource/Applications/lua/lua: 1.91% (3.8723 => 3.9463, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.76% (1.5415 => 1.5687, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.66% (1.4186 => 1.4422, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.61% (17.1811 => 17.4571, std. dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (2.2024 => 2.2375, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.53% (1.5859 => 1.6102, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.48% (0.7115 => 0.7220, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.46% (0.9765 => 0.9908, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7466, std. dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 1.66% (3.1578 => 3.2101, std. dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.31% (9.1159 => 9.2355, std. dev.: 0.0232) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7879, std. dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.23% (2.6546 => 2.6872, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.10% (6.6465 => 6.7195, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1259, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.35% (5.2763 => 3.1473, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.96% (5.3855 => 3.7182, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.68% (5.3526 => 3.7102, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.22% (2.9384 => 2.5498, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -10.46% (22.1758 => 19.8556, std. dev.: 0.0092) SingleSource/UnitTests/Vector/constpool: -4.94% (54.1659 => 51.4896, std. dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.43% (3.8922 => 3.8364, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.73% (1.2373 => 1.1045, std. dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.07% (19.9488 => 18.5387, std. dev.: 0.0526) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9130, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0855, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8085, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.03% (32.5116 => 32.1773, std. dev.: 0.0082) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 13:49:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 15:49:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120717204952.AE0852A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2153?compare_to=2148&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2153, Order: 160375, Start Time: 2012-07-17 18:06:58, End Time: 2012-07-17 20:50:05 To: 2148, Order: 160362, Start Time: 2012-07-17 14:55:43, End Time: 2012-07-17 17:39:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (79 on baseline) Performance Improvements: 1 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 950 (813 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.28% (0.9931 => 1.0058, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -5.28% (131.7040 => 124.7531, std. dev.: 1.1575) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.84% (0.3465 => 0.3910, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 12.61% (0.3496 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3442 => 0.3876, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.57% (0.3460 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.57% (0.3446 => 0.3879, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.56% (0.3488 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.40% (0.3469 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.16% (0.3650 => 0.4094, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.97% (0.3643 => 0.4079, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.63% (0.3724 => 0.4157, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.64% (0.5826 => 0.6213, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.23% (0.5889 => 0.6256, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.88% (0.7171 => 0.7521, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.82% (3.5627 => 3.7343, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.74% (1.6211 => 1.6979, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.44% (0.5900 => 0.6162, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.40% (0.4361 => 0.4553, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.16% (0.2714 => 0.2827, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.13% (0.2738 => 0.2851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.10% (0.2875 => 0.2993, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 4.10% (0.2803 => 0.2918, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.07% (0.2729 => 0.2840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.00% (0.2750 => 0.2860, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 3.96% (0.2780 => 0.2890, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.90% (2.0673 => 2.1480, std. dev.: 0.0096) MultiSource/Applications/spiff/spiff: 3.90% (0.4029 => 0.4186, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 3.87% (0.2813 => 0.2922, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.87% (0.2792 => 0.2900, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 3.86% (0.2823 => 0.2932, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.85% (1.3152 => 1.3659, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.85% (0.2911 => 0.3023, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.81% (0.2811 => 0.2918, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.77% (0.9909 => 1.0283, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 3.76% (0.3267 => 0.3390, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.76% (0.4994 => 0.5182, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.75% (2.7292 => 2.8315, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 3.74% (0.3258 => 0.3380, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 3.73% (0.3004 => 0.3116, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.72% (0.9697 => 1.0058, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.69% (0.3930 => 0.4075, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.66% (0.3362 => 0.3485, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.65% (0.3124 => 0.3238, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.56% (0.3060 => 0.3169, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.56% (0.2866 => 0.2968, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (0.3195 => 0.3308, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.52% (0.5026 => 0.5203, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.48% (0.5000 => 0.5174, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.48% (4.2109 => 4.3574, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 3.47% (0.3317 => 0.3432, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.38% (0.3282 => 0.3393, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.37% (0.3678 => 0.3802, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.26% (0.3348 => 0.3457, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.26% (0.3625 => 0.3743, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 3.22% (0.3726 => 0.3846, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.19% (0.3477 => 0.3588, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.10% (1.9694 => 2.0305, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.01% (0.3690 => 0.3801, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.97% (0.4146 => 0.4269, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.88% (1.9966 => 2.0541, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 2.82% (0.4251 => 0.4371, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.78% (0.3845 => 0.3952, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 2.67% (1.0781 => 1.1069, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.66% (0.3981 => 0.4087, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.66% (0.4658 => 0.4782, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (0.3890 => 0.3991, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.58% (2.1013 => 2.1555, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 2.57% (23.5202 => 24.1244, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.37% (4.4195 => 4.5243, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.5012 => 0.5130, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.34% (4.6177 => 4.7259, std. dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: 2.29% (1.8794 => 1.9225, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (2.1653 => 2.2137, std. dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 2.21% (5.5417 => 5.6639, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.19% (0.6435 => 0.6576, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.99% (0.7875 => 0.8032, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.92% (1.4269 => 1.4543, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.04% (2.8036 => 2.8328, std. dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.90% (2.4764 => 2.3799, std. dev.: 0.0101) MultiSource/Applications/kimwitu++/kc: -1.78% (11.9555 => 11.7425, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 15:10:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 17:10:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120717221021.5897F2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2154?compare_to=2151&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2154, Order: 160393, Start Time: 2012-07-17 20:56:39, End Time: 2012-07-17 22:10:32 To: 2151, Order: 160384, Start Time: 2012-07-17 19:14:38, End Time: 2012-07-17 20:28:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 7 (143 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 945 (708 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.54% (0.7616 => 0.7733, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.42% (2.0748 => 2.1043, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.07% (1.2670 => 1.2805, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.20% (78.3659 => 80.8757, std. dev.: 0.3804) MultiSource/Benchmarks/llubenchmark/llu: 2.08% (3.7754 => 3.8540, std. dev.: 0.0232) SingleSource/Benchmarks/Misc/lowercase: 1.66% (7.9328 => 8.0647, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.12% (1.4354 => 1.4515, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.74% (2.0176 => 2.3149, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.71% (0.5818 => 0.6383, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.59% (0.5748 => 0.6299, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 9.52% (0.7061 => 0.7733, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 9.39% (0.3578 => 0.3914, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.11% (0.3601 => 0.3929, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.11% (0.3646 => 0.3978, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.07% (0.3650 => 0.3981, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.03% (0.3623 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.97% (0.3789 => 0.4129, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.95% (0.3663 => 0.3991, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.79% (0.3914 => 0.4258, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.74% (0.4003 => 0.4353, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.65% (0.3940 => 0.4281, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 7.94% (1.3693 => 1.4780, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.39% (0.4062 => 0.4362, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.15% (0.1986 => 0.2128, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.89% (0.4328 => 0.4626, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.69% (0.2781 => 0.2967, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.56% (0.7710 => 0.8216, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2782 => 0.2962, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.44% (0.2607 => 0.2775, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.44% (0.2937 => 0.3126, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.42% (0.3022 => 0.3216, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.37% (0.2655 => 0.2824, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.36% (0.2721 => 0.2894, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2628 => 0.2795, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.33% (3.9660 => 4.2170, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2690 => 0.2860, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.30% (0.2761 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2760 => 0.2933, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.26% (0.2765 => 0.2938, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.22% (0.7038 => 0.7476, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 6.16% (0.2726 => 0.2894, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.13% (0.5265 => 0.5588, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.13% (1.9828 => 2.1043, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.12% (0.3107 => 0.3297, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2596 => 0.2754, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.08% (0.2696 => 0.2860, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.04% (0.2966 => 0.3145, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (0.3149 => 0.3338, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.92% (0.3580 => 0.3792, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.86% (0.3192 => 0.3379, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: 5.79% (0.2988 => 0.3161, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.79% (0.3489 => 0.3691, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.72% (0.1819 => 0.1923, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 5.68% (0.3453 => 0.3649, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.67% (0.3899 => 0.4120, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.62% (0.3485 => 0.3681, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.4379 => 0.4616, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.28% (0.3293 => 0.3467, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.22% (0.3868 => 0.4070, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.19% (0.6959 => 0.7320, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 5.18% (0.3534 => 0.3717, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.13% (0.4390 => 0.4615, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.06% (1.2193 => 1.2810, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.06% (0.3756 => 0.3946, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.96% (13.8202 => 14.5057, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2945 => 0.3089, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.80% (0.9199 => 0.9641, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.77% (0.2914 => 0.3053, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 4.62% (16.6129 => 17.3798, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.55% (0.5577 => 0.5831, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 4.42% (0.7506 => 0.7838, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (13.2842 => 13.8654, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 4.34% (0.2925 => 0.3052, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.31% (1.1364 => 1.1854, std. dev.: 0.0077) MultiSource/Benchmarks/nbench/nbench: 4.25% (1.0594 => 1.1044, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.17% (1.2292 => 1.2805, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.3245 => 1.3794, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.11% (1.3819 => 1.4387, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.07% (0.3246 => 0.3378, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.06% (7.2180 => 7.5108, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.05% (1.4563 => 1.5153, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.04% (0.5637 => 0.5865, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.90% (1.1061 => 1.1492, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 3.85% (1.9270 => 2.0011, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.84% (1.3813 => 1.4343, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.83% (0.3755 => 0.3899, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.79% (0.8310 => 0.8625, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 3.76% (3.8646 => 4.0101, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.71% (0.7460 => 0.7737, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.71% (3.6692 => 3.8054, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3220 => 0.3329, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.34% (4.3801 => 4.5262, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.27% (4.4433 => 4.5885, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.07% (4.9865 => 5.1394, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.98% (0.4791 => 0.4934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.97% (0.8698 => 0.8956, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.87% (2.1791 => 2.2417, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.76% (1.1333 => 1.1646, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 2.72% (0.4113 => 0.4225, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.67% (0.6283 => 0.6451, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 2.66% (3.1889 => 3.2737, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 2.56% (6.5754 => 6.7439, std. dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 2.54% (14.8535 => 15.2309, std. dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.30% (0.6135 => 0.6276, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 2.28% (8.4961 => 8.6897, std. dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: 2.26% (16.2614 => 16.6281, std. dev.: 0.0140) MultiSource/Applications/ClamAV/clamscan: 2.21% (14.5298 => 14.8505, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.1007 => 2.1434, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.95% (3.2742 => 3.3380, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.78% (1.5188 => 1.5458, std. dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 1.77% (4.6629 => 4.7455, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 1.63% (0.6250 => 0.6352, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: 1.48% (0.6744 => 0.6844, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (0.9108 => 0.9243, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.10% (1.0313 => 1.0426, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 27.68% (1.8175 => 2.3205, std. dev.: 0.0263) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.29% (2.0200 => 2.1874, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 7.32% (1.2998 => 1.3949, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.23% (7.4271 => 7.7411, std. dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.2619 => 11.7366, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9202, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9739, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.30% (1.7688 => 1.8094, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 2.14% (3.7731 => 3.8540, std. dev.: 0.0232) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1915, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.86% (31.4682 => 32.0543, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.58% (3.6469 => 3.7047, std. dev.: 0.0034) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.19% (10.7476 => 10.8758, std. dev.: 0.0358) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.14% (3.1736 => 3.2097, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -6.91% (0.4657 => 0.4335, std. dev.: 0.0121) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.33% (22.5627 => 21.1334, std. dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.88% (0.3511 => 0.3410, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.76% (0.6576 => 0.6460, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.17% (0.8818 => 0.8715, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.05% (0.0997 => 0.0837, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -10.38% (1.2308 => 1.1031, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.69% (20.3410 => 18.5728, std. dev.: 0.1003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.25% (1.3780 => 1.3057, std. dev.: 0.0078) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.26% (1.9762 => 1.9118, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.65% (3.0263 => 2.9462, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5986, std. dev.: 0.0113) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.00% (0.8342 => 0.8175, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5053, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2563, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2353, std. dev.: 0.0085) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2505, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2235, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8719, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8045, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (28.2225 => 27.9283, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 15:28:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 17:28:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120717222855.E42F82A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2155?compare_to=2152&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2155, Order: 160393, Start Time: 2012-07-17 21:10:44, End Time: 2012-07-17 22:29:08 To: 2152, Order: 160385, Start Time: 2012-07-17 19:24:21, End Time: 2012-07-17 20:42:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (67 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (787 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lemon/lemon: 1.24% (1.4329 => 1.4506, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 1.03% (27.7409 => 28.0258, std. dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.30% (10.3673 => 13.1980, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: 11.52% (0.3473 => 0.3873, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.32% (0.3497 => 0.3893, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.23% (0.3516 => 0.3911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.21% (0.3543 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.18% (0.3543 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.09% (0.3561 => 0.3956, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (1.1194 => 1.2431, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 10.77% (0.3694 => 0.4092, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.29% (0.3886 => 0.4286, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.29% (0.3927 => 0.4331, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.51% (2.2022 => 2.3897, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.15% (1.7609 => 1.9044, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 5.84% (0.6030 => 0.6382, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.72% (0.5925 => 0.6264, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2065 => 0.2181, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.69% (7.0540 => 7.3849, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.4879 => 0.5105, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference: 4.45% (0.7326 => 0.7652, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.42% (0.4615 => 0.4819, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.18% (0.7433 => 0.7744, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.93% (0.8172 => 0.8493, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.54% (0.5569 => 0.5766, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (9.4845 => 9.8084, std. dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.30% (0.3121 => 0.3224, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.24% (10.4361 => 10.7743, std. dev.: 0.0131) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.16% (5.0018 => 5.1601, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.16% (4.9449 => 5.1012, std. dev.: 0.0073) MultiSource/Applications/hbd/hbd: 3.01% (1.5603 => 1.6072, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.83% (0.5860 => 0.6026, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.83% (5.7591 => 5.9222, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.83% (4.2646 => 4.3853, std. dev.: 0.0077) MultiSource/Applications/spiff/spiff: 2.73% (0.7835 => 0.8049, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.66% (8.1363 => 8.3530, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.59% (14.3668 => 14.7383, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.32% (1.1861 => 1.2136, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.27% (3.3354 => 3.4112, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.25% (1.3050 => 1.3344, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.18% (2.0665 => 2.1116, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.08% (1.1642 => 1.1884, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 2.06% (2.0273 => 2.0690, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.03% (0.8067 => 0.8231, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.92% (1.5415 => 1.5711, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 1.85% (3.8723 => 3.9438, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 1.80% (0.6456 => 0.6572, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.77% (2.2024 => 2.2414, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.73% (17.1811 => 17.4788, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.66% (1.4186 => 1.4422, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (1.5859 => 1.6082, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.39% (1.2842 => 1.3020, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 1.13% (0.8921 => 0.9022, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.06% (1.1840 => 1.1966, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7473, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (1.5086 => 1.5369, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 1.79% (3.1578 => 3.2143, std. dev.: 0.0053) MultiSource/Applications/minisat/minisat: 1.64% (9.1159 => 9.2651, std. dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6874, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.22% (11.6436 => 11.7851, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 1.04% (6.6465 => 6.7156, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1261, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.38% (5.2763 => 3.1458, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.30% (5.3855 => 3.6996, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.06% (5.3526 => 3.6900, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.66% (2.9384 => 2.5371, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -10.54% (22.1758 => 19.8381, std. dev.: 0.0163) SingleSource/UnitTests/Vector/constpool: -5.35% (54.1659 => 51.2691, std. dev.: 0.0242) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.50% (3.8922 => 3.8337, std. dev.: 0.0167) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2373 => 1.1056, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.19% (19.9488 => 18.5148, std. dev.: 0.0900) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.91% (8.1563 => 7.9192, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0827, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8097, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.06% (1.3677 => 1.3532, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.02% (32.5116 => 32.1794, std. dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 17:01:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 19:01:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120718000103.B90012A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2156?compare_to=2153&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2156, Order: 160393, Start Time: 2012-07-17 21:17:58, End Time: 2012-07-18 00:01:15 To: 2153, Order: 160375, Start Time: 2012-07-17 18:06:58, End Time: 2012-07-17 20:50:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (80 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 951 (812 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 3.78% (1.6069 => 1.6677, std. dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.84% (0.3465 => 0.3910, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.73% (0.3442 => 0.3880, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.71% (0.3446 => 0.3884, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.67% (0.3496 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.65% (0.3469 => 0.3908, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.63% (0.3460 => 0.3897, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.53% (0.3488 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.36% (0.3650 => 0.4101, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.16% (0.3643 => 0.4086, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.76% (0.3724 => 0.4162, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.90% (0.5826 => 0.6228, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.64% (0.5889 => 0.6280, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.16% (0.7171 => 0.7541, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.89% (0.2738 => 0.2872, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.77% (1.6211 => 1.6984, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.75% (3.5627 => 3.7321, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.68% (1.5932 => 1.6677, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.49% (0.4994 => 0.5218, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.44% (0.4029 => 0.4208, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.37% (0.5900 => 0.6158, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.31% (1.3152 => 1.3719, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.29% (0.4361 => 0.4548, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 4.22% (0.2725 => 0.2840, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.14% (0.2729 => 0.2842, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.14% (0.2875 => 0.2994, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.13% (0.2714 => 0.2826, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.12% (0.2813 => 0.2929, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.12% (0.3930 => 0.4092, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.2866 => 0.2984, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.98% (0.2792 => 0.2903, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.96% (0.2803 => 0.2914, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.93% (0.2823 => 0.2934, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.92% (0.9909 => 1.0297, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.88% (0.3096 => 0.3216, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.87% (2.0673 => 2.1474, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.86% (0.5000 => 0.5193, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: 3.81% (0.2811 => 0.2918, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.78% (2.7292 => 2.8325, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 3.78% (0.2780 => 0.2885, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.76% (0.9697 => 1.0062, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.73% (0.3267 => 0.3389, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.73% (0.3004 => 0.3116, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.71% (4.2109 => 4.3673, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary: 3.71% (0.3258 => 0.3379, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.71% (0.2911 => 0.3019, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.70% (0.5026 => 0.5212, std. dev.: 0.0048) MultiSource/Applications/d/make_dparser: 3.69% (1.0781 => 1.1179, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.69% (0.3362 => 0.3486, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.3625 => 0.3758, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.65% (0.3124 => 0.3238, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.53% (0.3317 => 0.3434, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.51% (0.3195 => 0.3307, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.50% (0.3282 => 0.3397, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.40% (0.3060 => 0.3164, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.39% (0.3477 => 0.3595, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.27% (0.3726 => 0.3848, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.21% (1.9694 => 2.0327, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 3.20% (0.3348 => 0.3455, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.18% (0.4251 => 0.4386, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.12% (0.3690 => 0.3805, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.06% (0.3890 => 0.4009, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 3.02% (5.5417 => 5.7092, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 3.01% (0.4146 => 0.4271, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.91% (0.3845 => 0.3957, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.88% (0.4658 => 0.4792, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 2.86% (2.1013 => 2.1613, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.84% (1.9966 => 2.0533, std. dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 2.75% (23.5202 => 24.1680, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.3981 => 0.4089, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 2.71% (1.8794 => 1.9303, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (2.1653 => 2.2238, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.67% (4.4195 => 4.5373, std. dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 2.65% (4.6177 => 4.7402, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.63% (0.7875 => 0.8082, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.45% (0.5012 => 0.5135, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.33% (1.4269 => 1.4602, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.24% (0.6435 => 0.6579, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.11% (0.6634 => 0.6774, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.93% (0.5546 => 0.5653, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.00% (2.0346 => 2.0550, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.17% (2.4764 => 2.3980, std. dev.: 0.0188) MultiSource/Applications/kimwitu++/kc: -1.61% (11.9555 => 11.7634, std. dev.: 0.0136) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 17:20:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 19:20:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120718002005.5250F2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2157?compare_to=2154&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2157, Order: 160401, Start Time: 2012-07-17 23:06:25, End Time: 2012-07-18 00:20:17 To: 2154, Order: 160393, Start Time: 2012-07-17 20:56:39, End Time: 2012-07-17 22:10:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (142 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 951 (714 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.96% (3.8540 => 3.7783, std. dev.: 0.0141) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.67% (2.0176 => 2.3135, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.66% (0.5818 => 0.6380, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.50% (0.5748 => 0.6294, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 9.15% (0.7061 => 0.7707, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 8.61% (0.3578 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.44% (0.3650 => 0.3958, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 8.37% (0.3646 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.33% (0.3601 => 0.3901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.27% (0.3663 => 0.3966, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.26% (0.3789 => 0.4102, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.20% (0.3623 => 0.3920, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.10% (0.3914 => 0.4231, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.07% (0.4003 => 0.4326, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.94% (0.3940 => 0.4253, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.70% (0.3130 => 0.3371, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.41% (1.3693 => 1.4708, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.15% (0.1986 => 0.2128, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.55% (0.7710 => 0.8215, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.46% (0.7038 => 0.7493, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (0.4328 => 0.4607, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.40% (3.9660 => 4.2198, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.31% (0.5265 => 0.5597, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2596 => 0.2757, std. dev.: 0.0040) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.90% (0.2782 => 0.2946, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.86% (0.4062 => 0.4300, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 5.83% (0.2607 => 0.2759, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3022 => 0.3197, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.75% (0.2765 => 0.2924, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.71% (0.2628 => 0.2778, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.65% (0.2760 => 0.2916, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.62% (0.2937 => 0.3102, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.57% (0.4379 => 0.4623, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/strcat: 5.50% (0.2726 => 0.2876, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.49% (1.9828 => 2.0917, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.3107 => 0.3277, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.45% (0.2696 => 0.2843, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.45% (0.3192 => 0.3366, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.42% (0.3580 => 0.3774, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.42% (0.3489 => 0.3678, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.32% (1.2193 => 1.2842, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.29% (0.6959 => 0.7327, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 5.27% (0.3149 => 0.3315, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.26% (0.3899 => 0.4104, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.19% (0.3485 => 0.3666, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.04% (0.3293 => 0.3459, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.99% (0.9199 => 0.9658, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.99% (0.4390 => 0.4609, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 4.94% (13.8202 => 14.5027, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.91% (0.4016 => 0.4213, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.90% (0.3534 => 0.3707, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.74% (0.2914 => 0.3052, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3756 => 0.3932, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.64% (0.5577 => 0.5836, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.57% (16.6129 => 17.3722, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.3868 => 0.4044, std. dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 4.49% (1.0594 => 1.1070, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.43% (1.1364 => 1.1867, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: 4.38% (0.7506 => 0.7835, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.37% (1.4563 => 1.5200, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.36% (0.5637 => 0.5883, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.35% (13.2842 => 13.8618, std. dev.: 0.0209) MultiSource/Benchmarks/McCat/09-vor/vor: 4.34% (0.2925 => 0.3052, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.33% (1.3245 => 1.3819, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.28% (1.3819 => 1.4410, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.22% (0.3246 => 0.3383, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.13% (1.3813 => 1.4384, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.07% (7.2180 => 7.5117, std. dev.: 0.0066) MultiSource/Applications/Burg/burg: 4.05% (1.1061 => 1.1509, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 4.01% (0.8310 => 0.8643, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: 3.91% (3.8646 => 4.0158, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.87% (0.7460 => 0.7749, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.87% (1.9270 => 2.0015, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.85% (3.6692 => 3.8103, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.84% (1.2292 => 1.2764, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.60% (4.3801 => 4.5376, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3755 => 0.3885, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.39% (4.4433 => 4.5939, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.31% (4.9865 => 5.1518, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.09% (0.4791 => 0.4939, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.03% (2.1791 => 2.2452, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.98% (1.1333 => 1.1671, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 2.97% (0.4113 => 0.4235, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.77% (0.8698 => 0.8939, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.75% (14.8535 => 15.2619, std. dev.: 0.0076) MultiSource/Applications/d/make_dparser: 2.70% (3.1889 => 3.2749, std. dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 2.64% (6.5754 => 6.7491, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.63% (0.6283 => 0.6448, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 2.48% (8.4961 => 8.7072, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.44% (0.6135 => 0.6285, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.34% (16.2614 => 16.6420, std. dev.: 0.0118) MultiSource/Applications/ClamAV/clamscan: 2.31% (14.5298 => 14.8650, std. dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (2.1007 => 2.1473, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.05% (3.2742 => 3.3414, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 1.97% (4.6629 => 4.7549, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.90% (1.5188 => 1.5477, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.68% (0.9108 => 0.9261, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.53% (0.6744 => 0.6847, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.07% (1.0313 => 1.0423, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2670, std. dev.: 0.0367) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1908, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9996 => 1.0784, std. dev.: 0.0062) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.43% (1.5824 => 1.6999, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.05% (1.2998 => 1.3915, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.2619 => 11.7366, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.85% (7.4271 => 7.7129, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.55% (2.8606 => 2.9621, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4807, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0310 => 1.0562, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.25% (1.7688 => 1.8086, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1903, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.89% (31.4682 => 32.0618, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.55% (1.9290 => 1.9589, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.45% (3.6469 => 3.6996, std. dev.: 0.0077) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1941, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.08% (3.1736 => 3.2078, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout/ary3: 1.05% (3.6975 => 3.7365, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.45% (22.5627 => 21.1063, std. dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.65% (0.0997 => 0.0841, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.51% (1.2308 => 1.1137, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.79% (20.3410 => 18.5529, std. dev.: 0.0776) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.08% (1.3780 => 1.3080, std. dev.: 0.0101) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.19% (1.9762 => 1.9131, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.74% (3.0263 => 2.9433, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6056, std. dev.: 0.0101) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.32% (0.4867 => 0.4754, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.00% (0.8342 => 0.8175, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5052, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2529, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4899, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (0.9692 => 0.9564, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2263, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8044, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2568, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.03% (28.2225 => 27.9308, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 17:30:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 19:30:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120718003040.B17BB2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2158?compare_to=2155&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2158, Order: 160401, Start Time: 2012-07-17 23:12:41, End Time: 2012-07-18 00:30:53 To: 2155, Order: 160393, Start Time: 2012-07-17 21:10:44, End Time: 2012-07-17 22:29:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (66 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (788 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.17% (13.1980 => 13.4845, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.06% (54.9296 => 56.6130, std. dev.: 0.0364) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.07% (10.3673 => 13.4845, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.49% (1.1194 => 1.2480, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3516 => 0.3875, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.19% (0.3543 => 0.3904, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 10.18% (0.3497 => 0.3853, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.10% (0.3543 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.75% (0.3694 => 0.4054, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.61% (0.3828 => 0.4196, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.50% (0.3886 => 0.4255, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.42% (0.3927 => 0.4297, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.52% (2.2022 => 2.3899, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.09% (1.7609 => 1.9034, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (0.1622 => 0.1731, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2065 => 0.2180, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.3177 => 0.3343, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 5.06% (0.5925 => 0.6225, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 4.99% (0.6030 => 0.6331, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.80% (7.0540 => 7.3929, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: 4.72% (0.3282 => 0.3437, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.4879 => 0.5107, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.25% (0.4615 => 0.4811, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 4.10% (0.7433 => 0.7738, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.05% (0.7326 => 0.7623, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (9.4845 => 9.7987, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.30% (0.8172 => 0.8442, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.18% (0.5569 => 0.5746, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.0018 => 5.1605, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.12% (4.9449 => 5.0991, std. dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 2.91% (10.4361 => 10.7400, std. dev.: 0.0145) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.79% (4.2646 => 4.3837, std. dev.: 0.0111) MultiSource/Applications/spiff/spiff: 2.78% (0.7835 => 0.8053, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.71% (0.5860 => 0.6019, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.60% (14.3668 => 14.7410, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.60% (8.1363 => 8.3481, std. dev.: 0.0038) MultiSource/Applications/hbd/hbd: 2.45% (1.5603 => 1.5986, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 2.40% (5.7591 => 5.8973, std. dev.: 0.0164) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.35% (1.1861 => 1.2140, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.27% (3.3354 => 3.4112, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.22% (1.3050 => 1.3340, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 2.10% (2.0273 => 2.0699, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.03% (1.1642 => 1.1878, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.95% (0.8067 => 0.8224, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.92% (3.8723 => 3.9468, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.5415 => 1.5700, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.75% (17.1811 => 17.4815, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.70% (2.2024 => 2.2399, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.66% (0.9765 => 0.9927, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.59% (1.4186 => 1.4411, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.54% (1.5859 => 1.6104, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.51% (2.0665 => 2.0978, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 1.06% (1.1840 => 1.1965, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.00% (2.2969 => 2.3199, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7494, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.83% (3.1578 => 3.2155, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5086 => 1.5345, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.49% (9.1159 => 9.2520, std. dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.38% (2.6546 => 2.6913, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.21% (11.6436 => 11.7847, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/oourafft: 1.10% (6.6465 => 6.7197, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.46% (5.2763 => 3.1416, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.17% (5.3855 => 3.7066, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.96% (5.3526 => 3.6952, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.24% (2.9384 => 2.5494, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.31% (22.1758 => 19.8900, std. dev.: 0.0053) SingleSource/UnitTests/Vector/constpool: -5.31% (54.1659 => 51.2916, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.50% (3.8922 => 3.8340, std. dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.23% (0.0998 => 0.0846, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.09% (1.2373 => 1.1125, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.78% (19.9488 => 18.5963, std. dev.: 0.0533) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (8.1563 => 7.9091, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0856, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.21% (1.8329 => 1.8108, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.03% (32.5116 => 32.1782, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 19:01:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 21:01:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120718020153.2A19B2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2159?compare_to=2157&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2159, Order: 160411, Start Time: 2012-07-18 00:48:09, End Time: 2012-07-18 02:02:04 To: 2157, Order: 160401, Start Time: 2012-07-17 23:06:25, End Time: 2012-07-18 00:20:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (139 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 949 (714 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.85% (33.4587 => 34.0772, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.55% (2.0917 => 2.1242, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 1.47% (0.7707 => 0.7820, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.29% (2.0176 => 2.3059, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 11.31% (0.5818 => 0.6476, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.22% (0.5748 => 0.6393, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.75% (0.7061 => 0.7820, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.45% (0.3578 => 0.3916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.24% (0.3646 => 0.3983, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.22% (0.3601 => 0.3933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.12% (0.3663 => 0.3997, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.10% (0.3650 => 0.3982, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 9.05% (0.3623 => 0.3951, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.05% (0.3789 => 0.4132, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.94% (0.3914 => 0.4264, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.78% (0.3940 => 0.4286, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 8.77% (0.4003 => 0.4354, std. dev.: 0.0042) SingleSource/Regression/C++/ofstream_ctor: 7.84% (0.2781 => 0.2999, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (0.4328 => 0.4659, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.62% (0.2782 => 0.2994, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.59% (1.3693 => 1.4732, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 7.56% (0.2607 => 0.2804, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.48% (0.3130 => 0.3364, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.46% (0.2655 => 0.2853, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 7.39% (0.2937 => 0.3154, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.36% (0.4062 => 0.4361, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 7.36% (0.2690 => 0.2888, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2628 => 0.2821, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 7.32% (0.2760 => 0.2962, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.22% (0.2966 => 0.3180, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3022 => 0.3240, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2765 => 0.2964, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.19% (0.2726 => 0.2922, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.17% (0.2761 => 0.2959, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.13% (1.9828 => 2.1242, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.11% (0.3107 => 0.3328, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.01% (0.3580 => 0.3831, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 6.99% (0.3149 => 0.3369, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.2721 => 0.2910, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.86% (0.7038 => 0.7521, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.85% (0.3489 => 0.3728, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2988 => 0.3190, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.70% (0.1986 => 0.2119, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.65% (0.4390 => 0.4682, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 6.64% (0.3192 => 0.3404, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.62% (0.3899 => 0.4157, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.58% (0.7710 => 0.8217, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 6.49% (0.3453 => 0.3677, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.48% (0.3485 => 0.3711, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.17% (0.5265 => 0.5590, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (3.9660 => 4.2086, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 6.10% (0.3293 => 0.3494, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.3534 => 0.3748, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.05% (0.2596 => 0.2753, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.96% (0.3756 => 0.3980, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.95% (0.3868 => 0.4098, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2945 => 0.3113, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.49% (16.6129 => 17.5249, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.25% (0.6959 => 0.7324, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.4379 => 0.4607, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.13% (1.2193 => 1.2818, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 4.92% (1.2292 => 1.2897, std. dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: 4.90% (13.8202 => 14.4979, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.90% (0.9199 => 0.9650, std. dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.77% (0.2914 => 0.3053, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.69% (0.3755 => 0.3931, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.65% (0.7506 => 0.7855, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.63% (0.5577 => 0.5835, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.48% (13.2842 => 13.8794, std. dev.: 0.0147) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.35% (1.3813 => 1.4414, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (1.3819 => 1.4418, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 4.24% (0.8310 => 0.8662, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.21% (1.3245 => 1.3803, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.21% (1.4563 => 1.5176, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.02% (1.1364 => 1.1821, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.99% (0.5637 => 0.5862, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.97% (0.3246 => 0.3375, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.97% (1.0594 => 1.1015, std. dev.: 0.0049) MultiSource/Applications/treecc/treecc: 3.96% (1.9270 => 2.0033, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 3.95% (1.1061 => 1.1498, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.91% (7.2180 => 7.5004, std. dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 3.90% (3.8646 => 4.0153, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.63% (3.6692 => 3.8024, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.50% (0.7460 => 0.7721, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.48% (0.8698 => 0.9001, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.41% (4.9865 => 5.1567, std. dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.37% (4.3801 => 4.5276, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.26% (4.4433 => 4.5883, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 3.04% (2.1791 => 2.2453, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.94% (0.4791 => 0.4932, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.77% (0.6283 => 0.6457, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.74% (1.1333 => 1.1644, std. dev.: 0.0079) MultiSource/Applications/JM/ldecod/ldecod: 2.61% (6.5754 => 6.7469, std. dev.: 0.0137) MultiSource/Applications/JM/lencod/lencod: 2.60% (14.8535 => 15.2404, std. dev.: 0.0067) MultiSource/Applications/d/make_dparser: 2.56% (3.1889 => 3.2706, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 2.48% (0.4113 => 0.4215, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.41% (16.2614 => 16.6529, std. dev.: 0.0148) MultiSource/Benchmarks/Bullet/bullet: 2.35% (33.2944 => 34.0772, std. dev.: 0.0137) MultiSource/Applications/ClamAV/clamscan: 2.28% (14.5298 => 14.8614, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.22% (0.6135 => 0.6271, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.22% (8.4961 => 8.6844, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.89% (2.1007 => 2.1405, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: 1.73% (0.6744 => 0.6861, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (3.2742 => 3.3300, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.44% (0.9108 => 0.9239, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 1.40% (4.6629 => 4.7284, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.16% (1.0313 => 1.0433, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2611, std. dev.: 0.0548) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1934, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9996 => 1.0782, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.41% (1.5824 => 1.6997, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.75% (1.2998 => 1.3876, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.2619 => 11.7364, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 4.05% (7.4271 => 7.7280, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9199, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.37% (1.0310 => 1.0554, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.27% (1.7688 => 1.8089, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.85% (31.4682 => 32.0519, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5336, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.60% (3.6469 => 3.7051, std. dev.: 0.0057) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4522, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (1.9290 => 1.9555, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.29% (3.1736 => 3.2145, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.26% (10.7476 => 10.8830, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.99% (0.4657 => 0.4145, std. dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.15% (22.5627 => 21.1740, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.60% (0.8818 => 0.8677, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.97% (1.2308 => 1.1081, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.54% (20.3410 => 18.6042, std. dev.: 0.0454) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std. dev.: 0.0071) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.15% (1.9762 => 1.9139, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.67% (3.0263 => 2.9454, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5901, std. dev.: 0.0136) SingleSource/Benchmarks/Dhrystone/dry: -2.51% (2.5089 => 2.4459, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.00% (0.8342 => 0.8175, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5106, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.58% (6.3560 => 6.2554, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: -1.58% (7.1097 => 6.9977, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8582, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.47% (0.9692 => 0.9550, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2130, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8046, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.14% (7.3305 => 7.2469, std. dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2561, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (28.2225 => 27.9281, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 19:16:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 21:16:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120718021651.B72F22A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2160?compare_to=2158&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2160, Order: 160412, Start Time: 2012-07-18 00:58:48, End Time: 2012-07-18 02:17:03 To: 2158, Order: 160401, Start Time: 2012-07-17 23:12:41, End Time: 2012-07-18 00:30:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (83 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (58 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 926 (771 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 2.39% (10.7400 => 10.9971, std. dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: 2.17% (13.4845 => 13.7770, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 1.58% (0.6331 => 0.6431, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 1.39% (0.7623 => 0.7729, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.34% (2.0978 => 2.1259, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: -1.03% (28.0300 => 27.7411, std. dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.89% (10.3673 => 13.7770, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.29% (0.3473 => 0.3865, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (1.1194 => 1.2434, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.98% (0.3543 => 0.3932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.92% (0.3497 => 0.3879, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.89% (0.3543 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.86% (0.3516 => 0.3898, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.78% (0.3561 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.11% (0.3828 => 0.4215, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.08% (0.3927 => 0.4323, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.04% (0.3886 => 0.4276, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.38% (2.2022 => 2.3867, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.55% (1.7609 => 1.8939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.72% (0.5925 => 0.6323, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.65% (0.6030 => 0.6431, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.50% (0.7326 => 0.7729, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.38% (10.4361 => 10.9971, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.33% (0.2065 => 0.2175, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.16% (0.3177 => 0.3341, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 5.12% (0.3282 => 0.3450, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.91% (7.0540 => 7.4007, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.4879 => 0.5105, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.61% (0.7433 => 0.7776, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.59% (0.4615 => 0.4827, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (9.4845 => 9.8311, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.56% (0.3121 => 0.3232, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.48% (5.0018 => 5.1758, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.42% (4.9449 => 5.1140, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.39% (0.5569 => 0.5758, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.19% (0.5860 => 0.6047, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.16% (0.8172 => 0.8430, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (14.3668 => 14.8119, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.07% (4.2646 => 4.3957, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 2.98% (0.3423 => 0.3525, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 2.97% (0.3603 => 0.3710, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.96% (0.3650 => 0.3758, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.93% (5.7591 => 5.9279, std. dev.: 0.0181) MultiSource/Applications/hbd/hbd: 2.93% (1.5603 => 1.6060, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.87% (2.0665 => 2.1259, std. dev.: 0.0058) MultiSource/Applications/spiff/spiff: 2.87% (0.7835 => 0.8060, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.83% (0.4203 => 0.4322, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.74% (0.3826 => 0.3931, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3865 => 0.3971, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.73% (8.1363 => 8.3585, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.4636 => 0.4761, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.69% (0.3935 => 0.4041, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.64% (1.3050 => 1.3395, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 2.64% (0.4620 => 0.4742, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.63% (0.4103 => 0.4211, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 2.58% (3.3354 => 3.4216, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.55% (1.1861 => 1.2164, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.42% (1.1642 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 2.32% (0.6456 => 0.6606, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.32% (2.0273 => 2.0743, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.22% (0.8067 => 0.8246, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.20% (3.8723 => 3.9574, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.2024 => 2.2473, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.02% (1.2842 => 1.3101, std. dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 2.01% (17.1811 => 17.5266, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.00% (1.5415 => 1.5723, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.93% (1.4186 => 1.4460, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.88% (0.9765 => 0.9949, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.80% (0.7115 => 0.7243, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.79% (1.5859 => 1.6143, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.71% (0.6675 => 0.6789, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 1.47% (0.8921 => 0.9052, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.31% (1.1840 => 1.1995, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.18% (2.2969 => 2.3239, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.03% (1.0722 => 1.0832, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7462, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.37% (1.0313 => 1.0557, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (1.5086 => 1.5364, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2138, std. dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2420, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6895, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.22% (11.6436 => 11.7852, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.09% (6.6465 => 6.7190, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.32% (5.2763 => 3.1489, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.22% (5.3855 => 3.7042, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.04% (5.3526 => 3.6912, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.57% (2.9384 => 2.5398, std. dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: -10.32% (22.1758 => 19.8864, std. dev.: 0.0097) SingleSource/UnitTests/Vector/constpool: -5.30% (54.1659 => 51.2929, std. dev.: 0.0426) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.39% (3.8922 => 3.8381, std. dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.04% (1.2373 => 1.1131, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.04% (19.9488 => 18.5448, std. dev.: 0.0821) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (8.1563 => 7.9173, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0859, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8097, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.00% (32.5116 => 32.1858, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 20:12:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 22:12:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120718031229.DA0AD2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2161?compare_to=2156&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2161, Order: 160408, Start Time: 2012-07-18 00:29:11, End Time: 2012-07-18 03:12:40 To: 2156, Order: 160393, Start Time: 2012-07-17 21:17:58, End Time: 2012-07-18 00:01:15 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 6 (85 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 946 (809 on baseline) Total Tests: 952 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 4.68% (2.3980 => 2.5102, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.31% (0.4171 => 0.4309, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.70% (2.1474 => 2.1839, std. dev.: 0.0115) MultiSource/Applications/hexxagon/hexxagon: 1.70% (1.0297 => 1.0472, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.67% (24.1680 => 24.5704, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.04% (124.2856 => 130.5475, std. dev.: 0.4868) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 12.49% (0.3460 => 0.3892, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.39% (0.3446 => 0.3873, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.38% (0.3465 => 0.3894, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3442 => 0.3868, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 12.36% (0.3496 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.33% (0.3488 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.25% (0.3469 => 0.3894, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.00% (0.3650 => 0.4088, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.91% (0.3643 => 0.4077, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.52% (0.3724 => 0.4153, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.20% (0.5826 => 0.6304, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.85% (0.5889 => 0.6351, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.88% (0.3792 => 0.4053, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.43% (0.2738 => 0.2914, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 6.32% (0.7171 => 0.7624, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.26% (0.2875 => 0.3055, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.17% (0.2725 => 0.2893, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2729 => 0.2896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.89% (0.2803 => 0.2968, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.81% (0.3096 => 0.3276, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.80% (0.2792 => 0.2954, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.71% (0.2750 => 0.2907, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2823 => 0.2984, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.69% (0.2813 => 0.2973, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 5.68% (0.9909 => 1.0472, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.67% (0.2911 => 0.3076, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.65% (0.2780 => 0.2937, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.64% (2.0673 => 2.1839, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2811 => 0.2969, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.48% (0.3267 => 0.3446, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.43% (0.3004 => 0.3167, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.40% (0.3258 => 0.3434, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.26% (0.3195 => 0.3363, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.22% (0.3317 => 0.3490, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.19% (0.3124 => 0.3286, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.10% (0.3060 => 0.3216, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.06% (0.3282 => 0.3448, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.95% (0.3678 => 0.3860, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.95% (0.3477 => 0.3649, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.91% (0.3625 => 0.3803, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.87% (1.6211 => 1.7000, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.84% (0.4361 => 0.4572, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.82% (0.3690 => 0.3868, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.81% (0.3348 => 0.3509, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.80% (0.3726 => 0.3905, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.74% (3.5627 => 3.7317, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash: 4.61% (0.4146 => 0.4337, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 4.55% (0.9697 => 1.0138, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 4.54% (0.4251 => 0.4444, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.53% (0.5900 => 0.6167, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 4.47% (23.5202 => 24.5704, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.45% (0.3845 => 0.4016, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 4.43% (1.5932 => 1.6637, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.33% (1.3152 => 1.3721, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.2866 => 0.2987, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.12% (0.3981 => 0.4145, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.11% (4.2109 => 4.3839, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.10% (0.3930 => 0.4091, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.94% (0.4994 => 0.5191, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.92% (0.5026 => 0.5223, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.86% (0.5000 => 0.5193, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 3.85% (0.5012 => 0.5205, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.85% (0.4029 => 0.4184, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 3.77% (1.0781 => 1.1187, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.60% (4.4195 => 4.5784, std. dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.44% (2.7292 => 2.8232, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.25% (0.6435 => 0.6644, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.22% (5.5417 => 5.7204, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.19% (1.9694 => 2.0323, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.08% (1.9966 => 2.0581, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.03% (0.4658 => 0.4799, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.01% (0.3890 => 0.4007, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.90% (4.6177 => 4.7517, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 2.86% (2.1013 => 2.1615, std. dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 2.73% (2.1653 => 2.2245, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.72% (0.3903 => 0.4009, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.66% (1.8794 => 1.9293, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 2.45% (0.7875 => 0.8068, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.41% (1.4269 => 1.4613, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 2.29% (0.5546 => 0.5673, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.23% (0.6634 => 0.6782, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.43% (2.0346 => 2.0637, std. dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: 1.36% (2.4764 => 2.5102, std. dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.17% (11.6398 => 11.7756, std. dev.: 0.0109) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 20:44:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 22:44:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120718034414.906A22A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2162?compare_to=2159&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2162, Order: 160416, Start Time: 2012-07-18 02:30:01, End Time: 2012-07-18 03:44:26 To: 2159, Order: 160411, Start Time: 2012-07-18 00:48:09, End Time: 2012-07-18 02:02:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (142 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 2 (64 on baseline) Unchanged Tests: 949 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.73% (54.5388 => 56.0271, std. dev.: 0.2750) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.87% (78.9814 => 80.4613, std. dev.: 0.4630) SingleSource/Benchmarks/Misc/mandel-2: 1.34% (1.3876 => 1.4062, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.25% (2.0176 => 2.3051, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.83% (0.5818 => 0.6448, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.75% (0.5748 => 0.6366, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.44% (0.7061 => 0.7798, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 9.67% (0.3578 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.41% (0.3601 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.40% (0.3650 => 0.3993, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.38% (0.3646 => 0.3988, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.33% (0.3623 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.25% (0.3663 => 0.4002, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.21% (0.3789 => 0.4138, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.99% (0.3914 => 0.4266, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.94% (0.4003 => 0.4361, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.86% (0.3940 => 0.4289, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.2781 => 0.3006, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.78% (0.4062 => 0.4378, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.73% (0.2782 => 0.2997, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (0.4328 => 0.4658, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.56% (0.2607 => 0.2804, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.53% (0.2655 => 0.2855, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.51% (0.2690 => 0.2892, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.46% (0.2628 => 0.2824, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 7.35% (0.2937 => 0.3153, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 7.30% (1.3693 => 1.4692, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2760 => 0.2961, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.25% (0.3022 => 0.3241, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 7.19% (0.2726 => 0.2922, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.17% (0.2761 => 0.2959, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.14% (1.9828 => 2.1243, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.12% (0.2696 => 0.2888, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.11% (0.3107 => 0.3328, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1986 => 0.2127, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.89% (0.3149 => 0.3366, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.85% (0.3489 => 0.3728, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.80% (0.3192 => 0.3409, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.73% (0.2988 => 0.3189, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.65% (0.3580 => 0.3818, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3453 => 0.3682, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.59% (0.7038 => 0.7502, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.48% (0.3485 => 0.3711, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.45% (0.7710 => 0.8207, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.36% (0.2596 => 0.2761, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.33% (0.3899 => 0.4146, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.27% (0.5265 => 0.5595, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (3.9660 => 4.2139, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.20% (0.3756 => 0.3989, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.14% (0.2721 => 0.2888, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.13% (0.4016 => 0.4262, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3534 => 0.3750, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.10% (0.4390 => 0.4658, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 6.07% (0.3293 => 0.3493, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.89% (0.3868 => 0.4096, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.88% (0.1819 => 0.1926, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.42% (0.6959 => 0.7336, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.34% (0.4379 => 0.4613, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.04% (1.2193 => 1.2807, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 4.99% (16.6129 => 17.4417, std. dev.: 0.0295) MultiSource/Applications/SPASS/SPASS: 4.98% (13.8202 => 14.5090, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.86% (0.9199 => 0.9646, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.85% (1.2292 => 1.2888, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.66% (0.3755 => 0.3930, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.64% (0.5577 => 0.5836, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.60% (0.2914 => 0.3048, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.47% (13.2842 => 13.8779, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.46% (1.3819 => 1.4436, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.38% (1.3813 => 1.4418, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 4.24% (0.2925 => 0.3049, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.17% (7.2180 => 7.5192, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 4.14% (1.1061 => 1.1519, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: 4.12% (0.7506 => 0.7815, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.10% (1.3245 => 1.3788, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.09% (1.1364 => 1.1829, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.06% (0.5637 => 0.5866, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.04% (1.4563 => 1.5152, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.98% (1.0594 => 1.1016, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 3.90% (0.8310 => 0.8634, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 3.78% (3.8646 => 4.0105, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 3.71% (1.9270 => 1.9984, std. dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.67% (3.6692 => 3.8040, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.61% (0.7460 => 0.7729, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3220 => 0.3330, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.32% (0.8698 => 0.8987, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.31% (4.3801 => 4.5251, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.28% (4.9865 => 5.1499, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.25% (4.4433 => 4.5877, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.82% (0.4791 => 0.4926, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.74% (3.1889 => 3.2762, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 2.73% (6.5754 => 6.7552, std. dev.: 0.0071) MultiSource/Benchmarks/McCat/05-eks/eks: 2.72% (0.4113 => 0.4225, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.70% (2.1791 => 2.2380, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.65% (1.1333 => 1.1633, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.58% (0.6283 => 0.6445, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.53% (14.8535 => 15.2298, std. dev.: 0.0175) MultiSource/Applications/sqlite3/sqlite3: 2.42% (16.2614 => 16.6551, std. dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 2.20% (8.4961 => 8.6832, std. dev.: 0.0132) MultiSource/Applications/ClamAV/clamscan: 2.17% (14.5298 => 14.8458, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.17% (0.6135 => 0.6268, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.76% (2.1007 => 2.1376, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.66% (0.6744 => 0.6856, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 1.66% (33.2944 => 33.8464, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.56% (3.2742 => 3.3252, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 1.49% (4.6629 => 4.7323, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.34% (1.5188 => 1.5391, std. dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.32% (0.9108 => 0.9228, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.10% (1.0313 => 1.0426, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.01% (1.8175 => 2.2720, std. dev.: 0.0504) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1891, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: 8.19% (1.2998 => 1.4062, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.93% (0.9996 => 1.0789, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.35% (1.5824 => 1.6987, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.2619 => 11.7366, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: 4.06% (7.4271 => 7.7288, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (12.4560 => 12.9183, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.30% (1.7688 => 1.8094, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.88% (31.4682 => 32.0607, std. dev.: 0.0106) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.81% (1.5089 => 1.5362, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.67% (3.6469 => 3.7078, std. dev.: 0.0051) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9583, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1938, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.01% (3.1736 => 3.2055, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.26% (22.5627 => 21.1498, std. dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.35% (0.8818 => 0.8699, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.54% (1.2308 => 1.1134, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.55% (20.3410 => 18.6017, std. dev.: 0.0200) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3097, std. dev.: 0.0069) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9830, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.18% (1.9762 => 1.9134, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5876, std. dev.: 0.0081) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9446, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.00% (0.8342 => 0.8175, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5067, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9980, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.53% (6.3560 => 6.2587, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8581, std. dev.: 0.0046) MultiSource/Applications/minisat/minisat: -1.42% (9.3358 => 9.2033, std. dev.: 0.0095) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -1.19% (7.3305 => 7.2431, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2544, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.15% (9.9194 => 9.8049, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.05% (28.2225 => 27.9269, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 21:03:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 17 Jul 2012 23:03:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120718040308.892632A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2163?compare_to=2160&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2163, Order: 160416, Start Time: 2012-07-18 02:44:54, End Time: 2012-07-18 04:03:18 To: 2160, Order: 160412, Start Time: 2012-07-18 00:58:48, End Time: 2012-07-18 02:17:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (103 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 2 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.15% (2.1259 => 2.1504, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.98% (78.2799 => 79.8264, std. dev.: 0.5502) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.97% (10.3673 => 13.7853, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.05% (1.1194 => 1.2543, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.98% (0.3473 => 0.3889, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.92% (0.3497 => 0.3914, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3543 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 11.63% (0.3516 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.57% (0.3561 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3694 => 0.4107, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.83% (0.3886 => 0.4307, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.80% (0.3927 => 0.4351, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.56% (2.2022 => 2.3906, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.38% (1.7609 => 1.9085, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.05% (0.6030 => 0.6455, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.92% (0.5925 => 0.6335, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.80% (0.7326 => 0.7751, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.41% (0.3177 => 0.3349, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.36% (10.4361 => 10.9951, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 5.15% (0.3282 => 0.3451, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.08% (7.0540 => 7.4126, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.4879 => 0.5121, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.63% (0.7433 => 0.7777, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.49% (0.4615 => 0.4822, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.48% (0.2905 => 0.3035, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: 4.29% (0.2725 => 0.2842, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.21% (0.2871 => 0.2992, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.19% (0.2891 => 0.3012, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.14% (0.2756 => 0.2870, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.13% (0.3098 => 0.3226, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.13% (0.3052 => 0.3178, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.11% (0.2872 => 0.2990, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 4.06% (0.2831 => 0.2946, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.06% (2.0665 => 2.1504, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.97% (0.2793 => 0.2904, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.97% (0.3650 => 0.3795, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.92% (0.3136 => 0.3259, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.89% (0.2877 => 0.2989, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.85% (0.2802 => 0.2910, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.81% (0.3232 => 0.3355, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.76% (0.3162 => 0.3281, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.75% (0.4289 => 0.4450, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.73% (0.3865 => 0.4009, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.72% (0.3603 => 0.3737, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.71% (0.3826 => 0.3968, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.65% (0.3422 => 0.3547, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.59% (9.4845 => 9.8248, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.55% (4.9449 => 5.1205, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (0.3935 => 0.4074, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.52% (1.5603 => 1.6153, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.51% (0.4103 => 0.4247, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.50% (0.3684 => 0.3813, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (5.0018 => 5.1764, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.45% (0.5569 => 0.5761, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.43% (0.4203 => 0.4347, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.42% (0.4064 => 0.4203, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3121 => 0.3227, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.37% (0.8172 => 0.8447, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.31% (0.5860 => 0.6054, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 3.28% (0.3379 => 0.3490, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.24% (0.4636 => 0.4786, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 3.14% (0.4620 => 0.4765, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.10% (4.2646 => 4.3970, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 3.09% (0.4048 => 0.4173, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.08% (0.6456 => 0.6655, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.02% (0.7835 => 0.8072, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.98% (8.1363 => 8.3787, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 2.95% (0.3423 => 0.3524, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (14.3668 => 14.7905, std. dev.: 0.0113) MultiSource/Applications/hexxagon/hexxagon: 2.86% (1.2842 => 1.3209, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.69% (5.7591 => 5.9139, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.57% (1.3050 => 1.3386, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.55% (1.1861 => 1.2164, std. dev.: 0.0103) MultiSource/Applications/d/make_dparser: 2.43% (3.3354 => 3.4164, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.42% (0.8067 => 0.8262, std. dev.: 0.0047) MultiSource/Applications/Burg/burg: 2.40% (1.1642 => 1.1921, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.38% (2.0273 => 2.0756, std. dev.: 0.0076) MultiSource/Applications/lua/lua: 2.10% (3.8723 => 3.9538, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.09% (1.5415 => 1.5737, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.03% (1.4186 => 1.4474, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.92% (0.9765 => 0.9952, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.78% (17.1811 => 17.4877, std. dev.: 0.0488) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (2.2024 => 2.2416, std. dev.: 0.0068) MultiSource/Applications/minisat/minisat: 1.76% (0.7115 => 0.7240, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.63% (0.6675 => 0.6784, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.59% (1.5859 => 1.6111, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 1.36% (0.8921 => 0.9042, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.17% (2.2969 => 2.3238, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7478, std. dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (1.5086 => 1.5374, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 1.64% (3.1578 => 3.2097, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4462, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2341, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 1.24% (11.6436 => 11.7878, std. dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6874, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 1.07% (6.6465 => 6.7173, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1618, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.67% (5.3855 => 3.7335, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.51% (5.3526 => 3.7197, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.04% (2.9384 => 2.5551, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -10.20% (22.1758 => 19.9132, std. dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -5.18% (54.1659 => 51.3594, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.42% (3.8922 => 3.8371, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.80% (1.2373 => 1.1160, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.78% (19.9488 => 18.5958, std. dev.: 0.0637) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.85% (8.1563 => 7.9241, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -2.06% (10.2830 => 10.0710, std. dev.: 0.0076) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.21% (1.8329 => 1.8108, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.00% (32.5116 => 32.1855, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 4.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 22:26:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 00:26:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120718052627.904842A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2164?compare_to=2162&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2164, Order: 160417, Start Time: 2012-07-18 04:12:22, End Time: 2012-07-18 05:26:35 To: 2162, Order: 160416, Start Time: 2012-07-18 02:30:01, End Time: 2012-07-18 03:44:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (137 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.07% (2.1243 => 2.1016, std. dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.09% (2.0176 => 2.3019, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 10.62% (0.5818 => 0.6436, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.53% (0.5748 => 0.6353, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.15% (0.7061 => 0.7778, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.20% (0.3578 => 0.3907, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.02% (0.3646 => 0.3975, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 9.00% (0.3601 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.82% (0.3650 => 0.3972, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 8.81% (0.3789 => 0.4123, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.80% (0.3623 => 0.3942, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.79% (0.3663 => 0.3985, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.71% (0.3914 => 0.4255, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.52% (0.4003 => 0.4344, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.45% (0.3940 => 0.4273, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.31% (1.3693 => 1.4694, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 6.75% (0.4062 => 0.4336, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (0.4328 => 0.4617, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.58% (0.2781 => 0.2964, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.29% (0.2782 => 0.2957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.25% (0.2607 => 0.2770, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.21% (0.2655 => 0.2820, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.19% (0.7710 => 0.8187, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2690 => 0.2856, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.14% (0.2721 => 0.2888, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 6.12% (0.7038 => 0.7469, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.10% (3.9660 => 4.2078, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 6.09% (0.2937 => 0.3116, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.09% (0.2760 => 0.2928, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.05% (0.2628 => 0.2787, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.03% (0.3580 => 0.3796, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.02% (0.3022 => 0.3204, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.02% (0.2726 => 0.2890, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2761 => 0.2927, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.00% (0.2765 => 0.2931, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.99% (1.9828 => 2.1016, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.97% (0.2596 => 0.2751, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.96% (0.3489 => 0.3697, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.89% (0.5265 => 0.5575, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.83% (0.2966 => 0.3139, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 5.79% (0.3107 => 0.3287, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.79% (0.2696 => 0.2852, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary3: 5.78% (0.3149 => 0.3331, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.56% (0.2988 => 0.3154, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.46% (0.3899 => 0.4112, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.39% (0.3485 => 0.3673, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.39% (0.3192 => 0.3364, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.24% (0.3453 => 0.3634, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.12% (0.3534 => 0.3715, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.09% (0.4379 => 0.4602, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (0.3756 => 0.3945, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 5.01% (0.3293 => 0.3458, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.00% (0.6959 => 0.7307, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.99% (0.4390 => 0.4609, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.96% (0.4016 => 0.4215, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.87% (1.2193 => 1.2787, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.73% (0.3868 => 0.4051, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.71% (13.8202 => 14.4713, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.67% (0.9199 => 0.9629, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.55% (16.6129 => 17.3688, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.43% (0.5577 => 0.5824, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.37% (1.3819 => 1.4423, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.36% (0.2914 => 0.3041, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.31% (1.3813 => 1.4409, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.31% (13.2842 => 13.8565, std. dev.: 0.0169) MultiSource/Benchmarks/McCat/09-vor/vor: 4.14% (0.2925 => 0.3046, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.10% (0.5637 => 0.5868, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.02% (1.3245 => 1.3777, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.01% (0.7506 => 0.7807, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 3.99% (1.2292 => 1.2782, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.95% (7.2180 => 7.5033, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.93% (1.4563 => 1.5135, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.92% (1.1364 => 1.1809, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.85% (1.0594 => 1.1002, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.82% (0.3246 => 0.3370, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.79% (1.9270 => 2.0000, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.73% (0.3755 => 0.3895, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 3.72% (1.1061 => 1.1472, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.71% (3.6692 => 3.8052, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 3.65% (0.8310 => 0.8613, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 3.60% (3.8646 => 4.0036, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.58% (0.7460 => 0.7727, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.25% (4.3801 => 4.5225, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.15% (4.4433 => 4.5832, std. dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.8698 => 0.8947, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.84% (4.9865 => 5.1281, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 2.73% (2.1791 => 2.2386, std. dev.: 0.0163) MultiSource/Benchmarks/McCat/05-eks/eks: 2.67% (0.4113 => 0.4223, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.59% (1.1333 => 1.1626, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 2.55% (3.1889 => 3.2703, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (6.5754 => 6.7394, std. dev.: 0.0196) MultiSource/Applications/JM/lencod/lencod: 2.39% (14.8535 => 15.2085, std. dev.: 0.0180) MultiSource/Applications/sqlite3/sqlite3: 2.37% (16.2614 => 16.6472, std. dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.36% (0.6283 => 0.6431, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.15% (8.4961 => 8.6787, std. dev.: 0.0109) MultiSource/Applications/ClamAV/clamscan: 2.14% (14.5298 => 14.8407, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.10% (0.6135 => 0.6264, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.64% (2.1007 => 2.1351, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 1.54% (4.6629 => 4.7349, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.44% (3.2742 => 3.3212, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.37% (1.5188 => 1.5396, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.27% (0.9108 => 0.9224, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.97% (1.8175 => 2.2714, std. dev.: 0.0440) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1916, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 7.47% (1.2998 => 1.3969, std. dev.: 0.0080) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.40% (1.5824 => 1.6995, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.2619 => 11.7370, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7363, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.28% (1.7688 => 1.8091, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1892, std. dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.92% (31.4682 => 32.0717, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5089 => 1.5335, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.63% (3.6469 => 3.7062, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.14% (3.1736 => 3.2098, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.46% (0.4657 => 0.4170, std. dev.: 0.0092) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.60% (22.5627 => 21.0733, std. dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.47% (0.8818 => 0.8688, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -9.69% (1.2308 => 1.1115, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.75% (20.3410 => 18.5615, std. dev.: 0.0567) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3068, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9129, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9450, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -2.55% (2.5089 => 2.4449, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6009, std. dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.00% (0.8342 => 0.8175, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5106, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2543, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.41% (0.9692 => 0.9555, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2127, std. dev.: 0.0178) MultiSource/Benchmarks/Bullet/bullet: -1.17% (7.3305 => 7.2447, std. dev.: 0.0111) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.15% (9.9194 => 9.8050, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (28.2225 => 27.9288, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 22:49:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 00:49:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120718054932.B63FB2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2165?compare_to=2163&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2165, Order: 160418, Start Time: 2012-07-18 04:31:22, End Time: 2012-07-18 05:49:42 To: 2163, Order: 160416, Start Time: 2012-07-18 02:44:54, End Time: 2012-07-18 04:03:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (71 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (784 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.02% (13.7853 => 13.9261, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.63% (2.1504 => 2.1153, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -1.23% (1.3209 => 1.3047, std. dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.33% (10.3673 => 13.9261, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.89% (1.1194 => 1.2525, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.81% (0.3473 => 0.3883, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3497 => 0.3901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.52% (0.3516 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.46% (0.3543 => 0.3949, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.43% (0.3543 => 0.3948, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.37% (0.3561 => 0.3966, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3694 => 0.4104, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.65% (0.3886 => 0.4300, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.59% (0.3927 => 0.4343, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.51% (1.7609 => 1.9108, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.25% (2.2022 => 2.3839, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.58% (0.6030 => 0.6427, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.46% (0.5925 => 0.6308, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2065 => 0.2180, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 5.34% (0.7326 => 0.7717, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.24% (7.0540 => 7.4235, std. dev.: 0.0093) MultiSource/Applications/JM/ldecod/ldecod: 4.97% (10.4361 => 10.9543, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.88% (0.4879 => 0.5117, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.88% (0.3282 => 0.3442, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.40% (0.4615 => 0.4818, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.09% (0.7433 => 0.7737, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (5.0018 => 5.1763, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (9.4845 => 9.8102, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.39% (4.9449 => 5.1127, std. dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.29% (0.5569 => 0.5752, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.22% (0.8172 => 0.8435, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.04% (1.5603 => 1.6078, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.04% (0.5860 => 0.6038, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (4.2646 => 4.3911, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: 2.95% (0.7835 => 0.8066, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.87% (8.1363 => 8.3701, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.78% (14.3668 => 14.7667, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.4289 => 0.4406, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.67% (5.7591 => 5.9129, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.43% (1.1861 => 1.2149, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.41% (1.3050 => 1.3365, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.36% (2.0665 => 2.1153, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 2.31% (3.3354 => 3.4123, std. dev.: 0.0109) MultiSource/Applications/Burg/burg: 2.30% (1.1642 => 1.1910, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.27% (2.0273 => 2.0733, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.24% (0.8067 => 0.8248, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.01% (3.8723 => 3.9501, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.97% (1.5415 => 1.5719, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 1.95% (0.6456 => 0.6582, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.83% (1.4186 => 1.4446, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.81% (0.9765 => 0.9942, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.77% (2.2024 => 2.2413, std. dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 1.60% (17.1811 => 17.4554, std. dev.: 0.0199) MultiSource/Applications/hexxagon/hexxagon: 1.60% (1.2842 => 1.3047, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.54% (1.5859 => 1.6103, std. dev.: 0.0079) MultiSource/Applications/minisat/minisat: 1.49% (0.7115 => 0.7221, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (1.1840 => 1.1997, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 1.31% (0.8921 => 0.9038, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.02% (2.2969 => 2.3204, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7528, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.93% (1.5086 => 1.5377, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 1.83% (3.1578 => 3.2157, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.47% (9.1159 => 9.2495, std. dev.: 0.0369) SingleSource/Benchmarks/Dhrystone/dry: 1.42% (2.4116 => 2.4458, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6896, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.21% (11.6436 => 11.7847, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.08% (6.6465 => 6.7182, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.10% (5.2763 => 3.1603, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.73% (5.3855 => 3.7304, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.54% (5.3526 => 3.7181, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.14% (2.9384 => 2.5523, std. dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: -10.23% (22.1758 => 19.9067, std. dev.: 0.0086) SingleSource/UnitTests/Vector/constpool: -5.22% (54.1659 => 51.3370, std. dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.45% (3.8922 => 3.8356, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.36% (1.2373 => 1.1091, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.02% (19.9488 => 18.5483, std. dev.: 0.0289) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.87% (8.1563 => 7.9224, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0848, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.02% (32.5116 => 32.1806, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 17 23:23:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 01:23:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120718062359.845EC2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2166?compare_to=2161&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2166, Order: 160416, Start Time: 2012-07-18 03:40:39, End Time: 2012-07-18 06:24:10 To: 2161, Order: 160408, Start Time: 2012-07-18 00:29:11, End Time: 2012-07-18 03:12:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (85 on baseline) Added Tests: 2 (60 on baseline) Unchanged Tests: 952 (809 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.33% (0.3446 => 0.3871, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.30% (0.3496 => 0.3926, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.20% (0.3442 => 0.3862, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.15% (0.3465 => 0.3886, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.14% (0.3460 => 0.3880, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.07% (0.3488 => 0.3909, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3469 => 0.3885, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.78% (0.3650 => 0.4080, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.64% (0.3643 => 0.4067, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.39% (0.3724 => 0.4148, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.54% (0.5826 => 0.6265, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.25% (0.5889 => 0.6316, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.68% (0.2738 => 0.2921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2725 => 0.2894, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2729 => 0.2897, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.09% (0.2875 => 0.3050, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.04% (0.2714 => 0.2878, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.04% (0.2750 => 0.2916, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.01% (0.3096 => 0.3282, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.90% (0.7171 => 0.7594, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 5.82% (0.2803 => 0.2966, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.67% (0.2823 => 0.2983, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.65% (0.2780 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.62% (0.2813 => 0.2971, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.55% (0.2792 => 0.2947, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.55% (0.2811 => 0.2967, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2911 => 0.3072, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.53% (2.0673 => 2.1816, std. dev.: 0.0125) SingleSource/Regression/C++/ofstream_ctor: 5.39% (0.3004 => 0.3166, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3060 => 0.3224, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 5.35% (0.9909 => 1.0439, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.34% (0.3258 => 0.3432, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3267 => 0.3441, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.27% (0.3678 => 0.3872, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.25% (0.3124 => 0.3288, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.21% (0.3625 => 0.3814, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.18% (0.3362 => 0.3536, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.16% (0.3195 => 0.3360, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.09% (0.3317 => 0.3486, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.09% (0.5026 => 0.5282, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.05% (1.6211 => 1.7029, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 4.89% (0.3477 => 0.3647, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.88% (0.3282 => 0.3442, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.83% (0.3726 => 0.3906, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.83% (0.5900 => 0.6185, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.78% (3.5627 => 3.7331, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 4.78% (0.3348 => 0.3508, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.61% (0.3690 => 0.3860, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.52% (1.3152 => 1.3746, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 4.41% (0.4146 => 0.4329, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.38% (0.4361 => 0.4552, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.28% (0.4251 => 0.4433, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.19% (0.3845 => 0.4006, std. dev.: 0.0035) MultiSource/Applications/hbd/hbd: 4.16% (0.9697 => 1.0100, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.12% (0.3981 => 0.4145, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.10% (0.4994 => 0.5199, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.10% (0.4029 => 0.4194, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 4.07% (1.5932 => 1.6581, std. dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.07% (0.3930 => 0.4090, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 4.05% (23.5202 => 24.4724, std. dev.: 0.0130) MultiSource/Applications/ClamAV/clamscan: 4.01% (4.2109 => 4.3799, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 3.79% (1.0781 => 1.1190, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.73% (0.2736 => 0.2838, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.5012 => 0.5198, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.70% (0.5000 => 0.5185, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.50% (2.7292 => 2.8248, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.48% (4.4195 => 4.5733, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.44% (5.5417 => 5.7321, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.40% (0.6435 => 0.6654, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (1.9694 => 2.0329, std. dev.: 0.0095) MultiSource/Benchmarks/mafft/pairlocalalign: 3.16% (2.1013 => 2.1677, std. dev.: 0.0127) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.04% (1.9966 => 2.0573, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.94% (0.4658 => 0.4795, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.93% (0.3890 => 0.4004, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 2.90% (4.6177 => 4.7514, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (2.1653 => 2.2275, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (1.8794 => 1.9330, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.79% (0.3903 => 0.4012, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.54% (0.7875 => 0.8075, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 2.52% (0.6634 => 0.6801, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 2.41% (1.4269 => 1.4613, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.27% (0.5546 => 0.5672, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.51% (2.0346 => 2.0654, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.26% (11.6398 => 11.7870, std. dev.: 0.0293) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.33% (0.2122 => 0.2235, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 00:11:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 02:11:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120718071116.1D93A2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2167?compare_to=2164&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2167, Order: 160426, Start Time: 2012-07-18 05:54:38, End Time: 2012-07-18 07:11:25 To: 2164, Order: 160417, Start Time: 2012-07-18 04:12:22, End Time: 2012-07-18 05:26:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (94 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: 7.19% (18.5615 => 19.8956, std. dev.: 0.0513) MultiSource/Benchmarks/Bullet/bullet: 1.25% (7.2447 => 7.3355, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -2.19% (32.0717 => 31.3688, std. dev.: 0.0289) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.45% (2.0176 => 2.2889, std. dev.: 0.0588) SingleSource/UnitTests/ObjC++/property-reference-object: 10.45% (0.5818 => 0.6426, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 10.41% (0.7061 => 0.7796, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.32% (0.5748 => 0.6341, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.97% (0.3578 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.75% (0.3601 => 0.3916, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.74% (0.3789 => 0.4120, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3663 => 0.3981, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.67% (0.3646 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.58% (0.3650 => 0.3963, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.53% (0.3623 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.38% (0.3914 => 0.4242, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.27% (0.4003 => 0.4334, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.22% (0.3940 => 0.4264, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.59% (1.3693 => 1.4596, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.52% (0.4062 => 0.4327, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.40% (0.4328 => 0.4605, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.24% (0.7038 => 0.7477, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.04% (0.2781 => 0.2949, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.87% (0.2607 => 0.2760, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.86% (0.2782 => 0.2945, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.69% (0.2760 => 0.2917, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.58% (0.2937 => 0.3101, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.2721 => 0.2872, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/methcall: 5.54% (0.2761 => 0.2914, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.53% (0.3580 => 0.3778, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 5.50% (0.2726 => 0.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2765 => 0.2917, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.38% (0.2696 => 0.2841, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.22% (0.2988 => 0.3144, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.99% (0.3485 => 0.3659, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.98% (0.3192 => 0.3351, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4390 => 0.4607, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 4.81% (0.3453 => 0.3619, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.77% (0.3293 => 0.3450, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.4016 => 0.4205, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.39% (13.8202 => 14.4266, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.05% (1.1061 => 1.1509, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.96% (0.7506 => 0.7803, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.68% (1.9270 => 1.9979, std. dev.: 0.0112) MultiSource/Applications/hexxagon/hexxagon: 3.65% (1.2292 => 1.2741, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.33% (0.3755 => 0.3880, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.96% (2.1791 => 2.2435, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.85% (4.9865 => 5.1285, std. dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.72% (0.8698 => 0.8935, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.71% (0.4791 => 0.4921, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.42% (6.5754 => 6.7342, std. dev.: 0.0073) MultiSource/Applications/d/make_dparser: 2.41% (3.1889 => 3.2659, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.20% (0.6283 => 0.6421, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.18% (2.1007 => 2.1464, std. dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 2.17% (16.2614 => 16.6144, std. dev.: 0.0150) MultiSource/Applications/ClamAV/clamscan: 1.98% (14.5298 => 14.8177, std. dev.: 0.0080) MultiSource/Applications/JM/lencod/lencod: 1.95% (14.8535 => 15.1433, std. dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: 1.90% (8.4961 => 8.6573, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.49% (3.2742 => 3.3231, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (1.5188 => 1.5402, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.57% (1.8175 => 2.2641, std. dev.: 0.0485) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1918, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 8.36% (1.2998 => 1.4085, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.90% (0.9996 => 1.0786, std. dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.73% (1.5824 => 1.7047, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7329, std. dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.2619 => 11.7202, std. dev.: 0.0176) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9220, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1901, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (3.6469 => 3.7091, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0106) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: 1.22% (1.9290 => 1.9525, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 1.19% (3.1736 => 3.2113, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.72% (22.5627 => 21.0476, std. dev.: 0.1534) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0119) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -10.57% (1.2308 => 1.1007, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3132, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9123, std. dev.: 0.0247) SingleSource/Benchmarks/Dhrystone/dry: -2.53% (2.5089 => 2.4454, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.43% (0.8342 => 0.8139, std. dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.19% (20.3410 => 19.8956, std. dev.: 0.0513) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5108, std. dev.: 0.0122) MultiSource/Applications/spiff/spiff: -1.75% (3.0263 => 2.9732, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2517, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4902, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: -1.33% (9.3358 => 9.2114, std. dev.: 0.0227) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8048, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2582, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 00:39:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 02:39:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120718073913.EDBFD2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2168?compare_to=2165&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2168, Order: 160426, Start Time: 2012-07-18 06:17:42, End Time: 2012-07-18 07:39:25 To: 2165, Order: 160418, Start Time: 2012-07-18 04:31:22, End Time: 2012-07-18 05:49:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (47 on baseline) Performance Improvements: 3 (18 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (808 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: 7.58% (18.5483 => 19.9539, std. dev.: 0.0612) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.30% (13.9261 => 13.3277, std. dev.: 0.0606) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.89% (8.6772 => 8.4267, std. dev.: 0.0944) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.19% (32.1806 => 31.4745, std. dev.: 0.0099) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.56% (10.3673 => 13.3277, std. dev.: 0.0606) SingleSource/UnitTests/ObjC/trivial-interface: 12.87% (0.3473 => 0.3920, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.66% (0.3516 => 0.3961, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.58% (0.3497 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.50% (0.3543 => 0.3986, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 12.39% (0.3543 => 0.3982, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.38% (0.3561 => 0.4002, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.04% (1.1194 => 1.2542, std. dev.: 0.0178) SingleSource/UnitTests/ObjC/for-in: 12.02% (0.3694 => 0.4138, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.58% (0.3886 => 0.4336, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.43% (0.3927 => 0.4376, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.87% (1.7609 => 1.9347, std. dev.: 0.0155) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.16% (2.2022 => 2.3819, std. dev.: 0.0249) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.12% (0.5925 => 0.6347, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.00% (0.6030 => 0.6452, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.81% (0.7326 => 0.7752, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 4.97% (10.4361 => 10.9551, std. dev.: 0.0159) SingleSource/Benchmarks/Misc/oourafft: 4.91% (0.3282 => 0.3443, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.96% (0.7433 => 0.7727, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (9.4845 => 9.8424, std. dev.: 0.0168) MultiSource/Applications/spiff/spiff: 2.67% (0.7835 => 0.8044, std. dev.: 0.0068) MultiSource/Applications/oggenc/oggenc: 2.61% (5.7591 => 5.9093, std. dev.: 0.0072) MultiSource/Applications/hbd/hbd: 2.60% (1.5603 => 1.6009, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/hash: 2.42% (0.4289 => 0.4393, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.37% (2.0665 => 2.1154, std. dev.: 0.0165) MultiSource/Applications/d/make_dparser: 2.31% (3.3354 => 3.4126, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.22% (0.4636 => 0.4739, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 2.18% (2.0273 => 2.0715, std. dev.: 0.0070) MultiSource/Applications/lua/lua: 1.83% (3.8723 => 3.9431, std. dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/bigfib: 1.81% (0.6456 => 0.6573, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.76% (2.2024 => 2.2412, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.54% (1.5859 => 1.6104, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.53% (17.1811 => 17.4438, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.47% (1.2842 => 1.3031, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9740, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.22% (3.6395 => 3.7566, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.23% (1.0313 => 1.0543, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2148, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.57% (11.6436 => 11.8265, std. dev.: 0.0189) SingleSource/Benchmarks/Dhrystone/dry: 1.42% (2.4116 => 2.4458, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6890, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2244, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/oourafft: 1.10% (6.6465 => 6.7197, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.68% (5.2763 => 3.1827, std. dev.: 0.0471) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.83% (5.3855 => 3.7249, std. dev.: 0.0517) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.66% (5.3526 => 3.7116, std. dev.: 0.0495) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.93% (2.9384 => 2.5586, std. dev.: 0.0668) MultiSource/Applications/ClamAV/clamscan: -10.21% (22.1758 => 19.9110, std. dev.: 0.0395) SingleSource/UnitTests/Vector/constpool: -5.17% (54.1659 => 51.3660, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.44% (3.8922 => 3.8361, std. dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.88% (1.2373 => 1.1027, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4745, std. dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4267, std. dev.: 0.0944) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.80% (8.1563 => 7.9281, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -1.99% (10.2830 => 10.0783, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3526, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 01:53:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 03:53:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120718085346.D925C2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2169?compare_to=2167&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2169, Order: 160429, Start Time: 2012-07-18 07:39:36, End Time: 2012-07-18 08:53:57 To: 2167, Order: 160426, Start Time: 2012-07-18 05:54:38, End Time: 2012-07-18 07:11:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (138 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.41% (54.6396 => 56.5001, std. dev.: 0.0466) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.17% (78.0896 => 80.5629, std. dev.: 0.2948) SingleSource/Benchmarks/McGill/chomp: 1.01% (1.1007 => 1.1118, std. dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.61% (2.0176 => 2.2921, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 10.76% (0.5818 => 0.6444, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.47% (0.5748 => 0.6350, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 9.55% (0.7061 => 0.7735, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 8.94% (0.3578 => 0.3898, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.80% (0.3601 => 0.3918, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-3: 8.69% (0.3623 => 0.3938, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 8.67% (0.3646 => 0.3962, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 8.63% (0.3663 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.60% (0.3789 => 0.4115, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.60% (0.3650 => 0.3964, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 8.48% (0.3914 => 0.4246, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.40% (0.3940 => 0.4271, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.29% (0.4003 => 0.4335, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.78% (1.3693 => 1.4621, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 6.67% (0.4062 => 0.4333, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4328 => 0.4610, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.37% (0.7038 => 0.7486, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.29% (0.7710 => 0.8195, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.21% (0.5265 => 0.5592, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.11% (0.2781 => 0.2951, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.01% (0.2596 => 0.2752, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 5.99% (0.2690 => 0.2851, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (3.9660 => 4.2031, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.97% (0.2782 => 0.2948, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.83% (0.2760 => 0.2921, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3022 => 0.3197, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.78% (0.2628 => 0.2780, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.77% (0.1819 => 0.1924, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.75% (0.2937 => 0.3106, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.73% (0.2721 => 0.2877, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.71% (1.9828 => 2.0960, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.59% (0.3580 => 0.3780, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3489 => 0.3683, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.56% (0.4390 => 0.4634, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 5.54% (0.2761 => 0.2914, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2696 => 0.2845, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.3149 => 0.3318, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.36% (0.3899 => 0.4108, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.29% (0.2988 => 0.3146, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.17% (0.6959 => 0.7319, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.14% (0.3485 => 0.3664, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.08% (0.3192 => 0.3354, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.96% (0.4379 => 0.4596, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.89% (0.3293 => 0.3454, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (0.3756 => 0.3938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.82% (1.2193 => 1.2781, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 4.79% (16.6129 => 17.4087, std. dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.73% (0.4016 => 0.4206, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.63% (0.5577 => 0.5835, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.62% (0.9199 => 0.9624, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.60% (0.3868 => 0.4046, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.59% (13.8202 => 14.4543, std. dev.: 0.0133) MultiSource/Benchmarks/McCat/09-vor/vor: 4.41% (0.2925 => 0.3054, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.40% (13.2842 => 13.8690, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.5637 => 0.5863, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.00% (0.3246 => 0.3376, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.00% (1.4563 => 1.5145, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 3.99% (1.1061 => 1.1502, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 3.97% (3.8646 => 4.0179, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.95% (1.3819 => 1.4365, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.95% (0.2914 => 0.3029, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 3.92% (0.7506 => 0.7800, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.89% (1.3813 => 1.4350, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.88% (1.1364 => 1.1805, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.87% (7.2180 => 7.4971, std. dev.: 0.0114) MultiSource/Applications/treecc/treecc: 3.86% (1.9270 => 2.0014, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.82% (1.2292 => 1.2762, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.75% (1.3245 => 1.3742, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (0.8310 => 0.8617, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.58% (0.7460 => 0.7727, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.45% (4.3801 => 4.5310, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 3.43% (1.0594 => 1.0957, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.34% (4.4433 => 4.5918, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.26% (3.6692 => 3.7887, std. dev.: 0.0150) MultiSource/Benchmarks/McCat/18-imp/imp: 3.23% (0.3220 => 0.3324, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.97% (2.1791 => 2.2439, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.90% (4.9865 => 5.1311, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.78% (0.8698 => 0.8940, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.78% (0.4791 => 0.4924, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 2.72% (3.1889 => 3.2756, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.51% (1.1333 => 1.1618, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 2.25% (6.5754 => 6.7234, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.23% (0.6283 => 0.6423, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.21% (16.2614 => 16.6208, std. dev.: 0.0205) MultiSource/Applications/ClamAV/clamscan: 2.17% (14.5298 => 14.8456, std. dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6135 => 0.6263, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 2.08% (14.8535 => 15.1618, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.90% (2.1007 => 2.1407, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 1.88% (8.4961 => 8.6557, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.61% (1.5188 => 1.5433, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (3.2742 => 3.3265, std. dev.: 0.0153) MultiSource/Applications/oggenc/oggenc: 1.41% (4.6629 => 4.7287, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.12% (0.9108 => 0.9210, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2623, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1910, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: 7.93% (1.2998 => 1.4029, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.73% (1.5824 => 1.7047, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7329, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.2619 => 11.7200, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9193, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4795, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.24% (1.7688 => 1.8084, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0037) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5351, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (3.6469 => 3.7091, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 1.27% (3.1736 => 3.2138, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.58% (22.5627 => 21.0781, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.22% (0.3511 => 0.3398, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.67% (1.2308 => 1.1118, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3151, std. dev.: 0.0086) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9127, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.45% (0.8342 => 0.8138, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9442, std. dev.: 0.0343) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5080, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: -1.80% (3.0263 => 2.9717, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9982, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.48% (6.3560 => 6.2621, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.48% (2.5254 => 2.4881, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8046, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2558, std. dev.: 0.0056) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2390, std. dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 02:26:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 04:26:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120718092620.C89292A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2170?compare_to=2168&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2170, Order: 160429, Start Time: 2012-07-18 08:07:56, End Time: 2012-07-18 09:26:32 To: 2168, Order: 160426, Start Time: 2012-07-18 06:17:42, End Time: 2012-07-18 07:39:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (76 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (778 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.64% (13.3277 => 13.8134, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.58% (79.3904 => 80.6454, std. dev.: 0.0534) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.24% (10.3673 => 13.8134, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/trivial-interface: 12.70% (0.3473 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.50% (0.3497 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.42% (0.3543 => 0.3983, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.31% (0.3543 => 0.3979, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.29% (0.3516 => 0.3948, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 12.27% (0.3561 => 0.3998, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.97% (0.3694 => 0.4136, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.86% (1.1194 => 1.2522, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3828 => 0.4265, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.25% (0.3886 => 0.4323, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.61% (1.7609 => 1.9302, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.20% (2.2022 => 2.3827, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 7.04% (0.5925 => 0.6342, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.92% (0.6030 => 0.6447, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.87% (0.7326 => 0.7756, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2065 => 0.2181, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.41% (0.4879 => 0.5143, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.17% (10.4361 => 10.9758, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/oourafft: 5.15% (0.3282 => 0.3451, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.85% (7.0540 => 7.3961, std. dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.29% (0.4615 => 0.4813, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (9.4845 => 9.8675, std. dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 4.02% (0.7433 => 0.7732, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.82% (0.8172 => 0.8484, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.81% (5.0018 => 5.1924, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.74% (4.9449 => 5.1299, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.41% (0.5569 => 0.5759, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 3.18% (1.5603 => 1.6099, std. dev.: 0.0031) MultiSource/Applications/spiff/spiff: 3.18% (0.7835 => 0.8084, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 3.18% (0.3180 => 0.3281, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.17% (0.5860 => 0.6046, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.12% (4.2646 => 4.3978, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.06% (8.1363 => 8.3854, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/18-imp/imp: 2.98% (0.3423 => 0.3525, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (14.3668 => 14.7883, std. dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.3050 => 1.3429, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (1.1861 => 1.2195, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 2.62% (5.7591 => 5.9100, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.49% (0.5981 => 0.6130, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 2.48% (3.3354 => 3.4181, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 2.47% (1.1642 => 1.1929, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.44% (0.4103 => 0.4203, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.42% (0.9765 => 1.0001, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.37% (2.0273 => 2.0753, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.33% (0.4636 => 0.4744, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.27% (1.5415 => 1.5765, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.24% (0.8067 => 0.8248, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.17% (2.0665 => 2.1113, std. dev.: 0.0047) MultiSource/Applications/lua/lua: 2.16% (3.8723 => 3.9560, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.06% (0.5105 => 0.5210, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 1.94% (0.6456 => 0.6581, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (2.2024 => 2.2426, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 1.75% (0.8921 => 0.9077, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.73% (1.4186 => 1.4432, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.67% (1.5859 => 1.6124, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.51% (0.6675 => 0.6776, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.47% (1.2842 => 1.3031, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.45% (17.1811 => 17.4306, std. dev.: 0.0276) MultiSource/Benchmarks/nbench/nbench: 1.28% (1.1840 => 1.1991, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9748, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.21% (3.6395 => 3.7562, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (1.5086 => 1.5368, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 1.67% (26.0924 => 26.5294, std. dev.: 0.0107) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8332, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash2: 1.62% (3.1578 => 3.2089, std. dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4464, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.21% (2.6546 => 2.6867, std. dev.: 0.0044) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2232, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/oourafft: 1.12% (6.6465 => 6.7209, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.01% (4.6441 => 4.6911, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.83% (5.2763 => 3.1746, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.87% (5.3855 => 3.7230, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.66% (5.3526 => 3.7114, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.13% (2.9384 => 2.5525, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -10.30% (22.1758 => 19.8920, std. dev.: 0.0130) SingleSource/UnitTests/Vector/constpool: -5.27% (54.1659 => 51.3098, std. dev.: 0.0327) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.19% (3.8922 => 3.8460, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.56% (1.2373 => 1.1067, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.18% (8.6802 => 8.4040, std. dev.: 0.0129) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4839, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.78% (8.1563 => 7.9293, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0860, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8095, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 02:37:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 04:37:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120718093700.0AEE12A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2171?compare_to=2166&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2171, Order: 160427, Start Time: 2012-07-18 06:52:10, End Time: 2012-07-18 09:37:09 To: 2166, Order: 160416, Start Time: 2012-07-18 03:40:39, End Time: 2012-07-18 06:24:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (52 on baseline) Performance Improvements: 4 (1 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 947 (841 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 23.67% (0.4018 => 0.4969, std. dev.: 0.0358) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 9.37% (119.2461 => 130.4228, std. dev.: 0.5116) SingleSource/Benchmarks/Dhrystone/fldry: 1.03% (17.1648 => 17.3418, std. dev.: 0.0374) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -2.30% (2.1816 => 2.1315, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -1.81% (1.0439 => 1.0250, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: -1.33% (1.0100 => 0.9966, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.30% (24.4724 => 24.1544, std. dev.: 0.0169) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 31.04% (0.3792 => 0.4969, std. dev.: 0.0358) SingleSource/UnitTests/ObjC/exceptions-2: 12.68% (0.3446 => 0.3883, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.64% (0.3442 => 0.3877, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.61% (0.3496 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.61% (0.3465 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.57% (0.3460 => 0.3895, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.53% (0.3488 => 0.3925, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 12.51% (0.3469 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.25% (0.3650 => 0.4097, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.08% (0.3643 => 0.4083, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.73% (0.3724 => 0.4161, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.55% (0.5826 => 0.6266, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.34% (0.5889 => 0.6321, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.88% (0.7171 => 0.7593, std. dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 5.16% (1.5932 => 1.6754, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.97% (1.6211 => 1.7016, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.91% (3.5627 => 3.7377, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.86% (0.4361 => 0.4573, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.61% (0.4994 => 0.5224, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.51% (1.3152 => 1.3745, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (0.5000 => 0.5224, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.48% (0.3930 => 0.4106, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.47% (0.2866 => 0.2994, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.31% (0.5900 => 0.6154, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 4.25% (4.2109 => 4.3898, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.04% (0.5026 => 0.5229, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 4.02% (0.4029 => 0.4191, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 4.02% (1.0781 => 1.1214, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.69% (0.3362 => 0.3486, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.53% (1.9694 => 2.0390, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.44% (0.9909 => 1.0250, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.40% (1.9966 => 2.0645, std. dev.: 0.0072) MultiSource/Applications/SPASS/SPASS: 3.26% (5.5417 => 5.7224, std. dev.: 0.0202) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (0.4658 => 0.4808, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.21% (4.4195 => 4.5614, std. dev.: 0.0150) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.16% (0.3890 => 0.4013, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.15% (2.7292 => 2.8152, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 3.12% (2.1653 => 2.2329, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.11% (2.0673 => 2.1315, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.03% (2.1013 => 2.1650, std. dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 2.95% (4.6177 => 4.7538, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 2.91% (0.6634 => 0.6827, std. dev.: 0.0059) MultiSource/Applications/hbd/hbd: 2.77% (0.9697 => 0.9966, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 2.71% (1.8794 => 1.9304, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 2.70% (23.5202 => 24.1544, std. dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.66% (0.3903 => 0.4007, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.58% (0.5546 => 0.5689, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.55% (0.7875 => 0.8076, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.51% (0.4139 => 0.4243, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.50% (1.4269 => 1.4626, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash: 2.48% (0.4146 => 0.4249, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.31% (2.0346 => 2.0612, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.27% (11.9555 => 11.8042, std. dev.: 0.0079) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 03:36:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 05:36:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120718103616.F29BC2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2172?compare_to=2169&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2172, Order: 160430, Start Time: 2012-07-18 09:22:00, End Time: 2012-07-18 10:36:26 To: 2169, Order: 160429, Start Time: 2012-07-18 07:39:36, End Time: 2012-07-18 08:53:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (136 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (722 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.54% (2.0176 => 2.2908, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 10.67% (0.5818 => 0.6439, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.56% (0.5748 => 0.6355, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.47% (0.7061 => 0.7800, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.11% (0.3578 => 0.3904, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.74% (0.3650 => 0.3969, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 8.72% (0.3646 => 0.3964, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.66% (0.3601 => 0.3913, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.61% (0.3623 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.60% (0.3663 => 0.3978, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.58% (0.3789 => 0.4114, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.47% (0.4003 => 0.4342, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.46% (0.3914 => 0.4245, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.27% (0.3940 => 0.4266, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.15% (0.1986 => 0.2128, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.78% (1.3693 => 1.4622, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 6.65% (0.4062 => 0.4332, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (0.4328 => 0.4614, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.45% (0.7710 => 0.8207, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.34% (0.7038 => 0.7484, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.31% (0.5265 => 0.5597, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.22% (0.2781 => 0.2954, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2596 => 0.2757, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.97% (0.2782 => 0.2948, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.91% (3.9660 => 4.2003, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/random: 5.87% (0.2690 => 0.2848, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.87% (0.2607 => 0.2760, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.86% (0.2937 => 0.3109, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.77% (0.1819 => 0.1924, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2726 => 0.2883, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.75% (0.2628 => 0.2779, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3022 => 0.3195, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.67% (0.3489 => 0.3687, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.65% (1.9828 => 2.0949, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2765 => 0.2920, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2696 => 0.2846, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.50% (0.3107 => 0.3278, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.47% (0.3580 => 0.3776, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.28% (0.3899 => 0.4105, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.13% (0.4390 => 0.4615, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.08% (0.3485 => 0.3662, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.08% (0.3192 => 0.3354, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.02% (0.6959 => 0.7308, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 5.01% (0.3453 => 0.3626, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.84% (0.4379 => 0.4591, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.82% (0.3756 => 0.3937, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.77% (0.3293 => 0.3450, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.77% (1.2193 => 1.2774, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 4.76% (16.6129 => 17.4030, std. dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/moments: 4.60% (0.3868 => 0.4046, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 4.57% (13.8202 => 14.4517, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.57% (0.9199 => 0.9619, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.34% (0.5577 => 0.5819, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.21% (0.2925 => 0.3048, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.20% (1.4563 => 1.5174, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.18% (13.2842 => 13.8395, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.02% (0.7506 => 0.7808, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.98% (1.3819 => 1.4369, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.97% (0.5637 => 0.5861, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 3.96% (1.1061 => 1.1499, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.88% (0.3246 => 0.3372, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.85% (7.2180 => 7.4958, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.84% (1.1364 => 1.1800, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.83% (1.3813 => 1.4342, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (3.8646 => 4.0122, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.81% (0.7460 => 0.7744, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.77% (0.2914 => 0.3024, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.77% (1.2292 => 1.2755, std. dev.: 0.0103) MultiSource/Applications/treecc/treecc: 3.71% (1.9270 => 1.9984, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (1.3245 => 1.3728, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 3.60% (0.8310 => 0.8609, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3755 => 0.3887, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.0594 => 1.0951, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.34% (4.3801 => 4.5262, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.29% (4.4433 => 4.5893, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.25% (3.6692 => 3.7885, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.00% (2.1791 => 2.2444, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.88% (4.9865 => 5.1300, std. dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.65% (0.4791 => 0.4918, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.62% (0.8698 => 0.8926, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.61% (3.1889 => 3.2722, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.54% (1.1333 => 1.1621, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.32% (6.5754 => 6.7280, std. dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 2.24% (16.2614 => 16.6256, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (0.6283 => 0.6419, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.15% (14.5298 => 14.8428, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6135 => 0.6263, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 2.05% (14.8535 => 15.1582, std. dev.: 0.0152) MultiSource/Benchmarks/mafft/pairlocalalign: 1.93% (8.4961 => 8.6603, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.71% (2.1007 => 2.1367, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.34% (3.2742 => 3.3182, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.34% (1.5188 => 1.5392, std. dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 1.30% (4.6629 => 4.7233, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.71% (1.8175 => 2.2847, std. dev.: 0.0447) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.64% (2.0200 => 2.1946, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.92% (0.9996 => 1.0788, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.74% (1.5824 => 1.7049, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 7.52% (1.2998 => 1.3975, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.29% (7.4271 => 7.7455, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.2619 => 11.7206, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9208, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4788, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.33% (1.7688 => 1.8100, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.96% (4.1080 => 4.1887, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5089 => 1.5364, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.49% (3.6469 => 3.7013, std. dev.: 0.0090) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1939, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.26% (3.1736 => 3.2136, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.66% (22.5627 => 21.0603, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.16% (0.3511 => 0.3400, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -9.03% (1.2308 => 1.1197, std. dev.: 0.0241) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.18% (1.9762 => 1.9133, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4463, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.43% (0.8342 => 0.8139, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.27% (20.3410 => 19.8802, std. dev.: 0.0519) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0043) MultiSource/Applications/spiff/spiff: -1.79% (3.0263 => 2.9721, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2506, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8612, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2149, std. dev.: 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8042, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.3167 => 5.2628, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 04:12:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 06:12:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120718111257.A6E2B2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2173?compare_to=2170&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2173, Order: 160431, Start Time: 2012-07-18 09:54:34, End Time: 2012-07-18 11:13:10 To: 2170, Order: 160429, Start Time: 2012-07-18 08:07:56, End Time: 2012-07-18 09:26:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (75 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (779 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.12% (3.6863 => 3.7275, std. dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.28% (10.3673 => 13.8178, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/trivial-interface: 12.64% (0.3473 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.33% (0.3543 => 0.3980, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.33% (0.3561 => 0.4000, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3497 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.28% (0.3543 => 0.3978, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.26% (0.3516 => 0.3947, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.91% (1.1194 => 1.2527, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3828 => 0.4265, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.35% (0.3886 => 0.4327, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.28% (0.3927 => 0.4370, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.75% (1.7609 => 1.9325, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.19% (2.2022 => 2.3826, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.08% (0.6030 => 0.6457, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.02% (0.5925 => 0.6341, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.3177 => 0.3367, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 5.91% (0.7326 => 0.7759, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2065 => 0.2180, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.47% (0.4879 => 0.5146, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.27% (10.4361 => 10.9857, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/oourafft: 5.15% (0.3282 => 0.3451, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.85% (7.0540 => 7.3960, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.38% (0.4615 => 0.4817, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 4.25% (0.7433 => 0.7749, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.95% (9.4845 => 9.8595, std. dev.: 0.0110) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.94% (5.0018 => 5.1990, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (4.9449 => 5.1347, std. dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.72% (0.3121 => 0.3237, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.59% (0.8172 => 0.8465, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.48% (0.5569 => 0.5763, std. dev.: 0.0041) MultiSource/Applications/spiff/spiff: 3.36% (0.7835 => 0.8098, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.26% (0.5860 => 0.6051, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.22% (4.2646 => 4.4021, std. dev.: 0.0037) MultiSource/Applications/hbd/hbd: 3.16% (1.5603 => 1.6096, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.01% (0.3423 => 0.3526, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.94% (8.1363 => 8.3758, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.94% (14.3668 => 14.7896, std. dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.92% (1.1861 => 1.2207, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.86% (1.3050 => 1.3423, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.74% (1.5415 => 1.5838, std. dev.: 0.0093) MultiSource/Applications/oggenc/oggenc: 2.69% (5.7591 => 5.9141, std. dev.: 0.0040) MultiSource/Applications/Burg/burg: 2.57% (1.1642 => 1.1941, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.49% (0.4103 => 0.4205, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.43% (3.3354 => 3.4166, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.38% (2.0273 => 2.0755, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.35% (0.4636 => 0.4745, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.33% (0.8067 => 0.8255, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.28% (2.0665 => 2.1136, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.16% (0.9765 => 0.9976, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.01% (3.8723 => 3.9500, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.98% (0.5105 => 0.5206, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 1.96% (0.8921 => 0.9096, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 1.95% (0.6456 => 0.6582, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.82% (1.5859 => 1.6147, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.78% (0.6450 => 0.6565, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.72% (0.5981 => 0.6084, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.68% (0.6675 => 0.6787, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.66% (1.4186 => 1.4421, std. dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 1.55% (17.1811 => 17.4474, std. dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 1.32% (1.1840 => 1.1996, std. dev.: 0.0050) MultiSource/Applications/siod/siod: 1.17% (2.2969 => 2.3237, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7470, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.01% (1.0313 => 1.0520, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.93% (1.5086 => 1.5377, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2149, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 1.65% (26.0924 => 26.5236, std. dev.: 0.0168) MultiSource/Benchmarks/nbench/nbench: 1.58% (11.6436 => 11.8271, std. dev.: 0.0147) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4460, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6900, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2185, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/oourafft: 1.10% (6.6465 => 6.7196, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.80% (5.2763 => 3.1764, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.90% (5.3855 => 3.7215, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.71% (5.3526 => 3.7089, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.17% (2.9384 => 2.5514, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -10.20% (22.1758 => 19.9133, std. dev.: 0.0147) SingleSource/UnitTests/Vector/constpool: -5.18% (54.1659 => 51.3599, std. dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.20% (3.8922 => 3.8456, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.63% (0.0998 => 0.0842, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.41% (1.2373 => 1.1085, std. dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4727, std. dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4202, std. dev.: 0.0206) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9149, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0831, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8089, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 05:18:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 07:18:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120718121825.D1FE12A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2174?compare_to=2172&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2174, Order: 160431, Start Time: 2012-07-18 11:04:34, End Time: 2012-07-18 12:18:38 To: 2172, Order: 160430, Start Time: 2012-07-18 09:22:00, End Time: 2012-07-18 10:36:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (136 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (1.9697 => 1.9921, std. dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.39% (1.1197 => 1.1041, std. dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.57% (2.0176 => 2.2914, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 10.79% (0.5818 => 0.6446, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 10.56% (0.5748 => 0.6355, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 10.51% (0.7061 => 0.7803, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.97% (0.3578 => 0.3899, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.75% (0.3601 => 0.3916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.69% (0.3646 => 0.3963, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3663 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.63% (0.3650 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.58% (0.3789 => 0.4114, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.56% (0.3623 => 0.3933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.48% (0.3914 => 0.4246, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.39% (0.4003 => 0.4339, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/property: 8.27% (0.3940 => 0.4266, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.05% (0.1986 => 0.2126, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 6.69% (1.3693 => 1.4609, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 6.60% (0.4062 => 0.4330, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (0.4328 => 0.4612, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.41% (0.7710 => 0.8204, std. dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 6.15% (0.2781 => 0.2952, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.12% (0.2596 => 0.2755, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 6.08% (0.7038 => 0.7466, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.06% (0.5265 => 0.5584, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.03% (3.9660 => 4.2051, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.99% (0.3022 => 0.3203, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.97% (0.2782 => 0.2948, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.95% (0.2607 => 0.2762, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2655 => 0.2812, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 5.84% (0.2690 => 0.2847, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.79% (0.2937 => 0.3107, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.77% (0.2721 => 0.2878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2726 => 0.2883, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.75% (0.2628 => 0.2779, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.69% (0.2760 => 0.2917, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.61% (0.1819 => 0.1921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2696 => 0.2845, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.52% (1.9828 => 2.0922, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 5.49% (0.3149 => 0.3322, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.47% (0.3580 => 0.3776, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.47% (0.3489 => 0.3680, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.44% (0.3107 => 0.3276, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.44% (0.3899 => 0.4111, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.18% (0.5577 => 0.5866, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.16% (0.3485 => 0.3665, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.06% (0.4390 => 0.4612, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.04% (0.3192 => 0.3353, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 5.01% (0.3453 => 0.3626, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.89% (0.6959 => 0.7299, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.86% (0.4379 => 0.4592, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.74% (16.6129 => 17.4005, std. dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/lists: 4.74% (0.3293 => 0.3449, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.73% (1.2193 => 1.2770, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.69% (0.9199 => 0.9630, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.68% (0.4016 => 0.4204, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.58% (0.3868 => 0.4045, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.49% (13.8202 => 14.4413, std. dev.: 0.0091) MultiSource/Benchmarks/McCat/09-vor/vor: 4.38% (0.2925 => 0.3053, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.25% (13.2842 => 13.8490, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.12% (0.5637 => 0.5869, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.08% (0.2914 => 0.3033, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.99% (1.4563 => 1.5144, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 3.98% (0.7506 => 0.7805, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.93% (1.9270 => 2.0027, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 3.93% (3.8646 => 4.0163, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.89% (1.1364 => 1.1806, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.89% (7.2180 => 7.4987, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 3.89% (1.1061 => 1.1491, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3246 => 0.3369, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.77% (1.2292 => 1.2756, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.72% (1.3813 => 1.4327, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.71% (1.3819 => 1.4332, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.66% (0.7460 => 0.7733, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 3.62% (0.8310 => 0.8611, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.55% (1.3245 => 1.3715, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3755 => 0.3886, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.43% (1.0594 => 1.0957, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.42% (4.4433 => 4.5953, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.42% (4.3801 => 4.5298, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.35% (3.6692 => 3.7923, std. dev.: 0.0095) MultiSource/Benchmarks/McCat/18-imp/imp: 3.23% (0.3220 => 0.3324, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.08% (2.1791 => 2.2463, std. dev.: 0.0171) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.92% (4.9865 => 5.1320, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.76% (0.4791 => 0.4923, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.71% (0.8698 => 0.8934, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.63% (1.1333 => 1.1631, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.59% (3.1889 => 3.2716, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 2.20% (14.5298 => 14.8499, std. dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: 2.20% (16.2614 => 16.6184, std. dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (6.5754 => 6.7191, std. dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 2.11% (14.8535 => 15.1673, std. dev.: 0.0135) MultiSource/Benchmarks/mafft/pairlocalalign: 1.91% (8.4961 => 8.6580, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.85% (2.1007 => 2.1396, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.62% (1.5188 => 1.5434, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.58% (3.2742 => 3.3259, std. dev.: 0.0125) MultiSource/Applications/oggenc/oggenc: 1.30% (4.6629 => 4.7235, std. dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.11% (0.9108 => 0.9209, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.69% (1.8175 => 2.2663, std. dev.: 0.0452) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.55% (2.0200 => 2.1927, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.71% (1.5824 => 1.7044, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 7.52% (1.2998 => 1.3976, std. dev.: 0.0152) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.17% (7.4271 => 7.7367, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.2619 => 11.7198, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9223, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4788, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.82% (1.7688 => 1.8187, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9738, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.51% (1.9433 => 1.9921, std. dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1898, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.68% (3.6469 => 3.7081, std. dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (1.5089 => 1.5321, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.32% (2.0152 => 2.0418, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 1.18% (3.1736 => 3.2111, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.66% (22.5627 => 21.0604, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.3511 => 0.3397, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2308 => 1.1041, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.55% (1.3780 => 1.3153, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.19% (1.9762 => 1.9131, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.43% (0.8342 => 0.8139, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4991, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9422, std. dev.: 0.0832) MultiSource/Applications/spiff/spiff: -1.79% (3.0263 => 2.9722, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2550, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8711, std. dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2544, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8048, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.14% (3.8887 => 3.8443, std. dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 05:49:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 07:49:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120718124933.7A7E22A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2175?compare_to=2171&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2175, Order: 160431, Start Time: 2012-07-18 10:05:43, End Time: 2012-07-18 12:49:47 To: 2171, Order: 160427, Start Time: 2012-07-18 06:52:10, End Time: 2012-07-18 09:37:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (52 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (841 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.00% (2.0360 => 2.0768, std. dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.07% (130.4228 => 131.8158, std. dev.: 0.2629) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 12.70% (0.3442 => 0.3879, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.67% (0.3488 => 0.3930, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3465 => 0.3904, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.65% (0.3446 => 0.3882, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.59% (0.3496 => 0.3936, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.54% (0.3460 => 0.3894, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.40% (0.3469 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.27% (0.3643 => 0.4090, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.19% (0.3650 => 0.4095, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3724 => 0.4163, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.64% (0.5826 => 0.6271, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.23% (0.5889 => 0.6315, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.75% (0.7171 => 0.7583, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 5.07% (1.5932 => 1.6740, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.04% (1.6211 => 1.7028, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.94% (3.5627 => 3.7386, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.72% (0.4361 => 0.4567, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.52% (1.3152 => 1.3747, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.49% (0.4994 => 0.5218, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.25% (0.3930 => 0.4097, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.15% (4.2109 => 4.3858, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.15% (0.5900 => 0.6145, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.12% (0.5000 => 0.5206, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.05% (0.4029 => 0.4192, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 3.97% (1.0781 => 1.1209, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.96% (0.5026 => 0.5225, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.65% (0.2736 => 0.2836, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.52% (0.2866 => 0.2967, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.52% (1.9694 => 2.0388, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.34% (1.9966 => 2.0633, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.25% (4.4195 => 4.5631, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.24% (5.5417 => 5.7213, std. dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.17% (2.7292 => 2.8158, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.11% (0.3890 => 0.4011, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (2.0673 => 2.1301, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.03% (0.4658 => 0.4799, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.98% (0.9909 => 1.0204, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 2.96% (2.1653 => 2.2293, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 2.88% (4.6177 => 4.7505, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 2.87% (0.4146 => 0.4265, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.76% (0.9697 => 0.9965, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (1.8794 => 1.9313, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.3845 => 0.3950, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.72% (0.3903 => 0.4009, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (2.1013 => 2.1582, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.56% (23.5202 => 24.1221, std. dev.: 0.0085) MultiSource/Applications/treecc/treecc: 2.55% (0.7875 => 0.8076, std. dev.: 0.0051) MultiSource/Applications/lua/lua: 2.38% (1.4269 => 1.4609, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.34% (0.5546 => 0.5676, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.08% (0.6634 => 0.6772, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.59% (0.6435 => 0.6537, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.25% (2.0346 => 2.0601, std. dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.45% (11.9555 => 11.7820, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 07:14:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 09:14:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120718141444.CA6692A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2176?compare_to=2174&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2176, Order: 160432, Start Time: 2012-07-18 13:00:40, End Time: 2012-07-18 14:14:58 To: 2174, Order: 160431, Start Time: 2012-07-18 11:04:34, End Time: 2012-07-18 12:18:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (135 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (722 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.14% (27.6278 => 29.6012, std. dev.: 0.0455) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: -1.22% (1.9921 => 1.9678, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.56% (2.0176 => 2.2912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.78% (0.5818 => 0.6445, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.51% (0.5748 => 0.6352, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.48% (0.7061 => 0.7801, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.92% (0.3578 => 0.3897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.69% (0.3601 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.67% (0.3646 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.65% (0.3663 => 0.3980, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.63% (0.3789 => 0.4116, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.58% (0.3623 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.55% (0.3650 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.43% (0.3914 => 0.4244, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.32% (0.4003 => 0.4336, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.22% (0.3940 => 0.4264, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.38% (0.3130 => 0.3361, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 6.73% (1.3693 => 1.4614, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.38% (0.4328 => 0.4604, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.33% (0.7710 => 0.8198, std. dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 6.26% (0.2781 => 0.2955, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.22% (0.7038 => 0.7476, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2596 => 0.2757, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 6.18% (0.4062 => 0.4313, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.08% (0.2765 => 0.2933, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.99% (3.9660 => 4.2037, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 5.98% (0.2607 => 0.2763, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.97% (0.2782 => 0.2948, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.91% (0.2690 => 0.2849, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.91% (0.5265 => 0.5576, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.76% (0.2760 => 0.2919, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.72% (0.2937 => 0.3105, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.71% (0.2628 => 0.2778, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.70% (0.2721 => 0.2876, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.62% (1.9828 => 2.0942, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2966 => 0.3132, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.58% (0.4390 => 0.4635, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.56% (0.3580 => 0.3779, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2696 => 0.2845, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.50% (0.3107 => 0.3278, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.44% (0.3899 => 0.4111, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.35% (0.2988 => 0.3148, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.14% (0.6959 => 0.7317, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.14% (0.3485 => 0.3664, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.11% (0.3192 => 0.3355, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.02% (0.4379 => 0.4599, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 5.01% (0.3453 => 0.3626, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.91% (1.2193 => 1.2792, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 4.87% (16.6129 => 17.4226, std. dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.83% (0.4016 => 0.4210, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.83% (0.3293 => 0.3452, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.82% (0.5577 => 0.5846, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.82% (0.3756 => 0.3937, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.69% (0.9199 => 0.9630, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.52% (0.3868 => 0.4043, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.52% (0.2945 => 0.3078, std. dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 4.44% (13.8202 => 14.4342, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/09-vor/vor: 4.38% (0.2925 => 0.3053, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.15% (13.2842 => 13.8359, std. dev.: 0.0167) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.11% (1.4563 => 1.5161, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 4.00% (1.1061 => 1.1503, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.97% (0.3246 => 0.3375, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.95% (0.2914 => 0.3029, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.94% (0.5637 => 0.5859, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 3.88% (0.7506 => 0.7797, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.84% (1.1364 => 1.1800, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.83% (3.8646 => 4.0128, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.80% (7.2180 => 7.4926, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 3.78% (1.2292 => 1.2757, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.78% (1.9270 => 1.9998, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.73% (1.3819 => 1.4334, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 3.67% (0.8310 => 0.8615, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.66% (1.3813 => 1.4319, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.59% (1.3245 => 1.3721, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.54% (0.7460 => 0.7724, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.52% (4.3801 => 4.5342, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 3.46% (1.0594 => 1.0961, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.29% (4.4433 => 4.5896, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.17% (0.3220 => 0.3322, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.13% (3.6692 => 3.7842, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 3.04% (2.1791 => 2.2453, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.91% (4.9865 => 5.1315, std. dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (0.4791 => 0.4920, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.68% (1.1333 => 1.1637, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.64% (0.8698 => 0.8928, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.52% (3.1889 => 3.2694, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6283 => 0.6428, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.25% (16.2614 => 16.6271, std. dev.: 0.0089) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (6.5754 => 6.7193, std. dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.17% (0.6135 => 0.6268, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.08% (14.8535 => 15.1628, std. dev.: 0.0124) MultiSource/Applications/ClamAV/clamscan: 2.08% (14.5298 => 14.8313, std. dev.: 0.0155) MultiSource/Benchmarks/mafft/pairlocalalign: 1.90% (8.4961 => 8.6579, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.80% (2.1007 => 2.1385, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.56% (3.2742 => 3.3253, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 1.32% (4.6629 => 4.7243, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.12% (0.9108 => 0.9210, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 25.03% (1.8175 => 2.2725, std. dev.: 0.0195) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1916, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.15% (0.9996 => 1.0811, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.71% (1.5824 => 1.7044, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.54% (1.2998 => 1.3848, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (2.5629 => 2.7293, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.4271 => 7.7331, std. dev.: 0.0105) MultiSource/Benchmarks/nbench/nbench: 4.08% (11.2619 => 11.7209, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9203, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.03% (1.9199 => 1.9781, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.38% (1.7688 => 1.8109, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1904, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.67% (0.8273 => 0.8411, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5340, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.58% (3.6469 => 3.7047, std. dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1969, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.22% (3.1736 => 3.2124, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.72% (22.5627 => 21.0472, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.28% (0.3511 => 0.3396, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.55% (0.0997 => 0.0842, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.43% (1.2308 => 1.1024, std. dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.63% (1.3780 => 1.3142, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9123, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.46% (0.8342 => 0.8137, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9471, std. dev.: 0.0396) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5097, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: -1.79% (3.0263 => 2.9722, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3456, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2519, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8564, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.5254 => 2.4903, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2208, std. dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2516, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8042, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 07:19:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 09:19:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120718141907.31C572A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2177?compare_to=2173&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2177, Order: 160432, Start Time: 2012-07-18 13:00:49, End Time: 2012-07-18 14:19:21 To: 2173, Order: 160431, Start Time: 2012-07-18 09:54:34, End Time: 2012-07-18 11:13:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (76 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (778 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.94% (79.0973 => 80.6297, std. dev.: 0.3647) SingleSource/Benchmarks/Shootout-C++/ary3: 1.06% (3.7006 => 3.7399, std. dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.35% (10.3673 => 13.8246, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: 12.58% (0.3473 => 0.3910, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.53% (0.3497 => 0.3935, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: 12.42% (0.3543 => 0.3983, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.31% (0.3543 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.29% (0.3516 => 0.3948, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.19% (0.3561 => 0.3995, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.82% (1.1194 => 1.2517, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 11.44% (0.3828 => 0.4266, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.35% (0.3886 => 0.4327, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3927 => 0.4372, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.73% (1.7609 => 1.9322, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.24% (0.1432 => 0.1550, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.20% (2.2022 => 2.3827, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 7.06% (0.6030 => 0.6456, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.04% (0.5925 => 0.6342, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.94% (0.7326 => 0.7761, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.3177 => 0.3364, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2065 => 0.2181, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.49% (0.4879 => 0.5147, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 5.21% (0.3282 => 0.3453, std. dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 5.19% (10.4361 => 10.9782, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.75% (7.0540 => 7.3889, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.36% (0.4615 => 0.4816, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.19% (0.8172 => 0.8514, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 4.10% (0.7433 => 0.7738, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.99% (9.4845 => 9.8633, std. dev.: 0.0115) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (5.0018 => 5.1997, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.78% (4.9449 => 5.1320, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.54% (1.5603 => 1.6156, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.39% (0.5569 => 0.5758, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.29% (0.5860 => 0.6053, std. dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.27% (0.3121 => 0.3223, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.20% (4.2646 => 4.4012, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.04% (8.1363 => 8.3834, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.99% (0.7835 => 0.8069, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 2.98% (0.3423 => 0.3525, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.94% (14.3668 => 14.7894, std. dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.82% (1.3050 => 1.3418, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.74% (1.1861 => 1.2186, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.62% (5.7591 => 5.9100, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.61% (1.5415 => 1.5817, std. dev.: 0.0085) MultiSource/Applications/Burg/burg: 2.54% (1.1642 => 1.1938, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.50% (2.0665 => 2.1181, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.49% (3.3354 => 3.4186, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.48% (0.4636 => 0.4751, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.40% (2.0273 => 2.0759, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/hash: 2.38% (0.4289 => 0.4391, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.33% (0.8067 => 0.8255, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.18% (0.9765 => 0.9978, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.12% (3.8723 => 3.9543, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 1.98% (0.6456 => 0.6584, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.87% (2.2024 => 2.2435, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.81% (0.6450 => 0.6567, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.75% (1.4186 => 1.4434, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.70% (1.5859 => 1.6128, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 1.66% (0.8921 => 0.9069, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.58% (1.2842 => 1.3045, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.58% (17.1811 => 17.4519, std. dev.: 0.0249) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.50% (0.6675 => 0.6775, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.28% (1.1840 => 1.1991, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.19% (2.2969 => 2.3242, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7561, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.01% (1.0313 => 1.0520, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (1.5086 => 1.5370, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.79% (11.6436 => 11.8520, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 1.73% (26.0924 => 26.5432, std. dev.: 0.0540) SingleSource/Benchmarks/Shootout-C++/hash2: 1.58% (3.1578 => 3.2077, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4463, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6896, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.15% (9.1159 => 9.2210, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.07% (6.6465 => 6.7173, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1292, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.81% (5.2763 => 3.1759, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.83% (5.3855 => 3.7249, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.54% (5.3526 => 3.7177, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.16% (2.9384 => 2.5518, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -10.30% (22.1758 => 19.8926, std. dev.: 0.0118) SingleSource/UnitTests/Vector/constpool: -5.26% (54.1659 => 51.3180, std. dev.: 0.0297) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (3.8922 => 3.8465, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.63% (0.0998 => 0.0842, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2373 => 1.1057, std. dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4747, std. dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4119, std. dev.: 0.0158) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.77% (8.1563 => 7.9300, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0834, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8097, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.06% (1.3677 => 1.3532, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 09:01:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 11:01:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120718160115.10B5A2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2178?compare_to=2175&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2178, Order: 160432, Start Time: 2012-07-18 13:17:52, End Time: 2012-07-18 16:01:28 To: 2175, Order: 160431, Start Time: 2012-07-18 10:05:43, End Time: 2012-07-18 12:49:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (53 on baseline) Performance Improvements: 1 (2 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 950 (839 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.74% (2.4630 => 2.5058, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.2108 => 0.2264, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.12% (54.2287 => 54.8334, std. dev.: 0.0605) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: -7.32% (0.2403 => 0.2227, std. dev.: 0.0055) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 12.78% (0.3442 => 0.3882, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.65% (0.3446 => 0.3882, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.61% (0.3488 => 0.3928, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 12.61% (0.3465 => 0.3902, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.56% (0.3496 => 0.3935, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.54% (0.3460 => 0.3894, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 12.54% (0.3469 => 0.3904, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.22% (0.3650 => 0.4096, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.11% (0.3643 => 0.4084, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3724 => 0.4163, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.59% (0.5826 => 0.6268, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.27% (0.5889 => 0.6317, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.80% (0.7171 => 0.7587, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.07% (1.6211 => 1.7033, std. dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 5.01% (1.5932 => 1.6730, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.96% (3.5627 => 3.7395, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.82% (0.4361 => 0.4571, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.81% (0.5900 => 0.6184, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.66% (0.3930 => 0.4113, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 4.57% (0.4029 => 0.4213, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.53% (1.3152 => 1.3748, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.2866 => 0.2995, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.42% (0.5000 => 0.5221, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.40% (0.5026 => 0.5247, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.25% (0.4994 => 0.5206, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 4.03% (1.0781 => 1.1216, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 3.92% (4.2109 => 4.3758, std. dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.88% (1.9694 => 2.0459, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (1.9966 => 2.0709, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.59% (0.4658 => 0.4825, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.30% (5.5417 => 5.7247, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.17% (4.4195 => 4.5598, std. dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.11% (2.7292 => 2.8142, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (2.0673 => 2.1301, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.98% (0.3890 => 0.4006, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.98% (0.9909 => 1.0204, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 2.92% (2.1653 => 2.2286, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.92% (0.3903 => 0.4017, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 2.87% (2.1013 => 2.1616, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.79% (4.6177 => 4.7467, std. dev.: 0.0123) MultiSource/Benchmarks/MallocBench/gs/gs: 2.77% (1.8794 => 1.9315, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 2.73% (0.9697 => 0.9962, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.72% (0.7875 => 0.8089, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 2.60% (23.5202 => 24.1322, std. dev.: 0.0110) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.56% (0.4139 => 0.4245, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4146 => 0.4252, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.49% (0.5546 => 0.5684, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.25% (1.4269 => 1.4590, std. dev.: 0.0115) MultiSource/Applications/siod/siod: 2.08% (0.6634 => 0.6772, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.60% (0.6435 => 0.6538, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.22% (2.0346 => 2.0595, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: 1.19% (2.4764 => 2.5058, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.2122 => 0.2264, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.49% (11.9555 => 11.7770, std. dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: -7.29% (0.2402 => 0.2227, std. dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 09:02:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 11:02:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120718160238.E6CF92A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2179?compare_to=2176&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2179, Order: 160433, Start Time: 2012-07-18 14:48:50, End Time: 2012-07-18 16:02:52 To: 2176, Order: 160432, Start Time: 2012-07-18 13:00:40, End Time: 2012-07-18 14:14:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (133 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (725 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.56% (2.0176 => 2.2911, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 10.73% (0.5818 => 0.6442, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.68% (0.5748 => 0.6362, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 10.61% (0.7061 => 0.7810, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.11% (0.3578 => 0.3904, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-2: 8.91% (0.3601 => 0.3922, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.76% (0.3663 => 0.3984, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.72% (0.3646 => 0.3964, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.63% (0.3650 => 0.3965, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.61% (0.3623 => 0.3935, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.60% (0.3789 => 0.4115, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.46% (0.3914 => 0.4245, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.37% (0.4003 => 0.4338, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.22% (0.3940 => 0.4264, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.05% (0.1986 => 0.2126, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.59% (1.3693 => 1.4595, std. dev.: 0.0080) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.43% (0.7710 => 0.8206, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.34% (0.7038 => 0.7484, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 6.25% (0.4062 => 0.4316, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 6.15% (0.2781 => 0.2952, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.10% (0.5265 => 0.5586, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.05% (0.2596 => 0.2753, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.00% (0.2782 => 0.2949, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.98% (0.2607 => 0.2763, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (3.9660 => 4.2031, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 5.95% (0.2690 => 0.2850, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.78% (0.2628 => 0.2780, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.76% (0.3022 => 0.3196, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.72% (0.2760 => 0.2918, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.72% (0.2726 => 0.2882, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.70% (0.2721 => 0.2876, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1819 => 0.1922, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.65% (1.9828 => 2.0949, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.63% (0.2966 => 0.3133, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.61% (0.3580 => 0.3781, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.61% (0.2761 => 0.2916, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2765 => 0.2920, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.60% (0.2696 => 0.2847, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3489 => 0.3682, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.3107 => 0.3277, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.40% (0.6959 => 0.7335, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.39% (0.3899 => 0.4109, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.3149 => 0.3318, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.14% (0.3485 => 0.3664, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.04% (0.3192 => 0.3353, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.03% (0.4390 => 0.4611, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.89% (0.4379 => 0.4593, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (0.3756 => 0.3939, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 4.85% (16.6129 => 17.4193, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/lists: 4.80% (0.3293 => 0.3451, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.80% (1.2193 => 1.2778, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.78% (0.4016 => 0.4208, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.60% (0.9199 => 0.9622, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 4.52% (13.8202 => 14.4453, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.52% (0.5577 => 0.5829, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.50% (0.3868 => 0.4042, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.34% (0.2925 => 0.3052, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.23% (13.2842 => 13.8467, std. dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.13% (1.4563 => 1.5164, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.12% (0.5637 => 0.5869, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.03% (3.8646 => 4.0205, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: 4.02% (0.7506 => 0.7808, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.91% (0.2914 => 0.3028, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 3.87% (1.1061 => 1.1489, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.86% (1.1364 => 1.1803, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.85% (7.2180 => 7.4961, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.85% (1.3819 => 1.4351, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3246 => 0.3369, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 3.78% (0.8310 => 0.8624, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.77% (1.2292 => 1.2756, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 3.77% (1.9270 => 1.9997, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.71% (1.3813 => 1.4325, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (1.3245 => 1.3728, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.58% (0.7460 => 0.7727, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.45% (1.0594 => 1.0960, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.37% (4.3801 => 4.5275, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (4.4433 => 4.5902, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 3.20% (0.3220 => 0.3323, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.15% (3.6692 => 3.7849, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 2.97% (2.1791 => 2.2438, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.87% (4.9865 => 5.1297, std. dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.72% (0.8698 => 0.8935, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (0.4791 => 0.4920, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.64% (1.1333 => 1.1632, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.53% (3.1889 => 3.2697, std. dev.: 0.0164) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (6.5754 => 6.7258, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.24% (0.6283 => 0.6424, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.18% (16.2614 => 16.6152, std. dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: 2.17% (14.5298 => 14.8453, std. dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6135 => 0.6263, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 2.02% (14.8535 => 15.1542, std. dev.: 0.0204) MultiSource/Benchmarks/mafft/pairlocalalign: 1.97% (8.4961 => 8.6632, std. dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.56% (3.2742 => 3.3254, std. dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 1.53% (4.6629 => 4.7342, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.39% (1.5188 => 1.5399, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.48% (1.8175 => 2.2625, std. dev.: 0.0288) SingleSource/Benchmarks/Misc/mandel-2: 8.49% (1.2998 => 1.4101, std. dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.37% (2.0200 => 2.1891, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.05% (0.9996 => 1.0801, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.73% (1.5824 => 1.7047, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.06% (11.2619 => 11.7192, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7190, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9230, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4800, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.37% (1.0310 => 1.0554, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.23% (1.7688 => 1.8083, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1902, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.75% (1.4298 => 1.4548, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5343, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.46% (3.6469 => 3.7002, std. dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/fldry: 1.34% (1.9290 => 1.9549, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1968, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.5627 => 21.0516, std. dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.30% (0.3511 => 0.3395, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.50% (1.2308 => 1.1139, std. dev.: 0.0100) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3133, std. dev.: 0.0097) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9130, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.46% (0.8342 => 0.8137, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.12% (20.3410 => 19.9100, std. dev.: 0.0635) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5067, std. dev.: 0.0045) MultiSource/Applications/spiff/spiff: -1.86% (3.0263 => 2.9701, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2517, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4893, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.36% (0.9692 => 0.9560, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2522, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8706, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8041, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 09:07:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 11:07:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120718160714.66D352A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2180?compare_to=2177&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2180, Order: 160433, Start Time: 2012-07-18 14:48:47, End Time: 2012-07-18 16:07:26 To: 2177, Order: 160432, Start Time: 2012-07-18 13:00:49, End Time: 2012-07-18 14:19:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (74 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (780 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.27% (10.3673 => 13.8167, std. dev.: 0.0122) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3473 => 0.3911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.32% (0.3497 => 0.3928, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.32% (0.3516 => 0.3949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.31% (0.3543 => 0.3979, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.28% (0.3543 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.19% (0.3561 => 0.3995, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.90% (1.1194 => 1.2526, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 11.80% (0.3694 => 0.4130, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.44% (0.3828 => 0.4266, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.35% (0.3886 => 0.4327, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.28% (0.3927 => 0.4370, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.61% (1.7609 => 1.9302, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.24% (2.2022 => 2.3836, std. dev.: 0.0122) SingleSource/UnitTests/ObjC++/Hello: 7.04% (0.5925 => 0.6342, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.93% (0.6030 => 0.6448, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.54% (0.7326 => 0.7805, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.3177 => 0.3364, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.47% (0.2065 => 0.2178, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.35% (0.4879 => 0.5140, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.21% (10.4361 => 10.9799, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 5.09% (0.3282 => 0.3449, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.81% (7.0540 => 7.3930, std. dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.42% (0.4615 => 0.4819, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 4.02% (0.7433 => 0.7732, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.98% (0.8172 => 0.8497, std. dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (9.4845 => 9.8601, std. dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.88% (4.9449 => 5.1369, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (5.0018 => 5.1936, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.41% (0.5569 => 0.5759, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.25% (4.2646 => 4.4034, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.24% (0.5860 => 0.6050, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.08% (1.5603 => 1.6084, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 3.04% (0.3423 => 0.3527, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.93% (8.1363 => 8.3746, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.89% (14.3668 => 14.7820, std. dev.: 0.0238) MultiSource/Applications/spiff/spiff: 2.81% (0.7835 => 0.8055, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.80% (1.3050 => 1.3416, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.78% (1.1861 => 1.2191, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 2.66% (5.7591 => 5.9122, std. dev.: 0.0146) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.43% (1.5415 => 1.5790, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.43% (1.1642 => 1.1925, std. dev.: 0.0086) MultiSource/Applications/d/make_dparser: 2.41% (3.3354 => 3.4157, std. dev.: 0.0156) MultiSource/Applications/treecc/treecc: 2.41% (2.0273 => 2.0761, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.39% (0.4636 => 0.4747, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.18% (2.0665 => 2.1116, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.17% (0.8067 => 0.8242, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.16% (0.9765 => 0.9976, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.05% (0.5020 => 0.5123, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.01% (2.2024 => 2.2466, std. dev.: 0.0132) MultiSource/Applications/lua/lua: 1.93% (3.8723 => 3.9472, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 1.91% (0.6456 => 0.6579, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.82% (0.5981 => 0.6090, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.80% (0.6450 => 0.6566, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.78% (1.5859 => 1.6141, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/football/football: 1.74% (0.8921 => 0.9076, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.69% (0.6675 => 0.6788, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.50% (17.1811 => 17.4382, std. dev.: 0.0165) MultiSource/Applications/hexxagon/hexxagon: 1.50% (1.2842 => 1.3034, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.41% (0.7115 => 0.7215, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.14% (2.2969 => 2.3230, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.92% (3.6395 => 3.7458, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.5086 => 1.5376, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 1.81% (26.0924 => 26.5656, std. dev.: 0.0149) MultiSource/Benchmarks/nbench/nbench: 1.55% (11.6436 => 11.8244, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 1.47% (3.1578 => 3.2043, std. dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4463, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2437, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6901, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.10% (6.6465 => 6.7196, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.83% (5.2763 => 3.1745, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.87% (5.3855 => 3.7231, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7091, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.06% (2.9384 => 2.5547, std. dev.: 0.0145) MultiSource/Applications/ClamAV/clamscan: -10.27% (22.1758 => 19.8981, std. dev.: 0.0268) SingleSource/UnitTests/Vector/constpool: -5.30% (54.1659 => 51.2957, std. dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.20% (3.8922 => 3.8456, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.23% (0.0998 => 0.0846, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.06% (1.2373 => 1.1128, std. dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4853, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9146, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.6802 => 8.4304, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0846, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8086, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 11:20:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 13:20:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120718182044.7751C2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2181?compare_to=2179&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2181, Order: 160437, Start Time: 2012-07-18 17:06:48, End Time: 2012-07-18 18:20:55 To: 2179, Order: 160433, Start Time: 2012-07-18 14:48:50, End Time: 2012-07-18 16:02:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (135 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.60% (2.0176 => 2.2920, std. dev.: 0.0148) SingleSource/UnitTests/ObjC++/property-reference-object: 9.54% (0.5818 => 0.6373, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 9.47% (0.7061 => 0.7730, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 9.41% (0.5748 => 0.6289, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.80% (0.3578 => 0.3893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.58% (0.3601 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.56% (0.3646 => 0.3958, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.49% (0.3650 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.42% (0.3789 => 0.4108, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 8.41% (0.3663 => 0.3971, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.39% (0.3623 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.38% (0.3914 => 0.4242, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/parameter-passing: 8.14% (0.4003 => 0.4329, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.05% (0.3940 => 0.4257, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.90% (0.1986 => 0.2123, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 6.33% (1.3693 => 1.4560, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.23% (0.7710 => 0.8190, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4328 => 0.4596, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.04% (0.7038 => 0.7463, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.86% (0.2596 => 0.2748, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.83% (3.9660 => 4.1973, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.77% (0.5265 => 0.5569, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.70% (0.2721 => 0.2876, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.65% (0.2781 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.64% (0.4062 => 0.4291, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.39% (0.2782 => 0.2932, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3022 => 0.3184, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.33% (0.2607 => 0.2746, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.27% (0.2655 => 0.2795, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.26% (1.9828 => 2.0870, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2628 => 0.2766, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.20% (0.2690 => 0.2830, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.18% (0.2760 => 0.2903, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.17% (0.2765 => 0.2908, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.13% (0.4390 => 0.4615, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.12% (0.3107 => 0.3266, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.11% (0.2937 => 0.3087, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.06% (0.2966 => 0.3116, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.03% (0.2761 => 0.2900, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.03% (0.3899 => 0.4095, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.01% (0.2696 => 0.2831, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.99% (0.2726 => 0.2862, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.97% (0.3580 => 0.3758, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.90% (0.6959 => 0.7300, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.84% (0.3489 => 0.3658, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.84% (0.4379 => 0.4591, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.2988 => 0.3131, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.74% (1.2193 => 1.2771, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary3: 4.73% (0.3149 => 0.3298, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.65% (0.3485 => 0.3647, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.49% (0.9199 => 0.9612, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 4.48% (0.3192 => 0.3335, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.46% (16.6129 => 17.3539, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/sieve: 4.46% (0.3453 => 0.3607, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.45% (13.8202 => 14.4347, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3534 => 0.3691, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.37% (0.3756 => 0.3920, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.31% (0.2925 => 0.3051, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.30% (0.5577 => 0.5817, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.23% (0.4016 => 0.4186, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.16% (0.3293 => 0.3430, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.00% (1.4563 => 1.5145, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.98% (0.7506 => 0.7805, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.96% (13.2842 => 13.8108, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/moments: 3.88% (0.3868 => 0.4018, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.87% (1.1364 => 1.1804, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.87% (0.5637 => 0.5855, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.84% (0.2914 => 0.3026, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.82% (0.3246 => 0.3370, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.82% (1.3813 => 1.4340, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.81% (1.3819 => 1.4345, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.74% (7.2180 => 7.4880, std. dev.: 0.0092) MultiSource/Applications/Burg/burg: 3.69% (1.1061 => 1.1469, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 3.69% (3.8646 => 4.0071, std. dev.: 0.0075) MultiSource/Applications/treecc/treecc: 3.64% (1.9270 => 1.9971, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 3.60% (0.2945 => 0.3051, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.50% (1.3245 => 1.3708, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 3.49% (0.8310 => 0.8600, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.46% (0.7460 => 0.7718, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.28% (1.2292 => 1.2695, std. dev.: 0.0104) MultiSource/Benchmarks/nbench/nbench: 3.25% (1.0594 => 1.0938, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.18% (4.3801 => 4.5193, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.11% (4.4433 => 4.5815, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (3.6692 => 3.7800, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.96% (0.3755 => 0.3866, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 2.83% (2.1791 => 2.2407, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.61% (0.4791 => 0.4916, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.60% (4.9865 => 5.1160, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.53% (1.1333 => 1.1620, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.38% (0.8698 => 0.8905, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.28% (3.1889 => 3.2615, std. dev.: 0.0156) MultiSource/Applications/JM/ldecod/ldecod: 2.15% (6.5754 => 6.7169, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.12% (16.2614 => 16.6062, std. dev.: 0.0224) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.08% (0.6283 => 0.6414, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.04% (14.8535 => 15.1562, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.00% (0.6135 => 0.6258, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.91% (14.5298 => 14.8073, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.91% (2.1007 => 2.1408, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 1.82% (8.4961 => 8.6511, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.58% (3.2742 => 3.3258, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.46% (1.5188 => 1.5409, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.39% (4.6629 => 4.7278, std. dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.05% (1.8175 => 2.2728, std. dev.: 0.0226) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.46% (0.9996 => 1.0842, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.41% (2.0200 => 2.1898, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4040, std. dev.: 0.0072) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.73% (1.5824 => 1.7047, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.06% (11.2619 => 11.7192, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.4271 => 7.7213, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4801, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.37% (1.7688 => 1.8107, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1893, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.79% (3.6469 => 3.7121, std. dev.: 0.0052) MultiSource/Applications/lemon/lemon: 1.75% (1.4298 => 1.4548, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.67% (0.8273 => 0.8411, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5331, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 1.29% (3.1736 => 3.2146, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.98% (22.5627 => 20.9875, std. dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.05% (0.0997 => 0.0847, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -10.10% (1.2308 => 1.1065, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3181, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5512, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.17% (1.9762 => 1.9136, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -2.51% (2.5089 => 2.4460, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.43% (0.8342 => 0.8139, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9419, std. dev.: 0.0627) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5020, std. dev.: 0.0069) MultiSource/Applications/spiff/spiff: -1.88% (3.0263 => 2.9694, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2549, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4890, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.27% (0.9692 => 0.9569, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2263, std. dev.: 0.0333) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8043, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2551, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.13% (3.8887 => 3.8448, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 11:25:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 13:25:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120718182505.0EA052A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2182?compare_to=2180&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2182, Order: 160437, Start Time: 2012-07-18 17:06:50, End Time: 2012-07-18 18:25:17 To: 2180, Order: 160433, Start Time: 2012-07-18 14:48:47, End Time: 2012-07-18 16:07:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (72 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (782 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.32% (54.6383 => 56.4505, std. dev.: 0.1723) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.51% (13.8167 => 13.3317, std. dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.59% (10.3673 => 13.3317, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3473 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.95% (0.3497 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.88% (0.3543 => 0.3964, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.86% (0.3516 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.85% (0.3543 => 0.3963, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.85% (0.3561 => 0.3983, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.58% (1.1194 => 1.2490, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3694 => 0.4121, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions: 11.15% (0.3828 => 0.4255, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.04% (0.3886 => 0.4315, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.00% (0.3927 => 0.4359, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.15% (1.7609 => 1.9221, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.41% (0.3817 => 0.4138, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.54% (2.2022 => 2.3682, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 6.45% (0.6030 => 0.6419, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.31% (0.5925 => 0.6299, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.62% (0.7326 => 0.7738, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.60% (0.3177 => 0.3355, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.23% (10.4361 => 10.9820, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.19% (0.4879 => 0.5132, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.63% (0.8172 => 0.8550, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.35% (7.0540 => 7.3606, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.31% (0.4615 => 0.4814, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 4.09% (0.7433 => 0.7737, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (9.4845 => 9.8311, std. dev.: 0.0111) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.61% (5.0018 => 5.1824, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.50% (4.9449 => 5.1182, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.43% (0.5569 => 0.5760, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.29% (0.5860 => 0.6053, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.13% (4.2646 => 4.3980, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.03% (8.1363 => 8.3826, std. dev.: 0.0059) MultiSource/Applications/spiff/spiff: 2.97% (0.7835 => 0.8068, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.86% (14.3668 => 14.7770, std. dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.85% (1.1861 => 1.2199, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.60% (1.3050 => 1.3389, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.51% (3.3354 => 3.4192, std. dev.: 0.0057) MultiSource/Applications/Burg/burg: 2.51% (1.1642 => 1.1934, std. dev.: 0.0077) MultiSource/Applications/hbd/hbd: 2.51% (1.5603 => 1.5994, std. dev.: 0.0049) MultiSource/Applications/treecc/treecc: 2.50% (2.0273 => 2.0780, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (1.5415 => 1.5792, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.38% (0.8067 => 0.8259, std. dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 2.32% (5.7591 => 5.8928, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.06% (3.8723 => 3.9521, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.97% (0.9765 => 0.9957, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.97% (2.2024 => 2.2457, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.73% (1.5859 => 1.6133, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.71% (1.4186 => 1.4428, std. dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 1.67% (17.1811 => 17.4678, std. dev.: 0.0376) SingleSource/Benchmarks/Misc-C++/bigfib: 1.63% (0.6456 => 0.6561, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.57% (0.6450 => 0.6551, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.44% (2.0665 => 2.0962, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 1.41% (0.8921 => 0.9047, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.23% (2.2969 => 2.3251, std. dev.: 0.0073) MultiSource/Applications/lemon/lemon: 1.04% (1.0722 => 1.0834, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7525, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.5086 => 1.5375, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 1.83% (3.1578 => 3.2156, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.66% (26.0924 => 26.5251, std. dev.: 0.0594) MultiSource/Benchmarks/nbench/nbench: 1.57% (11.6436 => 11.8259, std. dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6892, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 1.11% (6.6465 => 6.7201, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.10% (9.1159 => 9.2165, std. dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.02% (1.3045 => 1.3178, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.94% (5.2763 => 3.1689, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.13% (5.3855 => 3.7092, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.86% (5.3526 => 3.7006, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.25% (2.9384 => 2.5490, std. dev.: 0.0077) MultiSource/Applications/ClamAV/clamscan: -10.36% (22.1758 => 19.8792, std. dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -5.16% (54.1659 => 51.3706, std. dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.45% (3.8922 => 3.8357, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.34% (1.2373 => 1.1094, std. dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4683, std. dev.: 0.0124) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.15% (8.6802 => 8.4064, std. dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.97% (8.1563 => 7.9140, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0862, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8095, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 12:12:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 14:12:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120718191252.849A02A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2183?compare_to=2178&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2183, Order: 160433, Start Time: 2012-07-18 16:29:32, End Time: 2012-07-18 19:13:06 To: 2178, Order: 160432, Start Time: 2012-07-18 13:17:52, End Time: 2012-07-18 16:01:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (53 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (840 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.60% (127.9739 => 131.3073, std. dev.: 0.4463) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.68% (0.3446 => 0.3883, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3465 => 0.3904, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3442 => 0.3878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.64% (0.3488 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.64% (0.3496 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.57% (0.3460 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.51% (0.3469 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.27% (0.3650 => 0.4098, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.08% (0.3643 => 0.4083, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.73% (0.3724 => 0.4161, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.62% (0.5826 => 0.6270, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.27% (0.5889 => 0.6317, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.93% (0.7171 => 0.7596, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 5.12% (1.5932 => 1.6748, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.08% (1.6211 => 1.7035, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.03% (3.5627 => 3.7418, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.81% (0.5900 => 0.6184, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.77% (0.4361 => 0.4569, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.60% (0.5026 => 0.5257, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 4.54% (0.4029 => 0.4212, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.43% (0.3930 => 0.4104, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.42% (1.3152 => 1.3733, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.38% (0.5000 => 0.5219, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.31% (0.4994 => 0.5209, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 4.17% (4.2109 => 4.3865, std. dev.: 0.0051) MultiSource/Applications/d/make_dparser: 3.95% (1.0781 => 1.1207, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.69% (0.2736 => 0.2837, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.65% (1.9694 => 2.0412, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.47% (1.9966 => 2.0658, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.21% (4.4195 => 4.5614, std. dev.: 0.0102) MultiSource/Applications/SPASS/SPASS: 3.21% (5.5417 => 5.7194, std. dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 3.14% (2.1653 => 2.2333, std. dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.13% (2.7292 => 2.8147, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.11% (2.0673 => 2.1315, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 3.09% (0.3267 => 0.3368, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.06% (0.3890 => 0.4009, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.01% (0.4658 => 0.4798, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.00% (0.3362 => 0.3463, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 2.94% (0.4146 => 0.4268, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.94% (0.9909 => 1.0200, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 2.89% (2.1013 => 2.1620, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.87% (4.6177 => 4.7501, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 2.73% (1.8794 => 1.9307, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 2.72% (0.7875 => 0.8089, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 2.71% (0.3726 => 0.3827, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.66% (0.3903 => 0.4007, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 2.57% (23.5202 => 24.1237, std. dev.: 0.0071) MultiSource/Applications/lua/lua: 2.44% (1.4269 => 1.4617, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 2.42% (0.9697 => 0.9932, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.42% (0.4139 => 0.4239, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.11% (0.5546 => 0.5663, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.76% (0.6435 => 0.6548, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.21% (2.0346 => 2.0593, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.48% (11.9555 => 11.7787, std. dev.: 0.0129) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 13:02:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 15:02:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120718200253.1A3012A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2184?compare_to=2181&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2184, Order: 160439, Start Time: 2012-07-18 18:48:55, End Time: 2012-07-18 20:03:06 To: 2181, Order: 160437, Start Time: 2012-07-18 17:06:48, End Time: 2012-07-18 18:20:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (134 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (722 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.68% (2.0176 => 2.2936, std. dev.: 0.0063) SingleSource/UnitTests/ObjC++/property-reference-object: 9.61% (0.5818 => 0.6377, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.52% (0.7061 => 0.7733, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 9.32% (0.5748 => 0.6284, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.75% (0.3578 => 0.3891, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.55% (0.3650 => 0.3962, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 8.53% (0.3601 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.50% (0.3646 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.41% (0.3663 => 0.3971, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.37% (0.3789 => 0.4106, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3623 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.27% (0.4003 => 0.4334, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3914 => 0.4236, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.07% (0.3940 => 0.4258, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.80% (0.1986 => 0.2121, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.34% (1.3693 => 1.4561, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4328 => 0.4596, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.12% (0.7710 => 0.8182, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 6.06% (0.4062 => 0.4308, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 5.83% (0.7038 => 0.7448, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.82% (0.2596 => 0.2747, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.80% (3.9660 => 4.1962, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.74% (0.5265 => 0.5567, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.70% (0.2721 => 0.2876, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.50% (0.2781 => 0.2934, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.43% (0.2782 => 0.2933, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2690 => 0.2835, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3022 => 0.3184, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.29% (0.2760 => 0.2906, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.26% (0.2607 => 0.2744, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.25% (0.3580 => 0.3768, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.20% (0.2655 => 0.2793, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.19% (0.4390 => 0.4618, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/fibo: 5.18% (0.2628 => 0.2764, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.12% (0.2966 => 0.3118, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.11% (0.2937 => 0.3087, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 5.07% (0.2761 => 0.2901, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.03% (0.2765 => 0.2904, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.01% (0.2696 => 0.2831, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.00% (1.9828 => 2.0819, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 4.99% (0.2726 => 0.2862, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.99% (0.3489 => 0.3663, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.99% (0.2988 => 0.3137, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.91% (0.6959 => 0.7301, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 4.89% (0.3107 => 0.3259, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.74% (0.3899 => 0.4084, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.72% (1.2193 => 1.2768, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.5577 => 0.5838, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.66% (0.4379 => 0.4583, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.65% (0.3485 => 0.3647, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.45% (16.6129 => 17.3521, std. dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.42% (0.9199 => 0.9606, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary2: 4.39% (0.3192 => 0.3332, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 4.34% (13.8202 => 14.4204, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4016 => 0.4187, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: 4.25% (0.3293 => 0.3433, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (0.3756 => 0.3915, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.22% (0.3534 => 0.3683, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.10% (0.2925 => 0.3045, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.4563 => 1.5156, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.97% (13.2842 => 13.8112, std. dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.81% (0.5637 => 0.5852, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.81% (1.3819 => 1.4345, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3246 => 0.3369, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.77% (0.2914 => 0.3024, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.2945 => 0.3056, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.76% (1.3813 => 1.4333, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.76% (1.1364 => 1.1791, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.73% (7.2180 => 7.4869, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.70% (3.8646 => 4.0077, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.66% (1.3245 => 1.3730, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 3.63% (1.1061 => 1.1462, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 3.61% (0.8310 => 0.8610, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.52% (0.7506 => 0.7770, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.50% (0.7460 => 0.7721, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.46% (1.9270 => 1.9936, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.33% (1.0594 => 1.0947, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.28% (1.2292 => 1.2695, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.26% (4.3801 => 4.5230, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 3.17% (0.3220 => 0.3322, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.13% (4.4433 => 4.5822, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.06% (3.6692 => 3.7814, std. dev.: 0.0051) MultiSource/Applications/siod/siod: 2.77% (2.1791 => 2.2395, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.71% (0.4791 => 0.4921, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.58% (4.9865 => 5.1152, std. dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.52% (1.1333 => 1.1619, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.39% (0.8698 => 0.8906, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.30% (3.1889 => 3.2624, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 2.16% (6.5754 => 6.7176, std. dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: 2.06% (16.2614 => 16.5960, std. dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.04% (0.6283 => 0.6411, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.00% (14.5298 => 14.8203, std. dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 1.98% (14.8535 => 15.1473, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.89% (0.6135 => 0.6251, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (8.4961 => 8.6482, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (2.1007 => 2.1380, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.51% (3.2742 => 3.3238, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.44% (1.5188 => 1.5407, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 1.43% (4.6629 => 4.7297, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.63% (1.8175 => 2.2652, std. dev.: 0.0191) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1933, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 8.30% (1.2998 => 1.4077, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9996 => 1.0782, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.71% (1.5824 => 1.7044, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.06% (11.2619 => 11.7195, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 3.89% (7.4271 => 7.7159, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9226, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9620, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0310 => 1.0556, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.34% (1.7688 => 1.8102, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.71% (1.9290 => 1.9619, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5343, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.46% (3.6469 => 3.7002, std. dev.: 0.0083) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.16% (3.1736 => 3.2103, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 1.11% (10.7476 => 10.8672, std. dev.: 0.0370) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.92% (22.5627 => 21.0020, std. dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.55% (0.0997 => 0.0842, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.94% (1.2308 => 1.1084, std. dev.: 0.0193) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.08% (1.3780 => 1.3080, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9125, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.45% (0.8342 => 0.8138, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5038, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: -1.87% (3.0263 => 2.9698, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.78% (20.3410 => 19.9798, std. dev.: 0.0200) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2521, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.40% (0.9692 => 0.9556, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2179, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8692, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8044, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8473, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.3167 => 5.2624, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 13:11:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 15:11:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120718201132.2E6632A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2185?compare_to=2182&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2185, Order: 160439, Start Time: 2012-07-18 18:53:20, End Time: 2012-07-18 20:11:44 To: 2182, Order: 160437, Start Time: 2012-07-18 17:06:50, End Time: 2012-07-18 18:25:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (66 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (788 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.91% (3.9120 => 3.8374, std. dev.: 0.0261) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.70% (10.3673 => 13.3429, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: 12.21% (0.3473 => 0.3897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3497 => 0.3916, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.97% (0.3516 => 0.3937, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.88% (0.3543 => 0.3964, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.83% (0.3543 => 0.3962, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 11.79% (0.3561 => 0.3981, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.61% (1.1194 => 1.2494, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 11.42% (0.3694 => 0.4116, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 11.26% (0.3828 => 0.4259, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.05% (0.3927 => 0.4361, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.99% (0.3886 => 0.4313, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.02% (1.7609 => 1.9197, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.52% (2.2022 => 2.3679, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.37% (0.6030 => 0.6414, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 6.35% (0.5925 => 0.6301, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.84% (0.7326 => 0.7754, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2065 => 0.2180, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 5.25% (10.4361 => 10.9840, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.12% (0.4879 => 0.5129, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/oourafft: 4.42% (0.3282 => 0.3427, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.41% (7.0540 => 7.3651, std. dev.: 0.0142) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.20% (0.4615 => 0.4809, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.06% (0.7433 => 0.7735, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 3.60% (9.4845 => 9.8262, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.55% (0.5860 => 0.6068, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.0018 => 5.1778, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.46% (4.9449 => 5.1161, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.35% (0.8172 => 0.8446, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.27% (0.5569 => 0.5751, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.03% (4.2646 => 4.3938, std. dev.: 0.0100) MultiSource/Applications/spiff/spiff: 3.02% (0.7835 => 0.8072, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.91% (8.1363 => 8.3733, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (14.3668 => 14.7710, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.59% (1.1861 => 1.2168, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.54% (1.3050 => 1.3382, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.51% (3.3354 => 3.4192, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.49% (2.0273 => 2.0778, std. dev.: 0.0045) MultiSource/Applications/Burg/burg: 2.41% (1.1642 => 1.1922, std. dev.: 0.0064) MultiSource/Applications/hbd/hbd: 2.33% (1.5603 => 1.5966, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.28% (1.5415 => 1.5767, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.28% (5.7591 => 5.8903, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.14% (0.8067 => 0.8240, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.96% (3.8723 => 3.9481, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.94% (2.2024 => 2.2452, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.92% (0.9765 => 0.9952, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.73% (1.5859 => 1.6134, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 1.58% (17.1811 => 17.4522, std. dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.56% (1.4186 => 1.4408, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.40% (0.8921 => 0.9046, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.38% (2.0665 => 2.0950, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.12% (2.2969 => 2.3227, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 1.01% (1.1840 => 1.1959, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9749, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.32% (3.6395 => 3.7603, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.03% (1.5086 => 1.5393, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.69% (26.0924 => 26.5335, std. dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/hash2: 1.59% (3.1578 => 3.2080, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 1.56% (11.6436 => 11.8253, std. dev.: 0.0152) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6885, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 1.06% (6.6465 => 6.7167, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.85% (5.2763 => 3.1739, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.17% (5.3855 => 3.7070, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.91% (5.3526 => 3.6982, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.25% (2.9384 => 2.5492, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -10.26% (22.1758 => 19.9006, std. dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -5.16% (54.1659 => 51.3720, std. dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.47% (3.8922 => 3.8348, std. dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2373 => 1.1164, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.21% (8.6802 => 8.4012, std. dev.: 0.0142) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4841, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.87% (8.1563 => 7.9221, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0831, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.30% (1.8329 => 1.8090, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 14:46:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 16:46:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120718214628.7E2AF2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2186?compare_to=2184&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2186, Order: 160446, Start Time: 2012-07-18 20:32:27, End Time: 2012-07-18 21:46:39 To: 2184, Order: 160439, Start Time: 2012-07-18 18:48:55, End Time: 2012-07-18 20:03:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (134 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (722 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.41% (2.0176 => 2.3083, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.81% (0.5818 => 0.6389, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.76% (0.7061 => 0.7750, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.71% (0.5748 => 0.6306, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.66% (0.3578 => 0.3852, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.57% (0.3130 => 0.3367, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 7.43% (0.3646 => 0.3917, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.41% (0.3601 => 0.3868, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.40% (0.3650 => 0.3920, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.34% (0.3789 => 0.4067, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.32% (0.4003 => 0.4296, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.31% (1.3693 => 1.4694, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/synchronized: 7.29% (0.3663 => 0.3930, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 7.29% (0.3623 => 0.3887, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.11% (0.3940 => 0.4220, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 6.65% (0.4062 => 0.4332, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (0.4328 => 0.4611, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.50% (0.1986 => 0.2115, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.48% (0.7038 => 0.7494, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.97% (0.2782 => 0.2948, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.97% (3.9660 => 4.2026, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.2937 => 0.3112, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.88% (0.1819 => 0.1926, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.87% (0.2690 => 0.2848, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.85% (0.5265 => 0.5573, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.84% (0.2721 => 0.2880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.82% (0.2628 => 0.2781, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.82% (0.2596 => 0.2747, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.80% (0.2655 => 0.2809, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.79% (0.2607 => 0.2758, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.76% (0.3022 => 0.3196, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.72% (0.2726 => 0.2882, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.70% (0.3580 => 0.3784, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.69% (0.4390 => 0.4640, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.68% (1.9828 => 2.0954, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.67% (0.7710 => 0.8147, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.66% (0.2966 => 0.3134, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3107 => 0.3280, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.54% (0.2761 => 0.2914, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.54% (0.3899 => 0.4115, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2696 => 0.2845, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.43% (0.3149 => 0.3320, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.25% (0.2988 => 0.3145, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.19% (0.3485 => 0.3666, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.14% (0.3192 => 0.3356, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.04% (0.3453 => 0.3627, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.00% (0.6959 => 0.7307, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/lists1: 4.90% (0.3534 => 0.3707, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.86% (16.6129 => 17.4210, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.80% (0.4379 => 0.4589, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.78% (1.2193 => 1.2776, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.77% (0.3293 => 0.3450, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.74% (13.8202 => 14.4755, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.73% (0.9199 => 0.9634, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.71% (0.3756 => 0.3933, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.52% (0.3868 => 0.4043, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.46% (0.5577 => 0.5826, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.2945 => 0.3072, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.24% (13.2842 => 13.8478, std. dev.: 0.0100) MultiSource/Benchmarks/McCat/09-vor/vor: 4.17% (0.2925 => 0.3047, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.4563 => 1.5156, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 4.07% (1.2292 => 1.2792, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.07% (1.1364 => 1.1826, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.00% (1.1061 => 1.1503, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.94% (0.3246 => 0.3374, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.89% (0.5637 => 0.5856, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.87% (1.3819 => 1.4354, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.87% (1.3245 => 1.3757, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.82% (1.3813 => 1.4340, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.78% (7.2180 => 7.4912, std. dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.74% (0.2914 => 0.3023, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.71% (0.7460 => 0.7737, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (0.8310 => 0.8617, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.68% (3.8646 => 4.0069, std. dev.: 0.0111) MultiSource/Applications/spiff/spiff: 3.61% (0.7506 => 0.7777, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.58% (1.9270 => 1.9959, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.57% (1.0594 => 1.0972, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.33% (4.3801 => 4.5258, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.29% (4.4433 => 4.5896, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.21% (3.6692 => 3.7869, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 3.14% (0.3220 => 0.3321, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.06% (2.1791 => 2.2458, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.97% (4.9865 => 5.1346, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.92% (0.4791 => 0.4931, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.84% (0.8698 => 0.8945, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.65% (1.1333 => 1.1633, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.64% (3.1889 => 3.2732, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.51% (0.6283 => 0.6441, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.49% (16.2614 => 16.6669, std. dev.: 0.0150) MultiSource/Applications/JM/ldecod/ldecod: 2.28% (6.5754 => 6.7250, std. dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 2.19% (14.8535 => 15.1788, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.07% (2.1007 => 2.1441, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.02% (14.5298 => 14.8233, std. dev.: 0.0098) MultiSource/Applications/oggenc/oggenc: 2.01% (4.6629 => 4.7564, std. dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: 1.99% (8.4961 => 8.6654, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.88% (3.2742 => 3.3358, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.63% (1.5188 => 1.5436, std. dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.31% (0.9108 => 0.9227, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 25.08% (1.8175 => 2.2733, std. dev.: 0.0324) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.52% (2.0200 => 2.1922, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 8.39% (1.2998 => 1.4089, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.70% (1.5824 => 1.7043, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.2619 => 11.7208, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 3.97% (7.4271 => 7.7220, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9198, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.29% (1.7688 => 1.8093, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1913, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.77% (3.6469 => 3.7116, std. dev.: 0.0027) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5342, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.28% (3.1736 => 3.2142, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.50% (22.5627 => 21.0950, std. dev.: 0.0200) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.39% (0.3511 => 0.3392, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.63% (1.0460 => 0.8616, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.61% (1.2308 => 1.1002, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.14% (1.3780 => 1.3209, std. dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9124, std. dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: -2.46% (2.5089 => 2.4471, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.43% (0.8342 => 0.8139, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.32% (0.4867 => 0.4754, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -1.88% (3.0263 => 2.9694, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5090, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.69% (20.3410 => 19.9969, std. dev.: 0.0441) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.56% (6.3560 => 6.2569, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.37% (2.5254 => 2.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8649, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (0.9692 => 0.9563, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2231, std. dev.: 0.0277) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2535, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8496, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 14:58:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 16:58:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120718215810.175062A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2187?compare_to=2185&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2187, Order: 160446, Start Time: 2012-07-18 20:39:48, End Time: 2012-07-18 21:58:22 To: 2185, Order: 160439, Start Time: 2012-07-18 18:53:20, End Time: 2012-07-18 20:11:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (71 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (783 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.62% (13.3429 => 13.5588, std. dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.25% (3.6838 => 3.7298, std. dev.: 0.0128) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.78% (10.3673 => 13.5588, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.07% (1.1194 => 1.2545, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.80% (0.3473 => 0.3848, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3497 => 0.3867, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.53% (0.3543 => 0.3916, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.50% (0.3543 => 0.3915, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.45% (0.3561 => 0.3933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.10% (0.3694 => 0.4067, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.82% (0.3828 => 0.4204, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.70% (0.3886 => 0.4263, std. dev.: 0.0097) SingleSource/UnitTests/ObjC/parameter-passing: 9.65% (0.3927 => 0.4306, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.02% (1.7609 => 1.9198, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.06% (2.2022 => 2.3798, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.30% (0.6030 => 0.6410, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.26% (0.5925 => 0.6296, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.17% (0.7326 => 0.7705, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.13% (0.2065 => 0.2171, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 5.06% (0.3282 => 0.3448, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.4879 => 0.5123, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.89% (10.4361 => 10.9466, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.70% (7.0540 => 7.3857, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.12% (0.4615 => 0.4805, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.05% (0.7433 => 0.7734, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.64% (9.4845 => 9.8296, std. dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.0018 => 5.1743, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.41% (4.9449 => 5.1137, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.29% (0.8172 => 0.8441, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.16% (0.5569 => 0.5745, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.02% (0.5860 => 0.6037, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 2.99% (0.7835 => 0.8069, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 2.92% (0.3423 => 0.3523, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.86% (4.2646 => 4.3864, std. dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 2.74% (5.7591 => 5.9170, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.74% (8.1363 => 8.3590, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.63% (14.3668 => 14.7444, std. dev.: 0.0100) MultiSource/Applications/d/make_dparser: 2.48% (3.3354 => 3.4182, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.47% (1.3050 => 1.3372, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.46% (1.1861 => 1.2153, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 2.46% (2.0273 => 2.0771, std. dev.: 0.0112) MultiSource/Applications/hbd/hbd: 2.42% (1.5603 => 1.5981, std. dev.: 0.0072) MultiSource/Applications/Burg/burg: 2.41% (1.1642 => 1.1922, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.03% (0.8067 => 0.8231, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.01% (1.5415 => 1.5725, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 1.90% (3.8723 => 3.9460, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (2.2024 => 2.2417, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.78% (0.6450 => 0.6565, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.75% (0.9765 => 0.9936, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.62% (1.5859 => 1.6116, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 1.61% (0.6456 => 0.6560, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.59% (2.0665 => 2.0994, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.50% (17.1811 => 17.4382, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.45% (1.4186 => 1.4392, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 1.32% (0.8921 => 0.9039, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.11% (1.2842 => 1.2985, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.01% (2.2969 => 2.3201, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.13% (3.6395 => 3.7534, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.35% (1.0313 => 1.0555, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (1.5086 => 1.5365, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 1.82% (3.1578 => 3.2154, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.69% (26.0924 => 26.5346, std. dev.: 0.0403) MultiSource/Benchmarks/nbench/nbench: 1.56% (11.6436 => 11.8249, std. dev.: 0.0142) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6892, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.15% (9.1159 => 9.2208, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/oourafft: 1.04% (6.6465 => 6.7157, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.00% (5.2763 => 3.1659, std. dev.: 0.0096) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.11% (5.3855 => 3.7102, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.85% (5.3526 => 3.7015, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.17% (2.9384 => 2.5513, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -10.28% (22.1758 => 19.8961, std. dev.: 0.0034) SingleSource/UnitTests/Vector/constpool: -5.21% (54.1659 => 51.3461, std. dev.: 0.0282) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.44% (3.8922 => 3.8362, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.93% (0.0998 => 0.0839, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.58% (1.2373 => 1.1064, std. dev.: 0.0197) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4849, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.10% (8.6802 => 8.4110, std. dev.: 0.0196) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.81% (8.1563 => 7.9270, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0857, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.21% (1.8329 => 1.8108, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3531, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 15:24:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 17:24:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120718222433.235982A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2188?compare_to=2183&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2188, Order: 160444, Start Time: 2012-07-18 19:41:11, End Time: 2012-07-18 22:24:44 To: 2183, Order: 160433, Start Time: 2012-07-18 16:29:32, End Time: 2012-07-18 19:13:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (67 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 950 (826 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 29.44% (57.9625 => 75.0294, std. dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/ary2: 5.70% (0.2264 => 0.2393, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.47% (54.0034 => 54.7970, std. dev.: 0.0419) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.34% (131.3073 => 125.6074, std. dev.: 1.6725) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.19% (0.3446 => 0.3866, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.14% (0.3442 => 0.3860, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.12% (0.3465 => 0.3885, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.11% (0.3460 => 0.3879, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.07% (0.3488 => 0.3909, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 12.01% (0.3496 => 0.3916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3469 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.70% (0.3650 => 0.4077, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.53% (0.3643 => 0.4063, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3724 => 0.4141, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.70% (0.3792 => 0.4160, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.16% (0.5826 => 0.6243, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.83% (0.5889 => 0.6291, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 5.27% (0.7171 => 0.7549, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 5.04% (1.5932 => 1.6735, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.89% (1.6211 => 1.7004, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.80% (3.5627 => 3.7336, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.45% (0.3930 => 0.4105, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.38% (0.4361 => 0.4552, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.38% (1.3152 => 1.3728, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.37% (0.5900 => 0.6158, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.32% (0.4029 => 0.4203, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.10% (0.5026 => 0.5232, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.04% (0.4994 => 0.5196, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.90% (0.2875 => 0.2987, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.87% (0.2738 => 0.2844, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 3.87% (0.2714 => 0.2819, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.85% (0.2725 => 0.2830, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.84% (0.5000 => 0.5192, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.77% (0.2729 => 0.2832, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.77% (0.2866 => 0.2974, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.72% (1.0781 => 1.1182, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 3.70% (4.2109 => 4.3665, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wc: 3.59% (0.3096 => 0.3207, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 3.37% (0.9909 => 1.0243, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.37% (2.0673 => 2.1369, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.37% (1.9694 => 2.0357, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.34% (1.9966 => 2.0632, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3258 => 0.3363, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.18% (0.3267 => 0.3371, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.16% (2.7292 => 2.8155, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 3.04% (0.3317 => 0.3418, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.03% (4.4195 => 4.5534, std. dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 3.00% (5.5417 => 5.7082, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.97% (0.3362 => 0.3462, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 2.85% (0.3678 => 0.3783, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3690 => 0.3795, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 2.82% (0.3726 => 0.3831, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.76% (0.9697 => 0.9965, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (0.3625 => 0.3725, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.68% (4.6177 => 4.7414, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.68% (0.3845 => 0.3948, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.65% (0.3890 => 0.3993, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.64% (0.4658 => 0.4781, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 2.64% (2.1653 => 2.2224, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 2.58% (2.1013 => 2.1555, std. dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 2.58% (23.5202 => 24.1262, std. dev.: 0.0083) MultiSource/Applications/treecc/treecc: 2.51% (0.7875 => 0.8073, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (1.8794 => 1.9255, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 2.44% (0.4146 => 0.4247, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.4251 => 0.4352, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.37% (0.6634 => 0.6791, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.09% (0.5546 => 0.5662, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 2.04% (1.4269 => 1.4560, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.88% (0.6435 => 0.6556, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.01% (2.0346 => 2.0551, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.66% (11.9555 => 11.7574, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 16:28:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 18:28:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120718232817.D25062A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2189?compare_to=2186&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2189, Order: 160453, Start Time: 2012-07-18 22:14:37, End Time: 2012-07-18 23:28:29 To: 2186, Order: 160446, Start Time: 2012-07-18 20:32:27, End Time: 2012-07-18 21:46:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (137 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.11% (1.1002 => 1.1124, std. dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.22% (2.0176 => 2.3046, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.50% (0.5818 => 0.6429, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.40% (0.5748 => 0.6346, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.08% (0.7061 => 0.7773, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 8.78% (0.3578 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.53% (0.3601 => 0.3908, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.45% (0.3646 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.27% (0.3663 => 0.3966, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.26% (0.3789 => 0.4102, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.17% (0.3623 => 0.3919, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.11% (0.3650 => 0.3946, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3914 => 0.4230, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 7.97% (0.4003 => 0.4322, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.92% (0.3940 => 0.4252, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.49% (1.3693 => 1.4719, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 7.09% (0.4062 => 0.4350, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.00% (0.1986 => 0.2125, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4328 => 0.4620, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.62% (0.2781 => 0.2965, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.52% (0.7038 => 0.7497, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.29% (0.2782 => 0.2957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.28% (0.2690 => 0.2859, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.28% (0.7710 => 0.8194, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.25% (0.3022 => 0.3211, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.25% (0.2607 => 0.2770, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.18% (0.2655 => 0.2819, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.13% (3.9660 => 4.2093, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/wc: 6.09% (0.2937 => 0.3116, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2628 => 0.2788, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.09% (0.2760 => 0.2928, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.08% (0.5265 => 0.5585, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.08% (0.2765 => 0.2933, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 6.05% (0.2726 => 0.2891, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.05% (0.2596 => 0.2753, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.03% (0.3580 => 0.3796, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.03% (0.2721 => 0.2885, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2761 => 0.2927, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.99% (1.9828 => 2.1015, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.98% (0.3899 => 0.4132, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.86% (0.2696 => 0.2854, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.83% (0.3107 => 0.3288, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.79% (0.3489 => 0.3691, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.72% (0.3149 => 0.3329, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.67% (0.3192 => 0.3373, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.60% (0.3485 => 0.3680, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.59% (0.2988 => 0.3155, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 5.47% (0.3453 => 0.3642, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.33% (0.6959 => 0.7330, std. dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.22% (0.4390 => 0.4619, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 5.19% (0.3293 => 0.3464, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.12% (0.3534 => 0.3715, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.05% (0.4016 => 0.4219, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4379 => 0.4600, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (0.3756 => 0.3945, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.92% (1.2193 => 1.2793, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 4.91% (16.6129 => 17.4293, std. dev.: 0.0245) SingleSource/Benchmarks/Shootout-C++/moments: 4.86% (0.3868 => 0.4056, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.79% (0.9199 => 0.9640, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.66% (0.5577 => 0.5837, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 4.56% (13.8202 => 14.4505, std. dev.: 0.0129) MultiSource/Benchmarks/McCat/09-vor/vor: 4.55% (0.2925 => 0.3058, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.25% (13.2842 => 13.8487, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.10% (0.3246 => 0.3379, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 4.08% (1.2292 => 1.2793, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.05% (1.4563 => 1.5153, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.04% (1.1364 => 1.1823, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.97% (7.2180 => 7.5047, std. dev.: 0.0052) MultiSource/Applications/Burg/burg: 3.96% (1.1061 => 1.1499, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.96% (0.5637 => 0.5860, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.95% (0.2914 => 0.3029, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 3.94% (3.8646 => 4.0167, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: 3.92% (0.7506 => 0.7800, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3755 => 0.3902, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.76% (1.3245 => 1.3743, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 3.74% (0.8310 => 0.8621, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 3.70% (1.9270 => 1.9983, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.68% (1.3813 => 1.4321, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.68% (1.3819 => 1.4327, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.67% (0.7460 => 0.7734, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.57% (1.0594 => 1.0972, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.43% (4.3801 => 4.5302, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.31% (3.6692 => 3.7906, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (4.4433 => 4.5903, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 3.23% (0.3220 => 0.3324, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.07% (2.1791 => 2.2461, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.97% (4.9865 => 5.1348, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.92% (0.4791 => 0.4931, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.91% (0.8698 => 0.8951, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.66% (1.1333 => 1.1635, std. dev.: 0.0052) MultiSource/Applications/d/make_dparser: 2.59% (3.1889 => 3.2714, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.47% (0.6283 => 0.6438, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.36% (16.2614 => 16.6447, std. dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.33% (0.6135 => 0.6278, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.27% (6.5754 => 6.7249, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.19% (14.8535 => 15.1785, std. dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.18% (2.1007 => 2.1464, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.09% (14.5298 => 14.8335, std. dev.: 0.0161) MultiSource/Benchmarks/mafft/pairlocalalign: 1.98% (8.4961 => 8.6645, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.78% (1.5188 => 1.5459, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.66% (3.2742 => 3.3286, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 1.54% (4.6629 => 4.7346, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.24% (0.9108 => 0.9221, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2705, std. dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.39% (2.0200 => 2.1895, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: 8.16% (1.2998 => 1.4058, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.69% (1.5824 => 1.7041, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.20% (7.4271 => 7.7388, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 4.06% (11.2619 => 11.7196, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9230, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4792, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0310 => 1.0557, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.27% (1.7688 => 1.8089, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.90% (3.6469 => 3.7162, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5337, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9593, std. dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.43% (1.9433 => 1.9711, std. dev.: 0.0065) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.18% (3.1736 => 3.2112, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 1.16% (10.7476 => 10.8725, std. dev.: 0.0400) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.51% (22.5627 => 21.0936, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.28% (0.3511 => 0.3396, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.75% (0.0997 => 0.0840, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.62% (1.2308 => 1.1124, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.53% (1.3780 => 1.3156, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9830, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9130, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4468, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.46% (20.3410 => 19.8407, std. dev.: 0.0695) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.42% (0.8342 => 0.8140, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5050, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: -1.74% (3.0263 => 2.9737, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2519, std. dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8586, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.47% (0.9692 => 0.9550, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2209, std. dev.: 0.0187) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8046, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 16:44:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 18:44:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120718234439.8C4DA2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2190?compare_to=2187&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2190, Order: 160454, Start Time: 2012-07-18 22:26:23, End Time: 2012-07-18 23:44:50 To: 2187, Order: 160446, Start Time: 2012-07-18 20:39:48, End Time: 2012-07-18 21:58:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (74 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (780 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.47% (13.5588 => 13.8939, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.10% (4.6897 => 4.6383, std. dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.02% (10.3673 => 13.8939, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/trivial-interface: 12.32% (0.3473 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.10% (0.3497 => 0.3920, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.00% (0.3543 => 0.3968, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.97% (0.3516 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.97% (0.3543 => 0.3967, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.96% (0.3561 => 0.3987, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.87% (1.1194 => 1.2523, std. dev.: 0.0187) SingleSource/UnitTests/ObjC/for-in: 11.59% (0.3694 => 0.4122, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.21% (0.3828 => 0.4257, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.03% (0.3927 => 0.4360, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.01% (0.3886 => 0.4314, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.02% (1.7609 => 1.9197, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.38% (2.2022 => 2.3868, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.18% (0.6030 => 0.6463, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.14% (0.5925 => 0.6348, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.95% (0.7326 => 0.7762, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.3177 => 0.3364, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.54% (10.4361 => 11.0144, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/oourafft: 5.48% (0.3282 => 0.3462, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.25% (0.4879 => 0.5135, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.91% (7.0540 => 7.4001, std. dev.: 0.0316) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.53% (0.4615 => 0.4824, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 4.17% (0.7433 => 0.7743, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.77% (5.0018 => 5.1904, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 3.72% (9.4845 => 9.8377, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.65% (4.9449 => 5.1256, std. dev.: 0.0093) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.50% (0.8172 => 0.8458, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.47% (0.5569 => 0.5762, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.20% (8.1363 => 8.3963, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.18% (4.2646 => 4.4002, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 3.18% (0.3180 => 0.3281, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.14% (0.5860 => 0.6044, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 3.01% (0.3423 => 0.3526, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.92% (0.7835 => 0.8064, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.91% (0.4636 => 0.4771, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.89% (14.3668 => 14.7821, std. dev.: 0.0067) MultiSource/Applications/hbd/hbd: 2.78% (1.5603 => 1.6037, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.74% (1.1861 => 1.2186, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 2.68% (5.7591 => 5.9136, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 2.64% (3.3354 => 3.4234, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.53% (1.1642 => 1.1937, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.51% (1.3050 => 1.3378, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.48% (2.0273 => 2.0775, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.5415 => 1.5785, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.30% (3.8723 => 3.9613, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.26% (0.8067 => 0.8249, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.17% (2.0665 => 2.1114, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.01% (0.9765 => 0.9961, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.2024 => 2.2460, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 1.95% (0.6456 => 0.6582, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.69% (0.5981 => 0.6082, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.68% (1.4186 => 1.4424, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.64% (0.6450 => 0.6556, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.60% (17.1811 => 17.4562, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.53% (0.6675 => 0.6777, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.49% (0.8921 => 0.9054, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.38% (1.2842 => 1.3019, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.22% (2.2969 => 2.3250, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7481, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.5086 => 1.5375, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2148, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.63% (26.0924 => 26.5167, std. dev.: 0.0252) MultiSource/Benchmarks/nbench/nbench: 1.57% (11.6436 => 11.8265, std. dev.: 0.0132) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6895, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2348, std. dev.: 0.0397) SingleSource/Benchmarks/Misc/oourafft: 1.07% (6.6465 => 6.7179, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.87% (5.2763 => 3.1728, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.94% (5.3855 => 3.7190, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.77% (5.3526 => 3.7056, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.12% (2.9384 => 2.5530, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.11% (22.1758 => 19.9335, std. dev.: 0.0200) SingleSource/UnitTests/Vector/constpool: -5.22% (54.1659 => 51.3366, std. dev.: 0.0414) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.38% (3.8922 => 3.8385, std. dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.53% (1.2373 => 1.1070, std. dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4802, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4229, std. dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9155, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0850, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8092, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 18:10:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 20:10:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120719011022.EA2DC2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2191?compare_to=2189&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2191, Order: 160467, Start Time: 2012-07-18 23:56:39, End Time: 2012-07-19 01:10:33 To: 2189, Order: 160453, Start Time: 2012-07-18 22:14:37, End Time: 2012-07-18 23:28:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (138 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.79% (2.0176 => 2.3160, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 10.09% (0.5818 => 0.6405, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.83% (0.5748 => 0.6313, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.39% (0.7061 => 0.7724, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 9.11% (0.3578 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.94% (0.3601 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.78% (0.3646 => 0.3966, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.77% (0.3650 => 0.3970, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 8.75% (0.3623 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.71% (0.3789 => 0.4119, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.71% (0.3663 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.51% (0.3914 => 0.4247, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.42% (0.4003 => 0.4340, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.38% (0.3940 => 0.4270, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.90% (0.1986 => 0.2123, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 6.72% (1.3693 => 1.4613, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.23% (3.9660 => 4.2132, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash2: 6.10% (0.4328 => 0.4592, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2596 => 0.2754, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.08% (0.7710 => 0.8179, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.08% (0.5265 => 0.5585, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.05% (0.7038 => 0.7464, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 5.97% (0.2781 => 0.2947, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.4062 => 0.4288, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1819 => 0.1920, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.54% (0.2655 => 0.2802, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2690 => 0.2838, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2607 => 0.2750, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.33% (0.2628 => 0.2768, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.32% (0.2761 => 0.2908, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.30% (0.3489 => 0.3674, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.25% (0.3580 => 0.3768, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.24% (0.2937 => 0.3091, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.23% (0.3022 => 0.3180, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.22% (0.2760 => 0.2904, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.17% (1.9828 => 2.0853, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.10% (0.6959 => 0.7314, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 5.06% (0.2726 => 0.2864, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.06% (0.2966 => 0.3116, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4379 => 0.4600, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.98% (1.2193 => 1.2800, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.98% (0.3899 => 0.4093, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.94% (0.3485 => 0.3657, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.89% (0.3107 => 0.3259, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.2988 => 0.3133, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 4.84% (13.8202 => 14.4886, std. dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/ary3: 4.83% (0.3149 => 0.3301, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3192 => 0.3346, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.76% (0.9199 => 0.9637, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.62% (0.4390 => 0.4593, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 4.59% (16.6129 => 17.3753, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.55% (0.5577 => 0.5831, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.3453 => 0.3610, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.47% (0.3756 => 0.3924, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.47% (0.3534 => 0.3692, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.38% (0.4016 => 0.4192, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (13.2842 => 13.8663, std. dev.: 0.0146) MultiSource/Benchmarks/McCat/09-vor/vor: 4.38% (0.2925 => 0.3053, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.34% (0.3293 => 0.3436, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 4.32% (0.3868 => 0.4035, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.24% (1.4563 => 1.5180, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.22% (7.2180 => 7.5225, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.17% (1.3819 => 1.4395, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.15% (1.1364 => 1.1836, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.13% (1.3813 => 1.4384, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.10% (0.5637 => 0.5868, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 4.05% (1.1061 => 1.1509, std. dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.95% (0.2914 => 0.3029, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.94% (0.2945 => 0.3061, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.93% (1.3245 => 1.3766, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.91% (0.3246 => 0.3373, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.89% (1.9270 => 2.0020, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 3.87% (0.8310 => 0.8632, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.85% (0.7506 => 0.7795, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (3.8646 => 4.0122, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.79% (0.7460 => 0.7743, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.66% (1.0594 => 1.0982, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.48% (4.4433 => 4.5979, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.45% (4.3801 => 4.5312, std. dev.: 0.0093) MultiSource/Applications/hexxagon/hexxagon: 3.44% (1.2292 => 1.2715, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.37% (3.6692 => 3.7929, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.30% (0.3755 => 0.3879, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.29% (0.3220 => 0.3326, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.03% (2.1791 => 2.2451, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.94% (0.4791 => 0.4932, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.93% (4.9865 => 5.1324, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.81% (1.1333 => 1.1652, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.70% (3.1889 => 3.2749, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 2.64% (6.5754 => 6.7493, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.62% (0.8698 => 0.8926, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.45% (16.2614 => 16.6592, std. dev.: 0.0179) MultiSource/Applications/JM/lencod/lencod: 2.40% (14.8535 => 15.2093, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.37% (0.6283 => 0.6432, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.35% (0.6135 => 0.6279, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.21% (14.5298 => 14.8505, std. dev.: 0.0140) MultiSource/Benchmarks/mafft/pairlocalalign: 2.13% (8.4961 => 8.6771, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.01% (2.1007 => 2.1430, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (3.2742 => 3.3332, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.71% (1.5188 => 1.5448, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 1.37% (4.6629 => 4.7270, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.28% (0.9108 => 0.9225, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.07% (1.8175 => 2.2731, std. dev.: 0.0483) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.36% (2.0200 => 2.1888, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 8.05% (1.2998 => 1.4044, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.78% (0.9996 => 1.0774, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.72% (1.5824 => 1.7045, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7351, std. dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 4.06% (11.2619 => 11.7193, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4786, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.27% (1.7688 => 1.8089, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1913, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.60% (3.6469 => 3.7053, std. dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.15% (1.9290 => 1.9511, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 1.05% (3.1736 => 3.2070, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.72% (0.4657 => 0.4018, std. dev.: 0.0092) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.55% (22.5627 => 21.0858, std. dev.: 0.0270) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.66% (1.0460 => 0.8613, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.72% (1.2308 => 1.1112, std. dev.: 0.0074) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.31% (1.3780 => 1.3048, std. dev.: 0.0104) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.19% (1.9762 => 1.9132, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: -2.51% (0.4533 => 0.4419, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.45% (0.8342 => 0.8138, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.38% (20.3410 => 19.8570, std. dev.: 0.0666) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5065, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: -1.86% (3.0263 => 2.9699, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.50% (6.3560 => 6.2605, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8626, std. dev.: 0.0091) MultiSource/Applications/minisat/minisat: -1.38% (9.3358 => 9.2068, std. dev.: 0.0196) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8046, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2582, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8493, std. dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 18:31:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 20:31:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120719013103.EF06E2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2192?compare_to=2190&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2192, Order: 160467, Start Time: 2012-07-19 00:12:52, End Time: 2012-07-19 01:31:15 To: 2190, Order: 160454, Start Time: 2012-07-18 22:26:23, End Time: 2012-07-18 23:44:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (73 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (781 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.30% (13.8939 => 13.4358, std. dev.: 0.0077) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.60% (10.3673 => 13.4358, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3473 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3543 => 0.3981, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: 12.32% (0.3497 => 0.3928, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.29% (0.3516 => 0.3948, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.25% (0.3543 => 0.3977, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/synchronized: 12.22% (0.3561 => 0.3996, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.00% (1.1194 => 1.2537, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.78% (0.3694 => 0.4129, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 11.49% (0.3828 => 0.4268, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.43% (0.3927 => 0.4376, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.32% (0.3886 => 0.4326, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.39% (1.7609 => 1.9262, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.13% (2.2022 => 2.3813, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.11% (0.6030 => 0.6459, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.09% (0.5925 => 0.6345, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 5.90% (0.7326 => 0.7758, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.85% (0.3177 => 0.3363, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3282 => 0.3457, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.16% (0.4879 => 0.5131, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.01% (10.4361 => 10.9590, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.81% (7.0540 => 7.3933, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.49% (0.4615 => 0.4822, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.04% (0.7433 => 0.7733, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (9.4845 => 9.8419, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.73% (4.9449 => 5.1292, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (5.0018 => 5.1881, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.54% (0.8172 => 0.8461, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.43% (0.5569 => 0.5760, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.12% (0.5860 => 0.6043, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.10% (8.1363 => 8.3887, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 3.01% (0.7835 => 0.8071, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 3.01% (0.3423 => 0.3526, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.00% (4.2646 => 4.3927, std. dev.: 0.0107) MultiSource/Applications/hbd/hbd: 2.90% (1.5603 => 1.6055, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.73% (14.3668 => 14.7592, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.71% (1.1861 => 1.2182, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.54% (5.7591 => 5.9055, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.3050 => 1.3379, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 2.49% (2.0273 => 2.0778, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 2.48% (1.1642 => 1.1931, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 2.41% (3.3354 => 3.4157, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.16% (0.8067 => 0.8241, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.02% (0.9765 => 0.9962, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 1.96% (3.8723 => 3.9482, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.81% (2.0665 => 2.1040, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.2024 => 2.2397, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.69% (0.6450 => 0.6559, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 1.69% (0.6456 => 0.6565, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.67% (0.5981 => 0.6081, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.60% (1.5859 => 1.6112, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.54% (1.4186 => 1.4405, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.50% (0.6675 => 0.6775, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.46% (17.1811 => 17.4324, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/football/football: 1.36% (0.8921 => 0.9042, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 1.25% (1.2842 => 1.3003, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.08% (2.2969 => 2.3218, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9744, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7536, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (1.5086 => 1.5389, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2150, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 1.62% (26.0924 => 26.5149, std. dev.: 0.0221) MultiSource/Benchmarks/nbench/nbench: 1.56% (11.6436 => 11.8254, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 1.41% (2.4116 => 2.4457, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6884, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2228, std. dev.: 0.0152) SingleSource/Benchmarks/Misc/oourafft: 1.11% (6.6465 => 6.7206, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.93% (5.2763 => 3.1694, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.95% (5.3855 => 3.7185, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.73% (5.3526 => 3.7079, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.10% (2.9384 => 2.5535, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -10.22% (22.1758 => 19.9084, std. dev.: 0.0124) SingleSource/UnitTests/Vector/constpool: -5.29% (54.1659 => 51.3016, std. dev.: 0.0242) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.47% (3.8922 => 3.8351, std. dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.63% (0.0998 => 0.0842, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1166, std. dev.: 0.0242) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4791, std. dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4282, std. dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.77% (8.1563 => 7.9305, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0852, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.25% (1.8329 => 1.8100, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 18:36:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 20:36:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120719013643.9E5772A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2193?compare_to=2188&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2193, Order: 160461, Start Time: 2012-07-18 22:52:51, End Time: 2012-07-19 01:36:56 To: 2188, Order: 160444, Start Time: 2012-07-18 19:41:11, End Time: 2012-07-18 22:24:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (72 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (821 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 8.01% (0.2097 => 0.2265, std. dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.18% (1.5979 => 1.6168, std. dev.: 0.0068) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 12.75% (0.3460 => 0.3901, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.74% (0.3446 => 0.3885, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.73% (0.3465 => 0.3906, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 12.73% (0.3442 => 0.3880, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.70% (0.3488 => 0.3931, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 12.64% (0.3496 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.57% (0.3469 => 0.3905, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.41% (0.3650 => 0.4103, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.16% (0.3643 => 0.4086, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3724 => 0.4164, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.98% (0.5826 => 0.6291, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.74% (0.5889 => 0.6345, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.16% (0.7171 => 0.7613, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.34% (0.1968 => 0.2073, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.29% (3.5627 => 3.7511, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.23% (0.4361 => 0.4589, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.19% (1.6211 => 1.7052, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.93% (1.3152 => 1.3800, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.74% (0.4029 => 0.4220, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.74% (0.5026 => 0.5264, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.61% (0.3930 => 0.4111, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.58% (0.5900 => 0.6170, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.56% (0.5000 => 0.5228, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.55% (0.4994 => 0.5221, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 4.35% (1.5932 => 1.6625, std. dev.: 0.0166) MultiSource/Applications/ClamAV/clamscan: 4.35% (4.2109 => 4.3939, std. dev.: 0.0043) MultiSource/Applications/d/make_dparser: 4.32% (1.0781 => 1.1247, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hello: 3.98% (0.2714 => 0.2822, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2725 => 0.2833, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (1.9694 => 2.0466, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.2866 => 0.2978, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.90% (0.2875 => 0.2987, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.2736 => 0.2842, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.87% (0.2738 => 0.2844, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.85% (0.2729 => 0.2834, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.71% (0.2911 => 0.3019, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 3.67% (0.2803 => 0.2906, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.60% (2.7292 => 2.8274, std. dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: 3.50% (0.9909 => 1.0256, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.47% (1.9966 => 2.0659, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.43% (0.3124 => 0.3231, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.41% (5.5417 => 5.7307, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.41% (2.0673 => 2.1378, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 3.34% (0.3267 => 0.3376, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (0.4658 => 0.4812, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.29% (0.3890 => 0.4018, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.26% (4.4195 => 4.5637, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 3.20% (4.6177 => 4.7654, std. dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (2.1013 => 2.1684, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.19% (0.3195 => 0.3297, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.10% (2.1653 => 2.2325, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.3271 => 0.3372, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.06% (0.3362 => 0.3465, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.05% (0.3678 => 0.3790, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3690 => 0.3800, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 2.93% (0.3477 => 0.3579, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 2.90% (0.3726 => 0.3834, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (0.3625 => 0.3730, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.88% (0.9697 => 0.9976, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.84% (0.3903 => 0.4014, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.82% (0.4146 => 0.4263, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (1.8794 => 1.9309, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.73% (0.7875 => 0.8090, std. dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 2.70% (23.5202 => 24.1547, std. dev.: 0.0112) MultiSource/Applications/siod/siod: 2.59% (0.6634 => 0.6806, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 2.56% (0.4251 => 0.4360, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.50% (1.4269 => 1.4626, std. dev.: 0.0058) MultiSource/Applications/Burg/burg: 2.38% (0.5546 => 0.5678, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.99% (0.6435 => 0.6563, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.56% (2.0346 => 2.0663, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.74% (0.2122 => 0.2265, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.45% (11.9555 => 11.7821, std. dev.: 0.0143) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 19:52:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 21:52:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120719025222.B30812A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2194?compare_to=2191&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2194, Order: 160483, Start Time: 2012-07-19 01:38:36, End Time: 2012-07-19 02:52:34 To: 2191, Order: 160467, Start Time: 2012-07-18 23:56:39, End Time: 2012-07-19 01:10:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (139 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.93% (54.5556 => 56.1517, std. dev.: 0.1619) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.03% (2.0176 => 2.3209, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 10.16% (0.5818 => 0.6409, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.04% (0.5748 => 0.6325, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.63% (0.7061 => 0.7741, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.72% (0.3578 => 0.3890, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.48% (0.3646 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3601 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.37% (0.3789 => 0.4106, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.33% (0.3650 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.33% (0.3663 => 0.3968, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.15% (0.3914 => 0.4233, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.02% (0.4003 => 0.4324, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.64% (0.3130 => 0.3369, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.15% (0.1986 => 0.2128, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.85% (1.3693 => 1.4631, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.42% (0.4328 => 0.4606, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.37% (3.9660 => 4.2188, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.36% (0.7710 => 0.8200, std. dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 6.11% (0.7038 => 0.7468, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 6.08% (0.2781 => 0.2950, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.01% (0.2596 => 0.2752, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.94% (0.1819 => 0.1927, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.91% (0.5265 => 0.5576, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.82% (0.2782 => 0.2944, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.79% (0.2607 => 0.2758, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.79% (0.4062 => 0.4297, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: 5.67% (0.2628 => 0.2777, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.66% (0.2966 => 0.3134, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.58% (0.2937 => 0.3101, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.56% (0.3580 => 0.3779, std. dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4379 => 0.4622, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.54% (0.2761 => 0.2914, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.3489 => 0.3679, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.44% (1.9828 => 2.0906, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.43% (0.3022 => 0.3186, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.28% (0.2726 => 0.2870, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.14% (0.3485 => 0.3664, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.13% (0.6959 => 0.7316, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.08% (0.3899 => 0.4097, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.05% (0.2988 => 0.3139, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.97% (0.9199 => 0.9656, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.93% (1.2193 => 1.2794, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: 4.86% (0.3192 => 0.3347, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.75% (16.6129 => 17.4023, std. dev.: 0.0226) MultiSource/Applications/SPASS/SPASS: 4.73% (13.8202 => 14.4735, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists1: 4.73% (0.3534 => 0.3701, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.63% (0.3756 => 0.3930, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.59% (0.3293 => 0.3444, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.56% (0.4016 => 0.4199, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.50% (0.5577 => 0.5828, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 4.31% (0.2925 => 0.3051, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.27% (1.4563 => 1.5185, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.23% (13.2842 => 13.8460, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.19% (0.5637 => 0.5873, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.17% (1.1364 => 1.1838, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.10% (1.3819 => 1.4386, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.07% (7.2180 => 7.5119, std. dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.05% (0.2914 => 0.3032, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.03% (1.3813 => 1.4369, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 3.96% (1.1061 => 1.1499, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.96% (0.7506 => 0.7803, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.86% (1.3245 => 1.3756, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.85% (0.3246 => 0.3371, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.79% (0.8310 => 0.8625, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.70% (0.7460 => 0.7736, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.68% (3.8646 => 4.0069, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 3.67% (1.9270 => 1.9978, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 3.63% (1.0594 => 1.0979, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.60% (1.2292 => 1.2734, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.52% (3.6692 => 3.7984, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3755 => 0.3886, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.49% (4.3801 => 4.5328, std. dev.: 0.0120) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.47% (4.4433 => 4.5975, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/18-imp/imp: 3.23% (0.3220 => 0.3324, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.19% (4.9865 => 5.1454, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.17% (0.4791 => 0.4943, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.02% (2.1791 => 2.2449, std. dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.83% (1.1333 => 1.1654, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.68% (0.8698 => 0.8931, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.63% (0.6283 => 0.6448, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: 2.60% (3.1889 => 3.2719, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 2.55% (0.4113 => 0.4218, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (6.5754 => 6.7391, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 2.43% (14.8535 => 15.2145, std. dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 2.36% (16.2614 => 16.6459, std. dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.31% (0.6135 => 0.6277, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 2.25% (8.4961 => 8.6874, std. dev.: 0.0125) MultiSource/Applications/ClamAV/clamscan: 2.14% (14.5298 => 14.8410, std. dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.97% (2.1007 => 2.1421, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (3.2742 => 3.3337, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.67% (4.6629 => 4.7408, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.55% (1.5188 => 1.5424, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.30% (0.9108 => 0.9226, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 24.64% (1.8175 => 2.2654, std. dev.: 0.0521) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.33% (2.0200 => 2.1882, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.72% (1.5824 => 1.7045, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.99% (1.2998 => 1.3907, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7310, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.2619 => 11.7198, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9199, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9616, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.32% (1.7688 => 1.8098, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1896, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4546, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (1.5089 => 1.5344, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.60% (3.6469 => 3.7051, std. dev.: 0.0074) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (1.9290 => 1.9581, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.18% (3.1736 => 3.2110, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.11% (10.7476 => 10.8672, std. dev.: 0.0377) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.50% (0.4657 => 0.4075, std. dev.: 0.0116) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.47% (22.5627 => 21.1018, std. dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.63% (0.6576 => 0.6469, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.65% (1.0460 => 0.8614, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.52% (1.2308 => 1.1013, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.90% (1.3780 => 1.3105, std. dev.: 0.0259) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9123, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.45% (0.8342 => 0.8138, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4867 => 0.4748, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5055, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.83% (20.3410 => 19.9692, std. dev.: 0.0080) MultiSource/Applications/spiff/spiff: -1.78% (3.0263 => 2.9723, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2506, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.5254 => 2.4890, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.43% (0.9692 => 0.9553, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2158, std. dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2524, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8042, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 20:17:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 22:17:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120719031746.948622A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2195?compare_to=2192&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2195, Order: 160483, Start Time: 2012-07-19 01:59:25, End Time: 2012-07-19 03:17:59 To: 2192, Order: 160467, Start Time: 2012-07-19 00:12:52, End Time: 2012-07-19 01:31:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (71 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (783 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.18% (13.4358 => 13.9977, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.82% (55.0207 => 56.5714, std. dev.: 0.0314) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.02% (1.3035 => 1.3168, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.08% (1.3348 => 1.3204, std. dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.02% (10.3673 => 13.9977, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3473 => 0.3900, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.09% (1.1194 => 1.2547, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 12.04% (0.3497 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.92% (0.3516 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.91% (0.3543 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.91% (0.3543 => 0.3965, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.82% (0.3561 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.42% (0.3694 => 0.4116, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.13% (0.3828 => 0.4254, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.04% (0.3886 => 0.4315, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.03% (0.3927 => 0.4360, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.51% (1.7609 => 1.9108, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.23% (2.2022 => 2.3835, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.02% (0.5925 => 0.6341, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.00% (0.6030 => 0.6452, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.91% (0.2065 => 0.2187, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.80% (0.7326 => 0.7751, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 5.50% (10.4361 => 11.0098, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.45% (0.3177 => 0.3350, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.97% (0.3282 => 0.3445, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.96% (0.4615 => 0.4844, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.88% (7.0540 => 7.3980, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.7433 => 0.7756, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.0018 => 5.1850, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.65% (0.8172 => 0.8470, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (9.4845 => 9.8273, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (4.9449 => 5.1209, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.50% (0.5569 => 0.5764, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.33% (0.3180 => 0.3286, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.19% (0.5860 => 0.6047, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.17% (4.2646 => 4.3999, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.15% (8.1363 => 8.3924, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/18-imp/imp: 3.07% (0.3423 => 0.3528, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.92% (14.3668 => 14.7862, std. dev.: 0.0059) MultiSource/Applications/spiff/spiff: 2.90% (0.7835 => 0.8062, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.72% (1.1861 => 1.2184, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.65% (1.1642 => 1.1951, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 2.63% (5.7591 => 5.9104, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.3050 => 1.3387, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.57% (2.0273 => 2.0795, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.51% (3.3354 => 3.4192, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 2.50% (1.5603 => 1.5993, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.38% (0.8067 => 0.8259, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.33% (1.5415 => 1.5774, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.22% (3.8723 => 3.9584, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.07% (0.9765 => 0.9967, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.76% (2.2024 => 2.2412, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.76% (2.0665 => 2.1029, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 1.70% (0.6456 => 0.6566, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.68% (1.4186 => 1.4425, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.68% (17.1811 => 17.4697, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.62% (1.5859 => 1.6116, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.55% (2.2969 => 2.3326, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 1.41% (0.8921 => 0.9047, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.28% (1.2842 => 1.3006, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7539, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5366, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2148, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.65% (26.0924 => 26.5236, std. dev.: 0.0420) MultiSource/Benchmarks/nbench/nbench: 1.56% (11.6436 => 11.8257, std. dev.: 0.0136) SingleSource/Benchmarks/Dhrystone/dry: 1.48% (2.4116 => 2.4474, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (2.6546 => 2.6919, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2303, std. dev.: 0.0275) SingleSource/Benchmarks/Misc/oourafft: 1.10% (6.6465 => 6.7199, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.31% (5.2763 => 3.1495, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.91% (5.3855 => 3.7209, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.55% (5.3526 => 3.7173, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.98% (2.9384 => 2.5569, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.22% (22.1758 => 19.9095, std. dev.: 0.0354) SingleSource/UnitTests/Vector/constpool: -5.04% (54.1659 => 51.4368, std. dev.: 0.1294) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.47% (3.8922 => 3.8349, std. dev.: 0.0149) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.90% (1.2373 => 1.1148, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4748, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (8.1563 => 7.9161, std. dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4275, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.23% (1.8329 => 1.8104, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 21:34:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 23:34:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120719043417.6813F2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2196?compare_to=2194&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2196, Order: 160486, Start Time: 2012-07-19 03:20:31, End Time: 2012-07-19 04:34:30 To: 2194, Order: 160483, Start Time: 2012-07-19 01:38:36, End Time: 2012-07-19 02:52:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (135 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (722 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.08% (1.4736 => 1.4895, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 1.06% (1.1013 => 1.1130, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.56% (0.7741 => 0.7620, std. dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.19% (2.0176 => 2.3039, std. dev.: 0.0138) SingleSource/UnitTests/ObjC++/property-reference-object: 8.89% (0.5818 => 0.6335, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.73% (0.5748 => 0.6250, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3578 => 0.3887, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.44% (0.3650 => 0.3958, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3601 => 0.3904, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.34% (0.3646 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 8.23% (0.3623 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.22% (0.3663 => 0.3964, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.10% (0.3914 => 0.4231, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: 7.97% (0.4003 => 0.4322, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.92% (0.7061 => 0.7620, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 7.84% (0.3940 => 0.4249, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.80% (0.1986 => 0.2121, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.73% (1.3693 => 1.4614, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 6.19% (0.7038 => 0.7474, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.17% (0.2721 => 0.2889, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.08% (0.7710 => 0.8179, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (3.9660 => 4.2061, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 5.91% (0.4328 => 0.4584, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.89% (0.2596 => 0.2749, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.74% (0.5265 => 0.5567, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.66% (0.4062 => 0.4292, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.28% (0.2782 => 0.2929, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.22% (0.2607 => 0.2743, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.21% (0.2781 => 0.2926, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2690 => 0.2829, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.12% (0.2655 => 0.2791, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.07% (0.2937 => 0.3086, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.04% (0.2760 => 0.2899, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.02% (0.2628 => 0.2760, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.00% (0.3022 => 0.3173, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 4.96% (0.2761 => 0.2898, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.91% (0.6959 => 0.7301, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.90% (0.3489 => 0.3660, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.89% (0.4379 => 0.4593, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.84% (1.9828 => 2.0788, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.82% (0.2696 => 0.2826, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.81% (0.2765 => 0.2898, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.81% (0.2726 => 0.2857, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.79% (1.2193 => 1.2777, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.79% (0.2966 => 0.3108, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.78% (0.3580 => 0.3751, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3107 => 0.3254, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.70% (13.8202 => 14.4699, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.67% (0.9199 => 0.9629, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3899 => 0.4080, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.62% (0.2988 => 0.3126, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.60% (0.3149 => 0.3294, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.53% (0.3485 => 0.3643, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.48% (13.2842 => 13.8797, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.45% (0.5577 => 0.5825, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 4.35% (16.6129 => 17.3363, std. dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/ary2: 4.32% (0.3192 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.24% (0.2925 => 0.3049, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.24% (0.4390 => 0.4576, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.16% (1.3819 => 1.4394, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.13% (0.5637 => 0.5870, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.13% (0.3534 => 0.3680, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.09% (1.4563 => 1.5158, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (0.3756 => 0.3909, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.07% (1.1364 => 1.1826, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.06% (0.4016 => 0.4179, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.05% (1.3813 => 1.4373, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 4.04% (0.3293 => 0.3426, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.93% (0.3868 => 0.4020, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.92% (7.2180 => 7.5008, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.91% (0.2914 => 0.3028, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.88% (0.3246 => 0.3372, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 3.80% (0.8310 => 0.8626, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.73% (3.8646 => 4.0087, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.70% (0.7506 => 0.7784, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 3.68% (1.1061 => 1.1468, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.67% (0.7460 => 0.7734, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.66% (1.9270 => 1.9975, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (1.3245 => 1.3729, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.62% (1.0594 => 1.0977, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.53% (0.2945 => 0.3049, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (3.6692 => 3.7891, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.26% (4.4433 => 4.5883, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.23% (4.3801 => 4.5215, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 3.19% (1.2292 => 1.2684, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.07% (0.4791 => 0.4938, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.01% (4.9865 => 5.1366, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3755 => 0.3867, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.91% (2.1791 => 2.2425, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.67% (0.8698 => 0.8930, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.63% (1.1333 => 1.1631, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.58% (3.1889 => 3.2712, std. dev.: 0.0136) MultiSource/Applications/sqlite3/sqlite3: 2.43% (16.2614 => 16.6566, std. dev.: 0.0270) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.40% (0.6283 => 0.6434, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (6.5754 => 6.7261, std. dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: 2.16% (14.5298 => 14.8440, std. dev.: 0.0121) MultiSource/Benchmarks/mafft/pairlocalalign: 2.16% (8.4961 => 8.6792, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (2.1007 => 2.1446, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 2.08% (14.8535 => 15.1628, std. dev.: 0.0172) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6135 => 0.6261, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.85% (1.5188 => 1.5469, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (3.2742 => 3.3338, std. dev.: 0.0192) MultiSource/Applications/oggenc/oggenc: 1.79% (4.6629 => 4.7465, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.26% (0.9108 => 0.9223, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 23.93% (1.8175 => 2.2525, std. dev.: 0.0418) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.39% (2.0200 => 2.1894, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.91% (0.9996 => 1.0787, std. dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.74% (1.5824 => 1.7048, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 7.08% (1.2998 => 1.3918, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.16% (7.4271 => 7.7360, std. dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 4.06% (11.2619 => 11.7189, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9197, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.28% (1.7688 => 1.8091, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1911, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.85% (3.6469 => 3.7142, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 1.16% (3.1736 => 3.2104, std. dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: 1.02% (1.9290 => 1.9487, std. dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.18% (0.4657 => 0.4043, std. dev.: 0.0102) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.61% (22.5627 => 21.0723, std. dev.: 0.0202) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.3511 => 0.3397, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.65% (1.0460 => 0.8614, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.65% (0.0997 => 0.0841, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.57% (1.2308 => 1.1130, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3112, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5506, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.19% (1.9762 => 1.9132, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4470, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.43% (0.8342 => 0.8139, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.23% (20.3410 => 19.8872, std. dev.: 0.1040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5049, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: -1.84% (3.0263 => 2.9707, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.52% (6.3560 => 6.2595, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4892, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.42% (0.9692 => 0.9554, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2177, std. dev.: 0.0359) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2521, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8039, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 21:48:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 18 Jul 2012 23:48:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120719044835.131852A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2197?compare_to=2193&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2197, Order: 160483, Start Time: 2012-07-19 02:04:57, End Time: 2012-07-19 04:48:47 To: 2193, Order: 160461, Start Time: 2012-07-18 22:52:51, End Time: 2012-07-19 01:36:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (63 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (830 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.99% (126.1830 => 129.9529, std. dev.: 0.8858) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.99% (0.3496 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.96% (0.3442 => 0.3888, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.95% (0.3460 => 0.3908, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.94% (0.3446 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.90% (0.3465 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.87% (0.3488 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.80% (0.3469 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.55% (0.3650 => 0.4108, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.38% (0.3643 => 0.4094, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.06% (0.3724 => 0.4173, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.32% (0.5826 => 0.6311, std. dev.: 0.0083) SingleSource/UnitTests/ObjC++/property-reference-object: 7.96% (0.5889 => 0.6358, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.1620 => 0.1728, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.44% (0.7171 => 0.7633, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.54% (1.6211 => 1.7109, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.43% (3.5627 => 3.7563, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.97% (0.4994 => 0.5242, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.95% (0.4361 => 0.4577, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.94% (0.4029 => 0.4228, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.79% (1.3152 => 1.3782, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.75% (0.5900 => 0.6180, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.52% (0.5000 => 0.5226, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.40% (0.3930 => 0.4103, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.2866 => 0.2989, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 4.27% (1.5932 => 1.6612, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.16% (0.5026 => 0.5235, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 4.06% (4.2109 => 4.3817, std. dev.: 0.0059) MultiSource/Applications/d/make_dparser: 3.99% (1.0781 => 1.1211, std. dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.82% (2.7292 => 2.8335, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.76% (0.4658 => 0.4833, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.68% (0.2714 => 0.2814, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.62% (1.9694 => 2.0407, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.58% (0.2875 => 0.2978, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.48% (0.9909 => 1.0254, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 3.36% (0.3096 => 0.3200, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.32% (1.9966 => 2.0628, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.26% (0.3890 => 0.4017, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.24% (2.0673 => 2.1343, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.24% (5.5417 => 5.7210, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: 3.18% (0.3267 => 0.3371, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.18% (2.1013 => 2.1681, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.12% (0.3271 => 0.3373, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.10% (0.3258 => 0.3359, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.06% (4.6177 => 4.7592, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/moments: 3.02% (0.3678 => 0.3789, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.01% (2.1653 => 2.2304, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (0.3903 => 0.4016, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 2.82% (0.9697 => 0.9970, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (4.4195 => 4.5435, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (0.3625 => 0.3725, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 2.76% (0.7875 => 0.8092, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (1.8794 => 1.9309, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 2.70% (0.5546 => 0.5696, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.68% (0.6634 => 0.6812, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.51% (0.4139 => 0.4243, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 2.51% (0.4146 => 0.4250, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 2.40% (0.4251 => 0.4353, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.36% (1.4269 => 1.4606, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 2.33% (23.5202 => 24.0684, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.6435 => 0.6552, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.22% (2.0346 => 2.0594, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.2122 => 0.2242, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: 1.22% (2.8036 => 2.8379, std. dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.42% (11.9555 => 11.7853, std. dev.: 0.0126) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 22:04:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 00:04:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120719050405.EAF402A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2198?compare_to=2195&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2198, Order: 160488, Start Time: 2012-07-19 03:45:53, End Time: 2012-07-19 05:04:19 To: 2195, Order: 160483, Start Time: 2012-07-19 01:59:25, End Time: 2012-07-19 03:17:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (70 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (784 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.78% (13.9977 => 13.7482, std. dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: -1.66% (11.0098 => 10.8266, std. dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.61% (10.3673 => 13.7482, std. dev.: 0.0102) SingleSource/UnitTests/ObjC/trivial-interface: 11.98% (0.3473 => 0.3889, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 11.64% (0.3497 => 0.3904, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.58% (0.3516 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.54% (0.3543 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.54% (0.3543 => 0.3952, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 11.54% (0.3561 => 0.3972, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.41% (1.1194 => 1.2471, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.15% (0.3694 => 0.4106, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.79% (0.3828 => 0.4241, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.62% (0.3927 => 0.4344, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.65% (2.2022 => 2.3927, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.26% (1.7609 => 1.9063, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.00% (0.6030 => 0.6392, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 5.94% (0.5925 => 0.6277, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.41% (0.3177 => 0.3349, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 5.06% (0.3282 => 0.3448, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.88% (0.4879 => 0.5117, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.78% (0.7326 => 0.7676, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.71% (7.0540 => 7.3860, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.33% (0.4615 => 0.4815, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 4.04% (0.7433 => 0.7733, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 3.74% (10.4361 => 10.8266, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (9.4845 => 9.8382, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.58% (5.0018 => 5.1810, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (4.9449 => 5.1207, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.43% (0.8172 => 0.8452, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.29% (0.5569 => 0.5752, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.12% (0.5860 => 0.6043, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (4.2646 => 4.3961, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 3.01% (0.3423 => 0.3526, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.97% (8.1363 => 8.3780, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 2.81% (0.7835 => 0.8055, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (14.3668 => 14.7698, std. dev.: 0.0262) MultiSource/Applications/oggenc/oggenc: 2.73% (5.7591 => 5.9164, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.64% (1.1861 => 1.2174, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.64% (1.3050 => 1.3394, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.44% (1.1642 => 1.1926, std. dev.: 0.0073) MultiSource/Applications/d/make_dparser: 2.43% (3.3354 => 3.4163, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.38% (0.8067 => 0.8259, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.36% (1.5603 => 1.5972, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.33% (1.5415 => 1.5774, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.32% (2.0273 => 2.0744, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.97% (2.2024 => 2.2457, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.94% (3.8723 => 3.9476, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.94% (0.9765 => 0.9954, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.63% (1.5859 => 1.6117, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.57% (0.6450 => 0.6551, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.53% (1.4186 => 1.4403, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.50% (0.6675 => 0.6775, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.50% (17.1811 => 17.4382, std. dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/football/football: 1.30% (0.8921 => 0.9037, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.20% (2.0665 => 2.0913, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 1.06% (1.1840 => 1.1966, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.06% (2.2969 => 2.3213, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9742, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 5.73% (1.1277 => 1.1923, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (3.6395 => 3.7598, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.80% (26.0924 => 26.5608, std. dev.: 0.0214) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5086 => 1.5354, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 1.71% (3.1578 => 3.2119, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.57% (11.6436 => 11.8267, std. dev.: 0.0130) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4462, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.38% (2.6546 => 2.6913, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 1.14% (9.1159 => 9.2202, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/oourafft: 1.12% (6.6465 => 6.7209, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.42% (5.2763 => 3.1434, std. dev.: 0.0142) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.17% (5.3855 => 3.7067, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.90% (5.3526 => 3.6989, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.62% (2.9384 => 2.5383, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.39% (22.1758 => 19.8722, std. dev.: 0.0214) SingleSource/UnitTests/Vector/constpool: -5.32% (54.1659 => 51.2856, std. dev.: 0.0258) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.40% (3.8922 => 3.8378, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.73% (0.0998 => 0.0831, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -10.05% (1.2373 => 1.1130, std. dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4830, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4175, std. dev.: 0.0114) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (8.1563 => 7.9162, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0857, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.22% (1.8329 => 1.8105, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.10% (1.3677 => 1.3527, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 23:16:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 01:16:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120719061619.E234C2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2199?compare_to=2196&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2199, Order: 160492, Start Time: 2012-07-19 05:02:24, End Time: 2012-07-19 06:16:31 To: 2196, Order: 160486, Start Time: 2012-07-19 03:20:31, End Time: 2012-07-19 04:34:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (135 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.26% (1.3918 => 1.4094, std. dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.19% (2.0176 => 2.3038, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3578 => 0.3913, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.30% (0.5818 => 0.6359, std. dev.: 0.0088) SingleSource/UnitTests/ObjC++/Hello: 9.15% (0.5748 => 0.6274, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.14% (0.3601 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.03% (0.3623 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.02% (0.3646 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.01% (0.3650 => 0.3979, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.95% (0.3663 => 0.3991, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3789 => 0.4128, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.92% (0.3914 => 0.4263, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.74% (0.4003 => 0.4353, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.70% (0.7061 => 0.7675, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/property: 8.68% (0.3940 => 0.4282, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.95% (0.1986 => 0.2124, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.59% (1.3693 => 1.4595, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 6.31% (0.4328 => 0.4601, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.2596 => 0.2756, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (3.9660 => 4.2088, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 6.11% (0.7038 => 0.7468, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.04% (0.7710 => 0.8176, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.02% (0.5265 => 0.5582, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 5.90% (0.2781 => 0.2945, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.88% (0.2721 => 0.2881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.76% (0.4062 => 0.4296, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2607 => 0.2753, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/random: 5.54% (0.2690 => 0.2839, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.39% (0.2782 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.31% (0.2655 => 0.2796, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 5.28% (0.2937 => 0.3092, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.27% (0.3489 => 0.3673, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.27% (0.3149 => 0.3315, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.26% (0.3022 => 0.3181, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.25% (0.2760 => 0.2905, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.21% (0.2628 => 0.2765, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.19% (0.6959 => 0.7320, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.17% (1.9828 => 2.0854, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2761 => 0.2902, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.06% (0.2966 => 0.3116, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.02% (0.4379 => 0.4599, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 4.99% (0.3107 => 0.3262, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.90% (0.3899 => 0.4090, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.82% (0.3485 => 0.3653, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.78% (1.2193 => 1.2776, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 4.71% (13.8202 => 14.4715, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.66% (0.9199 => 0.9628, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 4.66% (0.3453 => 0.3614, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.64% (0.3192 => 0.3340, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.58% (0.4390 => 0.4591, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.52% (0.5577 => 0.5829, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 4.42% (16.6129 => 17.3475, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.41% (0.4016 => 0.4193, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.37% (0.3756 => 0.3920, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 4.36% (0.3534 => 0.3688, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.34% (13.2842 => 13.8605, std. dev.: 0.0226) MultiSource/Benchmarks/McCat/09-vor/vor: 4.31% (0.2925 => 0.3051, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.27% (0.3868 => 0.4033, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.15% (0.2914 => 0.3035, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.08% (0.5637 => 0.5867, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.06% (1.1364 => 1.1825, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.05% (1.3819 => 1.4378, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.04% (1.4563 => 1.5151, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.98% (7.2180 => 7.5053, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.90% (1.3813 => 1.4352, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.88% (0.3246 => 0.3372, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.86% (1.1061 => 1.1488, std. dev.: 0.0066) MultiSource/Applications/spiff/spiff: 3.80% (0.7506 => 0.7791, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.2945 => 0.3056, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.76% (3.8646 => 4.0098, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 3.74% (1.9270 => 1.9990, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (1.3245 => 1.3729, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 3.61% (0.8310 => 0.8610, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.53% (1.0594 => 1.0968, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.51% (0.7460 => 0.7722, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.49% (1.2292 => 1.2721, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (4.3801 => 4.5272, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.30% (3.6692 => 3.7902, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.23% (4.4433 => 4.5866, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.22% (0.3755 => 0.3876, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.11% (0.3220 => 0.3320, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.05% (4.9865 => 5.1388, std. dev.: 0.0089) MultiSource/Applications/siod/siod: 2.94% (2.1791 => 2.2431, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.82% (0.4791 => 0.4926, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.81% (0.8698 => 0.8942, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.60% (1.1333 => 1.1628, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.57% (3.1889 => 3.2709, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.45% (0.6283 => 0.6437, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (6.5754 => 6.7257, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.23% (16.2614 => 16.6247, std. dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 2.14% (14.5298 => 14.8405, std. dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: 2.08% (8.4961 => 8.6732, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.07% (0.6135 => 0.6262, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.99% (14.8535 => 15.1493, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.97% (1.5188 => 1.5487, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.95% (2.1007 => 2.1416, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.75% (3.2742 => 3.3316, std. dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 1.34% (4.6629 => 4.7255, std. dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.46% (1.8175 => 2.2985, std. dev.: 0.0361) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.57% (2.0200 => 2.1931, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: 8.43% (1.2998 => 1.4094, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.73% (1.5824 => 1.7047, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (2.5629 => 2.7293, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.15% (7.4271 => 7.7353, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 4.06% (11.2619 => 11.7194, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.75% (12.4560 => 12.9226, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.30% (1.7688 => 1.8094, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5354, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.60% (3.6469 => 3.7052, std. dev.: 0.0065) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9663, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.11% (3.1736 => 3.2088, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.60% (22.5627 => 21.0731, std. dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.30% (0.3511 => 0.3395, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.15% (0.8818 => 0.8717, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.65% (1.0460 => 0.8614, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.55% (0.0997 => 0.0842, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1100, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std. dev.: 0.0081) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9125, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.45% (0.8342 => 0.8138, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.07% (20.3410 => 19.9200, std. dev.: 0.0274) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5075, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: -1.75% (3.0263 => 2.9733, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2541, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4900, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2499, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8040, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8491, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 18 23:50:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 01:50:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120719065051.E35042A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2200?compare_to=2198&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2200, Order: 160494, Start Time: 2012-07-19 05:32:40, End Time: 2012-07-19 06:51:04 To: 2198, Order: 160488, Start Time: 2012-07-19 03:45:53, End Time: 2012-07-19 05:04:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (70 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (784 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.12% (80.1755 => 81.0723, std. dev.: 0.1502) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.69% (10.3673 => 13.8601, std. dev.: 0.0104) SingleSource/UnitTests/ObjC/trivial-interface: 11.98% (0.3473 => 0.3889, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.84% (0.3497 => 0.3911, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.67% (1.1194 => 1.2500, std. dev.: 0.0082) SingleSource/UnitTests/ObjC/exceptions-3: 11.63% (0.3516 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.63% (0.3543 => 0.3955, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.46% (0.3561 => 0.3969, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.15% (0.3694 => 0.4106, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.82% (0.3828 => 0.4242, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.63% (0.3886 => 0.4299, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.72% (1.7609 => 1.9144, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.33% (2.2022 => 2.3857, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.03% (0.5925 => 0.6282, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.00% (0.6030 => 0.6392, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.81% (0.2065 => 0.2185, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.63% (0.3177 => 0.3356, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.90% (0.4879 => 0.5118, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 4.87% (0.7326 => 0.7683, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: 4.75% (0.3282 => 0.3438, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.54% (7.0540 => 7.3744, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.31% (0.4615 => 0.4814, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 3.74% (0.7433 => 0.7711, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.0018 => 5.1849, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.62% (0.3121 => 0.3234, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 3.60% (9.4845 => 9.8255, std. dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 3.51% (10.4361 => 10.8026, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.41% (4.9449 => 5.1134, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.40% (0.8172 => 0.8450, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5569 => 0.5749, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (4.2646 => 4.3961, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.95% (8.1363 => 8.3763, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.88% (0.5860 => 0.6029, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 2.81% (0.7835 => 0.8055, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.64% (14.3668 => 14.7468, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 2.61% (0.4289 => 0.4401, std. dev.: 0.0036) MultiSource/Applications/hbd/hbd: 2.54% (1.5603 => 1.6000, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.3050 => 1.3375, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.44% (1.1861 => 1.2150, std. dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 2.40% (5.7591 => 5.8971, std. dev.: 0.0204) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.24% (1.5415 => 1.5761, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.22% (3.3354 => 3.4093, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 2.16% (1.1642 => 1.1894, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.09% (2.0273 => 2.0697, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.06% (0.8067 => 0.8233, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.84% (0.9765 => 0.9945, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.79% (2.0665 => 2.1035, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 1.67% (0.6456 => 0.6564, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.67% (3.8723 => 3.9370, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (2.2024 => 2.2374, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.51% (0.6675 => 0.6776, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.49% (1.5859 => 1.6096, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.47% (1.4186 => 1.4394, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.33% (17.1811 => 17.4094, std. dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 1.21% (1.2842 => 1.2998, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 1.19% (0.8921 => 0.9027, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9749, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 5.75% (1.1277 => 1.1925, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7536, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (1.5086 => 1.5381, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 1.70% (3.1578 => 3.2115, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 1.70% (26.0924 => 26.5355, std. dev.: 0.0150) MultiSource/Benchmarks/nbench/nbench: 1.56% (11.6436 => 11.8257, std. dev.: 0.0147) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4466, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6876, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 1.10% (6.6465 => 6.7198, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.05% (9.1159 => 9.2119, std. dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.14% (5.2763 => 3.1583, std. dev.: 0.0147) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.99% (5.3855 => 3.7168, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.74% (5.3526 => 3.7073, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.20% (2.9384 => 2.5504, std. dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: -10.34% (22.1758 => 19.8832, std. dev.: 0.0207) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3278, std. dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.50% (3.8922 => 3.8338, std. dev.: 0.0161) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.17% (1.2373 => 1.1115, std. dev.: 0.0237) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4666, std. dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4175, std. dev.: 0.0155) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.82% (8.1563 => 7.9267, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0824, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8092, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 01:01:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 03:01:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120719080106.0F4DB2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2201?compare_to=2199&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2201, Order: 160494, Start Time: 2012-07-19 06:44:24, End Time: 2012-07-19 08:01:18 To: 2199, Order: 160492, Start Time: 2012-07-19 05:02:24, End Time: 2012-07-19 06:16:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (95 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.05% (2.0176 => 2.3213, std. dev.: 0.0457) SingleSource/UnitTests/ObjC++/property-reference-object: 9.23% (0.5818 => 0.6355, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.15% (0.5748 => 0.6274, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.58% (0.3578 => 0.3885, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.57% (0.7061 => 0.7666, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.47% (0.3650 => 0.3959, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.33% (0.3601 => 0.3901, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 8.28% (0.3646 => 0.3948, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.16% (0.3789 => 0.4098, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 8.14% (0.3663 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.11% (0.3623 => 0.3917, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3914 => 0.4230, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.07% (0.4003 => 0.4326, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.79% (0.3940 => 0.4247, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.94% (1.3693 => 1.4643, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 6.38% (0.7038 => 0.7487, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 6.06% (0.4062 => 0.4308, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.01% (0.4328 => 0.4588, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.65% (0.2781 => 0.2938, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.53% (0.3580 => 0.3778, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.21% (0.2782 => 0.2927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.18% (0.2607 => 0.2742, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.16% (0.2655 => 0.2792, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.13% (0.2690 => 0.2828, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.11% (13.8202 => 14.5265, std. dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.08% (0.4390 => 0.4613, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.99% (0.3489 => 0.3663, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.93% (0.2760 => 0.2896, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (0.3485 => 0.3655, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wc: 4.87% (0.2937 => 0.3080, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.81% (0.2765 => 0.2898, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.75% (0.2696 => 0.2824, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.74% (0.2761 => 0.2892, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.70% (0.3107 => 0.3253, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.70% (0.2726 => 0.2854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.60% (0.3149 => 0.3294, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.52% (0.2988 => 0.3123, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.26% (0.3192 => 0.3328, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4016 => 0.4187, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.26% (0.3453 => 0.3600, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.10% (0.3534 => 0.3679, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.09% (0.7506 => 0.7813, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 4.01% (0.3293 => 0.3425, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.91% (1.1061 => 1.1493, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 3.90% (0.3868 => 0.4019, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.83% (1.9270 => 2.0009, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 3.46% (0.2945 => 0.3047, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.37% (2.1791 => 2.2525, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.30% (0.4791 => 0.4949, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.25% (1.2292 => 1.2692, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.10% (3.1889 => 3.2877, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.09% (4.9865 => 5.1408, std. dev.: 0.0492) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.04% (0.3755 => 0.3869, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.90% (0.8698 => 0.8950, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 2.79% (16.2614 => 16.7145, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 2.78% (6.5754 => 6.7581, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.72% (0.6283 => 0.6454, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.60% (14.5298 => 14.9080, std. dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 2.53% (14.8535 => 15.2286, std. dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 2.31% (8.4961 => 8.6925, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.27% (2.1007 => 2.1483, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 1.98% (4.6629 => 4.7554, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.97% (3.2742 => 3.3387, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.78% (1.5188 => 1.5458, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.25% (1.0313 => 1.0442, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 95.29% (0.1824 => 0.3562, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2689, std. dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.43% (2.0200 => 2.1903, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.96% (1.2998 => 1.4032, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0112) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.72% (1.5824 => 1.7046, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.09% (7.4271 => 7.7310, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 4.06% (11.2619 => 11.7191, std. dev.: 0.0259) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9200, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4798, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0310 => 1.0557, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0084) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4553, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (3.6469 => 3.7033, std. dev.: 0.0046) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0417) SingleSource/Benchmarks/Shootout-C++/hash2: 1.33% (3.1736 => 3.2158, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: 1.26% (1.9290 => 1.9533, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.28% (22.5627 => 21.1454, std. dev.: 0.0275) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.65% (1.0460 => 0.8614, std. dev.: 0.0129) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -10.66% (1.2308 => 1.0996, std. dev.: 0.0076) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.11% (1.3780 => 1.3076, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.21% (0.4366 => 0.4182, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9129, std. dev.: 0.0153) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4474, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4867 => 0.4748, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.04% (6.6320 => 6.4970, std. dev.: 0.0154) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9615, std. dev.: 0.0331) MultiSource/Applications/spiff/spiff: -1.84% (3.0263 => 2.9705, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9980, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2564, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2156, std. dev.: 0.0346) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2507, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8046, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.10% (3.8887 => 3.8461, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 01:03:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 03:03:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120719080353.B6DE22A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2202?compare_to=2197&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2202, Order: 160492, Start Time: 2012-07-19 05:16:44, End Time: 2012-07-19 08:04:06 To: 2197, Order: 160483, Start Time: 2012-07-19 02:04:57, End Time: 2012-07-19 04:48:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (48 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (845 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.55% (0.2163 => 0.2283, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/treeadd/treeadd: 1.67% (10.7491 => 10.9285, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.70% (0.3446 => 0.3918, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/trivial-interface: 13.65% (0.3442 => 0.3912, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-4: 13.65% (0.3465 => 0.3938, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.53% (0.3488 => 0.3960, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/synchronized: 13.52% (0.3469 => 0.3938, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/for-in: 13.47% (0.3496 => 0.3967, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-3: 13.44% (0.3460 => 0.3925, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/property: 12.96% (0.3650 => 0.4123, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions: 12.90% (0.3643 => 0.4113, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/parameter-passing: 12.49% (0.3724 => 0.4189, std. dev.: 0.0064) SingleSource/UnitTests/ObjC++/property-reference-object: 6.62% (0.5889 => 0.6279, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.48% (0.1620 => 0.1725, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (1.6211 => 1.7106, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.20% (3.5627 => 3.7478, std. dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 4.97% (1.5932 => 1.6724, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (0.5026 => 0.5272, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.83% (0.5900 => 0.6185, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.74% (0.4029 => 0.4220, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.69% (1.3152 => 1.3769, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.50% (0.3930 => 0.4107, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.47% (0.4361 => 0.4556, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.43% (0.4994 => 0.5215, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.40% (0.2866 => 0.2992, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.39% (0.2736 => 0.2856, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.30% (0.5000 => 0.5215, std. dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.24% (2.7292 => 2.8450, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: 4.07% (4.2109 => 4.3824, std. dev.: 0.0085) MultiSource/Applications/d/make_dparser: 4.07% (1.0781 => 1.1220, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.64% (1.9694 => 2.0411, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.51% (0.2875 => 0.2976, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.44% (1.9966 => 2.0653, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (0.4658 => 0.4812, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.25% (5.5417 => 5.7218, std. dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 3.20% (4.6177 => 4.7655, std. dev.: 0.0161) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.14% (4.4195 => 4.5583, std. dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: 3.09% (2.1653 => 2.2323, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.08% (0.3890 => 0.4010, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.94% (2.0673 => 2.1280, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.84% (0.3903 => 0.4014, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 2.80% (1.8794 => 1.9321, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.80% (0.9909 => 1.0186, std. dev.: 0.0040) MultiSource/Applications/siod/siod: 2.71% (0.6634 => 0.6814, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/sieve: 2.71% (0.3726 => 0.3827, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.50% (0.7875 => 0.8072, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 2.17% (0.9697 => 0.9907, std. dev.: 0.0046) MultiSource/Applications/Burg/burg: 2.04% (0.5546 => 0.5659, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.57% (0.6435 => 0.6536, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.60% (0.2162 => 0.2283, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.79% (11.9555 => 11.7420, std. dev.: 0.0209) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 01:57:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 03:57:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120719085724.2E0782A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/2203?compare_to=2200&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2203, Order: 160496, Start Time: 2012-07-19 07:38:46, End Time: 2012-07-19 08:57:36 To: 2200, Order: 160494, Start Time: 2012-07-19 05:32:40, End Time: 2012-07-19 06:51:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (69 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (785 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.39% (3.8204 => 3.9117, std. dev.: 0.0262) SingleSource/Benchmarks/Misc/lowercase: 1.29% (7.9484 => 8.0507, std. dev.: 0.0191) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.13% (81.0723 => 79.3466, std. dev.: 0.3778) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.72% (10.3673 => 13.8632, std. dev.: 0.0104) SingleSource/UnitTests/ObjC/trivial-interface: 12.01% (0.3473 => 0.3890, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.77% (0.3516 => 0.3930, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.73% (1.1194 => 1.2507, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.71% (0.3543 => 0.3958, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 11.70% (0.3497 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.63% (0.3543 => 0.3955, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3694 => 0.4107, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.87% (0.3927 => 0.4354, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.72% (1.7609 => 1.9144, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.34% (2.2022 => 2.3859, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.13% (0.5925 => 0.6288, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.09% (0.6030 => 0.6397, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.82% (0.3177 => 0.3362, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.4879 => 0.5121, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 4.95% (0.7326 => 0.7689, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.85% (7.0540 => 7.3958, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/oourafft: 4.72% (0.3282 => 0.3437, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.63% (0.8172 => 0.8550, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.46% (0.4615 => 0.4821, std. dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.39% (0.3121 => 0.3258, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 3.73% (0.7433 => 0.7710, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.64% (5.0018 => 5.1838, std. dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: 3.62% (10.4361 => 10.8134, std. dev.: 0.0180) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.61% (4.9449 => 5.1235, std. dev.: 0.0116) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (9.4845 => 9.8207, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.54% (0.5569 => 0.5766, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.29% (0.5860 => 0.6053, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.06% (4.2646 => 4.3950, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.99% (8.1363 => 8.3793, std. dev.: 0.0067) MultiSource/Applications/spiff/spiff: 2.95% (0.7835 => 0.8066, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (14.3668 => 14.7481, std. dev.: 0.0136) MultiSource/Applications/hbd/hbd: 2.60% (1.5603 => 1.6009, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.57% (0.8067 => 0.8274, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.56% (1.3050 => 1.3384, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.5415 => 1.5788, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.41% (1.1861 => 1.2147, std. dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 2.35% (5.7591 => 5.8947, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 2.35% (3.3354 => 3.4137, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 2.26% (1.1642 => 1.1905, std. dev.: 0.0086) MultiSource/Applications/treecc/treecc: 2.20% (2.0273 => 2.0720, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.12% (0.9765 => 0.9972, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.96% (2.0665 => 2.1070, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.86% (0.6456 => 0.6576, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.67% (3.8723 => 3.9368, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.58% (1.4186 => 1.4410, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.50% (0.6675 => 0.6775, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 1.37% (0.8921 => 0.9043, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.31% (1.5859 => 1.6067, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 1.30% (17.1811 => 17.4051, std. dev.: 0.0200) MultiSource/Applications/hexxagon/hexxagon: 1.26% (1.2842 => 1.3004, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 3.54% (3.7781 => 3.9117, std. dev.: 0.0262) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7490, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0313 => 1.0559, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (1.5086 => 1.5381, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.75% (26.0924 => 26.5486, std. dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hash2: 1.64% (3.1578 => 3.2095, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 1.59% (11.6436 => 11.8291, std. dev.: 0.0163) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4468, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6898, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2328, std. dev.: 0.0371) SingleSource/Benchmarks/Misc/oourafft: 1.11% (6.6465 => 6.7204, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1290, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.00% (5.2763 => 3.1657, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.97% (5.3855 => 3.7176, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.74% (5.3526 => 3.7070, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.25% (2.9384 => 2.5491, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -10.29% (22.1758 => 19.8946, std. dev.: 0.0471) SingleSource/UnitTests/Vector/constpool: -5.18% (54.1659 => 51.3627, std. dev.: 0.0281) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.62% (3.8922 => 3.8292, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.12% (1.2373 => 1.1121, std. dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4804, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.10% (8.6802 => 8.4115, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9185, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0845, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.23% (1.8329 => 1.8103, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 02:43:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 04:43:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120719094323.9B6182A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2204?compare_to=2201&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2204, Order: 160496, Start Time: 2012-07-19 08:29:32, End Time: 2012-07-19 09:43:36 To: 2201, Order: 160494, Start Time: 2012-07-19 06:44:24, End Time: 2012-07-19 08:01:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (137 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.06% (2.0176 => 2.3215, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.28% (0.5818 => 0.6358, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.24% (0.5748 => 0.6279, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.66% (0.3578 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3601 => 0.3904, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.34% (0.3646 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.29% (0.3789 => 0.4103, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.25% (0.3650 => 0.3951, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.24% (0.3663 => 0.3965, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.24% (0.7061 => 0.7643, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-3: 8.20% (0.3623 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.10% (0.3914 => 0.4231, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.99% (0.4003 => 0.4323, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.99% (0.3130 => 0.3380, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.89% (0.3940 => 0.4251, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.95% (0.1986 => 0.2124, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 6.73% (1.3693 => 1.4615, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.51% (3.9660 => 4.2242, std. dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: 6.46% (0.7038 => 0.7493, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.30% (0.7710 => 0.8196, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.12% (0.5265 => 0.5587, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2596 => 0.2754, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1819 => 0.1929, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.03% (0.4328 => 0.4589, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.47% (0.4062 => 0.4284, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 5.43% (0.2781 => 0.2932, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.27% (0.6959 => 0.7326, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.18% (0.2782 => 0.2926, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.4379 => 0.4605, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.14% (13.8202 => 14.5307, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.13% (1.2193 => 1.2819, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.13% (0.2690 => 0.2828, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2655 => 0.2790, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.06% (0.3022 => 0.3175, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.97% (0.3580 => 0.3758, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.96% (0.2760 => 0.2897, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.96% (0.3489 => 0.3662, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.95% (13.2842 => 13.9412, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.93% (1.9828 => 2.0805, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.90% (0.2937 => 0.3081, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.90% (0.9199 => 0.9650, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.86% (0.2966 => 0.3110, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 4.77% (0.2726 => 0.2856, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.75% (0.5577 => 0.5842, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.75% (0.2696 => 0.2824, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.73% (0.3485 => 0.3650, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.70% (0.2765 => 0.2895, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.70% (0.3149 => 0.3297, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.67% (0.2761 => 0.2890, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.66% (1.3813 => 1.4457, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.63% (0.3107 => 0.3251, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.62% (0.4390 => 0.4593, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.62% (0.3899 => 0.4079, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.59% (1.3819 => 1.4453, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.53% (1.4563 => 1.5223, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 4.53% (16.6129 => 17.3654, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/matrix: 4.52% (0.2988 => 0.3123, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.37% (1.1364 => 1.1861, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.37% (0.3453 => 0.3604, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.32% (0.3192 => 0.3330, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4016 => 0.4187, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.24% (0.5637 => 0.5876, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.17% (7.2180 => 7.5188, std. dev.: 0.0096) MultiSource/Applications/Burg/burg: 4.16% (1.1061 => 1.1521, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.15% (0.3756 => 0.3912, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.11% (3.8646 => 4.0234, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 4.10% (0.3534 => 0.3679, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.07% (0.3293 => 0.3427, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.07% (0.3246 => 0.3378, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.03% (1.9270 => 2.0046, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.02% (1.0594 => 1.1020, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.02% (0.2914 => 0.3031, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 3.97% (0.8310 => 0.8640, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.94% (0.7506 => 0.7802, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.90% (1.3245 => 1.3762, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.81% (0.7460 => 0.7744, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.67% (3.6692 => 3.8039, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 3.57% (0.2945 => 0.3050, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.54% (0.3220 => 0.3334, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.53% (4.3801 => 4.5346, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (4.4433 => 4.5984, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.34% (0.4791 => 0.4951, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.29% (1.2292 => 1.2697, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.27% (2.1791 => 2.2504, std. dev.: 0.0158) MultiSource/Applications/d/make_dparser: 3.07% (3.1889 => 3.2869, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.01% (0.3755 => 0.3868, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.01% (1.1333 => 1.1674, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.98% (4.9865 => 5.1352, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.92% (0.8698 => 0.8952, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (6.5754 => 6.7642, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.79% (0.6283 => 0.6458, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.68% (16.2614 => 16.6978, std. dev.: 0.0192) MultiSource/Applications/JM/lencod/lencod: 2.57% (14.8535 => 15.2357, std. dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: 2.48% (14.5298 => 14.8906, std. dev.: 0.0178) MultiSource/Benchmarks/mafft/pairlocalalign: 2.44% (8.4961 => 8.7034, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.41% (0.6135 => 0.6283, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.31% (2.1007 => 2.1493, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.07% (3.2742 => 3.3419, std. dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 2.05% (4.6629 => 4.7587, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (1.5188 => 1.5483, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.45% (0.9108 => 0.9240, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.38% (1.0313 => 1.0455, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.63% (1.8175 => 2.2652, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.59% (2.0200 => 2.1935, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.05% (0.9996 => 1.0801, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.71% (1.5824 => 1.7044, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 6.59% (1.2998 => 1.3854, std. dev.: 0.0173) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.2619 => 11.7201, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.4271 => 7.7210, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9189, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4802, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.24% (1.7688 => 1.8084, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (4.1080 => 4.1888, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.60% (3.6469 => 3.7051, std. dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9591, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.02% (3.1736 => 3.2059, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.23% (22.5627 => 21.1565, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.65% (1.0460 => 0.8614, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2308 => 1.1046, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3159, std. dev.: 0.0125) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5510, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -3.19% (1.9762 => 1.9132, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4475, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.45% (0.8342 => 0.8138, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5051, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: -1.77% (3.0263 => 2.9726, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2531, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.53% (2.5254 => 2.4867, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.50% (20.3410 => 20.0368, std. dev.: 0.0217) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8633, std. dev.: 0.0097) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2201, std. dev.: 0.0129) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2529, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.15% (9.9194 => 9.8051, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 04:15:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 06:15:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120719111550.CBD5E2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2205?compare_to=2202&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2205, Order: 160496, Start Time: 2012-07-19 08:32:21, End Time: 2012-07-19 11:16:06 To: 2202, Order: 160492, Start Time: 2012-07-19 05:16:44, End Time: 2012-07-19 08:04:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (69 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (824 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.38% (7.3229 => 7.4969, std. dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.38% (0.3446 => 0.3907, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.30% (0.3465 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.28% (0.3442 => 0.3899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.24% (0.3496 => 0.3959, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.24% (0.3460 => 0.3918, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.22% (0.3488 => 0.3949, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 13.12% (0.3469 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.79% (0.3650 => 0.4117, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.68% (0.3643 => 0.4105, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3724 => 0.4184, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.40% (0.5826 => 0.6257, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.22% (0.5889 => 0.6314, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.79% (0.1620 => 0.1730, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.72% (0.7171 => 0.7581, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.51% (3.5627 => 3.7591, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.49% (1.6211 => 1.7101, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.00% (0.4361 => 0.4579, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.55% (1.3152 => 1.3751, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.43% (0.4994 => 0.5215, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.37% (0.4029 => 0.4205, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.33% (0.3930 => 0.4100, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.32% (0.5900 => 0.6155, std. dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (2.7292 => 2.8457, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.18% (0.5000 => 0.5209, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.14% (0.5026 => 0.5234, std. dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 4.02% (1.5932 => 1.6573, std. dev.: 0.0155) MultiSource/Benchmarks/nbench/nbench: 3.98% (0.2566 => 0.2668, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.87% (0.2866 => 0.2977, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.86% (0.2875 => 0.2986, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 3.85% (4.2109 => 4.3729, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hello: 3.83% (0.2714 => 0.2818, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 3.82% (0.2725 => 0.2829, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.80% (0.2738 => 0.2842, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 3.78% (1.0781 => 1.1189, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.77% (0.2729 => 0.2832, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2803 => 0.2908, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.65% (0.2736 => 0.2836, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.57% (1.9694 => 2.0397, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wc: 3.52% (0.3096 => 0.3205, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.49% (2.0673 => 2.1394, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.37% (0.9909 => 1.0243, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (2.1013 => 2.1716, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.34% (1.9966 => 2.0633, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.29% (0.3195 => 0.3300, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.28% (0.3267 => 0.3374, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.23% (5.5417 => 5.7207, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.21% (0.3362 => 0.3470, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.20% (0.3124 => 0.3224, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3317 => 0.3423, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.14% (0.3890 => 0.4012, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 3.13% (0.9697 => 1.0001, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.09% (0.4658 => 0.4802, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 3.05% (0.3678 => 0.3790, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.01% (0.3625 => 0.3734, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (4.4195 => 4.5489, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: 2.93% (0.3726 => 0.3835, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.85% (4.6177 => 4.7492, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.3903 => 0.4013, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (2.1653 => 2.2258, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3690 => 0.3793, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.64% (1.8794 => 1.9291, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4251 => 0.4356, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.46% (0.4139 => 0.4241, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.29% (1.4269 => 1.4596, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 2.29% (0.5546 => 0.5673, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.27% (0.7875 => 0.8054, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 2.13% (23.5202 => 24.0215, std. dev.: 0.0158) MultiSource/Applications/siod/siod: 2.00% (0.6634 => 0.6767, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.77% (0.6435 => 0.6549, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.70% (11.9555 => 11.7518, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 04:36:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 06:36:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120719113612.2E4A02A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2206?compare_to=2204&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2206, Order: 160500, Start Time: 2012-07-19 10:22:22, End Time: 2012-07-19 11:36:25 To: 2204, Order: 160496, Start Time: 2012-07-19 08:29:32, End Time: 2012-07-19 09:43:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (135 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (723 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.88% (54.4676 => 56.5816, std. dev.: 0.0427) SingleSource/Benchmarks/Misc/mandel-2: 1.66% (1.3854 => 1.4084, std. dev.: 0.0079) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.30% (2.0176 => 2.3062, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.18% (0.5818 => 0.6352, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5748 => 0.6268, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3578 => 0.3887, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.58% (0.3650 => 0.3963, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 8.45% (0.3789 => 0.4109, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3601 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.39% (0.3646 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3623 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.35% (0.3663 => 0.3969, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.24% (0.7061 => 0.7643, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: 8.20% (0.3914 => 0.4235, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.02% (0.4003 => 0.4324, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.75% (0.1986 => 0.2120, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 6.64% (1.3693 => 1.4602, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.20% (3.9660 => 4.2120, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4328 => 0.4596, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.14% (0.7038 => 0.7470, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.12% (0.5265 => 0.5587, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.01% (0.2596 => 0.2752, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.90% (0.7710 => 0.8165, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 5.64% (0.4062 => 0.4291, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 5.61% (0.2781 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2607 => 0.2750, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.43% (0.2782 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2690 => 0.2835, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.33% (0.2628 => 0.2768, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.31% (0.2655 => 0.2796, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.22% (0.3489 => 0.3671, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.21% (0.2937 => 0.3090, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.20% (1.9828 => 2.0860, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/except: 5.18% (0.2760 => 0.2903, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4379 => 0.4604, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.09% (0.6959 => 0.7313, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2696 => 0.2833, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.07% (0.2761 => 0.2901, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.06% (0.2765 => 0.2905, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.06% (0.3580 => 0.3761, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.03% (0.2726 => 0.2863, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.02% (0.2966 => 0.3115, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.99% (0.3485 => 0.3659, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.92% (1.2193 => 1.2793, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 4.86% (0.3107 => 0.3258, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.84% (13.8202 => 14.4894, std. dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2988 => 0.3130, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.69% (0.3899 => 0.4082, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.62% (0.9199 => 0.9624, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 4.61% (0.3192 => 0.3339, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.60% (13.2842 => 13.8948, std. dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/lists: 4.52% (0.3293 => 0.3442, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.52% (0.5577 => 0.5829, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.52% (0.3453 => 0.3609, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.41% (0.2925 => 0.3054, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.4390 => 0.4583, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.39% (1.4563 => 1.5202, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 4.37% (16.6129 => 17.3396, std. dev.: 0.0320) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.34% (0.3756 => 0.3919, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (1.3819 => 1.4418, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.28% (0.4016 => 0.4188, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.27% (0.3534 => 0.3685, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.17% (7.2180 => 7.5189, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.15% (1.3813 => 1.4386, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.14% (1.1364 => 1.1834, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3868 => 0.4027, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.07% (1.1061 => 1.1511, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.5637 => 0.5863, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.94% (0.3246 => 0.3374, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.88% (0.7506 => 0.7797, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 3.84% (0.2945 => 0.3058, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (3.8646 => 4.0121, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.81% (1.3245 => 1.3750, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.81% (0.2914 => 0.3025, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.71% (1.0594 => 1.0987, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.70% (1.9270 => 1.9983, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 3.68% (0.8310 => 0.8616, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.68% (2.1791 => 2.2593, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.57% (0.7460 => 0.7726, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.41% (3.6692 => 3.7942, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.37% (4.3801 => 4.5278, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.34% (1.2292 => 1.2703, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.26% (4.4433 => 4.5883, std. dev.: 0.0057) MultiSource/Benchmarks/McCat/18-imp/imp: 3.23% (0.3220 => 0.3324, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.21% (0.4791 => 0.4945, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.09% (0.3755 => 0.3871, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.00% (4.9865 => 5.1359, std. dev.: 0.0119) MultiSource/Applications/d/make_dparser: 2.83% (3.1889 => 3.2790, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.80% (1.1333 => 1.1650, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.76% (0.8698 => 0.8938, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.57% (16.2614 => 16.6794, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.53% (0.6283 => 0.6442, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.48% (6.5754 => 6.7386, std. dev.: 0.0102) MultiSource/Applications/JM/lencod/lencod: 2.37% (14.8535 => 15.2050, std. dev.: 0.0109) MultiSource/Applications/ClamAV/clamscan: 2.27% (14.5298 => 14.8603, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 2.24% (8.4961 => 8.6865, std. dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.20% (0.6135 => 0.6270, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (2.1007 => 2.1425, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.75% (3.2742 => 3.3315, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 1.61% (4.6629 => 4.7378, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.10% (1.0313 => 1.0426, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.05% (1.8175 => 2.2728, std. dev.: 0.0251) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1918, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 8.36% (1.2998 => 1.4084, std. dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.98% (0.9996 => 1.0794, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.70% (1.5824 => 1.7042, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.25% (7.4271 => 7.7428, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 4.06% (11.2619 => 11.7191, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9206, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4793, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.36% (1.7688 => 1.8105, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.00% (4.1080 => 4.1900, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (3.6469 => 3.7091, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.5089 => 1.5318, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1940, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.24% (3.1736 => 3.2130, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.49% (22.5627 => 21.0985, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.65% (1.0460 => 0.8614, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.45% (0.0997 => 0.0843, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.94% (1.2308 => 1.1084, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.7573 => 5.4001, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.40% (1.3780 => 1.3174, std. dev.: 0.0077) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.66% (2.6470 => 2.5501, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9130, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -2.49% (2.5089 => 2.4465, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.43% (0.8342 => 0.8139, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.38% (20.3410 => 19.8576, std. dev.: 0.0418) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5042, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: -1.79% (3.0263 => 2.9720, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2545, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/ReedSolomon: -1.58% (7.1097 => 6.9977, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.55% (0.6589 => 0.6487, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.5254 => 2.4895, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.38% (9.3358 => 9.2071, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.23% (0.9692 => 0.9573, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2522, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8040, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 04:40:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 06:40:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120719114058.599972A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2207?compare_to=2203&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2207, Order: 160500, Start Time: 2012-07-19 10:22:31, End Time: 2012-07-19 11:41:13 To: 2203, Order: 160496, Start Time: 2012-07-19 07:38:46, End Time: 2012-07-19 08:57:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (72 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (782 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.84% (10.3673 => 13.8751, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: 12.09% (0.3473 => 0.3893, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.87% (0.3497 => 0.3912, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.75% (0.3516 => 0.3929, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.71% (0.3543 => 0.3958, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.70% (1.1194 => 1.2504, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.69% (0.3543 => 0.3957, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3561 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.23% (0.3694 => 0.4109, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.92% (0.3828 => 0.4246, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.75% (0.3927 => 0.4349, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.98% (1.7609 => 1.9190, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.35% (2.2022 => 2.3861, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.2065 => 0.2214, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 6.06% (0.5925 => 0.6284, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.6030 => 0.6393, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.73% (0.3177 => 0.3359, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.38% (0.7326 => 0.7720, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.98% (0.4879 => 0.5122, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.84% (0.3282 => 0.3441, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.71% (7.0540 => 7.3865, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.43% (0.8172 => 0.8534, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.38% (0.4615 => 0.4817, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.04% (0.5569 => 0.5794, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 3.75% (0.7433 => 0.7712, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.2758 => 0.2859, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.0018 => 5.1849, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 3.65% (10.4361 => 10.8174, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.64% (4.9449 => 5.1251, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 3.53% (9.4845 => 9.8192, std. dev.: 0.0145) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.16% (4.2646 => 4.3994, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.07% (0.5860 => 0.6040, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.01% (8.1363 => 8.3809, std. dev.: 0.0115) MultiSource/Applications/spiff/spiff: 2.95% (0.7835 => 0.8066, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 2.92% (0.3423 => 0.3523, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.78% (14.3668 => 14.7656, std. dev.: 0.0110) MultiSource/Applications/hbd/hbd: 2.66% (1.5603 => 1.6018, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.65% (0.4636 => 0.4759, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.58% (1.5415 => 1.5813, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.58% (1.1861 => 1.2167, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.51% (1.3050 => 1.3378, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 2.42% (5.7591 => 5.8985, std. dev.: 0.0182) MultiSource/Applications/Burg/burg: 2.40% (1.1642 => 1.1921, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.36% (3.3354 => 3.4141, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.14% (0.8067 => 0.8240, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 2.14% (2.0273 => 2.0707, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.93% (0.9765 => 0.9953, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.92% (2.0665 => 2.1062, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 1.82% (3.8723 => 3.9426, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.72% (0.5981 => 0.6084, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.66% (1.4186 => 1.4422, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.57% (0.6675 => 0.6780, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.50% (1.2842 => 1.3034, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.48% (1.5859 => 1.6093, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.43% (17.1811 => 17.4262, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 1.30% (0.8921 => 0.9037, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 1.01% (1.1840 => 1.1960, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7467, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.79% (26.0924 => 26.5596, std. dev.: 0.0416) SingleSource/Benchmarks/Shootout-C++/hash2: 1.75% (3.1578 => 3.2131, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (1.5086 => 1.5347, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8350, std. dev.: 0.0108) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4462, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.22% (2.6546 => 2.6870, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.12% (9.1159 => 9.2181, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: 1.09% (6.6465 => 6.7188, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1288, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1617, std. dev.: 0.0144) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.96% (5.3855 => 3.7181, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.73% (5.3526 => 3.7075, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.18% (2.9384 => 2.5510, std. dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: -10.28% (22.1758 => 19.8971, std. dev.: 0.0113) SingleSource/UnitTests/Vector/constpool: -5.20% (54.1659 => 51.3468, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.46% (3.8922 => 3.8352, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.23% (0.0998 => 0.0846, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.90% (1.2373 => 1.1148, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4775, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4281, std. dev.: 0.0174) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.85% (8.1563 => 7.9240, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.19% (1.8329 => 1.8111, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 06:18:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 08:18:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120719131821.DC18E2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2208?compare_to=2206&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2208, Order: 160501, Start Time: 2012-07-19 12:04:25, End Time: 2012-07-19 13:18:36 To: 2206, Order: 160500, Start Time: 2012-07-19 10:22:22, End Time: 2012-07-19 11:36:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (137 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.22% (2.0176 => 2.3046, std. dev.: 0.0150) SingleSource/UnitTests/ObjC++/property-reference-object: 9.14% (0.5818 => 0.6350, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.94% (0.5748 => 0.6262, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.89% (0.7061 => 0.7689, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3578 => 0.3887, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.50% (0.3646 => 0.3956, std. dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions-2: 8.44% (0.3601 => 0.3905, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.33% (0.3663 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.29% (0.3789 => 0.4103, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.22% (0.3650 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.05% (0.3914 => 0.4229, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.02% (0.4003 => 0.4324, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 7.92% (0.3940 => 0.4252, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 6.78% (1.3693 => 1.4622, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.75% (0.1986 => 0.2120, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.30% (0.4062 => 0.4318, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.16% (3.9660 => 4.2103, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4328 => 0.4593, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.11% (0.7710 => 0.8181, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 6.10% (0.7038 => 0.7467, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.01% (0.2596 => 0.2752, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.96% (0.5265 => 0.5579, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 5.54% (0.2781 => 0.2935, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (0.4379 => 0.4620, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.2607 => 0.2749, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.43% (0.2782 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2690 => 0.2834, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.32% (0.6959 => 0.7329, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.31% (0.2655 => 0.2796, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.29% (0.2628 => 0.2767, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.25% (0.2760 => 0.2905, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.24% (0.2937 => 0.3091, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.17% (0.4390 => 0.4617, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.9828 => 2.0835, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: 5.07% (0.2761 => 0.2901, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.06% (0.2765 => 0.2905, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.04% (0.3489 => 0.3665, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.03% (0.3580 => 0.3760, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.03% (0.2726 => 0.2863, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.01% (0.2696 => 0.2831, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.96% (0.2966 => 0.3113, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.95% (1.2193 => 1.2797, std. dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.94% (0.3485 => 0.3657, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.91% (0.9199 => 0.9651, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary: 4.89% (0.3107 => 0.3259, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 4.86% (0.3149 => 0.3302, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.77% (0.3899 => 0.4085, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.75% (13.8202 => 14.4772, std. dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2988 => 0.3130, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.2140 => 0.2241, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (13.2842 => 13.8944, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.57% (0.3192 => 0.3338, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.52% (0.3453 => 0.3609, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.48% (0.5577 => 0.5827, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 4.41% (0.2925 => 0.3054, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.37% (16.6129 => 17.3396, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: 4.36% (0.3534 => 0.3688, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.34% (0.3756 => 0.3919, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.33% (1.4563 => 1.5193, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.32% (1.3819 => 1.4416, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 4.31% (0.3293 => 0.3435, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.28% (0.4016 => 0.4188, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.23% (1.3813 => 1.4397, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.12% (0.2914 => 0.3034, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3868 => 0.4027, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.09% (1.1364 => 1.1829, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.08% (0.5637 => 0.5867, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.07% (1.1061 => 1.1511, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.06% (7.2180 => 7.5110, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.85% (0.3246 => 0.3371, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.85% (1.3245 => 1.3755, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: 3.80% (0.7506 => 0.7791, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.79% (1.0594 => 1.0995, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.2945 => 0.3056, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.77% (0.8310 => 0.8623, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 3.76% (3.8646 => 4.0098, std. dev.: 0.0144) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.70% (0.7460 => 0.7736, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.61% (1.9270 => 1.9965, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.45% (4.3801 => 4.5312, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.43% (3.6692 => 3.7949, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 3.42% (1.2292 => 1.2712, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.30% (4.4433 => 4.5898, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.26% (0.4791 => 0.4947, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.23% (0.3220 => 0.3324, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.22% (0.3755 => 0.3876, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.93% (4.9865 => 5.1328, std. dev.: 0.0043) MultiSource/Applications/d/make_dparser: 2.93% (3.1889 => 3.2822, std. dev.: 0.0121) MultiSource/Applications/siod/siod: 2.90% (2.1791 => 2.2424, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.81% (0.8698 => 0.8942, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.70% (1.1333 => 1.1639, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.51% (0.6135 => 0.6289, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.47% (16.2614 => 16.6638, std. dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.47% (0.6283 => 0.6438, std. dev.: 0.0053) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (6.5754 => 6.7358, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 2.37% (14.8535 => 15.2056, std. dev.: 0.0148) MultiSource/Applications/ClamAV/clamscan: 2.29% (14.5298 => 14.8629, std. dev.: 0.0138) MultiSource/Benchmarks/mafft/pairlocalalign: 2.25% (8.4961 => 8.6876, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (2.1007 => 2.1419, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.72% (3.2742 => 3.3306, std. dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 1.61% (4.6629 => 4.7379, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.59% (1.5188 => 1.5430, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.28% (0.9108 => 0.9225, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.05% (1.0313 => 1.0421, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.03% (1.8175 => 2.2725, std. dev.: 0.0455) SingleSource/Benchmarks/Misc/mandel-2: 8.99% (1.2998 => 1.4166, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.47% (2.0200 => 2.1911, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9996 => 1.0778, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.71% (1.5824 => 1.7044, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.08% (11.2619 => 11.7215, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7187, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9205, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4791, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.31% (1.7688 => 1.8097, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.99% (4.1080 => 4.1899, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.91% (1.4298 => 1.4571, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.66% (3.6469 => 3.7076, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.54% (22.5627 => 21.0870, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.65% (1.0460 => 0.8614, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.05% (0.0997 => 0.0837, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2308 => 1.1037, std. dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3162, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9125, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.5089 => 2.4469, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.45% (0.8342 => 0.8138, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.92% (20.3410 => 19.9499, std. dev.: 0.0391) MultiSource/Applications/spiff/spiff: -1.88% (3.0263 => 2.9695, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5103, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9980, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.57% (6.3560 => 6.2565, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.5254 => 2.4894, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2130, std. dev.: 0.0356) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2521, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8043, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8463, std. dev.: 0.0071) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 06:27:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 08:27:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120719132719.82FA12A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2209?compare_to=2207&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2209, Order: 160501, Start Time: 2012-07-19 12:09:13, End Time: 2012-07-19 13:27:34 To: 2207, Order: 160500, Start Time: 2012-07-19 10:22:31, End Time: 2012-07-19 11:41:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (69 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (785 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.64% (10.3673 => 13.8553, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 11.98% (0.3473 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.70% (0.3497 => 0.3906, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.66% (0.3516 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.63% (0.3543 => 0.3955, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.30% (1.1194 => 1.2459, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/for-in: 11.21% (0.3694 => 0.4108, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.79% (0.3828 => 0.4241, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.54% (0.3927 => 0.4341, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.26% (1.7609 => 1.9064, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.06% (2.2022 => 2.3797, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.04% (0.5925 => 0.6283, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.95% (0.6030 => 0.6389, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.53% (0.7326 => 0.7731, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.4879 => 0.5107, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 4.51% (0.3282 => 0.3430, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.49% (7.0540 => 7.3710, std. dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.20% (0.4615 => 0.4809, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.17% (0.8172 => 0.8513, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.58% (5.0018 => 5.1809, std. dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: 3.54% (0.7433 => 0.7696, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (9.4845 => 9.8125, std. dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 3.37% (10.4361 => 10.7874, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.32% (4.9449 => 5.1089, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.20% (0.5569 => 0.5747, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.95% (4.2646 => 4.3906, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.88% (0.5860 => 0.6029, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.88% (8.1363 => 8.3707, std. dev.: 0.0106) MultiSource/Applications/spiff/spiff: 2.67% (0.7835 => 0.8044, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.63% (14.3668 => 14.7447, std. dev.: 0.0119) MultiSource/Applications/hbd/hbd: 2.56% (1.5603 => 1.6002, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.3050 => 1.3369, std. dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.43% (1.1861 => 1.2149, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.39% (0.4636 => 0.4747, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 2.30% (5.7591 => 5.8914, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.25% (1.5415 => 1.5762, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.21% (1.1642 => 1.1899, std. dev.: 0.0067) MultiSource/Applications/d/make_dparser: 2.12% (3.3354 => 3.4062, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 2.06% (2.0273 => 2.0691, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.96% (0.8067 => 0.8225, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.77% (0.9765 => 0.9938, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (2.0665 => 2.1030, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.68% (3.8723 => 3.9372, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: 1.66% (0.6456 => 0.6563, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.63% (2.2024 => 2.2383, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.51% (0.6675 => 0.6776, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.40% (17.1811 => 17.4222, std. dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.32% (1.4186 => 1.4373, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.24% (1.5859 => 1.6055, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.16% (1.2842 => 1.2991, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 1.14% (0.8921 => 0.9023, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9745, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7512, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5366, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 1.79% (3.1578 => 3.2144, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.79% (26.0924 => 26.5591, std. dev.: 0.0115) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8232, std. dev.: 0.0159) SingleSource/Benchmarks/Dhrystone/dry: 1.44% (2.4116 => 2.4463, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6901, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2299, std. dev.: 0.0341) SingleSource/Benchmarks/Misc/oourafft: 1.09% (6.6465 => 6.7192, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1285, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.24% (5.2763 => 3.1530, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.27% (5.3855 => 3.7017, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.96% (5.3526 => 3.6954, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.51% (2.9384 => 2.5414, std. dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: -10.46% (22.1758 => 19.8571, std. dev.: 0.0126) SingleSource/UnitTests/Vector/constpool: -5.38% (54.1659 => 51.2493, std. dev.: 0.0434) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.59% (3.8922 => 3.8303, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.67% (1.2373 => 1.1053, std. dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4870, std. dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4185, std. dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.97% (8.1563 => 7.9144, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0840, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8095, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 07:27:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 09:27:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120719142709.7DD602A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2210?compare_to=2205&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2210, Order: 160501, Start Time: 2012-07-19 11:43:53, End Time: 2012-07-19 14:27:23 To: 2205, Order: 160496, Start Time: 2012-07-19 08:32:21, End Time: 2012-07-19 11:16:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (73 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (819 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 6.24% (0.2259 => 0.2400, std. dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.32% (0.3446 => 0.3905, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.28% (0.3442 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.28% (0.3465 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.27% (0.3488 => 0.3951, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 13.27% (0.3460 => 0.3919, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.19% (0.3496 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.12% (0.3469 => 0.3924, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.82% (0.3650 => 0.4118, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.65% (0.3643 => 0.4104, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.41% (0.3724 => 0.4186, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.52% (0.5826 => 0.6264, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.22% (0.5889 => 0.6314, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.66% (0.7171 => 0.7577, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.52% (3.5627 => 3.7592, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.43% (1.6211 => 1.7092, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.82% (0.4361 => 0.4571, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.45% (0.4994 => 0.5216, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.42% (0.5900 => 0.6161, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.42% (1.3152 => 1.3733, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (2.7292 => 2.8485, std. dev.: 0.0086) MultiSource/Applications/spiff/spiff: 4.29% (0.4029 => 0.4202, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.27% (0.3930 => 0.4098, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.18% (0.5026 => 0.5236, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.14% (0.5000 => 0.5207, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.01% (4.2109 => 4.3799, std. dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: 3.99% (1.5932 => 1.6568, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.93% (0.2725 => 0.2832, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.85% (0.2729 => 0.2834, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.84% (1.0781 => 1.1195, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/random: 3.82% (0.2803 => 0.2910, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.80% (0.2866 => 0.2975, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 3.80% (0.2714 => 0.2817, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.76% (0.2738 => 0.2841, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.63% (0.2780 => 0.2881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.59% (0.3096 => 0.3207, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.56% (0.3258 => 0.3374, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.48% (2.0673 => 2.1393, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.38% (0.9909 => 1.0244, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.38% (1.9694 => 2.0359, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.35% (1.9966 => 2.0634, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 3.31% (0.3267 => 0.3375, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.26% (0.3195 => 0.3299, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.23% (0.3124 => 0.3225, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.21% (0.3362 => 0.3470, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.21% (5.5417 => 5.7196, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (2.1013 => 2.1684, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 3.17% (0.3348 => 0.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3317 => 0.3421, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.13% (0.3678 => 0.3793, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.11% (0.4658 => 0.4803, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.08% (0.3890 => 0.4010, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.06% (0.3625 => 0.3736, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3726 => 0.3839, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 3.01% (0.9697 => 0.9989, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.99% (4.6177 => 4.7558, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.96% (4.4195 => 4.5505, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.95% (0.3903 => 0.4018, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 2.88% (0.3477 => 0.3577, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 2.86% (2.1653 => 2.2273, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3690 => 0.3793, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.3845 => 0.3946, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.58% (0.4146 => 0.4253, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.53% (1.8794 => 1.9269, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4251 => 0.4356, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.46% (0.4139 => 0.4241, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.29% (0.7875 => 0.8055, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 2.25% (1.4269 => 1.4590, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 2.16% (23.5202 => 24.0294, std. dev.: 0.0070) MultiSource/Applications/Burg/burg: 2.07% (0.5546 => 0.5661, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.6435 => 0.6557, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.78% (0.6634 => 0.6752, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.29% (2.8036 => 2.8398, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.97% (2.4764 => 2.3780, std. dev.: 0.0072) MultiSource/Applications/kimwitu++/kc: -1.70% (11.9555 => 11.7518, std. dev.: 0.0130) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 08:32:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 10:32:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120719153231.58CB02A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2211?compare_to=2208&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2211, Order: 160505, Start Time: 2012-07-19 14:18:44, End Time: 2012-07-19 15:32:45 To: 2208, Order: 160501, Start Time: 2012-07-19 12:04:25, End Time: 2012-07-19 13:18:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (132 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (727 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.02% (1.4166 => 1.4021, std. dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.29% (2.0176 => 2.3059, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 9.26% (0.7061 => 0.7715, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.20% (0.5818 => 0.6353, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5748 => 0.6270, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/trivial-interface: 8.61% (0.3578 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.41% (0.3650 => 0.3957, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.39% (0.3601 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.34% (0.3646 => 0.3950, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3789 => 0.4104, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.30% (0.3663 => 0.3967, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3623 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.10% (0.3914 => 0.4231, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.99% (0.4003 => 0.4323, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.94% (0.3940 => 0.4253, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.90% (0.1986 => 0.2123, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 6.66% (1.3693 => 1.4605, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.2721 => 0.2898, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.31% (0.4328 => 0.4601, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.21% (3.9660 => 4.2122, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.15% (0.7710 => 0.8184, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 6.12% (0.7038 => 0.7469, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.98% (0.5265 => 0.5580, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.89% (0.2596 => 0.2749, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.79% (0.2607 => 0.2758, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 5.59% (0.4062 => 0.4289, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3022 => 0.3185, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.33% (0.2628 => 0.2768, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.24% (0.2937 => 0.3091, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.15% (0.4390 => 0.4616, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.11% (1.9828 => 2.0842, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.11% (0.3580 => 0.3763, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.09% (0.2988 => 0.3140, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.04% (0.3489 => 0.3665, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.03% (0.2761 => 0.2900, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.03% (0.2765 => 0.2904, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.02% (0.4379 => 0.4599, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.02% (0.6959 => 0.7308, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.99% (0.2966 => 0.3114, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.99% (0.2726 => 0.2862, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.96% (1.2193 => 1.2798, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.96% (0.3107 => 0.3261, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.79% (13.8202 => 14.4816, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.77% (0.3899 => 0.4085, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.66% (0.9199 => 0.9628, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 4.63% (0.3453 => 0.3613, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.61% (13.2842 => 13.8961, std. dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/ary2: 4.57% (0.3192 => 0.3338, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.41% (0.5577 => 0.5823, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.41% (0.4016 => 0.4193, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.38% (0.2925 => 0.3053, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.34% (0.3756 => 0.3919, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (1.3819 => 1.4417, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 4.32% (16.6129 => 17.3307, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.29% (1.4563 => 1.5188, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.25% (0.3293 => 0.3433, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.24% (0.3534 => 0.3684, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.14% (1.1364 => 1.1834, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.14% (7.2180 => 7.5165, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.13% (1.3813 => 1.4384, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.08% (0.3868 => 0.4026, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.99% (0.5637 => 0.5862, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.94% (0.3246 => 0.3374, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.89% (1.1061 => 1.1491, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.86% (3.8646 => 4.0137, std. dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.84% (0.2914 => 0.3026, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.78% (1.0594 => 1.0994, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.77% (0.7506 => 0.7789, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.2945 => 0.3056, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.75% (1.9270 => 1.9992, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 3.72% (0.8310 => 0.8619, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.3245 => 1.3734, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.50% (0.7460 => 0.7721, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.40% (1.2292 => 1.2710, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.36% (3.6692 => 3.7925, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.35% (4.4433 => 4.5921, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/18-imp/imp: 3.32% (0.3220 => 0.3327, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.31% (4.3801 => 4.5250, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3755 => 0.3873, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.04% (2.1791 => 2.2453, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.01% (0.4791 => 0.4935, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.97% (4.9865 => 5.1344, std. dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.78% (0.8698 => 0.8940, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.78% (1.1333 => 1.1648, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.78% (3.1889 => 3.2774, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.63% (0.6283 => 0.6448, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.52% (16.2614 => 16.6708, std. dev.: 0.0182) MultiSource/Applications/JM/ldecod/ldecod: 2.46% (6.5754 => 6.7373, std. dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: 2.31% (14.5298 => 14.8650, std. dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 2.25% (14.8535 => 15.1870, std. dev.: 0.0153) MultiSource/Benchmarks/mafft/pairlocalalign: 2.23% (8.4961 => 8.6855, std. dev.: 0.0163) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.12% (0.6135 => 0.6265, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.01% (2.1007 => 2.1430, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.74% (3.2742 => 3.3313, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.65% (1.5188 => 1.5438, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 1.61% (4.6629 => 4.7382, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.25% (0.9108 => 0.9222, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.22% (1.8175 => 2.2758, std. dev.: 0.0392) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.48% (2.0200 => 2.1912, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 7.87% (1.2998 => 1.4021, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.71% (1.5824 => 1.7044, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.08% (7.4271 => 7.7302, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 4.06% (11.2619 => 11.7195, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9191, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4794, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.29% (1.7688 => 1.8093, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.77% (3.6469 => 3.7115, std. dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5339, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (1.9290 => 1.9567, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 1.18% (3.1736 => 3.2110, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.53% (22.5627 => 21.0887, std. dev.: 0.0160) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.65% (1.0460 => 0.8614, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.63% (1.2308 => 1.1123, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.49% (1.3780 => 1.3161, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5508, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9125, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4467, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.45% (0.8342 => 0.8138, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.40% (0.4867 => 0.4750, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5062, std. dev.: 0.0046) MultiSource/Applications/spiff/spiff: -1.84% (3.0263 => 2.9707, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9777, std. dev.: 0.0375) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2541, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9981, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8616, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (0.9692 => 0.9562, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8046, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2568, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 08:37:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 10:37:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120719153704.C2CB02A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2212?compare_to=2209&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2212, Order: 160505, Start Time: 2012-07-19 14:18:50, End Time: 2012-07-19 15:37:20 To: 2209, Order: 160501, Start Time: 2012-07-19 12:09:13, End Time: 2012-07-19 13:27:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (73 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (781 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 4.37% (3.7833 => 3.9487, std. dev.: 0.0427) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.69% (54.6109 => 56.6276, std. dev.: 0.0436) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.42% (79.2608 => 80.3871, std. dev.: 0.2253) SingleSource/Benchmarks/Misc/lowercase: 1.27% (7.9468 => 8.0476, std. dev.: 0.0106) SingleSource/Benchmarks/McGill/chomp: 1.09% (1.1053 => 1.1174, std. dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.69% (10.3673 => 13.8598, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3473 => 0.3892, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 11.78% (0.3497 => 0.3909, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 11.69% (0.3516 => 0.3927, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3561 => 0.3976, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.29% (1.1194 => 1.2458, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 11.23% (0.3694 => 0.4109, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.84% (0.3828 => 0.4243, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.70% (0.3927 => 0.4347, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.25% (1.7609 => 1.9062, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.07% (2.2022 => 2.3799, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.13% (0.5925 => 0.6288, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.10% (0.6030 => 0.6398, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.81% (0.2065 => 0.2185, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.56% (0.7326 => 0.7733, std. dev.: 0.0085) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.51% (0.3177 => 0.3352, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.82% (0.4879 => 0.5114, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 4.54% (0.3282 => 0.3431, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.44% (7.0540 => 7.3672, std. dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.40% (0.4615 => 0.4818, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.31% (0.8172 => 0.8524, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 3.73% (0.7433 => 0.7710, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 3.62% (9.4845 => 9.8274, std. dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.61% (0.5569 => 0.5770, std. dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 3.44% (10.4361 => 10.7956, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.44% (4.9449 => 5.1152, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.44% (5.0018 => 5.1737, std. dev.: 0.0076) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.04% (4.2646 => 4.3944, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.00% (0.5860 => 0.6036, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.96% (8.1363 => 8.3774, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 2.96% (0.7835 => 0.8067, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 2.95% (0.3423 => 0.3524, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.70% (1.5603 => 1.6025, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.61% (14.3668 => 14.7412, std. dev.: 0.0168) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.59% (0.4636 => 0.4756, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.51% (1.3050 => 1.3377, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.40% (1.1861 => 1.2146, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.38% (1.5415 => 1.5782, std. dev.: 0.0077) MultiSource/Applications/oggenc/oggenc: 2.32% (5.7591 => 5.8927, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.28% (1.1642 => 1.1908, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.26% (3.3354 => 3.4109, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.17% (0.8067 => 0.8242, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.17% (2.0273 => 2.0712, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.89% (0.9765 => 0.9950, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 1.86% (3.8723 => 3.9442, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.85% (2.0665 => 2.1048, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.71% (0.5981 => 0.6083, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.67% (2.2024 => 2.2391, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 1.64% (0.6456 => 0.6562, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.58% (1.4186 => 1.4410, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.57% (0.6675 => 0.6780, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 1.42% (0.8921 => 0.9048, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.37% (1.5859 => 1.6076, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.34% (17.1811 => 17.4108, std. dev.: 0.0157) MultiSource/Applications/hexxagon/hexxagon: 1.23% (1.2842 => 1.3000, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.05% (1.1840 => 1.1964, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 4.52% (3.7781 => 3.9487, std. dev.: 0.0427) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7593, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.18% (1.0313 => 1.0538, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5086 => 1.5355, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 1.65% (26.0924 => 26.5221, std. dev.: 0.0338) SingleSource/Benchmarks/Shootout-C++/hash2: 1.63% (3.1578 => 3.2093, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 1.57% (11.6436 => 11.8261, std. dev.: 0.0151) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4116 => 2.4465, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.22% (2.6546 => 2.6871, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2252, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/oourafft: 1.14% (6.6465 => 6.7226, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1287, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.20% (5.2763 => 3.1552, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.22% (5.3855 => 3.7040, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.95% (5.3526 => 3.6958, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.59% (2.9384 => 2.5391, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: -10.43% (22.1758 => 19.8622, std. dev.: 0.0131) SingleSource/UnitTests/Vector/constpool: -5.30% (54.1659 => 51.2940, std. dev.: 0.0433) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.63% (3.8922 => 3.8287, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.69% (1.2373 => 1.1174, std. dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4797, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4188, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.89% (8.1563 => 7.9203, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0848, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.24% (1.8329 => 1.8101, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 10:14:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 12:14:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120719171424.637392A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2213?compare_to=2211&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2213, Order: 160507, Start Time: 2012-07-19 16:00:42, End Time: 2012-07-19 17:14:39 To: 2211, Order: 160505, Start Time: 2012-07-19 14:18:44, End Time: 2012-07-19 15:32:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (140 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.55% (2.0176 => 2.3112, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.33% (0.5818 => 0.6361, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.20% (0.5748 => 0.6277, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 8.79% (0.7061 => 0.7682, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 8.66% (0.3578 => 0.3888, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.42% (0.3646 => 0.3953, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.36% (0.3601 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.25% (0.3650 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.16% (0.3663 => 0.3962, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.16% (0.3789 => 0.4098, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.14% (0.3623 => 0.3918, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.99% (0.4003 => 0.4323, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.97% (0.3914 => 0.4226, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.82% (0.3940 => 0.4248, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.80% (0.1986 => 0.2121, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.78% (1.3693 => 1.4622, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (3.9660 => 4.2183, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 6.22% (0.7038 => 0.7476, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4328 => 0.4593, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.11% (0.4062 => 0.4310, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.06% (0.7710 => 0.8177, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.05% (0.2596 => 0.2753, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.93% (0.5265 => 0.5577, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2781 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.29% (0.2760 => 0.2906, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.28% (0.4379 => 0.4610, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.21% (0.2782 => 0.2927, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.20% (1.2193 => 1.2827, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.13% (0.2690 => 0.2828, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.08% (13.8202 => 14.5226, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.06% (0.3022 => 0.3175, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.03% (0.6959 => 0.7309, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.97% (1.9828 => 2.0814, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.97% (0.2655 => 0.2787, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.97% (0.2937 => 0.3083, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.88% (0.2726 => 0.2859, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.84% (0.3489 => 0.3658, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.83% (0.3580 => 0.3753, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.83% (0.9199 => 0.9643, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.82% (1.3813 => 1.4479, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.82% (0.2966 => 0.3109, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.82% (0.2761 => 0.2894, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.75% (0.2696 => 0.2824, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.73% (0.3149 => 0.3298, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3107 => 0.3254, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.70% (13.2842 => 13.9092, std. dev.: 0.0140) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.69% (0.4390 => 0.4596, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.5577 => 0.5838, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.65% (1.3819 => 1.4462, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3899 => 0.4080, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.62% (0.2988 => 0.3126, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.56% (0.3485 => 0.3644, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.49% (1.1364 => 1.1874, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.45% (0.3192 => 0.3334, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.44% (0.2925 => 0.3055, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 4.40% (0.3453 => 0.3605, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.37% (1.4563 => 1.5200, std. dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 4.31% (16.6129 => 17.3296, std. dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.30% (7.2180 => 7.5282, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.29% (0.5637 => 0.5879, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.23% (0.4016 => 0.4186, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.21% (0.8310 => 0.8660, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.15% (0.3756 => 0.3912, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.13% (0.3534 => 0.3680, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3868 => 0.4027, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.07% (0.3293 => 0.3427, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.04% (1.0594 => 1.1022, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.02% (1.3245 => 1.3777, std. dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.02% (0.2914 => 0.3031, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.97% (0.3246 => 0.3375, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.94% (3.8646 => 4.0170, std. dev.: 0.0068) MultiSource/Applications/treecc/treecc: 3.93% (1.9270 => 2.0028, std. dev.: 0.0078) MultiSource/Applications/spiff/spiff: 3.93% (0.7506 => 0.7801, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.87% (0.7460 => 0.7749, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 3.87% (1.1061 => 1.1489, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.64% (3.6692 => 3.8026, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.61% (4.4433 => 4.6035, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.59% (4.3801 => 4.5373, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 3.57% (0.2945 => 0.3050, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3220 => 0.3330, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.38% (0.4791 => 0.4953, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.34% (0.2995 => 0.3095, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.22% (1.2292 => 1.2688, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 3.10% (3.1889 => 3.2877, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 3.05% (2.1791 => 2.2455, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.95% (1.1333 => 1.1667, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.93% (4.9865 => 5.1326, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.93% (0.3755 => 0.3865, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.88% (0.6283 => 0.6464, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.85% (0.8698 => 0.8946, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (6.5754 => 6.7586, std. dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: 2.75% (16.2614 => 16.7092, std. dev.: 0.0148) MultiSource/Benchmarks/mafft/pairlocalalign: 2.73% (8.4961 => 8.7282, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 2.64% (14.8535 => 15.2463, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: 2.60% (0.4113 => 0.4220, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.52% (14.5298 => 14.8963, std. dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.44% (0.6135 => 0.6285, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.27% (2.1007 => 2.1484, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (3.2742 => 3.3457, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 2.06% (4.6629 => 4.7591, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.04% (1.5188 => 1.5498, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (0.9108 => 0.9264, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.23% (1.0313 => 1.0440, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.20% (1.8175 => 2.2755, std. dev.: 0.0459) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.39% (2.0200 => 2.1894, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9996 => 1.0773, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.71% (1.5824 => 1.7044, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 7.39% (1.2998 => 1.3958, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.2619 => 11.7206, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 3.81% (7.4271 => 7.7103, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9868, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9199, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4799, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.16% (1.7688 => 1.8070, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1892, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.86% (1.4298 => 1.4564, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.74% (3.6469 => 3.7102, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (1.9433 => 1.9655, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash2: 1.12% (3.1736 => 3.2092, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.28% (22.5627 => 21.1468, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.64% (1.0460 => 0.8615, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.86% (1.2308 => 1.1094, std. dev.: 0.0084) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3096, std. dev.: 0.0243) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9123, std. dev.: 0.0101) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.42% (0.8342 => 0.8140, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.89% (20.3410 => 19.9570, std. dev.: 0.0426) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5082, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: -1.80% (3.0263 => 2.9717, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2533, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.24% (0.9692 => 0.9572, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2530, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8704, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8042, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2352, std. dev.: 0.0091) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 10:23:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 12:23:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120719172336.D6CE42A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2214?compare_to=2212&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2214, Order: 160507, Start Time: 2012-07-19 16:05:21, End Time: 2012-07-19 17:23:52 To: 2212, Order: 160505, Start Time: 2012-07-19 14:18:50, End Time: 2012-07-19 15:37:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (71 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (784 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.07% (13.8598 => 14.2855, std. dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.32% (1.1174 => 1.1027, std. dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.79% (10.3673 => 14.2855, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/trivial-interface: 12.21% (0.3473 => 0.3897, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3497 => 0.3916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.97% (0.3543 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.93% (0.3561 => 0.3986, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.91% (0.3543 => 0.3965, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.89% (0.3516 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.51% (0.3694 => 0.4119, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.18% (1.1194 => 1.2446, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.01% (0.3886 => 0.4314, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3927 => 0.4355, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.21% (2.2022 => 2.3830, std. dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.13% (1.7609 => 1.9040, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.40% (0.5925 => 0.6304, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.30% (0.6030 => 0.6410, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.81% (0.7326 => 0.7752, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.4879 => 0.5103, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.52% (7.0540 => 7.3726, std. dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.40% (0.4615 => 0.4818, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 4.39% (0.3282 => 0.3426, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.08% (0.7433 => 0.7736, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 4.06% (10.4361 => 10.8599, std. dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.56% (5.0018 => 5.1800, std. dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 3.53% (9.4845 => 9.8193, std. dev.: 0.0135) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.48% (4.9449 => 5.1171, std. dev.: 0.0111) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.36% (4.2646 => 4.4080, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.34% (0.8172 => 0.8445, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.5569 => 0.5755, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.11% (0.4636 => 0.4780, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.11% (0.5860 => 0.6042, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.07% (8.1363 => 8.3864, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.94% (14.3668 => 14.7894, std. dev.: 0.0066) MultiSource/Applications/hbd/hbd: 2.84% (1.5603 => 1.6046, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.83% (1.5415 => 1.5852, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (1.1861 => 1.2195, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: 2.78% (0.7835 => 0.8053, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.63% (1.3050 => 1.3393, std. dev.: 0.0048) MultiSource/Applications/d/make_dparser: 2.58% (3.3354 => 3.4216, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.48% (2.0665 => 2.1178, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.41% (5.7591 => 5.8977, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 2.40% (0.4289 => 0.4392, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.40% (2.0273 => 2.0759, std. dev.: 0.0071) MultiSource/Applications/Burg/burg: 2.35% (1.1642 => 1.1916, std. dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.6456 => 0.6599, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.21% (0.8067 => 0.8245, std. dev.: 0.0035) MultiSource/Applications/lua/lua: 2.04% (3.8723 => 3.9514, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.94% (2.2024 => 2.2451, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.92% (0.9765 => 0.9952, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (0.6675 => 0.6791, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.69% (0.5981 => 0.6082, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.66% (1.2842 => 1.3055, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.65% (17.1811 => 17.4642, std. dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.42% (1.4186 => 1.4388, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 1.39% (0.8921 => 0.9045, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.21% (1.1840 => 1.1983, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 5.74% (1.1277 => 1.1924, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7509, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (1.5086 => 1.5387, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 1.75% (3.1578 => 3.2130, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 1.73% (26.0924 => 26.5425, std. dev.: 0.0180) MultiSource/Benchmarks/nbench/nbench: 1.57% (11.6436 => 11.8261, std. dev.: 0.0162) SingleSource/Benchmarks/Dhrystone/dry: 1.43% (2.4116 => 2.4462, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2364, std. dev.: 0.0299) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6876, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.09% (6.6465 => 6.7191, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.35% (5.2763 => 3.1475, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.34% (5.3855 => 3.6977, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.09% (5.3526 => 3.6885, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.15% (2.9384 => 2.5521, std. dev.: 0.0169) MultiSource/Applications/ClamAV/clamscan: -10.17% (22.1758 => 19.9197, std. dev.: 0.0065) SingleSource/UnitTests/Vector/constpool: -5.18% (54.1659 => 51.3583, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.47% (3.8922 => 3.8348, std. dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.23% (0.0998 => 0.0846, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.88% (1.2373 => 1.1027, std. dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4753, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.12% (8.6802 => 8.4095, std. dev.: 0.0197) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9127, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0860, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 10:38:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 12:38:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120719173828.87E132A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2215?compare_to=2210&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2215, Order: 160505, Start Time: 2012-07-19 14:55:09, End Time: 2012-07-19 17:38:42 To: 2210, Order: 160501, Start Time: 2012-07-19 11:43:53, End Time: 2012-07-19 14:27:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (68 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (824 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.44% (0.3446 => 0.3909, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.36% (0.3442 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.33% (0.3488 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.25% (0.3465 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.19% (0.3496 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.18% (0.3460 => 0.3916, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3469 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.77% (0.3650 => 0.4116, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.71% (0.3643 => 0.4106, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.24% (0.3724 => 0.4180, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.36% (0.5826 => 0.6255, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.17% (0.5889 => 0.6311, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.1620 => 0.1728, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.62% (0.7171 => 0.7574, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.43% (1.6211 => 1.7091, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.42% (3.5627 => 3.7559, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.90% (1.3152 => 1.3796, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.83% (0.5026 => 0.5269, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.75% (0.4994 => 0.5231, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.65% (0.4361 => 0.4564, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.57% (0.2866 => 0.2997, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.54% (0.5900 => 0.6168, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.48% (0.3930 => 0.4106, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.34% (2.7292 => 2.8476, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.26% (0.5000 => 0.5213, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.14% (0.4029 => 0.4196, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 3.94% (1.5932 => 1.6560, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.91% (0.2738 => 0.2845, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 3.87% (0.2714 => 0.2819, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.86% (4.2109 => 4.3734, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: 3.85% (0.2725 => 0.2830, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.79% (0.2875 => 0.2984, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.76% (1.0781 => 1.1186, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2803 => 0.2908, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.52% (2.0673 => 2.1401, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.52% (0.4658 => 0.4822, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 3.52% (0.3096 => 0.3205, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.50% (1.9694 => 2.0383, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.36% (1.9966 => 2.0636, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: 3.35% (0.3258 => 0.3367, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (2.1013 => 2.1714, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 3.32% (0.9909 => 1.0238, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.28% (0.3267 => 0.3374, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.23% (0.3124 => 0.3225, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.22% (0.3195 => 0.3298, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.14% (5.5417 => 5.7155, std. dev.: 0.0146) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.08% (0.3890 => 0.4010, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.06% (0.3362 => 0.3465, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.05% (0.3678 => 0.3790, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.01% (0.3625 => 0.3734, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (4.4195 => 4.5489, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (0.3903 => 0.4016, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.86% (0.9697 => 0.9974, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 2.84% (0.3726 => 0.3832, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.78% (4.6177 => 4.7462, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.76% (0.3690 => 0.3792, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.4146 => 0.4259, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.72% (2.1653 => 2.2242, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.63% (1.8794 => 1.9288, std. dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.60% (0.3845 => 0.3945, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.51% (0.4139 => 0.4243, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.49% (0.4251 => 0.4357, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.22% (0.7875 => 0.8050, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.15% (1.4269 => 1.4576, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 2.14% (23.5202 => 24.0244, std. dev.: 0.0139) MultiSource/Applications/Burg/burg: 2.09% (0.5546 => 0.5662, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.94% (0.6435 => 0.6560, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 1.84% (0.6634 => 0.6756, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.86% (2.4764 => 2.3808, std. dev.: 0.0151) MultiSource/Applications/kimwitu++/kc: -1.73% (11.9555 => 11.7483, std. dev.: 0.0183) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 11:56:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 13:56:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120719185636.1CD7C2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2216?compare_to=2213&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2216, Order: 160512, Start Time: 2012-07-19 17:42:37, End Time: 2012-07-19 18:56:50 To: 2213, Order: 160507, Start Time: 2012-07-19 16:00:42, End Time: 2012-07-19 17:14:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (137 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.26% (79.8167 => 80.8241, std. dev.: 0.3276) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.01% (1.4904 => 1.4753, std. dev.: 0.0052) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.99% (2.0176 => 2.3200, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.37% (0.5818 => 0.6363, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.35% (0.7061 => 0.7721, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.24% (0.5748 => 0.6279, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.83% (0.3578 => 0.3894, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.61% (0.3601 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.45% (0.3646 => 0.3954, std. dev.: 0.0076) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3789 => 0.4107, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3650 => 0.3956, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 8.38% (0.3663 => 0.3970, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.4003 => 0.4328, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.99% (0.3940 => 0.4255, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.35% (1.3693 => 1.4699, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1986 => 0.2122, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (0.4328 => 0.4607, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.44% (3.9660 => 4.2213, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.38% (0.7038 => 0.7487, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.24% (0.2596 => 0.2758, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.20% (0.7710 => 0.8188, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.4062 => 0.4303, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.91% (0.5265 => 0.5576, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.82% (0.2782 => 0.2944, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 5.69% (0.2760 => 0.2917, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.66% (0.3022 => 0.3193, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.58% (0.2937 => 0.3101, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.50% (1.9828 => 2.0919, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.39% (0.3580 => 0.3773, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.36% (0.3489 => 0.3676, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2696 => 0.2839, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.22% (1.2193 => 1.2829, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 5.21% (0.3149 => 0.3313, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.17% (0.4390 => 0.4617, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 5.15% (0.2988 => 0.3142, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.14% (0.3485 => 0.3664, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.12% (0.4379 => 0.4603, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.08% (0.3899 => 0.4097, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 5.08% (0.3192 => 0.3354, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.07% (13.8202 => 14.5206, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.02% (0.6959 => 0.7308, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 4.98% (0.3453 => 0.3625, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.87% (0.9199 => 0.9647, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.72% (13.2842 => 13.9109, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 4.71% (0.3868 => 0.4050, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.69% (1.3819 => 1.4467, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3293 => 0.3447, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.66% (0.4016 => 0.4203, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.66% (1.3813 => 1.4456, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.64% (0.5577 => 0.5836, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3756 => 0.3929, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.49% (16.6129 => 17.3595, std. dev.: 0.0306) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.42% (1.4563 => 1.5206, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.30% (1.1364 => 1.1853, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.29% (7.2180 => 7.5276, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 4.25% (1.0594 => 1.1044, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.20% (0.5637 => 0.5874, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.13% (1.3245 => 1.3792, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 4.13% (0.8310 => 0.8653, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.08% (0.2914 => 0.3033, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.97% (3.8646 => 4.0180, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.94% (0.3246 => 0.3374, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.94% (1.1061 => 1.1497, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 3.91% (1.9270 => 2.0023, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.89% (0.7506 => 0.7798, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.4791 => 0.4972, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.69% (1.2292 => 1.2746, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.69% (3.6692 => 3.8045, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.69% (0.7460 => 0.7735, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.56% (4.4433 => 4.6017, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.55% (4.3801 => 4.5356, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.38% (0.3755 => 0.3882, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.35% (0.3220 => 0.3328, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.29% (0.3131 => 0.3234, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 3.24% (2.1791 => 2.2496, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.21% (4.9865 => 5.1468, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.21% (0.8698 => 0.8977, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.14% (0.6283 => 0.6480, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.02% (1.1333 => 1.1675, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 2.86% (3.1889 => 3.2801, std. dev.: 0.0143) MultiSource/Applications/JM/ldecod/ldecod: 2.82% (6.5754 => 6.7606, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.79% (0.6135 => 0.6306, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.79% (16.2614 => 16.7143, std. dev.: 0.0131) MultiSource/Applications/JM/lencod/lencod: 2.74% (14.8535 => 15.2612, std. dev.: 0.0176) MultiSource/Benchmarks/mafft/pairlocalalign: 2.59% (8.4961 => 8.7161, std. dev.: 0.0109) MultiSource/Applications/ClamAV/clamscan: 2.53% (14.5298 => 14.8980, std. dev.: 0.0058) MultiSource/Benchmarks/McCat/05-eks/eks: 2.46% (0.4113 => 0.4214, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.02% (3.2742 => 3.3402, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.96% (1.5188 => 1.5485, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 1.73% (4.6629 => 4.7436, std. dev.: 0.0128) MultiSource/Applications/lemon/lemon: 1.27% (1.0313 => 1.0444, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.16% (1.8175 => 2.2747, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.59% (2.0200 => 2.1935, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.73% (1.5824 => 1.7047, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 6.18% (1.2998 => 1.3801, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7297, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.2619 => 11.7201, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9209, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (2.8606 => 2.9617, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4787, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.82% (1.9199 => 1.9741, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (4.1080 => 4.1893, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5339, std. dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9594, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.54% (3.6469 => 3.7030, std. dev.: 0.0082) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 1.34% (3.1736 => 3.2160, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.24% (0.8239 => 0.8341, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.14% (22.5627 => 21.1769, std. dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.65% (1.0460 => 0.8614, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.05% (0.0997 => 0.0847, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1106, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3140, std. dev.: 0.0153) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.20% (1.9762 => 1.9130, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4474, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.45% (0.8342 => 0.8138, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -1.85% (3.0263 => 2.9704, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5128, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9775, std. dev.: 0.0393) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2526, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.44% (0.9692 => 0.9552, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2142, std. dev.: 0.0390) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8045, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2572, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 12:10:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 14:10:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120719191005.108F22A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2217?compare_to=2214&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2217, Order: 160512, Start Time: 2012-07-19 17:51:50, End Time: 2012-07-19 19:10:20 To: 2214, Order: 160507, Start Time: 2012-07-19 16:05:21, End Time: 2012-07-19 17:23:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (80 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (774 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.36% (14.2855 => 14.9081, std. dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (10.8599 => 11.1641, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.31% (78.4493 => 80.2627, std. dev.: 0.4097) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -5.64% (1.1924 => 1.1251, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 43.80% (10.3673 => 14.9081, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/trivial-interface: 12.24% (0.3473 => 0.3898, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.04% (0.3497 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.03% (0.3516 => 0.3939, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.97% (0.3543 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.94% (0.3543 => 0.3966, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 11.85% (0.3561 => 0.3983, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/for-in: 11.51% (0.3694 => 0.4119, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.33% (1.1194 => 1.2462, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.15% (0.3828 => 0.4255, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.99% (0.3886 => 0.4313, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.98% (0.3927 => 0.4358, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.61% (2.2022 => 2.3918, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.47% (1.7609 => 1.9101, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.98% (10.4361 => 11.1641, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (0.1622 => 0.1733, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.37% (0.6030 => 0.6414, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.30% (0.5925 => 0.6298, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.91% (0.2065 => 0.2187, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.81% (0.7326 => 0.7752, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.63% (0.3177 => 0.3356, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.93% (7.0540 => 7.4020, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/oourafft: 4.88% (0.3282 => 0.3442, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.59% (0.4615 => 0.4827, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.40% (0.7433 => 0.7760, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.82% (9.4845 => 9.8472, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.78% (5.0018 => 5.1910, std. dev.: 0.0141) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.73% (0.8172 => 0.8477, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.73% (4.9449 => 5.1294, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.59% (4.2646 => 4.4179, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.57% (0.5569 => 0.5768, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.45% (0.5860 => 0.6062, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.23% (8.1363 => 8.3987, std. dev.: 0.0078) MultiSource/Applications/spiff/spiff: 3.14% (0.7835 => 0.8081, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 3.10% (0.3423 => 0.3529, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.02% (0.4636 => 0.4776, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.00% (1.5603 => 1.6071, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (14.3668 => 14.7947, std. dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.85% (1.1861 => 1.2199, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.79% (1.5415 => 1.5845, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.79% (1.3050 => 1.3414, std. dev.: 0.0070) MultiSource/Applications/d/make_dparser: 2.74% (3.3354 => 3.4268, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 2.73% (5.7591 => 5.9166, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.62% (0.5105 => 0.5239, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.62% (1.1642 => 1.1947, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.61% (2.0273 => 2.0803, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 2.61% (0.4289 => 0.4401, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.60% (0.8067 => 0.8277, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6456 => 0.6607, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.31% (2.0665 => 2.1143, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 2.24% (3.8723 => 3.9591, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.23% (0.6675 => 0.6824, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.22% (0.9765 => 0.9982, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (0.4620 => 0.4722, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.06% (1.5859 => 1.6185, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.05% (2.2024 => 2.2475, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.99% (17.1811 => 17.5227, std. dev.: 0.0167) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.84% (0.6450 => 0.6569, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.81% (0.5981 => 0.6089, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.75% (1.4186 => 1.4434, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.71% (1.2842 => 1.3061, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 1.61% (0.8921 => 0.9065, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.49% (1.1840 => 1.2016, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.45% (0.7115 => 0.7218, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.38% (2.2969 => 2.3287, std. dev.: 0.0042) MultiSource/Applications/lemon/lemon: 1.18% (1.0722 => 1.0848, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9749, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7502, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.30% (1.0313 => 1.0550, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (1.5086 => 1.5388, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2158, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.78% (26.0924 => 26.5580, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 1.58% (11.6436 => 11.8277, std. dev.: 0.0121) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6901, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2191, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 1.09% (6.6465 => 6.7191, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.30% (5.2763 => 3.1502, std. dev.: 0.0122) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.07% (5.3855 => 3.7122, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.87% (5.3526 => 3.7000, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.25% (2.9384 => 2.5491, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -10.13% (22.1758 => 19.9283, std. dev.: 0.0050) SingleSource/UnitTests/Vector/constpool: -5.19% (54.1659 => 51.3530, std. dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (3.8922 => 3.8497, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2373 => 1.1077, std. dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4812, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4128, std. dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9148, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0851, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.23% (1.8329 => 1.8103, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3677 => 1.3530, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 13:38:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 15:38:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120719203831.C8E932A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2218?compare_to=2216&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2218, Order: 160519, Start Time: 2012-07-19 19:24:43, End Time: 2012-07-19 20:38:45 To: 2216, Order: 160512, Start Time: 2012-07-19 17:42:37, End Time: 2012-07-19 18:56:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (133 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (724 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.67% (1.3801 => 1.4169, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.29% (54.3627 => 55.6102, std. dev.: 0.4675) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.09% (2.0176 => 2.3220, std. dev.: 0.0113) SingleSource/UnitTests/ObjC++/property-reference-object: 8.49% (0.5818 => 0.6312, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.48% (0.7061 => 0.7660, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.39% (0.5748 => 0.6230, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.29% (0.3578 => 0.3839, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 7.23% (1.3693 => 1.4683, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: 7.11% (0.3601 => 0.3857, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.05% (0.3646 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.99% (0.3789 => 0.4054, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.99% (0.3663 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.93% (0.3623 => 0.3874, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions: 6.90% (0.3914 => 0.4184, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.79% (0.4003 => 0.4275, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.73% (0.3940 => 0.4205, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.4062 => 0.4320, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 6.31% (0.7038 => 0.7482, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.14% (0.2721 => 0.2888, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.04% (0.4390 => 0.4655, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.02% (3.9660 => 4.2048, std. dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.96% (0.5265 => 0.5579, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.94% (0.1986 => 0.2104, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.79% (0.2781 => 0.2942, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.78% (0.7710 => 0.8156, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.78% (0.2596 => 0.2746, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.52% (1.9828 => 2.0922, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.49% (0.3022 => 0.3188, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.46% (0.2782 => 0.2934, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.2607 => 0.2749, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.44% (0.2628 => 0.2771, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.42% (0.2655 => 0.2799, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2690 => 0.2835, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.35% (0.2937 => 0.3094, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.33% (0.2760 => 0.2907, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.28% (0.2726 => 0.2870, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.3107 => 0.3271, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.26% (0.2966 => 0.3122, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.25% (0.2761 => 0.2906, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.24% (0.2765 => 0.2910, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.22% (0.3489 => 0.3671, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.17% (0.3580 => 0.3765, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.14% (0.6959 => 0.7317, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2696 => 0.2834, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.99% (0.3485 => 0.3659, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.92% (0.3899 => 0.4091, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.91% (0.9199 => 0.9651, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.89% (0.3192 => 0.3348, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.2988 => 0.3133, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.75% (13.8202 => 14.4763, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/sieve: 4.69% (0.3453 => 0.3615, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.68% (0.4379 => 0.4584, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.62% (16.6129 => 17.3804, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3293 => 0.3443, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.51% (13.2842 => 13.8839, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.42% (0.3756 => 0.3922, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.38% (0.5577 => 0.5821, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.30% (1.3813 => 1.4407, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 4.29% (0.3868 => 0.4034, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.28% (1.3819 => 1.4410, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.17% (1.1364 => 1.1838, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.09% (1.4563 => 1.5158, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 4.07% (0.2925 => 0.3044, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.01% (1.0594 => 1.1019, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (0.8310 => 0.8642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.97% (0.2945 => 0.3062, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.94% (0.5637 => 0.5859, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 3.78% (0.7506 => 0.7790, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.78% (1.9270 => 1.9998, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 3.77% (3.8646 => 4.0102, std. dev.: 0.0549) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.76% (0.3246 => 0.3368, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.72% (1.2292 => 1.2749, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (1.3245 => 1.3737, std. dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.70% (7.2180 => 7.4853, std. dev.: 0.0827) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.67% (3.6692 => 3.8040, std. dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.57% (0.2914 => 0.3018, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.53% (0.4791 => 0.4960, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.52% (1.1061 => 1.1450, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.42% (0.7460 => 0.7715, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.34% (4.3801 => 4.5266, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.33% (4.9865 => 5.1524, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (4.4433 => 4.5843, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.17% (0.3755 => 0.3874, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.11% (2.1791 => 2.2469, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.95% (0.8698 => 0.8955, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.79% (0.6283 => 0.6458, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.66% (1.1333 => 1.1634, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 2.63% (16.2614 => 16.6893, std. dev.: 0.0324) MultiSource/Applications/d/make_dparser: 2.62% (3.1889 => 3.2725, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.51% (0.6135 => 0.6289, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (6.5754 => 6.7389, std. dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 2.37% (14.5298 => 14.8746, std. dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 2.37% (14.8535 => 15.2051, std. dev.: 0.0120) MultiSource/Benchmarks/mafft/pairlocalalign: 2.26% (8.4961 => 8.6881, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.18% (2.1007 => 2.1465, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.11% (3.2742 => 3.3434, std. dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.88% (1.5188 => 1.5474, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 1.60% (4.6629 => 4.7375, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (0.9108 => 0.9247, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.91% (0.1824 => 0.3537, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.95% (1.8175 => 2.2709, std. dev.: 0.0496) SingleSource/Benchmarks/Misc/mandel-2: 9.01% (1.2998 => 1.4169, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.33% (2.0200 => 2.1882, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9996 => 1.0776, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.72% (1.5824 => 1.7045, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.21% (7.4271 => 7.7400, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7244, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (12.4560 => 12.9221, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4800, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.36% (1.7688 => 1.8106, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (4.1080 => 4.1914, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5089 => 1.5360, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (3.6469 => 3.7092, std. dev.: 0.0071) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.17% (1.9290 => 1.9516, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 1.10% (3.1736 => 3.2085, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.26% (22.5627 => 21.1499, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.05% (0.3511 => 0.3404, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.66% (0.6576 => 0.6467, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.65% (1.0460 => 0.8614, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.42% (1.2308 => 1.1026, std. dev.: 0.0062) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3998, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.86% (1.3780 => 1.3110, std. dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -3.65% (2.6470 => 2.5505, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.22% (1.9762 => 1.9125, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -2.48% (2.5089 => 2.4466, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4867 => 0.4748, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.43% (0.8342 => 0.8139, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -1.86% (3.0263 => 2.9699, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5090, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9766, std. dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2546, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4897, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8624, std. dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2504, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8040, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.09% (0.9692 => 0.9586, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 13:49:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 15:49:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120719204955.B47582A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2219?compare_to=2215&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2219, Order: 160512, Start Time: 2012-07-19 18:06:37, End Time: 2012-07-19 20:50:10 To: 2215, Order: 160505, Start Time: 2012-07-19 14:55:09, End Time: 2012-07-19 17:38:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (45 on baseline) Performance Improvements: 0 (3 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (846 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.29% (124.3031 => 129.6402, std. dev.: 1.0740) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.71% (0.3446 => 0.3884, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3465 => 0.3904, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3442 => 0.3878, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.63% (0.3460 => 0.3897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.61% (0.3496 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.60% (0.3469 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.59% (0.3488 => 0.3927, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.25% (0.3650 => 0.4097, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3643 => 0.4081, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.68% (0.3724 => 0.4159, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.87% (0.5826 => 0.6226, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.66% (0.5889 => 0.6281, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.02% (0.7171 => 0.7531, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.94% (1.6211 => 1.7012, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.74% (3.5627 => 3.7317, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 4.52% (1.5932 => 1.6652, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.40% (0.4361 => 0.4553, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.39% (0.4994 => 0.5213, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.24% (0.5026 => 0.5239, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.22% (0.5900 => 0.6149, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (1.3152 => 1.3685, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.89% (0.3930 => 0.4083, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.78% (0.5000 => 0.5189, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 3.65% (0.4029 => 0.4176, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 3.56% (4.2109 => 4.3606, std. dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.50% (2.7292 => 2.8248, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 3.49% (1.0781 => 1.1157, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.93% (0.3890 => 0.4004, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.86% (0.9909 => 1.0192, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.84% (1.9694 => 2.0254, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.68% (1.9966 => 2.0502, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 2.68% (2.1013 => 2.1576, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.66% (0.4658 => 0.4782, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.63% (5.5417 => 5.6876, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.63% (2.0673 => 2.1217, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.59% (4.6177 => 4.7374, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (4.4195 => 4.5323, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.42% (2.1653 => 2.2177, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 2.16% (1.8794 => 1.9200, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.96% (1.4269 => 1.4549, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.87% (0.7875 => 0.8022, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 1.86% (0.9697 => 0.9877, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.67% (0.6634 => 0.6745, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 1.36% (23.5202 => 23.8412, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.83% (0.2122 => 0.2267, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.65% (2.4764 => 2.3860, std. dev.: 0.0222) MultiSource/Applications/kimwitu++/kc: -2.34% (11.9555 => 11.6758, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (4.6926 => 4.6380, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 13:56:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 15:56:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120719205634.7C0222A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2220?compare_to=2217&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2220, Order: 160520, Start Time: 2012-07-19 19:38:22, End Time: 2012-07-19 20:56:48 To: 2217, Order: 160512, Start Time: 2012-07-19 17:51:50, End Time: 2012-07-19 19:10:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (69 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (785 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -6.09% (14.9081 => 13.9998, std. dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.04% (10.3673 => 13.9998, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (1.1194 => 1.2439, std. dev.: 0.0154) SingleSource/UnitTests/ObjC/trivial-interface: 11.03% (0.3473 => 0.3856, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.75% (0.3497 => 0.3873, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.73% (0.3543 => 0.3923, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.70% (0.3543 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.64% (0.3561 => 0.3940, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 10.58% (0.3516 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.23% (0.3694 => 0.4072, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.16% (0.3927 => 0.4326, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 10.01% (0.3828 => 0.4211, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.78% (0.3886 => 0.4266, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.65% (1.7609 => 1.9133, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.19% (2.2022 => 2.3825, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 6.35% (10.4361 => 11.0993, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.18% (0.2065 => 0.2172, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 5.16% (0.6030 => 0.6341, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 5.15% (0.5925 => 0.6230, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.10% (0.3177 => 0.3339, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 4.75% (0.7326 => 0.7674, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.62% (7.0540 => 7.3800, std. dev.: 0.0335) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.4879 => 0.5092, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 4.30% (0.3282 => 0.3423, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.10% (0.7433 => 0.7738, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.07% (0.4615 => 0.4803, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.38% (0.5860 => 0.6058, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.28% (9.4845 => 9.7957, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.27% (4.9449 => 5.1067, std. dev.: 0.0113) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.25% (5.0018 => 5.1645, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.09% (0.5569 => 0.5741, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.99% (4.2646 => 4.3919, std. dev.: 0.0086) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.97% (0.8172 => 0.8415, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.65% (8.1363 => 8.3517, std. dev.: 0.0100) MultiSource/Applications/spiff/spiff: 2.57% (0.7835 => 0.8036, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 2.56% (5.7591 => 5.9065, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 2.44% (1.5603 => 1.5984, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.42% (0.4636 => 0.4748, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.39% (1.1861 => 1.2145, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.37% (14.3668 => 14.7069, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.36% (1.3050 => 1.3358, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.30% (3.3354 => 3.4120, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.26% (1.5415 => 1.5763, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 2.22% (2.0273 => 2.0724, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 2.16% (1.1642 => 1.1894, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.14% (0.8067 => 0.8240, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.98% (0.5105 => 0.5206, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.83% (3.8723 => 3.9433, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 1.75% (0.6456 => 0.6569, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (0.6675 => 0.6791, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.73% (0.9765 => 0.9934, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.64% (1.5859 => 1.6119, std. dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 1.59% (17.1811 => 17.4542, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.55% (2.0665 => 2.0986, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.30% (1.4186 => 1.4371, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 1.23% (0.8921 => 0.9031, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.08% (1.2842 => 1.2981, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9747, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7518, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.98% (1.5086 => 1.5384, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.77% (26.0924 => 26.5548, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 1.63% (3.1578 => 3.2092, std. dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 1.58% (11.6436 => 11.8273, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4471, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.35% (2.6546 => 2.6904, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2334, std. dev.: 0.0290) SingleSource/Benchmarks/Misc/oourafft: 1.10% (6.6465 => 6.7197, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.60% (5.2763 => 3.1343, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.20% (5.3855 => 3.7053, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7036, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.71% (2.9384 => 2.5356, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -10.22% (22.1758 => 19.9094, std. dev.: 0.0158) SingleSource/UnitTests/Vector/constpool: -5.24% (54.1659 => 51.3265, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.38% (3.8922 => 3.8384, std. dev.: 0.0158) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.03% (0.0998 => 0.0838, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.05% (1.2373 => 1.1130, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4662, std. dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.02% (8.6802 => 8.4181, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.81% (8.1563 => 7.9275, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0847, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8096, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 15:20:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 17:20:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120719222044.7F3502A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2221?compare_to=2218&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2221, Order: 160521, Start Time: 2012-07-19 21:06:48, End Time: 2012-07-19 22:20:54 To: 2218, Order: 160519, Start Time: 2012-07-19 19:24:43, End Time: 2012-07-19 20:38:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (136 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 208.15% (2.9408 => 9.0620, std. dev.: 0.0184) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.84% (1.4169 => 1.3908, std. dev.: 0.0093) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.02% (2.0176 => 2.3207, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.49% (0.5818 => 0.6312, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.33% (0.5748 => 0.6227, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.09% (0.7061 => 0.7632, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.64% (0.3130 => 0.3369, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 7.27% (0.3578 => 0.3838, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.12% (0.3650 => 0.3910, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 7.04% (1.3693 => 1.4657, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 7.00% (0.3601 => 0.3853, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.99% (0.3789 => 0.4054, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3663 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.94% (0.3646 => 0.3899, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.90% (0.3623 => 0.3873, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.90% (0.3914 => 0.4184, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.74% (0.4003 => 0.4273, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.62% (0.3940 => 0.4201, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.39% (0.2596 => 0.2762, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.30% (0.4062 => 0.4318, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 6.26% (0.4328 => 0.4599, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.18% (0.7038 => 0.7473, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.14% (0.2721 => 0.2888, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.09% (0.1986 => 0.2107, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.99% (3.9660 => 4.2035, std. dev.: 0.0044) SingleSource/Regression/C++/ofstream_ctor: 5.86% (0.2781 => 0.2944, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.79% (0.5265 => 0.5570, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.69% (0.7710 => 0.8149, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.52% (1.9828 => 2.0922, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.50% (0.2782 => 0.2935, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.49% (0.3022 => 0.3188, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.41% (0.2607 => 0.2748, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2690 => 0.2835, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.34% (0.3580 => 0.3771, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.33% (0.2628 => 0.2768, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.33% (0.2760 => 0.2907, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.32% (0.2761 => 0.2908, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.32% (0.2726 => 0.2871, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.32% (0.2765 => 0.2912, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.30% (0.3489 => 0.3674, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2966 => 0.3123, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.21% (0.3107 => 0.3269, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.18% (0.3899 => 0.4101, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.14% (0.6959 => 0.7317, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2696 => 0.2833, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.05% (0.3485 => 0.3661, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.05% (0.3149 => 0.3308, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.93% (1.2193 => 1.2794, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 4.90% (0.3534 => 0.3707, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.89% (0.2988 => 0.3134, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: 4.86% (0.3192 => 0.3347, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.78% (0.4390 => 0.4600, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 4.77% (13.8202 => 14.4794, std. dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.75% (0.4379 => 0.4587, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.72% (0.3453 => 0.3616, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.71% (0.9199 => 0.9632, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 4.56% (16.6129 => 17.3710, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.51% (13.2842 => 13.8839, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (1.3813 => 1.4432, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: 4.46% (0.3293 => 0.3440, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.39% (0.3756 => 0.3921, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.38% (0.5577 => 0.5821, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 4.34% (0.3868 => 0.4036, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.31% (1.3819 => 1.4414, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.20% (0.5637 => 0.5874, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.10% (1.4563 => 1.5160, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.06% (1.1364 => 1.1825, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2945 => 0.3064, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.03% (0.2925 => 0.3043, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.02% (1.0594 => 1.1020, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 4.02% (0.8310 => 0.8644, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.91% (1.1061 => 1.1494, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.84% (0.7506 => 0.7794, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.80% (7.2180 => 7.4921, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 3.78% (3.8646 => 4.0108, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 3.77% (1.9270 => 1.9997, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.77% (1.3245 => 1.3744, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.73% (0.3246 => 0.3367, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.62% (0.7460 => 0.7730, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.51% (1.2292 => 1.2724, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.46% (0.4791 => 0.4957, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.35% (3.6692 => 3.7920, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.30% (4.9865 => 5.1510, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 3.26% (0.3131 => 0.3233, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.25% (0.3755 => 0.3877, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.25% (4.3801 => 4.5223, std. dev.: 0.0058) MultiSource/Applications/siod/siod: 3.13% (2.1791 => 2.2474, std. dev.: 0.0157) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.11% (4.4433 => 4.5813, std. dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.97% (0.8698 => 0.8956, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.72% (0.6283 => 0.6454, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.70% (1.1333 => 1.1639, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.65% (3.1889 => 3.2734, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.65% (16.2614 => 16.6921, std. dev.: 0.0171) MultiSource/Applications/JM/ldecod/ldecod: 2.51% (6.5754 => 6.7403, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.48% (0.6135 => 0.6287, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 2.42% (14.8535 => 15.2132, std. dev.: 0.0151) MultiSource/Benchmarks/mafft/pairlocalalign: 2.32% (8.4961 => 8.6930, std. dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: 2.23% (14.5298 => 14.8538, std. dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.21% (2.1007 => 2.1471, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (3.2742 => 3.3396, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.80% (1.5188 => 1.5461, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 1.61% (4.6629 => 4.7381, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (0.9108 => 0.9247, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.02% (0.1824 => 0.3539, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.68% (1.8175 => 2.2843, std. dev.: 0.0439) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.50% (2.0200 => 2.1918, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9996 => 1.0779, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.71% (1.5824 => 1.7044, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 7.00% (1.2998 => 1.3908, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.06% (11.2619 => 11.7186, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.4271 => 7.7250, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9210, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4796, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.82% (1.9199 => 1.9740, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0310 => 1.0556, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.31% (1.7688 => 1.8096, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1908, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5351, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.67% (3.6469 => 3.7077, std. dev.: 0.0041) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0070) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9660, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 1.16% (3.1736 => 3.2105, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.24% (22.5627 => 21.1557, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.05% (0.3511 => 0.3404, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.54% (0.6576 => 0.6475, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.65% (1.0460 => 0.8614, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.64% (1.2308 => 1.1122, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.78% (1.3780 => 1.3121, std. dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.62% (2.6470 => 2.5511, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -3.16% (1.9762 => 1.9138, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.5089 => 2.4474, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.43% (0.8342 => 0.8139, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.36% (0.4867 => 0.4752, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.03% (20.3410 => 19.9274, std. dev.: 0.0417) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5066, std. dev.: 0.0043) MultiSource/Applications/spiff/spiff: -1.78% (3.0263 => 2.9725, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9983, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2574, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.49% (2.5254 => 2.4878, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.46% (9.3358 => 9.1991, std. dev.: 0.0141) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (0.9692 => 0.9558, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8634, std. dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2535, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8047, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 5.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 15:43:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 17:43:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120719224308.1A8722A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2222?compare_to=2220&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2222, Order: 160521, Start Time: 2012-07-19 21:25:01, End Time: 2012-07-19 22:43:23 To: 2220, Order: 160520, Start Time: 2012-07-19 19:38:22, End Time: 2012-07-19 20:56:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (67 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (787 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.01% (78.4013 => 79.9749, std. dev.: 0.4619) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.97% (10.3673 => 13.9926, std. dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.19% (1.1194 => 1.2447, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.91% (0.3473 => 0.3852, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.84% (0.3516 => 0.3897, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.72% (0.3497 => 0.3872, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.64% (0.3543 => 0.3920, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.61% (0.3561 => 0.3939, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.58% (0.3543 => 0.3918, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.18% (0.3694 => 0.4070, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.93% (0.3886 => 0.4272, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.93% (0.3828 => 0.4208, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.85% (0.3927 => 0.4314, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.54% (0.3817 => 0.4181, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.69% (1.7609 => 1.9140, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.25% (2.2022 => 2.3838, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 6.11% (10.4361 => 11.0741, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference-object: 5.24% (0.6030 => 0.6346, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.22% (0.5925 => 0.6234, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.13% (0.2065 => 0.2171, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.07% (0.3177 => 0.3338, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 4.87% (0.7326 => 0.7683, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.62% (7.0540 => 7.3799, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.39% (0.4879 => 0.5093, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.27% (0.3282 => 0.3422, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.08% (0.7433 => 0.7736, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.01% (0.4615 => 0.4800, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.81% (0.8172 => 0.8483, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.35% (5.0018 => 5.1695, std. dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (9.4845 => 9.8016, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.29% (4.9449 => 5.1078, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.09% (0.5569 => 0.5741, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.02% (0.5860 => 0.6037, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.86% (4.2646 => 4.3864, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.68% (8.1363 => 8.3543, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.63% (14.3668 => 14.7446, std. dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 2.59% (5.7591 => 5.9080, std. dev.: 0.0065) MultiSource/Applications/spiff/spiff: 2.49% (0.7835 => 0.8030, std. dev.: 0.0037) MultiSource/Applications/hbd/hbd: 2.40% (1.5603 => 1.5978, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.34% (1.3050 => 1.3356, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 2.34% (3.3354 => 3.4134, std. dev.: 0.0134) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.29% (0.4636 => 0.4742, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.21% (0.8067 => 0.8245, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.21% (1.5415 => 1.5755, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.10% (2.0273 => 2.0698, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.02% (0.5105 => 0.5208, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.01% (1.1642 => 1.1876, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.90% (0.9765 => 0.9951, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 1.85% (3.8723 => 3.9441, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.75% (2.2024 => 2.2410, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.64% (17.1811 => 17.4624, std. dev.: 0.0278) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.58% (2.0665 => 2.0992, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.56% (1.5859 => 1.6106, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 1.29% (0.8921 => 0.9036, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.09% (1.2842 => 1.2982, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 1.01% (2.2969 => 2.3202, std. dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (2.6778 => 2.9749, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.13% (3.6395 => 3.7533, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.83% (3.1578 => 3.2156, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.57% (11.6436 => 11.8267, std. dev.: 0.0147) MultiSource/Applications/lua/lua: 1.53% (26.0924 => 26.4904, std. dev.: 0.0371) SingleSource/Benchmarks/Dhrystone/dry: 1.47% (2.4116 => 2.4470, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6878, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.13% (6.6465 => 6.7213, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.09% (9.1159 => 9.2149, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.59% (5.2763 => 3.1347, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.19% (5.3855 => 3.7060, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.80% (5.3526 => 3.7040, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.69% (2.9384 => 2.5360, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -10.35% (22.1758 => 19.8816, std. dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -5.31% (54.1659 => 51.2889, std. dev.: 0.0492) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.38% (3.8922 => 3.8384, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.72% (1.2373 => 1.1047, std. dev.: 0.0087) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4747, std. dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.16% (8.6802 => 8.4056, std. dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (8.1563 => 7.9165, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0825, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.19% (1.8329 => 1.8111, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 17:01:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 19:01:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120720000127.BE0272A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2223?compare_to=2219&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2223, Order: 160521, Start Time: 2012-07-19 21:18:00, End Time: 2012-07-20 00:01:42 To: 2219, Order: 160512, Start Time: 2012-07-19 18:06:37, End Time: 2012-07-19 20:50:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (45 on baseline) Performance Improvements: 0 (2 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (847 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3465 => 0.3869, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.64% (0.3446 => 0.3847, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.58% (0.3496 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.56% (0.3460 => 0.3860, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.53% (0.3442 => 0.3839, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.53% (0.3488 => 0.3890, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.44% (0.3469 => 0.3866, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.18% (0.3650 => 0.4058, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.98% (0.3643 => 0.4043, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/parameter-passing: 10.71% (0.3724 => 0.4123, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.65% (0.3792 => 0.4044, std. dev.: 0.0073) SingleSource/UnitTests/ObjC++/Hello: 5.82% (0.5826 => 0.6165, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.60% (0.5889 => 0.6219, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.68% (1.5932 => 1.6677, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.62% (0.5026 => 0.5258, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.53% (0.4994 => 0.5220, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.39% (1.6211 => 1.6923, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.31% (3.5627 => 3.7164, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 4.28% (0.7171 => 0.7478, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (1.3152 => 1.3653, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.78% (0.4361 => 0.4526, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.73% (0.5900 => 0.6120, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.58% (0.5000 => 0.5179, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.44% (0.3930 => 0.4065, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 3.35% (4.2109 => 4.3521, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 3.33% (0.4029 => 0.4163, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.24% (1.0781 => 1.1130, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.17% (2.7292 => 2.8157, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.65% (1.9694 => 2.0215, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.62% (0.3890 => 0.3992, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 2.61% (2.1013 => 2.1561, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.60% (0.4658 => 0.4779, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.55% (1.9966 => 2.0476, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.53% (2.0673 => 2.1197, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 2.47% (5.5417 => 5.6788, std. dev.: 0.0128) MultiSource/Applications/hexxagon/hexxagon: 2.43% (0.9909 => 1.0150, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.41% (4.4195 => 4.5259, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 2.06% (4.6177 => 4.7130, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 2.04% (1.8794 => 1.9177, std. dev.: 0.0097) MultiSource/Applications/JM/ldecod/ldecod: 2.03% (2.1653 => 2.2092, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 1.93% (0.9697 => 0.9884, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.85% (0.6634 => 0.6757, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 1.83% (23.5202 => 23.9504, std. dev.: 0.0152) MultiSource/Applications/treecc/treecc: 1.73% (0.7875 => 0.8011, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.63% (1.4269 => 1.4502, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.42% (0.4253 => 0.4150, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -2.16% (11.9555 => 11.6976, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 17:02:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 19:02:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120720000252.14CF02A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2224?compare_to=2221&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2224, Order: 160525, Start Time: 2012-07-19 22:49:01, End Time: 2012-07-20 00:03:04 To: 2221, Order: 160521, Start Time: 2012-07-19 21:06:48, End Time: 2012-07-19 22:20:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (135 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (722 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.21% (79.3141 => 80.2708, std. dev.: 0.3344) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.05% (55.7062 => 56.2918, std. dev.: 0.1547) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.06% (2.0176 => 2.3215, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 8.65% (0.7061 => 0.7672, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.56% (0.5818 => 0.6316, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.30% (0.5748 => 0.6225, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.27% (0.3578 => 0.3838, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.05% (0.3601 => 0.3855, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.02% (0.3646 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.99% (0.3789 => 0.4054, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.99% (1.3693 => 1.4650, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3663 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.93% (0.3650 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.87% (0.3623 => 0.3872, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.82% (0.3914 => 0.4181, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.77% (0.4003 => 0.4274, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.62% (0.3940 => 0.4201, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.34% (0.7038 => 0.7484, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 6.26% (0.4328 => 0.4599, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.2721 => 0.2891, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.09% (0.1986 => 0.2107, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.99% (3.9660 => 4.2036, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.87% (0.5265 => 0.5574, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 5.86% (0.2781 => 0.2944, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 5.86% (0.4062 => 0.4300, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.80% (0.7710 => 0.8157, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.74% (0.2596 => 0.2745, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.62% (1.9828 => 2.0942, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2782 => 0.2937, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.56% (0.3022 => 0.3190, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.48% (0.2628 => 0.2772, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.41% (0.2607 => 0.2748, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.39% (0.2726 => 0.2873, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2690 => 0.2835, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.38% (0.2937 => 0.3095, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.35% (0.2655 => 0.2797, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.30% (0.3489 => 0.3674, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/except: 5.29% (0.2760 => 0.2906, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.29% (0.2761 => 0.2907, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.28% (0.2765 => 0.2911, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.19% (0.3485 => 0.3666, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.14% (0.3149 => 0.3311, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.14% (0.3580 => 0.3764, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2696 => 0.2833, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.92% (0.3899 => 0.4091, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.89% (0.2988 => 0.3134, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.87% (0.6959 => 0.7298, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.87% (1.4563 => 1.5272, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.81% (1.2193 => 1.2779, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.75% (13.8202 => 14.4773, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/lists1: 4.73% (0.3534 => 0.3701, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.67% (16.6129 => 17.3895, std. dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.67% (0.4390 => 0.4595, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.65% (0.9199 => 0.9627, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.64% (0.4379 => 0.4582, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.53% (0.4016 => 0.4198, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (1.3813 => 1.4432, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.47% (13.2842 => 13.8774, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/lists: 4.46% (0.3293 => 0.3440, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.42% (0.3756 => 0.3922, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.41% (0.5577 => 0.5823, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (1.3819 => 1.4417, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.17% (1.1364 => 1.1838, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.10% (0.5637 => 0.5868, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.03% (1.0594 => 1.1021, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 3.97% (0.8310 => 0.8640, std. dev.: 0.0112) MultiSource/Benchmarks/McCat/09-vor/vor: 3.97% (0.2925 => 0.3041, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 3.94% (0.2945 => 0.3061, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.82% (0.3246 => 0.3370, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.72% (1.1061 => 1.1472, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.71% (7.2180 => 7.4861, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (1.3245 => 1.3736, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.67% (0.2914 => 0.3021, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.57% (3.8646 => 4.0026, std. dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.57% (0.4791 => 0.4962, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.55% (0.7460 => 0.7725, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.54% (1.2292 => 1.2727, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.53% (1.9270 => 1.9951, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.45% (0.7506 => 0.7765, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.39% (3.6692 => 3.7935, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.28% (4.3801 => 4.5237, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.23% (4.9865 => 5.1475, std. dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.22% (0.3755 => 0.3876, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.06% (4.4433 => 4.5794, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.00% (0.8698 => 0.8959, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.88% (0.6283 => 0.6464, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.87% (2.1791 => 2.2416, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 2.69% (16.2614 => 16.6984, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 2.66% (3.1889 => 3.2737, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.61% (1.1333 => 1.1629, std. dev.: 0.0104) MultiSource/Applications/JM/ldecod/ldecod: 2.41% (6.5754 => 6.7338, std. dev.: 0.0098) MultiSource/Applications/JM/lencod/lencod: 2.40% (14.8535 => 15.2107, std. dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.27% (0.6135 => 0.6274, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 2.25% (14.5298 => 14.8568, std. dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 2.24% (8.4961 => 8.6868, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.14% (2.1007 => 2.1457, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.96% (3.2742 => 3.3383, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.85% (1.5188 => 1.5469, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (0.9108 => 0.9247, std. dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 1.52% (4.6629 => 4.7339, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 24.95% (1.8175 => 2.2710, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.46% (2.0200 => 2.1909, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.16% (0.9996 => 1.0812, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.70% (1.5824 => 1.7042, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 7.53% (1.2998 => 1.3977, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.2619 => 11.7199, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.93% (7.4271 => 7.7192, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (12.4560 => 12.9207, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9618, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4806, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.31% (1.7688 => 1.8096, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.02% (4.1080 => 4.1910, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5339, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.56% (3.6469 => 3.7039, std. dev.: 0.0066) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash2: 1.37% (3.1736 => 3.2171, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9660, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: 1.04% (1.9290 => 1.9491, std. dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.5627 => 21.1402, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.05% (0.3511 => 0.3404, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.69% (0.6576 => 0.6465, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.66% (1.0460 => 0.8613, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.61% (1.2308 => 1.1125, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.4000, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.78% (1.3780 => 1.3122, std. dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -3.64% (2.6470 => 2.5507, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.21% (1.9762 => 1.9127, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.43% (0.8342 => 0.8139, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -2.42% (2.5089 => 2.4481, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.38% (20.3410 => 19.8560, std. dev.: 0.0532) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.38% (0.4867 => 0.4751, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5080, std. dev.: 0.0070) MultiSource/Applications/spiff/spiff: -1.84% (3.0263 => 2.9707, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2533, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9979, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.49% (0.9692 => 0.9548, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (9.9194 => 9.8038, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2587, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 17:31:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 19:31:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120720003110.B29182A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2225?compare_to=2222&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2225, Order: 160529, Start Time: 2012-07-19 23:12:49, End Time: 2012-07-20 00:31:22 To: 2222, Order: 160521, Start Time: 2012-07-19 21:25:01, End Time: 2012-07-19 22:43:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (84 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (770 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.48% (2.0992 => 2.1302, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.02% (1.1047 => 1.1160, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.53% (13.9926 => 13.7781, std. dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.90% (10.3673 => 13.7781, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 11.46% (0.3473 => 0.3871, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.32% (0.3543 => 0.3944, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.22% (1.1194 => 1.2450, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.18% (0.3516 => 0.3909, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.18% (0.3543 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3561 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.75% (0.3694 => 0.4091, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.37% (0.3828 => 0.4225, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.31% (0.3927 => 0.4332, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.27% (0.3886 => 0.4285, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.17% (1.7609 => 1.9048, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.16% (2.2022 => 2.3819, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.14% (10.4361 => 11.0769, std. dev.: 0.0095) SingleSource/UnitTests/ObjC++/property-reference-object: 6.07% (0.6030 => 0.6396, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.04% (0.5925 => 0.6283, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.58% (0.7326 => 0.7735, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.38% (0.3177 => 0.3348, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.49% (0.4615 => 0.4822, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 4.39% (0.3282 => 0.3426, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.38% (7.0540 => 7.3631, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.4879 => 0.5092, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.28% (0.8172 => 0.8522, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 4.22% (0.7433 => 0.7747, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.66% (0.5569 => 0.5773, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 3.47% (9.4845 => 9.8138, std. dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (0.4636 => 0.4796, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.40% (4.9449 => 5.1128, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.37% (5.0018 => 5.1703, std. dev.: 0.0071) MultiSource/Applications/hbd/hbd: 3.29% (1.5603 => 1.6116, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.22% (0.4289 => 0.4427, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.21% (4.2646 => 4.4014, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: 3.12% (0.3232 => 0.3333, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.11% (0.5860 => 0.6042, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.08% (2.0665 => 2.1302, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.04% (0.3423 => 0.3527, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.01% (8.1363 => 8.3808, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.95% (0.3865 => 0.3979, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.91% (0.7835 => 0.8063, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/sieve: 2.83% (0.3603 => 0.3705, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.80% (0.4103 => 0.4218, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.80% (0.3935 => 0.4045, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (14.3668 => 14.7616, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.74% (0.3826 => 0.3931, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.70% (1.1861 => 1.2181, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.65% (0.6456 => 0.6627, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.60% (1.5415 => 1.5816, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.3050 => 1.3387, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.55% (0.4203 => 0.4310, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.51% (0.4620 => 0.4736, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.50% (5.7591 => 5.9033, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.50% (1.1642 => 1.1933, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.43% (2.0273 => 2.0765, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 2.40% (3.3354 => 3.4153, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.33% (0.8067 => 0.8255, std. dev.: 0.0045) MultiSource/Applications/lua/lua: 2.12% (3.8723 => 3.9544, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.10% (0.5105 => 0.5212, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.08% (1.2842 => 1.3109, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.06% (0.9765 => 0.9966, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.01% (0.6675 => 0.6809, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.97% (2.2024 => 2.2457, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.83% (0.6450 => 0.6568, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.76% (0.5981 => 0.6086, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.73% (1.5859 => 1.6133, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 1.66% (0.8921 => 0.9069, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.63% (1.4186 => 1.4417, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 1.54% (17.1811 => 17.4463, std. dev.: 0.0177) MultiSource/Applications/siod/siod: 1.39% (2.2969 => 2.3288, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 1.13% (1.1840 => 1.1974, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7541, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0313 => 1.0566, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.81% (26.0924 => 26.5651, std. dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/hash2: 1.68% (3.1578 => 3.2108, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.57% (11.6436 => 11.8266, std. dev.: 0.0170) SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4469, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.38% (2.6546 => 2.6913, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.15% (9.1159 => 9.2207, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/oourafft: 1.07% (6.6465 => 6.7173, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.60% (5.2763 => 3.1342, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.27% (5.3855 => 3.7012, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.01% (5.3526 => 3.6926, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.66% (2.9384 => 2.5371, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.42% (22.1758 => 19.8644, std. dev.: 0.0126) SingleSource/UnitTests/Vector/constpool: -5.26% (54.1659 => 51.3147, std. dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.31% (3.8922 => 3.8412, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.53% (0.0998 => 0.0843, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.80% (1.2373 => 1.1160, std. dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4805, std. dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4132, std. dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.77% (8.1563 => 7.9306, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0844, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.23% (1.8329 => 1.8103, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 18:46:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 20:46:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120720014637.946302A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2226?compare_to=2224&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2226, Order: 160532, Start Time: 2012-07-20 00:32:47, End Time: 2012-07-20 01:46:51 To: 2224, Order: 160525, Start Time: 2012-07-19 22:49:01, End Time: 2012-07-20 00:03:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (136 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (723 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.61% (2.0176 => 2.3124, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.47% (0.5818 => 0.6369, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.35% (0.7061 => 0.7721, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.20% (0.5748 => 0.6277, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.89% (0.3578 => 0.3896, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.88% (0.3650 => 0.3974, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 8.69% (0.3601 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.67% (0.3646 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.57% (0.3663 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.47% (0.3623 => 0.3930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.47% (0.3789 => 0.4110, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.30% (0.3914 => 0.4239, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.19% (0.4003 => 0.4331, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.12% (0.3940 => 0.4260, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.15% (0.1986 => 0.2128, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.62% (1.3693 => 1.4599, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.32% (0.2721 => 0.2893, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.29% (0.7710 => 0.8195, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (3.9660 => 4.2139, std. dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: 6.21% (0.7038 => 0.7475, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4328 => 0.4596, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.05% (0.2596 => 0.2753, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.02% (0.5265 => 0.5582, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 5.75% (0.2781 => 0.2941, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.54% (0.2782 => 0.2936, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.43% (0.2690 => 0.2836, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.37% (0.2607 => 0.2747, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.33% (0.3022 => 0.3183, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.31% (0.4390 => 0.4623, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.31% (1.9828 => 2.0880, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/except: 5.29% (0.2760 => 0.2906, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.27% (0.6959 => 0.7326, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.27% (0.2655 => 0.2795, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2628 => 0.2766, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.24% (0.2937 => 0.3091, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.17% (0.2726 => 0.2867, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.17% (0.2765 => 0.2908, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.15% (0.3107 => 0.3267, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.14% (0.2761 => 0.2903, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.13% (1.2193 => 1.2819, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.10% (0.3489 => 0.3667, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2696 => 0.2833, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.06% (0.5577 => 0.5859, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4379 => 0.4600, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.02% (0.3149 => 0.3307, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.96% (0.2966 => 0.3113, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.92% (0.3899 => 0.4091, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 4.92% (13.8202 => 14.5005, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/ary2: 4.92% (0.3192 => 0.3349, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.89% (0.2988 => 0.3134, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.85% (0.3485 => 0.3654, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.82% (0.9199 => 0.9642, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.66% (0.3453 => 0.3614, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.63% (16.6129 => 17.3818, std. dev.: 0.0229) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.50% (0.3534 => 0.3693, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.48% (13.2842 => 13.8789, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.41% (1.3819 => 1.4428, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 4.40% (0.3293 => 0.3438, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.3813 => 1.4420, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.37% (0.3756 => 0.3920, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.36% (0.4016 => 0.4191, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 4.32% (0.3868 => 0.4035, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.27% (1.4563 => 1.5185, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.22% (1.1364 => 1.1844, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.22% (0.5637 => 0.5875, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.16% (7.2180 => 7.5185, std. dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.05% (0.2914 => 0.3032, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.99% (1.0594 => 1.1017, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: 3.96% (0.7506 => 0.7803, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.96% (1.3245 => 1.3769, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.95% (1.1061 => 1.1498, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.91% (0.3246 => 0.3373, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.87% (3.8646 => 4.0143, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 3.86% (0.8310 => 0.8631, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.84% (1.9270 => 2.0010, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 3.84% (0.2945 => 0.3058, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.77% (0.7460 => 0.7741, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.47% (3.6692 => 3.7965, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.44% (4.3801 => 4.5309, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 3.42% (1.2292 => 1.2712, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.38% (0.4791 => 0.4953, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.35% (4.4433 => 4.5922, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/18-imp/imp: 3.29% (0.3220 => 0.3326, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.23% (2.1791 => 2.2494, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.12% (0.3755 => 0.3872, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.06% (4.9865 => 5.1392, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.88% (1.1333 => 1.1659, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.87% (0.8698 => 0.8948, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.79% (0.6283 => 0.6458, std. dev.: 0.0040) MultiSource/Applications/d/make_dparser: 2.70% (3.1889 => 3.2749, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.51% (0.6135 => 0.6289, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.46% (6.5754 => 6.7372, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.41% (16.2614 => 16.6533, std. dev.: 0.0068) MultiSource/Applications/JM/lencod/lencod: 2.35% (14.8535 => 15.2029, std. dev.: 0.0159) MultiSource/Benchmarks/mafft/pairlocalalign: 2.29% (8.4961 => 8.6910, std. dev.: 0.0124) MultiSource/Applications/ClamAV/clamscan: 2.20% (14.5298 => 14.8496, std. dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.17% (2.1007 => 2.1463, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.95% (1.5188 => 1.5484, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.88% (3.2742 => 3.3356, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 1.69% (4.6629 => 4.7418, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (0.9108 => 0.9243, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.97% (0.1824 => 0.3538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.89% (1.8175 => 2.2881, std. dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/recursive: 8.58% (2.0200 => 2.1934, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9996 => 1.0775, std. dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.72% (1.5824 => 1.7045, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.09% (1.2998 => 1.3919, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.4271 => 7.7296, std. dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.2619 => 11.7205, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.72% (12.4560 => 12.9195, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (2.8606 => 2.9619, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4782, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.19% (1.7688 => 1.8075, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.01% (4.1080 => 4.1906, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.84% (3.6469 => 3.7140, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5354, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1937, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.27% (3.1736 => 3.2138, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.16% (1.9290 => 1.9514, std. dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.57% (22.5627 => 21.0805, std. dev.: 0.0220) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.66% (1.0460 => 0.8613, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.80% (1.2308 => 1.1102, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (5.7573 => 5.3999, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3070, std. dev.: 0.0057) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -3.63% (2.6470 => 2.5509, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.17% (1.9762 => 1.9135, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -2.50% (2.5089 => 2.4462, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.46% (0.8342 => 0.8137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.34% (0.4867 => 0.4753, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.87% (3.0263 => 2.9696, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5097, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.63% (20.3410 => 20.0101, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2530, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.60% (2.5254 => 2.4851, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (7.1097 => 6.9978, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2155, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.28% (0.9692 => 0.9568, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (9.9194 => 9.8040, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2586, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 19:17:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 21:17:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120720021742.BABD22A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2227?compare_to=2225&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2227, Order: 160532, Start Time: 2012-07-20 00:59:24, End Time: 2012-07-20 02:17:57 To: 2225, Order: 160529, Start Time: 2012-07-19 23:12:49, End Time: 2012-07-20 00:31:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (69 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (785 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.35% (54.8353 => 56.6699, std. dev.: 0.0516) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.00% (10.3673 => 13.8920, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 11.69% (0.3473 => 0.3879, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.50% (0.3497 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.43% (0.3516 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.43% (0.3543 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.37% (0.3543 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.32% (0.3561 => 0.3964, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.24% (1.1194 => 1.2452, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 10.88% (0.3694 => 0.4096, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.45% (0.3886 => 0.4292, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.06% (1.7609 => 1.9204, std. dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.07% (2.2022 => 2.3799, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.96% (0.5925 => 0.6278, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.88% (10.4361 => 11.0496, std. dev.: 0.0198) SingleSource/UnitTests/ObjC++/property-reference-object: 5.77% (0.6030 => 0.6378, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2065 => 0.2180, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.32% (0.7326 => 0.7716, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.32% (0.3177 => 0.3346, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.49% (0.4879 => 0.5098, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.34% (7.0540 => 7.3601, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/oourafft: 4.27% (0.3282 => 0.3422, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.12% (0.4615 => 0.4805, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 3.81% (0.7433 => 0.7716, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.45% (0.8172 => 0.8454, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.40% (0.5860 => 0.6059, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.26% (1.5603 => 1.6112, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.26% (4.9449 => 5.1061, std. dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.25% (5.0018 => 5.1642, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5569 => 0.5749, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 3.22% (9.4845 => 9.7896, std. dev.: 0.0126) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (4.2646 => 4.3961, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.93% (0.4636 => 0.4772, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.74% (8.1363 => 8.3589, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: 2.62% (0.7835 => 0.8040, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.59% (14.3668 => 14.7392, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash: 2.59% (0.4289 => 0.4400, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.5415 => 1.5785, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.38% (1.1861 => 1.2143, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.33% (1.3050 => 1.3354, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 2.31% (5.7591 => 5.8920, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.25% (2.0665 => 2.1130, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 2.22% (3.3354 => 3.4093, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (0.4620 => 0.4721, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.15% (2.0273 => 2.0709, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 2.11% (0.6456 => 0.6592, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.04% (1.1642 => 1.1879, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.01% (0.8067 => 0.8229, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 1.83% (3.8723 => 3.9433, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.76% (0.9765 => 0.9937, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.63% (17.1811 => 17.4619, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.59% (0.6675 => 0.6781, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.54% (1.2842 => 1.3040, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.33% (2.2024 => 2.2317, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.30% (1.4186 => 1.4370, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.18% (1.5859 => 1.6046, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.08% (2.6778 => 2.9746, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7468, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2163, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (1.5086 => 1.5364, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.74% (26.0924 => 26.5460, std. dev.: 0.0152) MultiSource/Benchmarks/nbench/nbench: 1.57% (11.6436 => 11.8261, std. dev.: 0.0153) SingleSource/Benchmarks/Dhrystone/dry: 1.50% (2.4116 => 2.4477, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6884, std. dev.: 0.0035) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2269, std. dev.: 0.0275) SingleSource/Benchmarks/Misc/oourafft: 1.09% (6.6465 => 6.7188, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.52% (5.2763 => 3.1385, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.18% (5.3855 => 3.7062, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.88% (5.3526 => 3.6999, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.34% (2.9384 => 2.5463, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -10.17% (22.1758 => 19.9212, std. dev.: 0.0133) SingleSource/UnitTests/Vector/constpool: -5.26% (54.1659 => 51.3141, std. dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.54% (3.8922 => 3.8324, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.23% (0.0998 => 0.0836, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2373 => 1.1164, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.24% (8.6802 => 8.3986, std. dev.: 0.0240) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4860, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.91% (8.1563 => 7.9193, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0856, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.24% (1.8329 => 1.8101, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.08% (1.3677 => 1.3529, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 20:13:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 22:13:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120720031308.247022A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2228?compare_to=2223&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2228, Order: 160531, Start Time: 2012-07-20 00:29:43, End Time: 2012-07-20 03:13:22 To: 2223, Order: 160521, Start Time: 2012-07-19 21:18:00, End Time: 2012-07-20 00:01:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (51 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (842 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.2263 => 0.2414, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.25% (128.2951 => 131.1817, std. dev.: 0.3621) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.49% (54.0596 => 54.8672, std. dev.: 0.0716) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.88% (0.3446 => 0.3890, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.84% (0.3465 => 0.3910, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.84% (0.3442 => 0.3884, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.76% (0.3496 => 0.3942, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.75% (0.3460 => 0.3901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.70% (0.3488 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.65% (0.3469 => 0.3908, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.47% (0.3650 => 0.4105, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.22% (0.3643 => 0.4088, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3724 => 0.4166, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.33% (0.3792 => 0.4108, std. dev.: 0.0041) SingleSource/UnitTests/ObjC++/Hello: 6.83% (0.5826 => 0.6224, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.55% (0.5889 => 0.6275, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.19% (0.7171 => 0.7543, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.92% (1.6211 => 1.7008, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.85% (3.5627 => 3.7355, std. dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 4.53% (1.5932 => 1.6654, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.40% (0.4361 => 0.4553, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.22% (0.5026 => 0.5238, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.14% (1.3152 => 1.3696, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.02% (0.3930 => 0.4088, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.96% (0.4994 => 0.5192, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.96% (0.5000 => 0.5198, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.86% (2.7292 => 2.8346, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.83% (0.5900 => 0.6126, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 3.75% (4.2109 => 4.3688, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: 3.70% (0.4029 => 0.4178, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 3.66% (1.0781 => 1.1176, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.08% (2.1013 => 2.1660, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.04% (1.9694 => 2.0293, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.03% (5.5417 => 5.7097, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (4.4195 => 4.5499, std. dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 2.91% (0.9909 => 1.0197, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.89% (1.9966 => 2.0543, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.88% (0.4658 => 0.4792, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.85% (2.0673 => 2.1262, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.78% (0.3890 => 0.3998, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.77% (2.1653 => 2.2253, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.70% (4.6177 => 4.7424, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.69% (0.3903 => 0.4008, std. dev.: 0.0037) MultiSource/Applications/hbd/hbd: 2.64% (0.9697 => 0.9953, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 2.60% (0.4146 => 0.4254, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.46% (0.4139 => 0.4241, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 2.33% (1.8794 => 1.9231, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.27% (0.7875 => 0.8054, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.14% (1.4269 => 1.4575, std. dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 1.91% (23.5202 => 23.9702, std. dev.: 0.0075) MultiSource/Applications/siod/siod: 1.90% (0.6634 => 0.6760, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.60% (0.6435 => 0.6538, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.12% (2.0346 => 2.0573, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.23% (0.2122 => 0.2233, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.81% (11.9555 => 11.7390, std. dev.: 0.0103) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 20:28:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 22:28:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120720032839.469F22A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2229?compare_to=2226&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2229, Order: 160535, Start Time: 2012-07-20 02:14:53, End Time: 2012-07-20 03:28:51 To: 2226, Order: 160532, Start Time: 2012-07-20 00:32:47, End Time: 2012-07-20 01:46:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 5 (136 on baseline) Performance Improvements: 5 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 944 (724 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 60.89% (0.1286 => 0.2069, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.60% (5.3999 => 5.7561, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: 4.75% (2.4462 => 2.5623, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.5548 => 56.4941, std. dev.: 0.0299) SingleSource/Benchmarks/Shootout-C++/lists1: 2.21% (0.6149 => 0.6285, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -8.71% (0.3538 => 0.3230, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: -5.88% (2.1934 => 2.0644, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.98% (1.0775 => 1.0562, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.63% (1.7045 => 1.6768, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.25% (2.5509 => 2.5191, std. dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.67% (2.0176 => 2.3135, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.54% (0.5818 => 0.6373, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 9.33% (0.7061 => 0.7720, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 9.32% (0.5748 => 0.6284, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.89% (0.3578 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.72% (0.3646 => 0.3964, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.72% (0.3601 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.61% (0.3623 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.58% (0.3650 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.57% (0.3663 => 0.3977, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 8.55% (0.3789 => 0.4113, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.32% (0.4003 => 0.4336, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.28% (0.3914 => 0.4238, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.27% (0.3940 => 0.4266, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.57% (0.3130 => 0.3367, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.00% (0.1986 => 0.2125, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 6.81% (1.3693 => 1.4625, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.36% (0.7710 => 0.8200, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.29% (3.9660 => 4.2154, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.12% (0.2596 => 0.2755, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.00% (0.5265 => 0.5581, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.99% (0.1819 => 0.1928, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 5.83% (0.4062 => 0.4299, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2782 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.52% (0.2607 => 0.2751, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.51% (0.2760 => 0.2912, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.49% (0.3022 => 0.3188, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.47% (0.3489 => 0.3680, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.43% (0.2690 => 0.2836, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.2966 => 0.3126, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.38% (1.9828 => 2.0895, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.33% (0.4390 => 0.4624, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.32% (0.6959 => 0.7329, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.32% (0.2765 => 0.2912, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.29% (0.2628 => 0.2767, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.28% (0.2937 => 0.3092, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.24% (0.2655 => 0.2794, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.19% (0.2696 => 0.2836, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.14% (0.3149 => 0.3311, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.11% (0.3485 => 0.3663, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2761 => 0.2902, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.08% (0.3580 => 0.3762, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.05% (0.3899 => 0.4096, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4379 => 0.4600, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.99% (1.2193 => 1.2802, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.85% (0.9199 => 0.9645, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3192 => 0.3346, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.82% (13.8202 => 14.4858, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/sieve: 4.81% (0.3453 => 0.3619, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.61% (0.5577 => 0.5834, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 4.60% (16.6129 => 17.3763, std. dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/lists1: 4.56% (0.3534 => 0.3695, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.53% (0.4016 => 0.4198, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.3756 => 0.3925, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/moments: 4.50% (0.3868 => 0.4042, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.46% (0.3293 => 0.3440, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.46% (13.2842 => 13.8768, std. dev.: 0.0129) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.42% (1.3813 => 1.4423, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.35% (1.4563 => 1.5197, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (1.3819 => 1.4417, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.20% (1.1364 => 1.1841, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.19% (0.5637 => 0.5873, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.03% (7.2180 => 7.5090, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/objinst: 4.01% (0.2945 => 0.3063, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.92% (0.8310 => 0.8636, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 3.90% (3.8646 => 4.0152, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.88% (0.3246 => 0.3372, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.85% (1.0594 => 1.1002, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.81% (0.7506 => 0.7792, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.81% (0.7460 => 0.7744, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.78% (1.1061 => 1.1479, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (1.3245 => 1.3740, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.66% (1.9270 => 1.9975, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 3.58% (1.2292 => 1.2732, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.45% (3.6692 => 3.7959, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.41% (4.3801 => 4.5294, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 3.29% (0.3220 => 0.3326, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.26% (4.4433 => 4.5882, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.25% (0.3755 => 0.3877, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.19% (0.4791 => 0.4944, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.03% (2.1791 => 2.2452, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.99% (4.9865 => 5.1354, std. dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.82% (0.8698 => 0.8943, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.75% (1.1333 => 1.1645, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.66% (3.1889 => 3.2737, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.46% (0.6135 => 0.6286, std. dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 2.37% (6.5754 => 6.7310, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 2.36% (8.4961 => 8.6969, std. dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: 2.32% (14.5298 => 14.8672, std. dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 2.27% (14.8535 => 15.1905, std. dev.: 0.0138) MultiSource/Applications/sqlite3/sqlite3: 2.26% (16.2614 => 16.6290, std. dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.07% (2.1007 => 2.1442, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.97% (3.2742 => 3.3388, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.80% (1.5188 => 1.5462, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.66% (4.6629 => 4.7402, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.08% (0.1824 => 0.3230, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 56.51% (0.1322 => 0.2069, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.23% (1.8175 => 2.2761, std. dev.: 0.0364) SingleSource/Benchmarks/Misc/mandel-2: 7.17% (1.2998 => 1.3930, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.97% (1.5824 => 1.6768, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.66% (0.9996 => 1.0562, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8140, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.24% (7.4271 => 7.7421, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 4.09% (11.2619 => 11.7229, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (12.4560 => 12.8586, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4748, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.79% (2.8606 => 2.9405, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.40% (1.7688 => 1.8113, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.20% (2.0200 => 2.0644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5623, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.11% (4.1080 => 4.1946, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 2.05% (0.6159 => 0.6285, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5337, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9590, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 1.26% (2.4679 => 2.4991, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.18% (3.1736 => 3.2110, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.45% (22.5627 => 21.1073, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.68% (1.0460 => 0.8611, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.06% (1.2308 => 1.0947, std. dev.: 0.0099) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.08% (1.3780 => 1.3080, std. dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: -4.83% (2.6470 => 2.5191, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9822, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.38% (1.9762 => 1.9095, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.59% (0.4867 => 0.4741, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.26% (20.3410 => 19.8823, std. dev.: 0.0822) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.21% (0.8342 => 0.8158, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2352, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5090, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -1.76% (3.0263 => 2.9729, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7606, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.59% (7.1097 => 6.9966, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2564, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2337, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8491, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 21:04:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 19 Jul 2012 23:04:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120720040410.726B32A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2230?compare_to=2227&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2230, Order: 160536, Start Time: 2012-07-20 02:46:02, End Time: 2012-07-20 04:04:22 To: 2227, Order: 160532, Start Time: 2012-07-20 00:59:24, End Time: 2012-07-20 02:17:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (66 on baseline) Performance Improvements: 10 (27 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 922 (780 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 6.62% (5.4000 => 5.7576, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.37% (11.0496 => 10.8977, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -9.28% (1.5374 => 1.3948, std. dev.: 0.0239) SingleSource/Benchmarks/Dhrystone/dry: -3.00% (2.4477 => 2.3742, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.31% (1.7256 => 1.6857, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.61% (2.0877 => 2.0541, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5527 => 2.5138, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.45% (12.5391 => 12.3567, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.37% (4.2316 => 4.1736, std. dev.: 0.0012) MultiSource/Applications/lua/lua: -1.11% (26.5460 => 26.2510, std. dev.: 0.0153) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.20% (10.3673 => 13.9130, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.63% (1.1194 => 1.2496, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 11.58% (0.3473 => 0.3875, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 11.41% (0.3497 => 0.3896, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.41% (0.3516 => 0.3917, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.35% (0.3561 => 0.3965, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.32% (0.3543 => 0.3944, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.29% (0.3543 => 0.3943, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 11.04% (0.3694 => 0.4102, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 10.45% (0.3886 => 0.4292, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 10.34% (0.3927 => 0.4333, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.13% (1.7609 => 1.9040, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.98% (2.2022 => 2.3779, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.94% (0.6030 => 0.6388, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.84% (0.5925 => 0.6271, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.27% (0.7326 => 0.7712, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.3177 => 0.3343, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 4.42% (10.4361 => 10.8977, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.4879 => 0.5094, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (7.0540 => 7.3545, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.05% (0.4615 => 0.4802, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/oourafft: 3.99% (0.3282 => 0.3413, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.7433 => 0.7720, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.41% (0.8172 => 0.8451, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (4.9449 => 5.1042, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.22% (5.0018 => 5.1628, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.18% (0.5569 => 0.5746, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 3.06% (9.4845 => 9.7745, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 3.00% (1.5603 => 1.6071, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.94% (0.5860 => 0.6032, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.83% (4.2646 => 4.3855, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.4636 => 0.4764, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (14.3668 => 14.7617, std. dev.: 0.0068) MultiSource/Applications/spiff/spiff: 2.68% (0.7835 => 0.8045, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.62% (8.1363 => 8.3492, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash: 2.47% (0.4289 => 0.4395, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 2.36% (5.7591 => 5.8951, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (1.3050 => 1.3357, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.28% (1.5415 => 1.5767, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.27% (1.1861 => 1.2130, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.19% (3.3354 => 3.4084, std. dev.: 0.0182) MultiSource/Applications/treecc/treecc: 2.07% (2.0273 => 2.0693, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.03% (2.0665 => 2.1084, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.01% (1.1642 => 1.1876, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.00% (0.8067 => 0.8228, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.83% (0.9765 => 0.9944, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 1.83% (0.6456 => 0.6574, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.70% (3.8723 => 3.9382, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.67% (17.1811 => 17.4675, std. dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.51% (0.6675 => 0.6776, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.38% (2.2024 => 2.2329, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 1.35% (1.2842 => 1.3015, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.34% (1.5859 => 1.6071, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.19% (1.4186 => 1.4355, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9755, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.62% (5.3999 => 5.7576, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.35% (3.6395 => 3.7616, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.38% (1.0313 => 1.0558, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.88% (11.6436 => 11.8620, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.58% (3.1578 => 3.2076, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6903, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: 1.15% (9.1159 => 9.2203, std. dev.: 0.0151) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.40% (5.2763 => 3.1445, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.43% (5.3855 => 3.6930, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.78% (5.3526 => 3.7049, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.25% (2.9384 => 2.5490, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -10.30% (22.1758 => 19.8923, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -5.25% (54.1659 => 51.3246, std. dev.: 0.1153) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.55% (3.8922 => 3.8318, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.80% (1.2373 => 1.1160, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -9.27% (1.5373 => 1.3948, std. dev.: 0.0239) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.22% (8.1563 => 7.8935, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4800, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4156, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.30% (1.7254 => 1.6857, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -2.08% (10.2830 => 10.0694, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.56% (2.0866 => 2.0541, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3742, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.54% (1.3677 => 1.3466, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.42% (12.5348 => 12.3567, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.29% (4.2280 => 4.1736, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 22:10:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 00:10:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120720051035.EAEDD2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2231?compare_to=2229&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2231, Order: 160536, Start Time: 2012-07-20 03:56:48, End Time: 2012-07-20 05:10:47 To: 2229, Order: 160535, Start Time: 2012-07-20 02:14:53, End Time: 2012-07-20 03:28:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (139 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.08% (2.2761 => 2.3462, std. dev.: 0.0219) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.12% (80.1295 => 81.0230, std. dev.: 0.1932) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.58% (2.0176 => 2.3118, std. dev.: 0.0108) SingleSource/UnitTests/ObjC++/property-reference-object: 9.44% (0.5818 => 0.6367, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.17% (0.5748 => 0.6275, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.06% (0.7061 => 0.7701, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 8.92% (0.3578 => 0.3897, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.72% (0.3601 => 0.3915, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.67% (0.3646 => 0.3962, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: 8.58% (0.3623 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.57% (0.3663 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.55% (0.3650 => 0.3962, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/for-in: 8.45% (0.3789 => 0.4109, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.28% (0.3914 => 0.4238, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.25% (0.3940 => 0.4265, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.14% (0.4003 => 0.4329, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.15% (0.1986 => 0.2128, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.86% (1.3693 => 1.4633, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.33% (0.7710 => 0.8198, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.32% (0.2721 => 0.2893, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.24% (3.9660 => 4.2133, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4328 => 0.4596, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1819 => 0.1929, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.04% (0.5265 => 0.5583, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.01% (0.2596 => 0.2752, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.75% (0.2781 => 0.2941, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 5.74% (0.7038 => 0.7442, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2765 => 0.2919, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3022 => 0.3185, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.37% (0.2628 => 0.2769, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.33% (0.2607 => 0.2746, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.33% (0.2760 => 0.2907, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.28% (0.2690 => 0.2832, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.21% (1.9828 => 2.0862, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 5.21% (0.2726 => 0.2868, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.3107 => 0.3268, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.11% (0.2937 => 0.3087, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.07% (0.2761 => 0.2901, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.06% (0.2966 => 0.3116, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.00% (0.4379 => 0.4598, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.99% (0.3485 => 0.3659, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.99% (0.3149 => 0.3306, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.97% (0.3580 => 0.3758, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.94% (0.6959 => 0.7303, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.93% (0.2696 => 0.2829, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.88% (1.2193 => 1.2788, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.87% (0.3899 => 0.4089, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.84% (0.3453 => 0.3620, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 4.77% (13.8202 => 14.4794, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary2: 4.73% (0.3192 => 0.3343, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.73% (0.9199 => 0.9634, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.67% (0.4390 => 0.4595, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 4.64% (0.3534 => 0.3698, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.61% (0.5577 => 0.5834, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 4.59% (16.6129 => 17.3761, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.58% (0.4016 => 0.4200, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.47% (13.2842 => 13.8784, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.45% (0.3868 => 0.4040, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.37% (0.3293 => 0.3437, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.34% (1.3819 => 1.4419, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.34% (1.3813 => 1.4412, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3756 => 0.3916, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.24% (0.2925 => 0.3049, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.19% (0.5637 => 0.5873, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.16% (1.4563 => 1.5169, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.09% (1.1364 => 1.1829, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.08% (0.2914 => 0.3033, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.01% (0.7506 => 0.7807, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.98% (7.2180 => 7.5050, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 3.90% (0.8310 => 0.8634, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.86% (0.7460 => 0.7748, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.84% (1.1061 => 1.1486, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 3.83% (1.0594 => 1.1000, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.80% (0.2945 => 0.3057, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.73% (3.8646 => 4.0088, std. dev.: 0.0124) MultiSource/Applications/treecc/treecc: 3.71% (1.9270 => 1.9984, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.3245 => 1.3734, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.53% (3.6692 => 3.7986, std. dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: 3.42% (1.2292 => 1.2713, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.39% (4.3801 => 4.5285, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.24% (4.4433 => 4.5871, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.15% (0.4791 => 0.4942, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 3.14% (0.3220 => 0.3321, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.09% (0.3755 => 0.3871, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.95% (4.9865 => 5.1338, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.90% (2.1791 => 2.2424, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.86% (0.6283 => 0.6463, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.78% (0.8698 => 0.8940, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.68% (1.1333 => 1.1637, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.67% (3.1889 => 3.2740, std. dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.43% (0.6135 => 0.6284, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.38% (6.5754 => 6.7319, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 2.35% (14.8535 => 15.2021, std. dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: 2.29% (8.4961 => 8.6910, std. dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 2.27% (16.2614 => 16.6309, std. dev.: 0.0266) MultiSource/Applications/ClamAV/clamscan: 2.22% (14.5298 => 14.8524, std. dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.94% (2.1007 => 2.1415, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (3.2742 => 3.3330, std. dev.: 0.0138) MultiSource/Applications/oggenc/oggenc: 1.65% (4.6629 => 4.7397, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.62% (1.5188 => 1.5434, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 76.97% (0.1824 => 0.3228, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 56.58% (0.1322 => 0.2070, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 29.09% (1.8175 => 2.3462, std. dev.: 0.0219) SingleSource/Benchmarks/Misc/mandel-2: 8.19% (1.2998 => 1.4062, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.00% (1.5824 => 1.6773, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.04% (0.9996 => 1.0500, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.26% (7.4271 => 7.7434, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7231, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (12.4560 => 12.8578, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4756, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.81% (2.8606 => 2.9409, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.46% (1.7688 => 1.8123, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.15% (2.0200 => 2.0634, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: 2.14% (2.5089 => 2.5625, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.11% (4.1080 => 4.1948, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 2.05% (0.6159 => 0.6285, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.53% (1.5089 => 1.5320, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.29% (1.9290 => 1.9539, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.27% (3.1736 => 3.2139, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 1.27% (2.4679 => 2.4992, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.18% (3.6469 => 3.6898, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.44% (22.5627 => 21.1096, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.70% (1.0460 => 0.8609, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.62% (1.2308 => 1.1001, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3096, std. dev.: 0.0088) SingleSource/UnitTests/Vector/multiplies: -4.87% (2.6470 => 2.5181, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.43% (1.9762 => 1.9085, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.57% (0.4867 => 0.4742, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.22% (0.8342 => 0.8157, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.08% (20.3410 => 19.9175, std. dev.: 0.0272) SingleSource/Benchmarks/Shootout/lists: -1.89% (6.3560 => 6.2357, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5105, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -1.71% (3.0263 => 2.9746, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7603, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9962, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4928, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2207, std. dev.: 0.0316) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2568, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 22:50:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 00:50:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120720055031.4BF822A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2232?compare_to=2230&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2232, Order: 160541, Start Time: 2012-07-20 04:32:22, End Time: 2012-07-20 05:50:44 To: 2230, Order: 160536, Start Time: 2012-07-20 02:46:02, End Time: 2012-07-20 04:04:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (66 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (778 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.17% (10.3673 => 13.9093, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 11.78% (0.3473 => 0.3882, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.55% (1.1194 => 1.2487, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 11.38% (0.3497 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.29% (0.3543 => 0.3943, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.29% (0.3543 => 0.3943, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.26% (0.3516 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.23% (0.3561 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.96% (0.3694 => 0.4099, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.45% (0.3886 => 0.4292, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3927 => 0.4335, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.19% (1.7609 => 1.9052, std. dev.: 0.0091) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.02% (2.2022 => 2.3788, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 5.86% (0.5925 => 0.6272, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 5.85% (0.6030 => 0.6383, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.41% (0.3177 => 0.3349, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.39% (0.7326 => 0.7721, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.52% (10.4361 => 10.9076, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.43% (0.4879 => 0.5095, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.25% (7.0540 => 7.3539, std. dev.: 0.0345) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.12% (0.4615 => 0.4805, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 3.99% (0.3282 => 0.3413, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 3.82% (0.7433 => 0.7717, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.41% (0.8172 => 0.8451, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.31% (4.9449 => 5.1086, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5569 => 0.5749, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.18% (5.0018 => 5.1610, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.17% (0.5860 => 0.6046, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 3.08% (9.4845 => 9.7768, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 3.04% (1.5603 => 1.6077, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.96% (0.4636 => 0.4773, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.91% (4.2646 => 4.3887, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 2.77% (0.4289 => 0.4408, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.76% (8.1363 => 8.3611, std. dev.: 0.0055) MultiSource/Applications/spiff/spiff: 2.69% (0.7835 => 0.8046, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.53% (14.3668 => 14.7302, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.41% (1.3050 => 1.3365, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.39% (1.5415 => 1.5784, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 2.36% (5.7591 => 5.8951, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.29% (1.1861 => 1.2133, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 2.23% (3.3354 => 3.4098, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.12% (0.8067 => 0.8238, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.12% (2.0665 => 2.1103, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 2.12% (2.0273 => 2.0702, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 1.92% (1.1642 => 1.1865, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: 1.84% (0.6456 => 0.6575, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.82% (3.8723 => 3.9428, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.77% (0.9765 => 0.9938, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.71% (0.6675 => 0.6789, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.71% (0.5981 => 0.6083, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.58% (17.1811 => 17.4527, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (2.2024 => 2.2357, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.50% (1.2842 => 1.3035, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.25% (1.4186 => 1.4364, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9757, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.62% (5.3999 => 5.7573, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7522, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.88% (11.6436 => 11.8627, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.61% (3.1578 => 3.2086, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.44% (2.6546 => 2.6927, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2430, std. dev.: 0.0395) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.37% (5.2763 => 3.1462, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.41% (5.3855 => 3.6940, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.77% (5.3526 => 3.7055, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.33% (2.9384 => 2.5466, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: -10.17% (22.1758 => 19.9215, std. dev.: 0.0126) SingleSource/UnitTests/Vector/constpool: -5.23% (54.1659 => 51.3352, std. dev.: 0.0503) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.65% (3.8922 => 3.8280, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.67% (1.2373 => 1.1176, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -7.20% (1.5373 => 1.4266, std. dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.23% (8.6802 => 8.3999, std. dev.: 0.0198) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4778, std. dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9043, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.28% (1.7254 => 1.6860, std. dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.14% (10.2830 => 10.0632, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.62% (1.3677 => 1.3456, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.59% (2.0866 => 2.0534, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3742, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.49% (2.5528 => 2.5147, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.41% (12.5348 => 12.3578, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.32% (4.2280 => 4.1723, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2324, std. dev.: 0.0209) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.03% (1.8329 => 1.8141, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 23:25:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 01:25:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120720062541.94C452A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2233?compare_to=2228&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2233, Order: 160536, Start Time: 2012-07-20 03:41:22, End Time: 2012-07-20 06:25:56 To: 2228, Order: 160531, Start Time: 2012-07-20 00:29:43, End Time: 2012-07-20 03:13:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 19 (100 on baseline) Performance Improvements: 8 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 927 (786 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.02% (0.9953 => 1.0055, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.40% (5.2851 => 11.7541, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.74% (0.2162 => 0.3367, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.92% (10.7632 => 13.6608, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/objinst: 19.57% (9.4511 => 11.3006, std. dev.: 0.0300) SingleSource/Benchmarks/Shootout/lists: 13.39% (32.9804 => 37.3980, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: 7.05% (15.4416 => 16.5306, std. dev.: 0.1119) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.71% (3.3918 => 3.6193, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: 5.43% (19.6272 => 20.6927, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-2: 4.47% (1.8056 => 1.8863, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.08% (2.2961 => 2.3897, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 3.69% (2.8280 => 2.9324, std. dev.: 0.0135) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.53% (3.1728 => 3.2532, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (3.1736 => 3.2463, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 1.95% (15.8667 => 16.1758, std. dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: 1.88% (17.1908 => 17.5147, std. dev.: 0.0651) MultiSource/Applications/sgefa/sgefa: 1.47% (1.5546 => 1.5775, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.27% (1.0922 => 1.1061, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.83% (6.2401 => 4.1288, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -6.92% (0.2414 => 0.2247, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: -4.97% (0.2233 => 0.2122, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -4.13% (14.0504 => 13.4704, std. dev.: 0.0325) SingleSource/Benchmarks/Misc/salsa20: -3.82% (35.5009 => 34.1456, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/objinst: -2.81% (12.0467 => 11.7080, std. dev.: 0.0230) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.33% (7.4969 => 7.3222, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6261 => 3.5755, std. dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.07% (0.3465 => 0.3918, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.91% (0.3469 => 0.3917, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.88% (0.3446 => 0.3890, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.86% (0.3460 => 0.3905, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.84% (0.3442 => 0.3884, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: 12.79% (0.3496 => 0.3943, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3488 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.30% (0.3650 => 0.4099, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 12.16% (0.3643 => 0.4086, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3724 => 0.4163, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.78% (0.3792 => 0.4163, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 6.85% (0.5826 => 0.6225, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.66% (0.5889 => 0.6281, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.23% (0.1620 => 0.1721, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.19% (0.7171 => 0.7543, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.89% (1.6211 => 1.7003, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.86% (3.5627 => 3.7359, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.40% (0.5026 => 0.5247, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.39% (0.5900 => 0.6159, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 4.36% (1.5932 => 1.6627, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.35% (1.3152 => 1.3724, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.31% (0.4361 => 0.4549, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 4.24% (0.2714 => 0.2829, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.24% (0.2738 => 0.2854, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.18% (0.2729 => 0.2843, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.17% (0.3930 => 0.4094, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.14% (0.2875 => 0.2994, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.07% (0.4029 => 0.4193, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.02% (0.4994 => 0.5195, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.00% (0.2803 => 0.2915, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.97% (0.2823 => 0.2935, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.95% (0.2813 => 0.2924, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.90% (0.5000 => 0.5195, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.88% (0.3096 => 0.3216, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.87% (0.2792 => 0.2900, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.83% (2.0673 => 2.1465, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.78% (0.2750 => 0.2854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.74% (0.2780 => 0.2884, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.71% (0.3317 => 0.3440, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.70% (2.7292 => 2.8303, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 3.70% (4.2109 => 4.3667, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 3.69% (0.9697 => 1.0055, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 3.66% (0.3004 => 0.3114, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.64% (0.3267 => 0.3386, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.63% (0.2811 => 0.2913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (0.3195 => 0.3310, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.58% (0.9909 => 1.0264, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 3.54% (1.0781 => 1.1163, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.54% (0.2911 => 0.3014, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.53% (0.3258 => 0.3373, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.45% (0.3362 => 0.3478, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.39% (0.3124 => 0.3230, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.37% (0.3060 => 0.3163, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.29% (0.3348 => 0.3458, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3282 => 0.3389, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.22% (0.3477 => 0.3589, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 3.21% (0.3678 => 0.3796, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.17% (0.3726 => 0.3844, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.16% (1.9694 => 2.0317, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 3.14% (0.4146 => 0.4276, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.04% (0.3690 => 0.3802, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (1.9966 => 2.0571, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (0.3890 => 0.4005, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.95% (0.3625 => 0.3732, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 2.93% (5.5417 => 5.7040, std. dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 2.93% (2.1013 => 2.1628, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.78% (0.3845 => 0.3952, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 2.78% (0.4251 => 0.4369, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 2.74% (4.6177 => 4.7441, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.71% (0.4658 => 0.4784, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 2.67% (2.1653 => 2.2231, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (4.4195 => 4.5368, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.56% (0.3903 => 0.4003, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.54% (0.3981 => 0.4082, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 2.31% (23.5202 => 24.0634, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 2.27% (0.7875 => 0.8054, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.23% (1.8794 => 1.9213, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 2.10% (0.6634 => 0.6773, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.02% (0.5012 => 0.5113, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (0.6435 => 0.6564, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.95% (0.5546 => 0.5654, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.94% (1.4269 => 1.4546, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.40% (5.2852 => 11.7541, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.74% (0.2162 => 0.3367, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.92% (10.7630 => 13.6608, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/objinst: 19.66% (9.4436 => 11.3006, std. dev.: 0.0300) SingleSource/Benchmarks/Shootout/lists: 13.43% (32.9687 => 37.3980, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: 7.04% (15.4430 => 16.5306, std. dev.: 0.1119) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.75% (3.3903 => 3.6193, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: 5.41% (19.6305 => 20.6927, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: 4.59% (2.8036 => 2.9324, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/flops-2: 4.46% (1.8057 => 1.8863, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.07% (2.2962 => 2.3897, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.55% (3.1722 => 3.2532, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (3.1728 => 3.2463, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 1.91% (15.8721 => 16.1758, std. dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (17.2379 => 17.5147, std. dev.: 0.0651) MultiSource/Applications/sgefa/sgefa: 1.42% (1.5554 => 1.5775, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.51% (2.4764 => 2.3895, std. dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: -2.06% (11.9555 => 11.7090, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.83% (6.2401 => 4.1288, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -6.45% (0.2402 => 0.2247, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -4.11% (14.0481 => 13.4704, std. dev.: 0.0325) SingleSource/Benchmarks/Misc/salsa20: -3.82% (35.5013 => 34.1456, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/objinst: -2.85% (12.0509 => 11.7080, std. dev.: 0.0230) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5755, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 19 23:52:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 01:52:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120720065229.E6A6C2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2234?compare_to=2231&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2234, Order: 160541, Start Time: 2012-07-20 05:38:42, End Time: 2012-07-20 06:52:42 To: 2231, Order: 160536, Start Time: 2012-07-20 03:56:48, End Time: 2012-07-20 05:10:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (138 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (722 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 1.41% (2.3462 => 2.3793, std. dev.: 0.0109) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.67% (2.0176 => 2.3135, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.50% (0.5818 => 0.6371, std. dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference: 9.38% (0.7061 => 0.7723, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 9.32% (0.5748 => 0.6284, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.94% (0.3578 => 0.3898, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.72% (0.3601 => 0.3915, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.67% (0.3646 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.60% (0.3650 => 0.3964, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 8.57% (0.3663 => 0.3977, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.56% (0.3623 => 0.3933, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.52% (0.3789 => 0.4112, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.25% (0.3914 => 0.4237, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.24% (0.4003 => 0.4333, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.20% (0.3940 => 0.4263, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.48% (0.3130 => 0.3364, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.15% (0.1986 => 0.2128, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.98% (1.3693 => 1.4649, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.38% (0.7710 => 0.8202, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.24% (0.4328 => 0.4598, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (3.9660 => 4.2110, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.12% (0.2596 => 0.2755, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.08% (0.5265 => 0.5585, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 5.97% (0.2781 => 0.2947, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.97% (0.7038 => 0.7458, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.94% (0.1819 => 0.1927, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.4062 => 0.4303, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2782 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.43% (0.2690 => 0.2836, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.36% (0.2760 => 0.2908, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.34% (1.9828 => 2.0887, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.32% (0.2765 => 0.2912, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.27% (0.3489 => 0.3673, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.26% (0.3022 => 0.3181, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.26% (0.2607 => 0.2744, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.24% (0.2655 => 0.2794, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.18% (0.2628 => 0.2764, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.17% (0.2726 => 0.2867, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.16% (0.2966 => 0.3119, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.14% (0.2761 => 0.2903, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.12% (0.6959 => 0.7315, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 5.05% (0.3107 => 0.3264, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.04% (0.2696 => 0.2832, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.02% (0.3149 => 0.3307, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.00% (0.3580 => 0.3759, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.99% (1.2193 => 1.2802, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.99% (0.3485 => 0.3659, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.98% (0.3192 => 0.3351, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.95% (0.3899 => 0.4092, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.90% (0.4390 => 0.4605, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 4.87% (0.3453 => 0.3621, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.86% (0.4379 => 0.4592, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.2988 => 0.3133, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.79% (0.9199 => 0.9640, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 4.79% (13.8202 => 14.4824, std. dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.4016 => 0.4205, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.67% (0.3534 => 0.3699, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.62% (0.3293 => 0.3445, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.58% (0.3868 => 0.4045, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.54% (13.2842 => 13.8874, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.52% (0.5577 => 0.5829, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.44% (16.6129 => 17.3511, std. dev.: 0.0163) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.42% (1.3813 => 1.4423, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.39% (1.3819 => 1.4425, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.31% (0.3756 => 0.3918, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.31% (0.2925 => 0.3051, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.17% (1.4563 => 1.5171, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.17% (0.5637 => 0.5872, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.10% (1.1364 => 1.1830, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.06% (7.2180 => 7.5107, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.98% (0.2914 => 0.3030, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.96% (1.0594 => 1.1013, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 3.88% (0.7506 => 0.7797, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 3.87% (0.8310 => 0.8632, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.87% (1.1061 => 1.1489, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.84% (0.2945 => 0.3058, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.81% (0.7460 => 0.7744, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.74% (1.9270 => 1.9990, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 3.70% (3.8646 => 4.0076, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.3245 => 1.3734, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.49% (3.6692 => 3.7973, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.47% (1.2292 => 1.2719, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.39% (4.3801 => 4.5285, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (4.4433 => 4.5903, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.21% (0.4791 => 0.4945, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.20% (0.3220 => 0.3323, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3755 => 0.3870, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.99% (2.1791 => 2.2443, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.99% (4.9865 => 5.1354, std. dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.90% (0.6283 => 0.6465, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.80% (1.1333 => 1.1650, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.79% (0.8698 => 0.8941, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.56% (3.1889 => 3.2704, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 2.50% (6.5754 => 6.7399, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.38% (0.6135 => 0.6281, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.35% (16.2614 => 16.6432, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 2.29% (14.8535 => 15.1939, std. dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 2.25% (8.4961 => 8.6869, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.20% (14.5298 => 14.8495, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.1007 => 2.1436, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (3.2742 => 3.3328, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.78% (1.5188 => 1.5459, std. dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 1.62% (4.6629 => 4.7386, std. dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.08% (0.1824 => 0.3230, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 56.51% (0.1322 => 0.2069, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 30.91% (1.8175 => 2.3793, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/mandel-2: 8.39% (1.2998 => 1.4089, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.95% (1.5824 => 1.6766, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.90% (0.9996 => 1.0486, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.33% (7.4271 => 7.7484, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7233, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (12.4560 => 12.8578, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4747, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.80% (2.8606 => 2.9407, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.36% (1.7688 => 1.8106, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.18% (2.0200 => 2.0640, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 2.14% (2.5089 => 2.5625, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.09% (4.1080 => 4.1940, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 2.03% (0.6159 => 0.6284, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0049) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5089 => 1.5335, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9576, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 1.27% (2.4679 => 2.4992, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.04% (3.1736 => 3.2066, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.42% (22.5627 => 21.1135, std. dev.: 0.0670) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.69% (1.0460 => 0.8610, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.54% (0.0997 => 0.0852, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.18% (1.2308 => 1.1055, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -4.90% (2.6470 => 2.5172, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.31% (1.3780 => 1.3186, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9821, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.38% (1.9762 => 1.9095, std. dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.55% (0.4867 => 0.4743, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.21% (0.8342 => 0.8158, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.16% (20.3410 => 19.9022, std. dev.: 0.0973) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2325, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5056, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.67% (3.0263 => 2.9758, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7609, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.59% (7.1097 => 6.9967, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8581, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.5254 => 2.4898, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2292, std. dev.: 0.0281) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2566, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 01:39:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 03:39:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120720083913.C67692A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2235?compare_to=2234&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2235, Order: 160542, Start Time: 2012-07-20 07:25:11, End Time: 2012-07-20 08:39:26 To: 2234, Order: 160541, Start Time: 2012-07-20 05:38:42, End Time: 2012-07-20 06:52:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (139 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (722 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.92% (54.6760 => 56.2699, std. dev.: 0.1695) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.68% (2.0176 => 2.3138, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 9.47% (0.5818 => 0.6369, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3578 => 0.3912, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.31% (0.5748 => 0.6283, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.29% (0.3650 => 0.3989, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 9.14% (0.3601 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.12% (0.3663 => 0.3997, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/exceptions-3: 9.05% (0.3623 => 0.3951, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.05% (0.3646 => 0.3976, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.87% (0.3789 => 0.4125, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.74% (0.4003 => 0.4353, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.71% (0.3914 => 0.4255, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.53% (0.3940 => 0.4276, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.44% (0.7061 => 0.7657, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.25% (0.1986 => 0.2130, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.05% (1.3693 => 1.4659, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.41% (3.9660 => 4.2202, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.32% (0.7710 => 0.8197, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2596 => 0.2757, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 6.19% (0.7038 => 0.7474, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.12% (0.5265 => 0.5587, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 6.11% (0.4062 => 0.4310, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 6.04% (0.2781 => 0.2949, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.57% (1.9828 => 2.0933, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2765 => 0.2919, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2607 => 0.2752, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3022 => 0.3189, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.51% (0.2760 => 0.2912, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 5.50% (0.2726 => 0.2876, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.47% (0.3489 => 0.3680, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.46% (0.2655 => 0.2800, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wc: 5.41% (0.2937 => 0.3096, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2761 => 0.2910, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.29% (0.6959 => 0.7327, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.28% (0.3899 => 0.4105, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2628 => 0.2766, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.25% (0.3485 => 0.3668, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3149 => 0.3314, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.16% (1.2193 => 1.2822, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.09% (0.9199 => 0.9667, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 5.06% (13.8202 => 14.5200, std. dev.: 0.0191) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4379 => 0.4600, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: 5.04% (0.3192 => 0.3353, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.99% (0.2988 => 0.3137, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.87% (0.4390 => 0.4604, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: 4.84% (0.3453 => 0.3620, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.82% (1.3819 => 1.4485, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: 4.70% (0.3534 => 0.3700, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.68% (0.4016 => 0.4204, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.66% (13.2842 => 13.9031, std. dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/moments: 4.65% (0.3868 => 0.4048, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.64% (0.5577 => 0.5836, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.59% (0.3293 => 0.3444, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.52% (16.6129 => 17.3631, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.45% (1.3813 => 1.4427, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.40% (0.5637 => 0.5885, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.36% (1.1364 => 1.1860, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.32% (1.4563 => 1.5192, std. dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.29% (0.2914 => 0.3039, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.28% (0.3246 => 0.3385, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.25% (7.2180 => 7.5246, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2945 => 0.3066, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 4.09% (1.1061 => 1.1513, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 4.08% (3.8646 => 4.0222, std. dev.: 0.0154) MultiSource/Applications/spiff/spiff: 4.06% (0.7506 => 0.7811, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.02% (0.7460 => 0.7760, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.02% (1.0594 => 1.1020, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 4.02% (0.8310 => 0.8644, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.97% (1.3245 => 1.3771, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.92% (1.9270 => 2.0026, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 3.70% (1.2292 => 1.2747, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.61% (3.6692 => 3.8016, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.50% (4.3801 => 4.5335, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (4.4433 => 4.5933, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 3.35% (0.3220 => 0.3328, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.28% (0.4791 => 0.4948, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.25% (0.3755 => 0.3877, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.18% (2.1791 => 2.2483, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.04% (4.9865 => 5.1381, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.91% (0.6283 => 0.6466, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.90% (0.8698 => 0.8950, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.82% (3.1889 => 3.2788, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (6.5754 => 6.7485, std. dev.: 0.0084) MultiSource/Benchmarks/McCat/05-eks/eks: 2.53% (0.4113 => 0.4217, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 2.52% (14.8535 => 15.2277, std. dev.: 0.0110) MultiSource/Benchmarks/mafft/pairlocalalign: 2.50% (8.4961 => 8.7081, std. dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: 2.44% (16.2614 => 16.6577, std. dev.: 0.0132) MultiSource/Applications/ClamAV/clamscan: 2.35% (14.5298 => 14.8710, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.18% (2.1007 => 2.1465, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.87% (3.2742 => 3.3353, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.83% (1.5188 => 1.5466, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 1.78% (4.6629 => 4.7460, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.03% (0.1824 => 0.3229, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 56.58% (0.1322 => 0.2070, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 26.00% (1.8175 => 2.2900, std. dev.: 0.0424) SingleSource/Benchmarks/Misc/mandel-2: 7.06% (1.2998 => 1.3916, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.95% (1.5824 => 1.6766, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.91% (0.9996 => 1.0487, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.27% (7.4271 => 7.7439, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.08% (11.2619 => 11.7217, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9869, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.24% (12.4560 => 12.8594, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4746, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.81% (2.8606 => 2.9409, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.39% (1.7688 => 1.8111, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.15% (2.0200 => 2.0634, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5624, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.11% (4.1080 => 4.1947, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 2.03% (0.6159 => 0.6284, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5343, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0040) MultiSource/Benchmarks/NPB-serial/is/is: 1.52% (8.3908 => 8.5184, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 1.26% (2.4679 => 2.4991, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 1.24% (3.1736 => 3.2130, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.40% (22.5627 => 21.1196, std. dev.: 0.0183) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.68% (1.0460 => 0.8611, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.65% (0.0997 => 0.0841, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.23% (1.2308 => 1.1049, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.87% (2.6470 => 2.5182, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9822, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.43% (1.9762 => 1.9084, std. dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.57% (0.4867 => 0.4742, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.22% (0.8342 => 0.8157, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2261, std. dev.: 0.0107) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -1.68% (3.0263 => 2.9754, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.61% (9.9194 => 9.7600, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9962, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.46% (20.3410 => 20.0448, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.35% (2.5254 => 2.4914, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.3167 => 5.2616, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.02% (9.3358 => 9.2404, std. dev.: 0.0075) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 01:43:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 03:43:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120720084321.B90ED2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2236?compare_to=2232&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2236, Order: 160542, Start Time: 2012-07-20 07:24:35, End Time: 2012-07-20 08:43:35 To: 2232, Order: 160541, Start Time: 2012-07-20 04:32:22, End Time: 2012-07-20 05:50:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (69 on baseline) Performance Improvements: 0 (27 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (777 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.24% (0.8451 => 0.8556, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.55% (29.2598 => 29.7143, std. dev.: 0.0563) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.15% (10.3673 => 13.9079, std. dev.: 0.0094) SingleSource/UnitTests/ObjC/trivial-interface: 11.63% (0.3473 => 0.3877, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.50% (0.3497 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.35% (0.3516 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3543 => 0.3945, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 11.29% (0.3543 => 0.3943, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.26% (0.3561 => 0.3962, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.18% (1.1194 => 1.2446, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 10.96% (0.3694 => 0.4099, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.71% (0.3828 => 0.4238, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.52% (0.3886 => 0.4295, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.03% (0.1432 => 0.1547, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.69% (1.7609 => 1.8964, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.64% (2.2022 => 2.3704, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.57% (0.3177 => 0.3354, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 5.54% (0.5925 => 0.6253, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 5.47% (0.6030 => 0.6360, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.70% (0.8172 => 0.8556, std. dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference: 4.48% (0.7326 => 0.7654, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 4.46% (10.4361 => 10.9012, std. dev.: 0.0161) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.39% (0.3121 => 0.3258, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.25% (7.0540 => 7.3540, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.18% (0.4615 => 0.4808, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.11% (0.5569 => 0.5798, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.10% (0.4879 => 0.5079, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 3.84% (0.3282 => 0.3408, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 3.82% (0.7433 => 0.7717, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.53% (4.9449 => 5.1196, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.46% (5.0018 => 5.1749, std. dev.: 0.0043) MultiSource/Applications/spiff/spiff: 3.32% (0.7835 => 0.8095, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.25% (4.2646 => 4.4030, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 3.16% (9.4845 => 9.7841, std. dev.: 0.0096) MultiSource/Applications/hbd/hbd: 3.15% (1.5603 => 1.6094, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.90% (0.8067 => 0.8301, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.87% (8.1363 => 8.3696, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 2.66% (0.4289 => 0.4403, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.66% (1.1861 => 1.2176, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.63% (14.3668 => 14.7444, std. dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.54% (1.3050 => 1.3381, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 2.44% (3.3354 => 3.4168, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.41% (1.5415 => 1.5786, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 2.28% (2.0273 => 2.0735, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 2.28% (5.7591 => 5.8902, std. dev.: 0.0055) MultiSource/Applications/Burg/burg: 2.17% (1.1642 => 1.1895, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.02% (0.5105 => 0.5208, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 1.91% (3.8723 => 3.9462, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.88% (0.9765 => 0.9949, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.81% (2.0665 => 2.1040, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/football/football: 1.73% (0.8921 => 0.9075, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.61% (17.1811 => 17.4584, std. dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/bigfib: 1.58% (0.6456 => 0.6558, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.54% (1.4186 => 1.4405, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (2.2024 => 2.2357, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.50% (0.6675 => 0.6775, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.32% (1.5859 => 1.6069, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.32% (1.2842 => 1.3011, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9756, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.63% (5.3999 => 5.7581, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7536, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.95% (11.6436 => 11.8708, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5086 => 1.5354, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 1.72% (3.1578 => 3.2120, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: 1.65% (1.0554 => 1.0728, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2348, std. dev.: 0.0343) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6877, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 1.02% (6.6465 => 6.7145, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.53% (0.8651 => 0.1684, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.48% (5.2763 => 3.1403, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.74% (5.3855 => 3.6764, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.09% (5.3526 => 3.6884, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.74% (2.9384 => 2.5347, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -10.28% (22.1758 => 19.8957, std. dev.: 0.0336) SingleSource/UnitTests/Vector/constpool: -5.41% (54.1659 => 51.2351, std. dev.: 0.0376) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.70% (3.8922 => 3.8259, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.83% (0.0998 => 0.0840, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -9.78% (1.2373 => 1.1163, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -7.61% (1.5373 => 1.4203, std. dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.32% (8.1563 => 7.8858, std. dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4702, std. dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.02% (8.6802 => 8.4181, std. dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.41% (0.4808 => 0.4692, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.30% (1.7254 => 1.6857, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.19% (10.2830 => 10.0577, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.59% (2.0866 => 2.0534, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.59% (1.3677 => 1.3460, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.48% (2.5528 => 2.5149, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: -1.44% (12.5348 => 12.3546, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.31% (4.2280 => 4.1728, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 02:39:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 04:39:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120720093930.A4C1A2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2237?compare_to=2233&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2237, Order: 160541, Start Time: 2012-07-20 06:53:49, End Time: 2012-07-20 09:39:44 To: 2233, Order: 160536, Start Time: 2012-07-20 03:41:22, End Time: 2012-07-20 06:25:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (77 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (809 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.90% (0.3465 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.89% (0.3460 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.88% (0.3446 => 0.3890, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 12.87% (0.3496 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.84% (0.3442 => 0.3884, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.80% (0.3469 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.76% (0.3488 => 0.3933, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/property: 12.19% (0.3650 => 0.4095, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.13% (0.3643 => 0.4085, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.84% (0.3724 => 0.4165, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.90% (0.5826 => 0.6228, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.67% (0.5889 => 0.6282, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.23% (0.1620 => 0.1721, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.20% (0.7171 => 0.7544, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.05% (1.6211 => 1.7030, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.96% (3.5627 => 3.7394, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.60% (0.9909 => 1.0365, std. dev.: 0.0105) MultiSource/Applications/oggenc/oggenc: 4.43% (1.5932 => 1.6638, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.38% (0.5026 => 0.5246, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.33% (0.3930 => 0.4100, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.31% (0.4361 => 0.4549, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.31% (0.2738 => 0.2856, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.30% (1.3152 => 1.3718, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.25% (0.3362 => 0.3505, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.20% (0.5900 => 0.6148, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 4.17% (0.4029 => 0.4197, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.10% (0.4994 => 0.5199, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 3.98% (0.9697 => 1.0083, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.96% (0.5000 => 0.5198, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.86% (2.0673 => 2.1471, std. dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 3.79% (4.2109 => 4.3706, std. dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.65% (2.7292 => 2.8289, std. dev.: 0.0088) SingleSource/Regression/C++/ofstream_ctor: 3.60% (0.3004 => 0.3112, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.59% (0.3317 => 0.3436, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.57% (0.2911 => 0.3015, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.47% (0.3258 => 0.3371, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.46% (0.3267 => 0.3380, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.43% (0.3060 => 0.3165, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 3.42% (1.0781 => 1.1150, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.33% (0.3124 => 0.3228, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.20% (0.3282 => 0.3387, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.19% (1.9694 => 2.0323, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 3.17% (5.5417 => 5.7171, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash: 3.16% (0.4146 => 0.4277, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.08% (1.9966 => 2.0580, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.01% (0.4658 => 0.4798, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 2.99% (2.1013 => 2.1641, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.94% (2.1653 => 2.2290, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (0.3890 => 0.4003, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.75% (0.4139 => 0.4253, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.66% (1.8794 => 1.9293, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 2.61% (4.6177 => 4.7384, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (4.4195 => 4.5333, std. dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 2.39% (23.5202 => 24.0829, std. dev.: 0.0077) MultiSource/Applications/treecc/treecc: 2.39% (0.7875 => 0.8063, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 2.25% (0.6634 => 0.6783, std. dev.: 0.0052) MultiSource/Applications/lua/lua: 2.12% (1.4269 => 1.4571, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 1.84% (0.5546 => 0.5648, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.41% (5.2852 => 11.7546, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.92% (0.2162 => 0.3371, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.92% (10.7630 => 13.6603, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.61% (0.5589 => 0.6685, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout/objinst: 19.40% (9.4436 => 11.2753, std. dev.: 0.0432) SingleSource/Benchmarks/Shootout/lists: 13.44% (32.9687 => 37.4002, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 7.08% (15.4430 => 16.5364, std. dev.: 0.0495) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.81% (3.3903 => 3.6212, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: 5.41% (19.6305 => 20.6920, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 5.18% (2.8036 => 2.9487, std. dev.: 0.0227) SingleSource/Benchmarks/Misc/flops-2: 4.39% (1.8057 => 1.8850, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.08% (2.2962 => 2.3898, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.31% (3.1722 => 3.2454, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (3.1728 => 3.2441, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: 2.04% (17.2379 => 17.5903, std. dev.: 0.0310) SingleSource/Benchmarks/Shootout-C++/ary3: 1.89% (15.8721 => 16.1716, std. dev.: 0.0169) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.43% (1.0927 => 1.1083, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 1.43% (1.5554 => 1.5776, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.21% (1.0142 => 1.0265, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.53% (2.4764 => 2.3890, std. dev.: 0.0138) MultiSource/Applications/kimwitu++/kc: -2.03% (11.9555 => 11.7124, std. dev.: 0.0154) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.81% (6.2401 => 4.1301, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: -6.99% (0.2402 => 0.2234, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: -4.20% (14.0481 => 13.4583, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -3.81% (35.5013 => 34.1487, std. dev.: 0.4227) SingleSource/Benchmarks/Shootout-C++/objinst: -2.98% (12.0509 => 11.6923, std. dev.: 0.1067) SingleSource/Benchmarks/Misc/mandel-2: -1.39% (3.6262 => 3.5757, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 03:21:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 05:21:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120720102129.A39F42A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2238?compare_to=2235&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2238, Order: 160543, Start Time: 2012-07-20 09:07:29, End Time: 2012-07-20 10:21:43 To: 2235, Order: 160542, Start Time: 2012-07-20 07:25:11, End Time: 2012-07-20 08:39:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (143 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.10% (3.7781 => 3.8574, std. dev.: 0.0184) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.60% (2.0176 => 2.3122, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 9.49% (0.5818 => 0.6370, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.47% (0.7061 => 0.7730, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3578 => 0.3913, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.32% (0.5748 => 0.6284, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.13% (0.3646 => 0.3979, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.11% (0.3601 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.06% (0.3663 => 0.3995, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.04% (0.3650 => 0.3980, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.03% (0.3623 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.00% (0.3789 => 0.4130, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.76% (0.3914 => 0.4257, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.63% (0.3940 => 0.4280, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.59% (0.4003 => 0.4347, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.15% (0.1986 => 0.2128, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 7.00% (1.3693 => 1.4652, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.54% (0.7710 => 0.8214, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (3.9660 => 4.2218, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.19% (0.5265 => 0.5591, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.2596 => 0.2756, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.11% (0.2781 => 0.2951, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 6.00% (0.7038 => 0.7460, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.99% (0.1819 => 0.1928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.4062 => 0.4303, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.58% (0.2760 => 0.2914, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.58% (1.9828 => 2.0934, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2607 => 0.2752, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.56% (0.3022 => 0.3190, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.54% (0.2690 => 0.2839, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2765 => 0.2917, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.43% (0.2966 => 0.3127, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.40% (0.2628 => 0.2770, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.39% (0.3489 => 0.3677, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.36% (0.2761 => 0.2909, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.35% (0.2655 => 0.2797, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.25% (0.3580 => 0.3768, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.21% (0.3149 => 0.3313, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.18% (0.3899 => 0.4101, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.16% (1.2193 => 1.2822, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.14% (0.3485 => 0.3664, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/matrix: 5.12% (0.2988 => 0.3141, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.12% (0.6959 => 0.7315, std. dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.12% (0.4379 => 0.4603, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 5.08% (13.8202 => 14.5227, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.92% (0.9199 => 0.9652, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.89% (0.3453 => 0.3622, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.83% (0.4390 => 0.4602, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: 4.73% (0.3534 => 0.3701, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.5577 => 0.5838, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.63% (0.2914 => 0.3049, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.63% (0.4016 => 0.4202, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.3819 => 1.4457, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.60% (13.2842 => 13.8951, std. dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/lists: 4.59% (0.3293 => 0.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.3868 => 0.4044, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.47% (1.3813 => 1.4430, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.46% (1.4563 => 1.5212, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.3756 => 0.3923, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 4.41% (16.6129 => 17.3450, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.5637 => 0.5884, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.34% (0.2925 => 0.3052, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 4.32% (0.8310 => 0.8669, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.25% (7.2180 => 7.5248, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.22% (1.1364 => 1.1844, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.07% (0.3246 => 0.3378, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.01% (1.3245 => 1.3776, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 4.00% (1.1061 => 1.1503, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 3.97% (1.0594 => 1.1015, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.97% (0.7460 => 0.7756, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.96% (0.7506 => 0.7803, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.81% (3.8646 => 4.0120, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 3.77% (1.9270 => 1.9997, std. dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: 3.63% (1.2292 => 1.2738, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.61% (3.6692 => 3.8016, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.47% (4.3801 => 4.5321, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.38% (0.3755 => 0.3882, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.36% (4.4433 => 4.5926, std. dev.: 0.0069) MultiSource/Benchmarks/McCat/18-imp/imp: 3.32% (0.3220 => 0.3327, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.26% (0.4791 => 0.4947, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.03% (2.1791 => 2.2451, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.01% (4.9865 => 5.1365, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.98% (0.6135 => 0.6318, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.94% (0.6283 => 0.6468, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.93% (0.8698 => 0.8953, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.86% (1.1333 => 1.1657, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.73% (3.1889 => 3.2759, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 2.66% (6.5754 => 6.7501, std. dev.: 0.0116) MultiSource/Benchmarks/McCat/05-eks/eks: 2.48% (0.4113 => 0.4215, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 2.41% (8.4961 => 8.7012, std. dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 2.39% (14.8535 => 15.2079, std. dev.: 0.0094) MultiSource/Applications/ClamAV/clamscan: 2.37% (14.5298 => 14.8745, std. dev.: 0.0153) MultiSource/Applications/sqlite3/sqlite3: 2.30% (16.2614 => 16.6350, std. dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (2.1007 => 2.1426, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.91% (3.2742 => 3.3368, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.86% (1.5188 => 1.5470, std. dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 1.64% (4.6629 => 4.7396, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.03% (0.1824 => 0.3229, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 56.43% (0.1322 => 0.2068, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.75% (0.4846 => 0.6966, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 26.45% (1.8175 => 2.2982, std. dev.: 0.0500) SingleSource/Benchmarks/Misc/mandel-2: 7.32% (1.2998 => 1.3950, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.97% (1.5824 => 1.6769, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.01% (0.9996 => 1.0497, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.39% (7.4271 => 7.7528, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 4.09% (11.2619 => 11.7226, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (12.4560 => 12.8582, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4749, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.79% (2.8606 => 2.9405, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.39% (1.7688 => 1.8110, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.23% (3.7731 => 3.8574, std. dev.: 0.0184) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.15% (2.0200 => 2.0635, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: 2.14% (2.5089 => 2.5625, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.11% (4.1080 => 4.1945, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 2.05% (0.6159 => 0.6285, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.68% (0.8273 => 0.8412, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.53% (1.5089 => 1.5320, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.30% (1.9290 => 1.9541, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 1.27% (2.4679 => 2.4992, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.24% (3.1736 => 3.2131, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6469 => 3.6854, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.43% (22.5627 => 21.1108, std. dev.: 0.0217) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.69% (1.0460 => 0.8610, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.80% (1.2308 => 1.1102, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3089, std. dev.: 0.0039) SingleSource/UnitTests/Vector/multiplies: -4.82% (2.6470 => 2.5194, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9820, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.39% (1.9762 => 1.9093, std. dev.: 0.0097) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.57% (0.4867 => 0.4742, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.23% (0.8342 => 0.8156, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.19% (20.3410 => 19.8962, std. dev.: 0.0637) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2204, std. dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: -1.72% (3.0263 => 2.9742, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.61% (9.9194 => 9.7601, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.59% (7.1097 => 6.9967, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8564, std. dev.: 0.0167) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.5254 => 2.4918, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.33% (9.3358 => 9.2118, std. dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8468, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2598, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 03:30:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 05:30:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120720103024.656222A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2239?compare_to=2236&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2239, Order: 160543, Start Time: 2012-07-20 09:11:52, End Time: 2012-07-20 10:30:37 To: 2236, Order: 160542, Start Time: 2012-07-20 07:24:35, End Time: 2012-07-20 08:43:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (66 on baseline) Performance Improvements: 0 (27 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (780 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.15% (10.3673 => 13.9080, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 11.86% (0.3473 => 0.3885, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 11.61% (0.3497 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.49% (0.3543 => 0.3950, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 11.38% (0.3516 => 0.3916, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 11.37% (0.3543 => 0.3946, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.26% (0.3561 => 0.3962, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.18% (1.1194 => 1.2446, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.02% (0.3694 => 0.4101, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.45% (0.3886 => 0.4292, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 10.44% (0.3927 => 0.4337, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.78% (1.7609 => 1.8979, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.62% (2.2022 => 2.3701, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2065 => 0.2181, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 5.57% (0.5925 => 0.6255, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 5.51% (0.6030 => 0.6362, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.10% (0.3177 => 0.3339, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 5.08% (0.7326 => 0.7698, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 4.36% (10.4361 => 10.8916, std. dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.31% (7.0540 => 7.3581, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.26% (0.8172 => 0.8520, std. dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.20% (0.4615 => 0.4809, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.4879 => 0.5078, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 3.90% (0.3282 => 0.3410, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.85% (0.7433 => 0.7719, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.30% (5.0018 => 5.1668, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.29% (4.9449 => 5.1075, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5569 => 0.5749, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 3.21% (9.4845 => 9.7886, std. dev.: 0.0077) MultiSource/Applications/hbd/hbd: 3.04% (1.5603 => 1.6078, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.04% (0.5860 => 0.6038, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.99% (4.2646 => 4.3919, std. dev.: 0.0059) MultiSource/Applications/spiff/spiff: 2.83% (0.7835 => 0.8057, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.79% (8.1363 => 8.3632, std. dev.: 0.0209) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.4636 => 0.4761, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.54% (14.3668 => 14.7321, std. dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/hash: 2.54% (0.4289 => 0.4398, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.51% (1.5415 => 1.5802, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.3050 => 1.3375, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 2.35% (5.7591 => 5.8947, std. dev.: 0.0060) MultiSource/Applications/d/make_dparser: 2.33% (3.3354 => 3.4130, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.27% (1.1861 => 1.2130, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 2.17% (2.0273 => 2.0713, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 1.99% (1.1642 => 1.1874, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.83% (0.9765 => 0.9944, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.80% (2.0665 => 2.1037, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 1.79% (3.8723 => 3.9417, std. dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/bigfib: 1.75% (0.6456 => 0.6569, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.67% (17.1811 => 17.4687, std. dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.42% (2.2024 => 2.2337, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.40% (1.5859 => 1.6081, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 1.22% (0.8921 => 0.9030, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.14% (1.2842 => 1.2989, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9757, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.61% (5.3999 => 5.7568, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7495, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.23% (1.0313 => 1.0543, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (1.5086 => 1.5382, std. dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: 1.88% (11.6436 => 11.8629, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/whetstone: 1.69% (1.0554 => 1.0732, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.51% (3.1578 => 3.2056, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6897, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2333, std. dev.: 0.0402) SingleSource/Benchmarks/Misc/oourafft: 1.02% (6.6465 => 6.7142, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1283, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.52% (0.8651 => 0.1685, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.52% (5.2763 => 3.1383, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.76% (5.3855 => 3.6749, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.09% (5.3526 => 3.6885, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.65% (2.9384 => 2.5374, std. dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: -10.44% (22.1758 => 19.8602, std. dev.: 0.0296) SingleSource/UnitTests/Vector/constpool: -5.35% (54.1659 => 51.2660, std. dev.: 0.0491) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.67% (3.8922 => 3.8272, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.56% (1.2373 => 1.1066, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: -8.05% (1.5373 => 1.4136, std. dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.26% (8.1563 => 7.8907, std. dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4880, std. dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4190, std. dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.31% (1.7254 => 1.6855, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -2.09% (10.2830 => 10.0683, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.61% (1.3677 => 1.3457, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.58% (2.0866 => 2.0537, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3741, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.48% (2.5528 => 2.5151, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.41% (12.5348 => 12.3575, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.41% (4.2280 => 4.1682, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 05:03:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 07:03:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120720120344.BB1DB2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2240?compare_to=2238&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2240, Order: 160544, Start Time: 2012-07-20 10:49:51, End Time: 2012-07-20 12:03:59 To: 2238, Order: 160543, Start Time: 2012-07-20 09:07:29, End Time: 2012-07-20 10:21:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (142 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.97% (2.0176 => 2.3196, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3578 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.47% (0.7061 => 0.7730, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 9.47% (0.5818 => 0.6369, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.47% (0.3601 => 0.3942, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.47% (0.3623 => 0.3966, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.41% (0.3646 => 0.3989, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.40% (0.3650 => 0.3993, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 9.39% (0.3663 => 0.4007, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.32% (0.5748 => 0.6284, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.32% (0.3789 => 0.4142, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.15% (0.3914 => 0.4272, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.09% (0.3940 => 0.4298, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.07% (0.4003 => 0.4366, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.24% (0.7710 => 0.8268, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 7.00% (1.3693 => 1.4651, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.82% (0.7038 => 0.7518, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.64% (3.9660 => 4.2295, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.2721 => 0.2898, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.47% (0.2596 => 0.2764, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.44% (0.5265 => 0.5604, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 6.28% (0.4062 => 0.4317, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.17% (0.4328 => 0.4595, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1819 => 0.1929, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 5.72% (0.2781 => 0.2940, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.56% (0.6959 => 0.7346, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.39% (0.4379 => 0.4615, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.36% (1.9828 => 2.0891, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3022 => 0.3184, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.32% (0.2782 => 0.2930, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.30% (0.3489 => 0.3674, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.28% (1.2193 => 1.2837, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.28% (0.2765 => 0.2911, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.28% (0.2690 => 0.2832, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.26% (0.2607 => 0.2744, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.25% (0.2760 => 0.2905, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.25% (0.2761 => 0.2906, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.24% (0.2655 => 0.2794, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.21% (0.2726 => 0.2868, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.19% (13.8202 => 14.5377, std. dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.19% (0.9199 => 0.9676, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.2937 => 0.3088, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (0.2628 => 0.2762, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.97% (0.2696 => 0.2830, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.96% (0.3107 => 0.3261, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.93% (0.5577 => 0.5852, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 4.89% (0.3149 => 0.3303, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (0.3485 => 0.3655, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.2988 => 0.3133, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 4.80% (16.6129 => 17.4105, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.72% (13.2842 => 13.9114, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.70% (1.4563 => 1.5247, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.67% (0.4390 => 0.4595, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 4.67% (0.3192 => 0.3341, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.64% (0.3534 => 0.3698, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.57% (1.3813 => 1.4444, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.3453 => 0.3610, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.53% (0.2914 => 0.3046, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.52% (0.5637 => 0.5892, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.3756 => 0.3923, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.44% (0.3246 => 0.3390, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.44% (1.3819 => 1.4432, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 4.43% (0.3293 => 0.3439, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.43% (0.4016 => 0.4194, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.42% (1.1061 => 1.1550, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 4.40% (3.8646 => 4.0348, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.36% (1.1364 => 1.1860, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.32% (7.2180 => 7.5301, std. dev.: 0.0073) MultiSource/Applications/spiff/spiff: 4.30% (0.7506 => 0.7829, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.20% (1.3245 => 1.3801, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 4.19% (0.3868 => 0.4030, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.16% (0.8310 => 0.8656, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.15% (1.9270 => 2.0069, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2945 => 0.3065, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.06% (0.7460 => 0.7763, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.04% (1.0594 => 1.1022, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.74% (1.2292 => 1.2752, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.69% (2.1791 => 2.2594, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.68% (3.6692 => 3.8044, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.67% (4.3801 => 4.5408, std. dev.: 0.0060) MultiSource/Benchmarks/McCat/18-imp/imp: 3.66% (0.3220 => 0.3338, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.51% (4.4433 => 4.5992, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.12% (0.3755 => 0.3872, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.1333 => 1.1680, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.92% (4.9865 => 5.1321, std. dev.: 0.0041) MultiSource/Applications/d/make_dparser: 2.87% (3.1889 => 3.2805, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.83% (0.6283 => 0.6461, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 2.80% (0.4113 => 0.4228, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.75% (0.6135 => 0.6304, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (6.5754 => 6.7497, std. dev.: 0.0156) MultiSource/Benchmarks/mafft/pairlocalalign: 2.61% (8.4961 => 8.7182, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 2.49% (14.8535 => 15.2229, std. dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 2.48% (14.5298 => 14.8897, std. dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: 2.34% (16.2614 => 16.6420, std. dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.16% (2.1007 => 2.1461, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.03% (3.2742 => 3.3406, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.99% (1.5188 => 1.5490, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 1.69% (4.6629 => 4.7415, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.22% (0.9108 => 0.9219, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.14% (1.0313 => 1.0431, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 76.92% (0.1824 => 0.3227, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 56.51% (0.1322 => 0.2069, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.40% (1.8175 => 2.2974, std. dev.: 0.0429) SingleSource/Benchmarks/Misc/mandel-2: 7.59% (1.2998 => 1.3984, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.95% (1.5824 => 1.6766, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.33% (0.9996 => 1.0529, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.26% (7.4271 => 7.7438, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 4.08% (11.2619 => 11.7218, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.24% (12.4560 => 12.8597, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4748, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.79% (2.8606 => 2.9405, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.36% (1.7688 => 1.8106, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.19% (2.0200 => 2.0642, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 2.14% (2.5089 => 2.5625, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.11% (4.1080 => 4.1946, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 2.05% (1.4298 => 1.4591, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 2.01% (0.6159 => 0.6283, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5336, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1941, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 1.27% (2.4679 => 2.4992, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.25% (1.9290 => 1.9532, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 1.18% (3.1736 => 3.2111, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6869, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.54% (22.5627 => 21.0861, std. dev.: 0.0177) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.70% (1.0460 => 0.8609, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.54% (0.0997 => 0.0852, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1020, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -4.81% (2.6470 => 2.5198, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3136, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.37% (1.9762 => 1.9096, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.29% (0.4533 => 0.4429, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.21% (0.8342 => 0.8158, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2286, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5037, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9720, std. dev.: 0.0166) MultiSource/Applications/spiff/spiff: -1.79% (3.0263 => 2.9721, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.59% (9.9194 => 9.7613, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.59% (7.1097 => 6.9966, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std. dev.: 0.0094) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.18% (3.8887 => 3.8429, std. dev.: 0.0068) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2572, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 05:17:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 07:17:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120720121700.8DEF02A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2241?compare_to=2239&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2241, Order: 160544, Start Time: 2012-07-20 10:58:47, End Time: 2012-07-20 12:17:16 To: 2239, Order: 160543, Start Time: 2012-07-20 09:11:52, End Time: 2012-07-20 10:30:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (66 on baseline) Performance Improvements: 1 (27 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (780 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.50% (3.7651 => 3.8215, std. dev.: 0.0144) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.07% (1.6078 => 1.5906, std. dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.87% (10.3673 => 13.9819, std. dev.: 0.0104) SingleSource/UnitTests/ObjC/trivial-interface: 11.58% (0.3473 => 0.3875, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.35% (0.3497 => 0.3894, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.32% (0.3543 => 0.3944, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 11.29% (0.3516 => 0.3913, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 11.26% (0.3543 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.20% (0.3561 => 0.3960, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (1.1194 => 1.2432, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.61% (0.3828 => 0.4234, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.58% (0.3886 => 0.4297, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3927 => 0.4335, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.83% (2.2022 => 2.3746, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.73% (1.7609 => 1.8970, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 5.36% (0.6030 => 0.6353, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 5.28% (0.5925 => 0.6238, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.13% (0.3177 => 0.3340, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 4.95% (0.7326 => 0.7689, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 4.75% (10.4361 => 10.9313, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.16% (0.4879 => 0.5082, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.16% (0.4615 => 0.4807, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.99% (7.0540 => 7.3356, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.99% (0.5569 => 0.5791, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 3.81% (0.3282 => 0.3407, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.71% (0.7433 => 0.7709, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.40% (0.8172 => 0.8450, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.27% (4.9449 => 5.1067, std. dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (9.4845 => 9.7871, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.14% (5.0018 => 5.1589, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.04% (0.5860 => 0.6038, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.94% (0.7835 => 0.8065, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.93% (4.2646 => 4.3897, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.65% (8.1363 => 8.3516, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.52% (14.3668 => 14.7295, std. dev.: 0.0127) MultiSource/Applications/oggenc/oggenc: 2.47% (5.7591 => 5.9016, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.42% (1.3050 => 1.3366, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.42% (1.1861 => 1.2148, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.5415 => 1.5785, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 2.35% (3.3354 => 3.4139, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 2.24% (2.0273 => 2.0727, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.23% (0.8067 => 0.8247, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 2.14% (1.1642 => 1.1891, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 1.94% (1.5603 => 1.5906, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.93% (0.9765 => 0.9953, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.83% (3.8723 => 3.9431, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.75% (2.2024 => 2.2410, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.58% (0.6450 => 0.6552, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 1.57% (17.1811 => 17.4512, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.53% (1.5859 => 1.6101, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.45% (1.4186 => 1.4391, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 1.22% (0.8921 => 0.9030, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 1.06% (1.1840 => 1.1965, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9756, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.60% (5.3999 => 5.7561, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7570, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.87% (11.6436 => 11.8619, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5086 => 1.5344, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.51% (3.1578 => 3.2054, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6901, std. dev.: 0.0011) MultiSource/Benchmarks/llubenchmark/llu: 1.15% (3.7781 => 3.8215, std. dev.: 0.0144) MultiSource/Applications/minisat/minisat: 1.04% (9.1159 => 9.2109, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/oourafft: 1.04% (6.6465 => 6.7153, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.51% (0.8651 => 0.1686, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.50% (5.2763 => 3.1395, std. dev.: 0.0160) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.84% (5.3855 => 3.6710, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.17% (5.3526 => 3.6840, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.65% (2.9384 => 2.5373, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -10.42% (22.1758 => 19.8661, std. dev.: 0.0275) SingleSource/UnitTests/Vector/constpool: -5.26% (54.1659 => 51.3175, std. dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.60% (3.8922 => 3.8300, std. dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.59% (1.1492 => 0.7632, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.10% (1.2373 => 1.1123, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel-2: -9.35% (1.5373 => 1.3936, std. dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.21% (8.1563 => 7.8945, std. dev.: 0.0111) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4791, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.6802 => 8.4305, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.28% (1.7254 => 1.6860, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.13% (10.2830 => 10.0641, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.61% (2.0866 => 2.0531, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.49% (1.3677 => 1.3473, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.48% (2.5528 => 2.5150, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.44% (12.5348 => 12.3538, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.41% (4.2280 => 4.1684, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 05:52:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 07:52:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120720125237.E14C22A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2242?compare_to=2237&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2242, Order: 160543, Start Time: 2012-07-20 10:07:59, End Time: 2012-07-20 12:52:54 To: 2237, Order: 160541, Start Time: 2012-07-20 06:53:49, End Time: 2012-07-20 09:39:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (93 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (793 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 20.80% (0.4193 => 0.5065, std. dev.: 0.0210) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 33.57% (0.3792 => 0.5065, std. dev.: 0.0210) SingleSource/UnitTests/ObjC/exceptions-4: 13.30% (0.3465 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.24% (0.3460 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.23% (0.3446 => 0.3902, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.22% (0.3442 => 0.3897, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.19% (0.3496 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.16% (0.3488 => 0.3947, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/synchronized: 13.12% (0.3469 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.60% (0.3650 => 0.4110, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions: 12.54% (0.3643 => 0.4100, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.11% (0.3724 => 0.4175, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.85% (0.5826 => 0.6225, std. dev.: 0.0080) SingleSource/UnitTests/ObjC++/property-reference-object: 6.61% (0.5889 => 0.6278, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.42% (0.1620 => 0.1724, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 5.86% (0.7171 => 0.7591, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.19% (1.6211 => 1.7053, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.17% (0.5026 => 0.5286, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.09% (3.5627 => 3.7442, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 4.94% (1.5932 => 1.6719, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.85% (0.5900 => 0.6186, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.85% (0.4994 => 0.5236, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.82% (0.4361 => 0.4571, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.58% (0.5000 => 0.5229, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.58% (1.3152 => 1.3754, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 4.40% (0.9697 => 1.0124, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 4.33% (1.0781 => 1.1248, std. dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.31% (2.7292 => 2.8469, std. dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.30% (0.3930 => 0.4099, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 4.24% (0.4029 => 0.4200, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 4.20% (4.2109 => 4.3879, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 4.05% (0.2566 => 0.2670, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2725 => 0.2834, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.93% (0.2875 => 0.2988, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.91% (0.2714 => 0.2820, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.88% (0.9909 => 1.0293, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.83% (0.2738 => 0.2843, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.81% (0.2729 => 0.2833, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.73% (0.2866 => 0.2973, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 3.68% (0.2823 => 0.2927, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.60% (0.2803 => 0.2904, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.59% (0.2811 => 0.2912, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.56% (0.3845 => 0.3982, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.56% (2.0673 => 2.1408, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 3.55% (0.3096 => 0.3206, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.54% (5.5417 => 5.7381, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.54% (0.4658 => 0.4823, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 3.53% (0.3258 => 0.3373, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.34% (0.3267 => 0.3376, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.33% (1.9966 => 2.0630, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (2.1013 => 2.1708, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.30% (1.9694 => 2.0344, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 3.29% (0.3317 => 0.3426, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.23% (0.3124 => 0.3225, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.19% (0.3195 => 0.3297, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.16% (0.3890 => 0.4013, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.15% (0.3362 => 0.3468, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 3.10% (4.6177 => 4.7610, std. dev.: 0.0148) MultiSource/Applications/JM/ldecod/ldecod: 3.07% (2.1653 => 2.2317, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (4.4195 => 4.5513, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 2.93% (0.3726 => 0.3835, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 2.91% (0.3678 => 0.3785, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.81% (1.8794 => 1.9323, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (0.3625 => 0.3725, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.74% (0.6634 => 0.6816, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 2.70% (0.4146 => 0.4258, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.69% (0.3903 => 0.4008, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.65% (0.7875 => 0.8084, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 2.56% (0.5546 => 0.5688, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 2.45% (0.4251 => 0.4355, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.44% (0.4139 => 0.4240, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.30% (1.4269 => 1.4597, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 2.16% (23.5202 => 24.0274, std. dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.69% (0.6435 => 0.6544, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.47% (2.0346 => 2.0646, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.40% (5.2852 => 11.7541, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.60% (0.2162 => 0.3364, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.92% (10.7630 => 13.6609, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.52% (0.5589 => 0.6736, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/objinst: 19.47% (9.4436 => 11.2825, std. dev.: 0.0446) SingleSource/Benchmarks/Shootout/lists: 13.38% (32.9687 => 37.3798, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/flops: 6.98% (15.4430 => 16.5210, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.79% (3.3903 => 3.6206, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: 5.40% (19.6305 => 20.6915, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 4.75% (2.8036 => 2.9369, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-2: 4.52% (1.8057 => 1.8874, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.08% (2.2962 => 2.3899, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.42% (3.1722 => 3.2491, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (3.1728 => 3.2463, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 2.08% (17.2379 => 17.5968, std. dev.: 0.0535) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1894, std. dev.: 0.0550) MultiSource/Applications/sgefa/sgefa: 1.42% (1.5554 => 1.5775, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.05% (2.4764 => 2.3760, std. dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: -1.81% (11.9555 => 11.7395, std. dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.82% (6.2401 => 4.1299, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -10.12% (0.2402 => 0.2159, std. dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: -4.36% (14.0481 => 13.4360, std. dev.: 0.0283) SingleSource/Benchmarks/Misc/salsa20: -3.81% (35.5013 => 34.1494, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: -3.12% (12.0509 => 11.6744, std. dev.: 0.0406) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5754, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 06:46:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 08:46:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120720134602.9DCB62A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2243?compare_to=2240&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2243, Order: 160546, Start Time: 2012-07-20 12:32:00, End Time: 2012-07-20 13:46:17 To: 2240, Order: 160544, Start Time: 2012-07-20 10:49:51, End Time: 2012-07-20 12:03:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (145 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.88% (54.3598 => 56.4679, std. dev.: 0.0726) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.17% (2.0176 => 2.3236, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 9.73% (0.3578 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.53% (0.3601 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.48% (0.3650 => 0.3996, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.41% (0.3646 => 0.3989, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.36% (0.3623 => 0.3962, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.35% (0.5818 => 0.6362, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.34% (0.3663 => 0.4005, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.32% (0.3789 => 0.4142, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.26% (0.5748 => 0.6280, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.12% (0.7061 => 0.7705, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/parameter-passing: 9.04% (0.4003 => 0.4365, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.99% (0.3914 => 0.4266, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.93% (0.3940 => 0.4292, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.15% (1.3693 => 1.4672, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.86% (0.5265 => 0.5626, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.7710 => 0.8238, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (3.9660 => 4.2296, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 6.45% (0.7038 => 0.7492, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.99% (0.1819 => 0.1928, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.97% (0.2781 => 0.2947, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.83% (0.4062 => 0.4299, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.63% (0.6959 => 0.7351, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.59% (1.9828 => 2.0937, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.56% (0.3022 => 0.3190, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.54% (0.2782 => 0.2936, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.53% (0.2765 => 0.2918, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (0.4379 => 0.4620, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.50% (0.2726 => 0.2876, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.49% (0.3899 => 0.4113, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2607 => 0.2750, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.43% (0.2761 => 0.2911, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.42% (0.4390 => 0.4628, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.42% (0.3489 => 0.3678, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2690 => 0.2835, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.37% (0.2628 => 0.2769, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.36% (0.2760 => 0.2908, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.36% (0.2966 => 0.3125, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.35% (13.8202 => 14.5596, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.35% (0.2655 => 0.2797, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.31% (0.3580 => 0.3770, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.30% (1.2193 => 1.2839, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.27% (0.5577 => 0.5871, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.24% (0.2937 => 0.3091, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.19% (0.9199 => 0.9676, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.3107 => 0.3268, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2696 => 0.2834, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.05% (0.3485 => 0.3661, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.99% (0.2988 => 0.3137, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.96% (13.2842 => 13.9428, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.91% (1.3813 => 1.4491, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 4.89% (0.3192 => 0.3348, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.75% (0.3453 => 0.3617, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.71% (1.3819 => 1.4470, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 4.70% (16.6129 => 17.3945, std. dev.: 0.0149) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.63% (0.4016 => 0.4202, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3293 => 0.3443, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.53% (1.4563 => 1.5222, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.52% (0.5637 => 0.5892, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.51% (7.2180 => 7.5433, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.49% (1.1364 => 1.1874, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 4.47% (0.3868 => 0.4041, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.46% (0.7506 => 0.7841, std. dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.3756 => 0.3923, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.39% (0.2914 => 0.3042, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.34% (0.7460 => 0.7784, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.32% (1.3245 => 1.3817, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.31% (0.3246 => 0.3386, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.27% (3.8646 => 4.0295, std. dev.: 0.0060) MultiSource/Applications/Burg/burg: 4.19% (1.1061 => 1.1524, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 4.16% (0.8310 => 0.8656, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.13% (1.0594 => 1.1032, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.13% (1.9270 => 2.0066, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 4.01% (0.2945 => 0.3063, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.80% (3.6692 => 3.8086, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.76% (1.2292 => 1.2754, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.70% (4.3801 => 4.5420, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (4.4433 => 4.6030, std. dev.: 0.0058) MultiSource/Applications/siod/siod: 3.58% (2.1791 => 2.2571, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.54% (0.3220 => 0.3334, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.36% (0.4791 => 0.4952, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.25% (0.3755 => 0.3877, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.14% (1.1333 => 1.1689, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.14% (0.6283 => 0.6480, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.05% (3.1889 => 3.2863, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.05% (4.9865 => 5.1388, std. dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.87% (0.8698 => 0.8948, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (6.5754 => 6.7639, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.84% (0.6135 => 0.6309, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.72% (14.8535 => 15.2569, std. dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: 2.65% (16.2614 => 16.6923, std. dev.: 0.0422) MultiSource/Benchmarks/mafft/pairlocalalign: 2.65% (8.4961 => 8.7210, std. dev.: 0.0102) MultiSource/Benchmarks/McCat/05-eks/eks: 2.63% (0.4113 => 0.4221, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.58% (14.5298 => 14.9046, std. dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.18% (2.1007 => 2.1465, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.07% (3.2742 => 3.3419, std. dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: 1.88% (4.6629 => 4.7506, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.86% (1.5188 => 1.5470, std. dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.24% (0.9108 => 0.9221, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.14% (1.0313 => 1.0431, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.08% (0.1824 => 0.3230, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 56.51% (0.1322 => 0.2069, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.89% (1.8175 => 2.3063, std. dev.: 0.0367) SingleSource/Benchmarks/Misc/mandel-2: 8.23% (1.2998 => 1.4068, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.96% (1.5824 => 1.6767, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.37% (0.9996 => 1.0533, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.26% (7.4271 => 7.7434, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 4.09% (11.2619 => 11.7229, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (12.4560 => 12.8574, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4743, std. dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 3.00% (3.7731 => 3.8864, std. dev.: 0.0351) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.79% (2.8606 => 2.9405, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.43% (1.7688 => 1.8117, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.18% (2.0200 => 2.0640, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5624, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.09% (4.1080 => 4.1940, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 2.06% (0.6159 => 0.6286, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.00% (1.0310 => 1.0516, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std. dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9593, std. dev.: 0.0071) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5074, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 1.36% (0.7499 => 0.7601, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 1.26% (2.4679 => 2.4991, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.36% (22.5627 => 21.1286, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.69% (1.0460 => 0.8610, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2308 => 1.1047, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -4.90% (2.6470 => 2.5172, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.87% (1.3780 => 1.3109, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.35% (1.9762 => 1.9099, std. dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.23% (0.8342 => 0.8156, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2233, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.85% (20.3410 => 19.9637, std. dev.: 0.0562) MultiSource/Applications/spiff/spiff: -1.78% (3.0263 => 2.9724, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7603, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.59% (7.1097 => 6.9964, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.36% (2.5254 => 2.4910, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8644, std. dev.: 0.0056) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2169, std. dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2580, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 07:03:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 09:03:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120720140333.38C572A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2244?compare_to=2241&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2244, Order: 160546, Start Time: 2012-07-20 12:45:14, End Time: 2012-07-20 14:03:48 To: 2241, Order: 160544, Start Time: 2012-07-20 10:58:47, End Time: 2012-07-20 12:17:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (69 on baseline) Performance Improvements: 0 (27 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (777 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.89% (54.8075 => 56.3889, std. dev.: 0.1759) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.09% (10.3673 => 14.1088, std. dev.: 0.0086) SingleSource/UnitTests/ObjC/trivial-interface: 11.52% (0.3473 => 0.3873, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.43% (1.1194 => 1.2474, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.37% (0.3543 => 0.3946, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 11.32% (0.3543 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.30% (0.3497 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.18% (0.3516 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3561 => 0.3955, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.80% (0.3694 => 0.4093, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.42% (0.3886 => 0.4291, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.3927 => 0.4336, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.95% (2.2022 => 2.3773, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.78% (1.7609 => 1.8979, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2065 => 0.2181, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 5.30% (10.4361 => 10.9888, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.26% (0.3177 => 0.3344, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.25% (0.5925 => 0.6236, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.24% (0.6030 => 0.6346, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.52% (0.8172 => 0.8541, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.37% (7.0540 => 7.3625, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.4879 => 0.5092, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 4.24% (0.3282 => 0.3421, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.22% (0.7326 => 0.7635, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.10% (0.4615 => 0.4804, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 3.82% (0.7433 => 0.7717, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.50% (4.9449 => 5.1180, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.43% (0.5569 => 0.5760, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (9.4845 => 9.7961, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.25% (5.0018 => 5.1646, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.09% (0.5860 => 0.6041, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (4.2646 => 4.3961, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.84% (8.1363 => 8.3670, std. dev.: 0.0076) MultiSource/Applications/spiff/spiff: 2.80% (0.7835 => 0.8054, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.51% (14.3668 => 14.7278, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.46% (1.5415 => 1.5794, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 2.45% (5.7591 => 5.9001, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.44% (1.1861 => 1.2151, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.3050 => 1.3368, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 2.40% (3.3354 => 3.4154, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.29% (0.8067 => 0.8252, std. dev.: 0.0052) MultiSource/Applications/treecc/treecc: 2.20% (2.0273 => 2.0720, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.17% (1.1642 => 1.1895, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 1.94% (1.5603 => 1.5905, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.92% (0.9765 => 0.9952, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 1.77% (3.8723 => 3.9408, std. dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.75% (0.6450 => 0.6563, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.68% (2.2024 => 2.2395, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.68% (1.5859 => 1.6126, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.60% (17.1811 => 17.4563, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.53% (0.6675 => 0.6777, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.42% (1.4186 => 1.4388, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 1.28% (0.8921 => 0.9035, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.08% (2.2969 => 2.3217, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 1.05% (1.1840 => 1.1964, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9755, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.65% (5.3999 => 5.7590, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7527, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 2.02% (3.7781 => 3.8546, std. dev.: 0.0272) MultiSource/Benchmarks/nbench/nbench: 1.88% (11.6436 => 11.8628, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/hash2: 1.70% (3.1578 => 3.2116, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5086 => 1.5343, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.44% (2.6546 => 2.6928, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2282, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/oourafft: 1.02% (6.6465 => 6.7145, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -80.49% (0.8651 => 0.1688, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.37% (5.2763 => 3.1462, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.67% (5.3855 => 3.6799, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.95% (5.3526 => 3.6960, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.33% (2.9384 => 2.5466, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -10.27% (22.1758 => 19.8980, std. dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -5.21% (54.1659 => 51.3426, std. dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.44% (3.8922 => 3.8361, std. dev.: 0.0170) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.09% (1.2373 => 1.1125, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -8.38% (1.5373 => 1.4084, std. dev.: 0.0237) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4790, std. dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (8.1563 => 7.9003, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4176, std. dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.27% (1.7254 => 1.6862, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.11% (10.2830 => 10.0657, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.60% (2.0866 => 2.0532, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.55% (1.3677 => 1.3465, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.50% (2.5528 => 2.5145, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -1.42% (12.5348 => 12.3570, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.33% (4.2280 => 4.1717, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 09:05:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 11:05:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120720160531.9E3DE2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2245?compare_to=2242&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2245, Order: 160546, Start Time: 2012-07-20 13:20:59, End Time: 2012-07-20 16:05:46 To: 2242, Order: 160543, Start Time: 2012-07-20 10:07:59, End Time: 2012-07-20 12:52:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (70 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (816 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 5.03% (0.5065 => 0.5320, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.15% (54.2081 => 54.8325, std. dev.: 0.0464) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 40.30% (0.3792 => 0.5320, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3465 => 0.3904, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.59% (0.3446 => 0.3880, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.59% (0.3496 => 0.3936, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.54% (0.3460 => 0.3894, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.51% (0.3469 => 0.3903, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/trivial-interface: 12.49% (0.3442 => 0.3872, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.47% (0.3488 => 0.3923, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.05% (0.3650 => 0.4090, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.91% (0.3643 => 0.4077, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.49% (0.3724 => 0.4152, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.09% (0.5826 => 0.6239, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.74% (0.5889 => 0.6286, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.1620 => 0.1722, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 6.05% (0.7171 => 0.7605, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.27% (1.6211 => 1.7065, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 5.12% (1.5932 => 1.6747, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.09% (3.5627 => 3.7442, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.81% (0.4994 => 0.5234, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.76% (0.5026 => 0.5265, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.59% (0.4029 => 0.4214, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.59% (0.4361 => 0.4561, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.49% (1.3152 => 1.3743, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.42% (0.5900 => 0.6161, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.28% (0.5000 => 0.5214, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.20% (0.3930 => 0.4095, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 4.01% (4.2109 => 4.3797, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 3.95% (1.0781 => 1.1207, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.89% (2.7292 => 2.8355, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.2866 => 0.2970, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (0.4658 => 0.4819, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.40% (5.5417 => 5.7300, std. dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 3.24% (0.9909 => 1.0230, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (2.1013 => 2.1684, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.16% (1.9694 => 2.0317, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.09% (0.3362 => 0.3466, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.07% (0.3845 => 0.3963, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.06% (1.9966 => 2.0576, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.03% (0.3890 => 0.4008, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.03% (2.0673 => 2.1300, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 3.01% (2.1653 => 2.2304, std. dev.: 0.0066) MultiSource/Applications/hbd/hbd: 3.00% (0.9697 => 0.9988, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.00% (0.4139 => 0.4263, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.95% (4.6177 => 4.7539, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (0.3903 => 0.4016, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.82% (4.4195 => 4.5440, std. dev.: 0.0039) MultiSource/Applications/treecc/treecc: 2.72% (0.7875 => 0.8089, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (1.8794 => 1.9282, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 2.44% (0.6634 => 0.6796, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.40% (0.5546 => 0.5679, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.23% (1.4269 => 1.4587, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 1.82% (23.5202 => 23.9486, std. dev.: 0.0149) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.40% (5.2852 => 11.7544, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.13% (0.2162 => 0.3354, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.94% (10.7630 => 13.6628, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.22% (0.5589 => 0.6719, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout/objinst: 19.13% (9.4436 => 11.2506, std. dev.: 0.0194) SingleSource/Benchmarks/Shootout/lists: 13.46% (32.9687 => 37.4057, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops: 7.01% (15.4430 => 16.5250, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.70% (3.3903 => 3.6175, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: 5.42% (19.6305 => 20.6935, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: 4.95% (2.8036 => 2.9425, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/flops-2: 4.69% (1.8057 => 1.8904, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.07% (2.2962 => 2.3897, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.53% (3.1722 => 3.2524, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (3.1728 => 3.2464, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 1.90% (15.8721 => 16.1736, std. dev.: 0.0060) MultiSource/Applications/sgefa/sgefa: 1.42% (1.5554 => 1.5775, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.38% (2.4764 => 2.3928, std. dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: -2.08% (11.9555 => 11.7067, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.82% (6.2401 => 4.1298, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -7.12% (0.2402 => 0.2231, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -4.75% (14.0481 => 13.3804, std. dev.: 0.0635) SingleSource/Benchmarks/Misc/salsa20: -3.85% (35.5013 => 34.1362, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: -2.81% (12.0509 => 11.7125, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5755, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 11:30:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 13:30:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120720183031.D3FF02A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2246?compare_to=2243&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2246, Order: 160549, Start Time: 2012-07-20 17:16:39, End Time: 2012-07-20 18:30:46 To: 2243, Order: 160546, Start Time: 2012-07-20 12:32:00, End Time: 2012-07-20 13:46:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (145 on baseline) Performance Improvements: 1 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.20% (3.8864 => 3.7620, std. dev.: 0.0275) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.15% (2.0176 => 2.3233, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.81% (0.3578 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3601 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.49% (0.3646 => 0.3992, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.48% (0.3650 => 0.3996, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/synchronized: 9.45% (0.3663 => 0.4009, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.42% (0.5818 => 0.6366, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.41% (0.3623 => 0.3964, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.32% (0.3789 => 0.4142, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.24% (0.5748 => 0.6279, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.10% (0.3914 => 0.4270, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.07% (0.4003 => 0.4366, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.04% (0.3940 => 0.4296, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.84% (0.7061 => 0.7685, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.05% (1.3693 => 1.4659, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.72% (0.7710 => 0.8228, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.66% (3.9660 => 4.2303, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.2721 => 0.2898, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.46% (0.5265 => 0.5605, std. dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 6.45% (0.7038 => 0.7492, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.33% (0.4328 => 0.4602, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 5.83% (0.4062 => 0.4299, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 5.83% (0.2781 => 0.2943, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.76% (0.6959 => 0.7360, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.56% (0.3022 => 0.3190, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 5.52% (0.2607 => 0.2751, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.49% (1.9828 => 2.0916, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.48% (0.4379 => 0.4619, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.47% (0.2726 => 0.2875, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2690 => 0.2837, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.46% (0.3899 => 0.4112, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.46% (0.2655 => 0.2800, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.3489 => 0.3679, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.38% (0.4390 => 0.4626, std. dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 5.35% (13.8202 => 14.5602, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.35% (1.2193 => 1.2845, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.33% (0.2966 => 0.3124, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.29% (0.2628 => 0.2767, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.29% (0.2761 => 0.2907, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.25% (0.3580 => 0.3768, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.21% (0.3149 => 0.3313, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.19% (0.2696 => 0.2836, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.16% (0.9199 => 0.9674, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.15% (0.2988 => 0.3142, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.02% (0.3485 => 0.3660, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 4.95% (0.3192 => 0.3350, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.85% (13.2842 => 13.9283, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.84% (0.5577 => 0.5847, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 4.81% (0.3534 => 0.3704, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.76% (1.3813 => 1.4471, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.76% (16.6129 => 17.4029, std. dev.: 0.0123) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.75% (0.2127 => 0.2228, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.4016 => 0.4205, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.67% (1.3819 => 1.4464, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.59% (1.1364 => 1.1886, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.58% (1.4563 => 1.5230, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3293 => 0.3443, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.55% (7.2180 => 7.5467, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.50% (0.2914 => 0.3045, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.49% (0.5637 => 0.5890, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.47% (0.3756 => 0.3924, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.44% (0.3246 => 0.3390, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.42% (0.3868 => 0.4039, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.41% (1.1061 => 1.1549, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 4.34% (3.8646 => 4.0325, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.30% (1.3245 => 1.3815, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.27% (0.8310 => 0.8665, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 4.25% (0.7506 => 0.7825, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.17% (1.0594 => 1.1036, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.12% (0.7460 => 0.7767, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.10% (1.9270 => 2.0061, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2945 => 0.3065, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.80% (3.6692 => 3.8088, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (4.3801 => 4.5459, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.78% (1.2292 => 1.2757, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.77% (4.4433 => 4.6106, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 3.63% (0.3220 => 0.3337, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.45% (2.1791 => 2.2543, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.34% (0.4791 => 0.4951, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.25% (0.3755 => 0.3877, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.17% (1.1333 => 1.1692, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.07% (4.9865 => 5.1396, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6283 => 0.6474, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.01% (3.1889 => 3.2848, std. dev.: 0.0115) MultiSource/Applications/JM/ldecod/ldecod: 2.96% (6.5754 => 6.7703, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.87% (0.6135 => 0.6311, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.84% (0.8698 => 0.8945, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.69% (16.2614 => 16.6992, std. dev.: 0.0132) MultiSource/Applications/JM/lencod/lencod: 2.68% (14.8535 => 15.2509, std. dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 2.65% (8.4961 => 8.7216, std. dev.: 0.0065) MultiSource/Benchmarks/McCat/05-eks/eks: 2.63% (0.4113 => 0.4221, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.52% (14.5298 => 14.8962, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.25% (2.1007 => 2.1480, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.08% (1.5188 => 1.5504, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.05% (3.2742 => 3.3412, std. dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 1.89% (4.6629 => 4.7510, std. dev.: 0.0134) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.31% (0.9108 => 0.9227, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.23% (3.7467 => 3.7929, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.20% (1.0313 => 1.0437, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.14% (0.1824 => 0.3231, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 56.73% (0.1322 => 0.2072, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 25.73% (1.8175 => 2.2851, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/mandel-2: 7.31% (1.2998 => 1.3948, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.96% (1.5824 => 1.6767, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.50% (0.9996 => 1.0546, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7554, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.08% (11.2619 => 11.7214, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 3.70% (1.9144 => 1.9852, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (12.4560 => 12.8574, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4742, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.80% (2.8606 => 2.9406, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.17% (2.0200 => 2.0639, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5624, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.08% (4.1080 => 4.1935, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 2.06% (0.6159 => 0.6286, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 1.26% (2.4679 => 2.4990, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.20% (3.6469 => 3.6907, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: 1.19% (3.1736 => 3.2114, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.5627 => 21.1487, std. dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.88% (0.3511 => 0.3410, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.69% (1.0460 => 0.8610, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.43% (1.2308 => 1.1024, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -4.81% (2.6470 => 2.5197, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.17% (1.3780 => 1.3205, std. dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: -3.37% (1.9762 => 1.9097, std. dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.59% (0.4867 => 0.4741, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.23% (0.8342 => 0.8156, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2278, std. dev.: 0.0087) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5062, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.89% (20.3410 => 19.9567, std. dev.: 0.0502) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -1.70% (3.0263 => 2.9748, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.61% (9.9194 => 9.7600, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9963, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2215, std. dev.: 0.0349) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2587, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 11:35:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 13:35:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120720183503.76A9A2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2247?compare_to=2244&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2247, Order: 160549, Start Time: 2012-07-20 17:16:41, End Time: 2012-07-20 18:35:17 To: 2244, Order: 160546, Start Time: 2012-07-20 12:45:14, End Time: 2012-07-20 14:03:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (64 on baseline) Performance Improvements: 0 (26 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (783 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.23% (7.9423 => 8.0399, std. dev.: 0.0232) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.12% (10.3673 => 14.1119, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.51% (1.1194 => 1.2482, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 11.49% (0.3473 => 0.3872, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 11.30% (0.3497 => 0.3892, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.21% (0.3543 => 0.3940, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3543 => 0.3940, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 11.15% (0.3516 => 0.3908, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3561 => 0.3955, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.88% (0.3694 => 0.4096, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.63% (0.3828 => 0.4235, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/property: 10.42% (0.3886 => 0.4291, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3927 => 0.4335, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.86% (2.2022 => 2.3754, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.82% (1.7609 => 1.8986, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.29% (0.3177 => 0.3345, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 5.26% (0.6030 => 0.6347, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 5.16% (0.5925 => 0.6231, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.16% (10.4361 => 10.9746, std. dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.3121 => 0.3272, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.4879 => 0.5096, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.36% (7.0540 => 7.3618, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 4.30% (0.3282 => 0.3423, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.18% (0.4615 => 0.4808, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 4.16% (0.7326 => 0.7631, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.07% (0.8172 => 0.8505, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 3.82% (0.7433 => 0.7717, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.52% (4.9449 => 5.1191, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.26% (0.5860 => 0.6051, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5569 => 0.5749, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.22% (5.0018 => 5.1630, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.18% (9.4845 => 9.7865, std. dev.: 0.0070) MultiSource/Applications/spiff/spiff: 3.02% (0.7835 => 0.8072, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (4.2646 => 4.3911, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.74% (8.1363 => 8.3595, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.56% (14.3668 => 14.7341, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.8067 => 0.8272, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.54% (1.1861 => 1.2162, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 2.44% (3.3354 => 3.4168, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 2.42% (5.7591 => 5.8987, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.42% (1.3050 => 1.3366, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.41% (1.5415 => 1.5786, std. dev.: 0.0079) MultiSource/Applications/treecc/treecc: 2.22% (2.0273 => 2.0724, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.98% (0.9765 => 0.9958, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 1.91% (1.5603 => 1.5901, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 1.85% (3.8723 => 3.9441, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.79% (2.2024 => 2.2419, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.62% (1.5859 => 1.6116, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 1.57% (17.1811 => 17.4509, std. dev.: 0.0450) MultiSource/Benchmarks/Prolangs-C/football/football: 1.30% (0.8921 => 0.9037, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 1.09% (2.2969 => 2.3219, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9757, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.62% (5.3999 => 5.7572, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.37% (3.6395 => 3.7623, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.89% (11.6436 => 11.8634, std. dev.: 0.0143) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5357, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.62% (3.1578 => 3.2091, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2450, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6903, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 1.02% (6.6465 => 6.7141, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.51% (0.8651 => 0.1686, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.36% (5.2763 => 3.1467, std. dev.: 0.0094) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.65% (5.3855 => 3.6809, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.90% (5.3526 => 3.6984, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.28% (2.9384 => 2.5483, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.43% (22.1758 => 19.8626, std. dev.: 0.0256) SingleSource/UnitTests/Vector/constpool: -5.27% (54.1659 => 51.3120, std. dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.46% (3.8922 => 3.8352, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.14% (1.2373 => 1.1118, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel-2: -7.13% (1.5373 => 1.4277, std. dev.: 0.0167) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.30% (8.1563 => 7.8868, std. dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4825, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4235, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.29% (1.7254 => 1.6859, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.11% (10.2830 => 10.0665, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.58% (2.0866 => 2.0537, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3742, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.55% (1.3677 => 1.3465, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.45% (2.5528 => 2.5157, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.41% (12.5348 => 12.3581, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.34% (4.2280 => 4.1712, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 13:01:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 15:01:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120720200113.A52E92A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2248?compare_to=2245&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2248, Order: 160549, Start Time: 2012-07-20 17:16:48, End Time: 2012-07-20 20:01:30 To: 2245, Order: 160546, Start Time: 2012-07-20 13:20:59, End Time: 2012-07-20 16:05:46 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (72 on baseline) Performance Improvements: 0 (7 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (815 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 31.41% (0.3792 => 0.4983, std. dev.: 0.0202) SingleSource/UnitTests/ObjC/for-in: 12.70% (0.3496 => 0.3940, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.65% (0.3446 => 0.3882, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.61% (0.3465 => 0.3902, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.57% (0.3460 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.52% (0.3442 => 0.3873, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.51% (0.3469 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.47% (0.3488 => 0.3923, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.08% (0.3650 => 0.4091, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.94% (0.3643 => 0.4078, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.63% (0.3724 => 0.4157, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.16% (0.5826 => 0.6243, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.78% (0.5889 => 0.6288, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.42% (0.1620 => 0.1724, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.91% (0.7171 => 0.7595, std. dev.: 0.0101) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.22% (1.6211 => 1.7058, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.18% (3.5627 => 3.7472, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.14% (0.4361 => 0.4585, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 5.13% (1.5932 => 1.6749, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (0.4994 => 0.5237, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.76% (0.5000 => 0.5238, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.51% (0.5900 => 0.6166, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.48% (1.3152 => 1.3741, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.32% (0.5026 => 0.5243, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.30% (0.3930 => 0.4099, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.27% (0.2738 => 0.2855, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 4.23% (1.0781 => 1.1237, std. dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 4.13% (4.2109 => 4.3848, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 4.05% (0.4029 => 0.4192, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.92% (2.7292 => 2.8363, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.73% (0.2866 => 0.2973, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.65% (0.2736 => 0.2836, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.52% (5.5417 => 5.7366, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.45% (1.9694 => 2.0373, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.31% (0.3903 => 0.4032, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 3.30% (2.1013 => 2.1706, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.24% (0.3890 => 0.4016, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (1.9966 => 2.0598, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.11% (0.4658 => 0.4803, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.06% (2.0673 => 2.1305, std. dev.: 0.0092) MultiSource/Applications/JM/lencod/lencod: 2.92% (4.6177 => 4.7525, std. dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: 2.90% (0.9909 => 1.0196, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.87% (0.9697 => 0.9975, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.86% (4.4195 => 4.5459, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (2.1653 => 2.2257, std. dev.: 0.0044) MultiSource/Applications/siod/siod: 2.77% (0.6634 => 0.6818, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.68% (0.3845 => 0.3948, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 2.64% (1.8794 => 1.9290, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.61% (0.4139 => 0.4247, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.51% (0.7875 => 0.8073, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 2.49% (0.5546 => 0.5684, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 2.30% (1.4269 => 1.4597, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 2.02% (23.5202 => 23.9948, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.30% (2.0346 => 2.0611, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.39% (5.2852 => 11.7539, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 54.44% (0.2162 => 0.3339, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.92% (10.7630 => 13.6607, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.92% (0.5589 => 0.6758, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/objinst: 19.13% (9.4436 => 11.2501, std. dev.: 0.0274) SingleSource/Benchmarks/Shootout/lists: 13.46% (32.9687 => 37.4052, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 7.02% (15.4430 => 16.5274, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.90% (3.3903 => 3.6242, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: 5.40% (19.6305 => 20.6915, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: 5.40% (2.8036 => 2.9551, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8938, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.08% (2.2962 => 2.3898, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.39% (3.1722 => 3.2480, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (3.1728 => 3.2441, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 1.94% (15.8721 => 16.1803, std. dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 1.42% (1.5554 => 1.5775, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.63% (2.4764 => 2.3864, std. dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: -1.98% (11.9555 => 11.7185, std. dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.84% (6.2401 => 4.1282, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -4.19% (14.0481 => 13.4590, std. dev.: 0.0338) SingleSource/Benchmarks/Misc/salsa20: -3.84% (35.5013 => 34.1387, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/objinst: -3.34% (12.0509 => 11.6488, std. dev.: 0.0156) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5755, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 13:12:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 15:12:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120720201241.F03D02A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2249?compare_to=2246&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2249, Order: 160554, Start Time: 2012-07-20 18:58:49, End Time: 2012-07-20 20:12:55 To: 2246, Order: 160549, Start Time: 2012-07-20 17:16:39, End Time: 2012-07-20 18:30:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (138 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.72% (2.0176 => 2.3146, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.42% (0.5818 => 0.6366, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.26% (0.5748 => 0.6280, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.99% (0.7061 => 0.7696, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.75% (0.3578 => 0.3891, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.50% (0.3601 => 0.3907, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.45% (0.3646 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.45% (0.3623 => 0.3929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.41% (0.3650 => 0.3957, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.41% (0.3663 => 0.3971, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3789 => 0.4104, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.25% (0.3914 => 0.4237, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.05% (0.3940 => 0.4257, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.02% (0.4003 => 0.4324, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.44% (0.3130 => 0.3363, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.75% (0.1986 => 0.2120, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 6.73% (1.3693 => 1.4614, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.55% (0.7710 => 0.8215, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 6.38% (0.4062 => 0.4321, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.32% (0.2721 => 0.2893, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.24% (3.9660 => 4.2133, std. dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.12% (0.2596 => 0.2755, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.01% (0.4328 => 0.4588, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.00% (0.5265 => 0.5581, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 5.94% (0.7038 => 0.7456, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.65% (0.2781 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.25% (0.2761 => 0.2906, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2782 => 0.2928, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.24% (0.2690 => 0.2831, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.22% (0.2607 => 0.2743, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.20% (1.9828 => 2.0859, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 5.18% (0.2760 => 0.2903, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.17% (0.6959 => 0.7319, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.15% (0.4390 => 0.4616, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.14% (0.2765 => 0.2907, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.09% (1.2193 => 1.2814, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.03% (0.3580 => 0.3760, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.03% (0.2726 => 0.2863, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.02% (0.2628 => 0.2760, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.02% (0.3489 => 0.3664, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.98% (0.4379 => 0.4597, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.96% (0.2966 => 0.3113, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.94% (0.2937 => 0.3082, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.93% (0.2655 => 0.2786, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.89% (0.3107 => 0.3259, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.89% (0.3149 => 0.3303, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.85% (0.9199 => 0.9645, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3192 => 0.3346, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.82% (0.3899 => 0.4087, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.80% (13.8202 => 14.4842, std. dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.73% (0.3485 => 0.3650, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.72% (0.2988 => 0.3129, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.58% (0.3453 => 0.3611, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3293 => 0.3443, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.47% (1.3813 => 1.4430, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.46% (1.3819 => 1.4435, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (13.2842 => 13.8759, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.43% (0.4016 => 0.4194, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.43% (0.5577 => 0.5824, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.41% (0.3534 => 0.3690, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.37% (0.3756 => 0.3920, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.30% (1.4563 => 1.5189, std. dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 4.29% (16.6129 => 17.3255, std. dev.: 0.0316) SingleSource/Benchmarks/Shootout-C++/moments: 4.24% (0.3868 => 0.4032, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.24% (0.2925 => 0.3049, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.22% (1.1364 => 1.1843, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.08% (0.5637 => 0.5867, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.05% (7.2180 => 7.5100, std. dev.: 0.0079) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.02% (0.2914 => 0.3031, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.97% (0.3246 => 0.3375, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.93% (0.7506 => 0.7801, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.93% (1.3245 => 1.3765, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.91% (0.7460 => 0.7752, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 3.86% (0.8310 => 0.8631, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.79% (1.1061 => 1.1480, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.2945 => 0.3054, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.70% (3.8646 => 4.0074, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 3.61% (1.9270 => 1.9966, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.50% (4.3801 => 4.5336, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.45% (3.6692 => 3.7958, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 3.42% (1.2292 => 1.2712, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.24% (0.4791 => 0.4946, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.17% (0.3220 => 0.3322, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 3.15% (2.1791 => 2.2478, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3755 => 0.3870, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.91% (0.6283 => 0.6466, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.90% (4.9865 => 5.1309, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.75% (0.8698 => 0.8937, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.73% (3.1889 => 3.2761, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.69% (1.1333 => 1.1638, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.69% (0.6135 => 0.6300, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.45% (16.2614 => 16.6606, std. dev.: 0.0206) MultiSource/Applications/JM/ldecod/ldecod: 2.43% (6.5754 => 6.7350, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 2.43% (14.8535 => 15.2139, std. dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: 2.34% (8.4961 => 8.6945, std. dev.: 0.0079) MultiSource/Applications/ClamAV/clamscan: 2.31% (14.5298 => 14.8657, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (3.2742 => 3.3364, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.89% (2.1007 => 2.1405, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.67% (1.5188 => 1.5442, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 1.66% (4.6629 => 4.7401, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.11% (0.9108 => 0.9209, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 76.97% (0.1824 => 0.3228, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 56.43% (0.1322 => 0.2068, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 26.65% (1.8175 => 2.3018, std. dev.: 0.0221) SingleSource/Benchmarks/Misc/mandel-2: 7.58% (1.2998 => 1.3983, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.96% (1.5824 => 1.6767, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.01% (0.9996 => 1.0497, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (4.5947 => 4.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7557, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7240, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (12.4560 => 12.8571, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4746, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.80% (2.8606 => 2.9408, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.43% (1.7688 => 1.8117, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.22% (2.0200 => 2.0649, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: 2.14% (2.5089 => 2.5626, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.11% (4.1080 => 4.1946, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 2.08% (0.6159 => 0.6287, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5345, std. dev.: 0.0078) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.33% (1.9290 => 1.9546, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.31% (3.6469 => 3.6945, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 1.26% (2.4679 => 2.4991, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.21% (3.1736 => 3.2120, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.41% (22.5627 => 21.1155, std. dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.16% (0.3511 => 0.3400, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.70% (1.0460 => 0.8609, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.73% (1.2308 => 1.0987, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -4.84% (2.6470 => 2.5189, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3119, std. dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.40% (1.9762 => 1.9091, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.59% (0.4867 => 0.4741, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.29% (6.3560 => 6.2104, std. dev.: 0.0195) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.23% (0.8342 => 0.8156, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.02% (20.3410 => 19.9295, std. dev.: 0.0112) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5100, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: -1.71% (3.0263 => 2.9747, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.61% (9.9194 => 9.7597, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9961, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.48% (2.5254 => 2.4880, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0163) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2226, std. dev.: 0.0071) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2574, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 13:21:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 15:21:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120720202144.9581B2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2250?compare_to=2247&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2250, Order: 160557, Start Time: 2012-07-20 19:03:30, End Time: 2012-07-20 20:21:59 To: 2247, Order: 160549, Start Time: 2012-07-20 17:16:41, End Time: 2012-07-20 18:35:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (72 on baseline) Performance Improvements: 0 (27 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (774 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.40% (54.3775 => 55.6804, std. dev.: 0.4001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.67% (10.3673 => 14.1691, std. dev.: 0.0072) SingleSource/UnitTests/ObjC/trivial-interface: 11.60% (0.3473 => 0.3876, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.44% (0.3497 => 0.3897, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.29% (0.3543 => 0.3943, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.24% (1.1194 => 1.2452, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.23% (0.3543 => 0.3941, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 11.15% (0.3516 => 0.3908, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3561 => 0.3955, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.77% (0.3694 => 0.4092, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3828 => 0.4228, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.37% (0.3886 => 0.4289, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.29% (0.3927 => 0.4331, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.84% (2.2022 => 2.3748, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.81% (1.7609 => 1.8985, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.56% (0.6030 => 0.6365, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 5.54% (0.5925 => 0.6253, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.41% (0.3177 => 0.3349, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 4.87% (10.4361 => 10.9446, std. dev.: 0.0269) SingleSource/UnitTests/ObjC++/property-reference: 4.55% (0.7326 => 0.7659, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.27% (0.4615 => 0.4812, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.4879 => 0.5087, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.23% (7.0540 => 7.3525, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/oourafft: 4.20% (0.3282 => 0.3420, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 3.74% (0.7433 => 0.7711, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.70% (0.8172 => 0.8474, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (9.4845 => 9.8051, std. dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.33% (4.9449 => 5.1097, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.30% (0.5569 => 0.5753, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.26% (5.0018 => 5.1647, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.16% (4.2646 => 4.3992, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.05% (0.5860 => 0.6039, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.93% (8.1363 => 8.3751, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.88% (0.7835 => 0.8061, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.57% (1.3050 => 1.3385, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.53% (1.1861 => 1.2161, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.50% (3.3354 => 3.4188, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (14.3668 => 14.7232, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.44% (1.5415 => 1.5791, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.42% (0.4636 => 0.4748, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.39% (0.8067 => 0.8260, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.36% (5.7591 => 5.8949, std. dev.: 0.0073) MultiSource/Applications/hbd/hbd: 2.27% (1.5603 => 1.5957, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 2.20% (2.0273 => 2.0719, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 2.19% (1.1642 => 1.1897, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.02% (0.5105 => 0.5208, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.99% (0.9765 => 0.9959, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 1.89% (3.8723 => 3.9453, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.85% (2.2024 => 2.2432, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.78% (0.6675 => 0.6794, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.72% (0.5981 => 0.6084, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.71% (1.5859 => 1.6130, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.63% (0.6450 => 0.6555, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.57% (17.1811 => 17.4511, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.45% (1.4186 => 1.4391, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.33% (2.0665 => 2.0940, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 1.24% (0.8921 => 0.9032, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.21% (1.1840 => 1.1983, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.07% (2.2969 => 2.3215, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.11% (2.6778 => 2.9753, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.46% (5.3999 => 5.7489, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7547, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.95% (1.5086 => 1.5380, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.88% (11.6436 => 11.8620, std. dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/hash2: 1.69% (3.1578 => 3.2111, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 1.65% (1.0554 => 1.0728, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2405, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6885, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 1.01% (6.6465 => 6.7134, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1259, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -80.50% (0.8651 => 0.1687, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.41% (5.2763 => 3.1444, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.56% (5.3855 => 3.6859, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.83% (5.3526 => 3.7026, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.27% (2.9384 => 2.5485, std. dev.: 0.0158) MultiSource/Applications/ClamAV/clamscan: -10.41% (22.1758 => 19.8671, std. dev.: 0.0250) SingleSource/UnitTests/Vector/constpool: -5.28% (54.1659 => 51.3071, std. dev.: 0.0237) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.34% (3.8922 => 3.8402, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.59% (1.1492 => 0.7632, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.58% (1.2373 => 1.1064, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -8.83% (1.5373 => 1.4015, std. dev.: 0.0292) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.22% (8.1563 => 7.8938, std. dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4821, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4134, std. dev.: 0.0156) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.41% (0.4808 => 0.4692, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.30% (1.7254 => 1.6858, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.16% (10.2830 => 10.0614, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.65% (1.3677 => 1.3451, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.59% (2.0866 => 2.0534, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3741, std. dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -1.45% (2.5528 => 2.5157, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.42% (12.5348 => 12.3572, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.39% (4.2280 => 4.1694, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 14:55:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 16:55:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120720215509.ACF382A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2251?compare_to=2249&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2251, Order: 160567, Start Time: 2012-07-20 20:41:00, End Time: 2012-07-20 21:55:23 To: 2249, Order: 160554, Start Time: 2012-07-20 18:58:49, End Time: 2012-07-20 20:12:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (140 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.13% (2.0176 => 2.3228, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 8.78% (0.5818 => 0.6329, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.58% (0.5748 => 0.6241, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.34% (0.7061 => 0.7650, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 7.85% (0.3578 => 0.3859, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.65% (0.3789 => 0.4079, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: 7.62% (0.3663 => 0.3942, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 7.55% (0.3601 => 0.3873, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.54% (0.3646 => 0.3921, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.48% (0.3623 => 0.3894, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.48% (0.3650 => 0.3923, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 7.26% (0.3940 => 0.4226, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 7.23% (0.3914 => 0.4197, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.19% (0.4003 => 0.4291, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.62% (1.3693 => 1.4600, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.55% (0.1986 => 0.2116, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.42% (0.7710 => 0.8205, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.29% (3.9660 => 4.2156, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.22% (0.7038 => 0.7476, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.03% (0.2721 => 0.2885, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.01% (0.2596 => 0.2752, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.00% (0.5265 => 0.5581, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.99% (0.1819 => 0.1928, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 5.57% (0.4328 => 0.4569, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.39% (0.6959 => 0.7334, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.00% (0.4379 => 0.4598, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.96% (1.2193 => 1.2798, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 4.95% (0.4062 => 0.4263, std. dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 4.89% (0.2781 => 0.2917, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.89% (13.8202 => 14.4957, std. dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.88% (0.5577 => 0.5849, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.78% (0.9199 => 0.9639, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.62% (0.4390 => 0.4593, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.60% (0.3022 => 0.3161, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 4.57% (0.2760 => 0.2886, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.55% (13.2842 => 13.8882, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.53% (0.3489 => 0.3647, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.51% (1.4563 => 1.5220, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.51% (1.9828 => 2.0722, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2782 => 0.2907, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.47% (0.3580 => 0.3740, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.46% (0.2914 => 0.3044, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (0.3485 => 0.3640, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.44% (0.2726 => 0.2847, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.39% (0.3899 => 0.4070, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.38% (0.2765 => 0.2886, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.33% (0.2655 => 0.2770, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 4.31% (0.2690 => 0.2806, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.28% (0.2966 => 0.3093, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.27% (16.6129 => 17.3220, std. dev.: 0.0251) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2628 => 0.2740, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.24% (0.2761 => 0.2878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.22% (0.2937 => 0.3061, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.18% (0.3107 => 0.3237, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.16% (1.3813 => 1.4388, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.16% (1.0594 => 1.1035, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.16% (1.3819 => 1.4394, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 4.15% (0.2988 => 0.3112, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.11% (1.1364 => 1.1831, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 4.10% (0.2925 => 0.3045, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.08% (0.2696 => 0.2806, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.06% (0.3149 => 0.3277, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 4.01% (0.8310 => 0.8643, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.97% (0.5637 => 0.5861, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.97% (7.2180 => 7.5046, std. dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/ary2: 3.92% (0.3192 => 0.3317, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.90% (1.1061 => 1.1492, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 3.86% (3.8646 => 4.0138, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 3.85% (0.3453 => 0.3586, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.85% (0.3246 => 0.3371, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.84% (0.7506 => 0.7794, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 3.82% (1.9270 => 2.0006, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.81% (1.3245 => 1.3750, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.81% (0.4016 => 0.4169, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.77% (0.7460 => 0.7741, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.76% (0.3534 => 0.3667, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (0.3293 => 0.3416, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.70% (0.3756 => 0.3895, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.62% (0.3868 => 0.4008, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (3.6692 => 3.7980, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.44% (0.4791 => 0.4956, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.41% (4.4433 => 4.5946, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.38% (4.3801 => 4.5283, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 3.35% (0.3220 => 0.3328, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 3.18% (2.1791 => 2.2484, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.93% (4.9865 => 5.1326, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.88% (0.6283 => 0.6464, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.2292 => 1.2642, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.76% (1.1333 => 1.1646, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 2.74% (3.1889 => 3.2763, std. dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.72% (0.6135 => 0.6302, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 2.55% (16.2614 => 16.6758, std. dev.: 0.0151) MultiSource/Applications/JM/ldecod/ldecod: 2.51% (6.5754 => 6.7407, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.48% (0.8698 => 0.8914, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.44% (14.8535 => 15.2152, std. dev.: 0.0170) MultiSource/Benchmarks/mafft/pairlocalalign: 2.39% (8.4961 => 8.6991, std. dev.: 0.0134) MultiSource/Applications/ClamAV/clamscan: 2.21% (14.5298 => 14.8507, std. dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.18% (2.1007 => 2.1465, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (3.2742 => 3.3395, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 1.96% (4.6629 => 4.7542, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.82% (1.5188 => 1.5465, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.05% (1.0313 => 1.0421, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.08% (0.1824 => 0.3230, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 56.35% (0.1322 => 0.2067, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/fbench: 26.57% (1.8175 => 2.3005, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/mandel-2: 7.55% (1.2998 => 1.3979, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (2.5629 => 2.7293, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.98% (1.5824 => 1.6771, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.92% (0.9996 => 1.0488, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 4.35% (7.4271 => 7.7503, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7234, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (12.4560 => 12.8567, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4757, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.80% (2.8606 => 2.9406, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.37% (1.7688 => 1.8108, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.18% (2.0200 => 2.0640, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5624, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.10% (4.1080 => 4.1944, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 2.09% (0.6159 => 0.6288, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (1.5089 => 1.5322, std. dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 1.27% (2.4679 => 2.4992, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 1.24% (3.1736 => 3.2130, std. dev.: 0.0017) MultiSource/Benchmarks/llubenchmark/llu: 1.24% (3.7731 => 3.8198, std. dev.: 0.0119) SingleSource/Benchmarks/Dhrystone/fldry: 1.18% (1.9290 => 1.9517, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6469 => 3.6842, std. dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1235, std. dev.: 0.0221) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.28% (0.3511 => 0.3396, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.69% (1.0460 => 0.8610, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2308 => 1.1038, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.82% (2.6470 => 2.5194, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.55% (1.3780 => 1.3153, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9822, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.43% (1.9762 => 1.9084, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.22% (0.8342 => 0.8157, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.01% (6.6320 => 6.4986, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2299, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9607, std. dev.: 0.1105) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -1.69% (3.0263 => 2.9752, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7603, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9962, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0044) MultiSource/Applications/minisat/minisat: -1.35% (9.3358 => 9.2102, std. dev.: 0.0134) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2571, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 15:08:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 17:08:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120720220813.E53792A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2252?compare_to=2250&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2252, Order: 160567, Start Time: 2012-07-20 20:50:00, End Time: 2012-07-20 22:08:29 To: 2250, Order: 160557, Start Time: 2012-07-20 19:03:30, End Time: 2012-07-20 20:21:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (69 on baseline) Performance Improvements: 1 (27 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (777 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.46% (55.6804 => 56.4959, std. dev.: 0.0303) SingleSource/Benchmarks/Shootout/ary3: 1.18% (3.6853 => 3.7287, std. dev.: 0.0110) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.44% (14.1691 => 13.8228, std. dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.33% (10.3673 => 13.8228, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.56% (1.1194 => 1.2488, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 11.26% (0.3473 => 0.3864, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.04% (0.3543 => 0.3934, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 10.95% (0.3497 => 0.3880, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.84% (0.3561 => 0.3947, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.84% (0.3543 => 0.3927, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.84% (0.3516 => 0.3897, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.50% (0.3694 => 0.4082, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.19% (0.3927 => 0.4327, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.09% (0.3886 => 0.4278, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.60% (1.7609 => 1.9124, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.41% (2.2022 => 2.3873, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (0.1622 => 0.1733, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.57% (0.3177 => 0.3354, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 5.55% (0.5925 => 0.6254, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.47% (0.6030 => 0.6360, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.34% (10.4361 => 10.9933, std. dev.: 0.0154) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.69% (0.4879 => 0.5108, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.64% (7.0540 => 7.3815, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/oourafft: 4.60% (0.3282 => 0.3433, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.37% (0.7326 => 0.7646, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.14% (0.4615 => 0.4806, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 4.00% (0.7433 => 0.7730, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.45% (4.9449 => 5.1157, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 3.36% (9.4845 => 9.8034, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.32% (5.0018 => 5.1679, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5569 => 0.5750, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.16% (0.8172 => 0.8430, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: 3.10% (0.7835 => 0.8078, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.96% (4.2646 => 4.3909, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.83% (0.5860 => 0.6026, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.80% (8.1363 => 8.3643, std. dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: 2.64% (5.7591 => 5.9114, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.59% (0.4636 => 0.4756, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.51% (14.3668 => 14.7275, std. dev.: 0.0206) MultiSource/Applications/d/make_dparser: 2.46% (3.3354 => 3.4175, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (1.5415 => 1.5792, std. dev.: 0.0036) MultiSource/Applications/hbd/hbd: 2.44% (1.5603 => 1.5983, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.39% (1.1861 => 1.2144, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.31% (0.8067 => 0.8253, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 2.18% (2.0273 => 2.0714, std. dev.: 0.0138) MultiSource/Applications/Burg/burg: 2.07% (1.1642 => 1.1883, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 1.82% (3.8723 => 3.9426, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.76% (0.9765 => 0.9937, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.64% (2.0665 => 2.1004, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (2.2024 => 2.2375, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.57% (0.6450 => 0.6551, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 1.56% (0.6456 => 0.6557, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.55% (1.5859 => 1.6105, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.53% (17.1811 => 17.4448, std. dev.: 0.0247) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.51% (0.6675 => 0.6776, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.35% (1.4186 => 1.4378, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 1.35% (0.8921 => 0.9041, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.06% (1.2842 => 1.2978, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.01% (1.1840 => 1.1960, std. dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9757, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.56% (5.3999 => 5.7543, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.32% (3.6395 => 3.7602, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.15% (11.6436 => 11.8942, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (1.5086 => 1.5341, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.61% (3.1578 => 3.2085, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6898, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 1.02% (6.6465 => 6.7146, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.28% (5.2763 => 3.1511, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.23% (5.3855 => 3.7037, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.51% (5.3526 => 3.7196, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.65% (2.9384 => 2.5374, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -10.32% (22.1758 => 19.8875, std. dev.: 0.0290) SingleSource/UnitTests/Vector/constpool: -5.34% (54.1659 => 51.2753, std. dev.: 0.0579) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.36% (3.8922 => 3.8392, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.18% (1.5373 => 1.3808, std. dev.: 0.0373) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2373 => 1.1164, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.17% (8.1563 => 7.8979, std. dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4827, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4116, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.34% (1.7254 => 1.6850, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -2.12% (10.2830 => 10.0645, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.62% (1.3677 => 1.3455, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.60% (2.0866 => 2.0533, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.46% (2.5528 => 2.5156, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -1.42% (12.5348 => 12.3562, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.31% (4.2280 => 4.1725, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 16:13:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 18:13:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120720231357.EADB42A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2253?compare_to=2248&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2253, Order: 160567, Start Time: 2012-07-20 20:29:35, End Time: 2012-07-20 23:14:14 To: 2248, Order: 160549, Start Time: 2012-07-20 17:16:48, End Time: 2012-07-20 20:01:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (67 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (819 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.32% (54.1314 => 54.8467, std. dev.: 0.0869) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 29.75% (0.3792 => 0.4920, std. dev.: 0.0339) SingleSource/UnitTests/ObjC/trivial-interface: 12.23% (0.3442 => 0.3863, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.16% (0.3446 => 0.3865, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.15% (0.3465 => 0.3886, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.13% (0.3488 => 0.3911, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 12.08% (0.3460 => 0.3878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.04% (0.3496 => 0.3917, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3469 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.56% (0.3650 => 0.4072, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3643 => 0.4059, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.04% (0.3724 => 0.4135, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.40% (0.5826 => 0.6199, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.20% (0.5889 => 0.6254, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.00% (1.5932 => 1.6729, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 4.98% (0.7171 => 0.7528, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.92% (1.6211 => 1.7009, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.71% (3.5627 => 3.7305, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.70% (0.5026 => 0.5262, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.53% (0.5900 => 0.6167, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.33% (0.4361 => 0.4550, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (0.4994 => 0.5210, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.15% (1.3152 => 1.3698, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.10% (0.4029 => 0.4194, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.08% (0.5000 => 0.5204, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.92% (0.3930 => 0.4084, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.85% (1.0781 => 1.1196, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 3.71% (4.2109 => 4.3670, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.65% (0.2738 => 0.2838, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.59% (2.7292 => 2.8272, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.18% (0.4658 => 0.4806, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.12% (1.9966 => 2.0589, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.01% (2.0673 => 2.1296, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.98% (1.9694 => 2.0280, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 2.95% (0.9697 => 0.9983, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.94% (0.3845 => 0.3958, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.93% (0.9909 => 1.0199, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.83% (0.3890 => 0.4000, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.73% (5.5417 => 5.6931, std. dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 2.67% (2.1013 => 2.1574, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (4.4195 => 4.5368, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 2.61% (1.8794 => 1.9284, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.48% (4.6177 => 4.7321, std. dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (2.1653 => 2.2182, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 2.20% (0.7875 => 0.8048, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 2.05% (0.6634 => 0.6770, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.93% (1.4269 => 1.4544, std. dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: 1.71% (23.5202 => 23.9228, std. dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.39% (5.2852 => 11.7540, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 54.72% (0.2162 => 0.3345, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.94% (10.7630 => 13.6626, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.93% (0.5589 => 0.6703, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/objinst: 19.42% (9.4436 => 11.2772, std. dev.: 0.0483) SingleSource/Benchmarks/Shootout/lists: 13.47% (32.9687 => 37.4088, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 6.98% (15.4430 => 16.5210, std. dev.: 0.0212) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.77% (3.3903 => 3.6197, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: 5.40% (19.6305 => 20.6909, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 5.09% (2.8036 => 2.9463, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/flops-2: 5.01% (1.8057 => 1.8962, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.07% (2.2962 => 2.3896, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.44% (3.1722 => 3.2495, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.24% (3.1728 => 3.2439, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 1.91% (15.8721 => 16.1749, std. dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 1.43% (1.5554 => 1.5776, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.23% (17.2379 => 17.4505, std. dev.: 0.0768) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.10% (2.4764 => 2.3996, std. dev.: 0.0097) MultiSource/Applications/kimwitu++/kc: -2.38% (11.9555 => 11.6712, std. dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.85% (6.2401 => 4.1276, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -6.12% (0.2402 => 0.2255, std. dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: -4.46% (14.0481 => 13.4221, std. dev.: 0.0179) SingleSource/Benchmarks/Misc/salsa20: -3.79% (35.5013 => 34.1571, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: -2.66% (12.0509 => 11.7303, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5754, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 16:37:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 18:37:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120720233712.5BF232A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2254?compare_to=2251&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2254, Order: 160581, Start Time: 2012-07-20 22:23:25, End Time: 2012-07-20 23:37:27 To: 2251, Order: 160567, Start Time: 2012-07-20 20:41:00, End Time: 2012-07-20 21:55:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (141 on baseline) Performance Improvements: 2 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 950 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.39% (2.0722 => 2.1010, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 1.11% (1.2642 => 1.2782, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7293 => 2.5538, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8143 => 4.5961, std. dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.79% (2.0176 => 2.3160, std. dev.: 0.0143) SingleSource/UnitTests/ObjC++/property-reference: 9.15% (0.7061 => 0.7707, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.09% (0.5818 => 0.6347, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.87% (0.5748 => 0.6258, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.16% (0.3578 => 0.3870, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3646 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.89% (0.3601 => 0.3885, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.86% (0.3650 => 0.3937, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.86% (0.3663 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.78% (0.3623 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.76% (0.3789 => 0.4083, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.56% (0.3914 => 0.4210, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.49% (0.3940 => 0.4235, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.47% (0.4003 => 0.4302, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.38% (1.3693 => 1.4703, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.90% (0.1986 => 0.2123, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.59% (0.2655 => 0.2830, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.50% (0.7710 => 0.8211, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.37% (3.9660 => 4.2187, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2690 => 0.2860, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 6.29% (0.2781 => 0.2956, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.28% (0.7038 => 0.7480, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 6.13% (0.4062 => 0.4311, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2596 => 0.2754, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.06% (0.3022 => 0.3205, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2696 => 0.2859, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.00% (0.5265 => 0.5581, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hello: 5.98% (0.2607 => 0.2763, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2761 => 0.2926, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.96% (1.9828 => 2.1010, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.93% (0.2765 => 0.2929, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 5.91% (0.2726 => 0.2887, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.91% (0.2760 => 0.2923, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.87% (0.2966 => 0.3140, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.86% (0.2937 => 0.3109, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.75% (0.3149 => 0.3330, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.75% (0.2628 => 0.2779, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.73% (0.3107 => 0.3285, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.72% (0.1819 => 0.1923, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.70% (0.3489 => 0.3688, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.70% (0.3580 => 0.3784, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.58% (0.3192 => 0.3370, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.54% (0.3899 => 0.4115, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 5.46% (0.2988 => 0.3151, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (0.3485 => 0.3675, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.40% (0.4390 => 0.4627, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 5.27% (0.3453 => 0.3635, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.23% (0.6959 => 0.7323, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.19% (1.2193 => 1.2826, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists: 5.10% (0.3293 => 0.3461, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.07% (0.3534 => 0.3713, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.04% (13.8202 => 14.5172, std. dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.02% (0.4379 => 0.4599, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.97% (0.5577 => 0.5854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.96% (0.4016 => 0.4215, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.89% (0.3868 => 0.4057, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (0.3756 => 0.3939, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.85% (0.9199 => 0.9645, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.72% (1.4563 => 1.5251, std. dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 4.61% (16.6129 => 17.3794, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (13.2842 => 13.8940, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.34% (1.1364 => 1.1857, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.31% (0.2925 => 0.3051, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 4.26% (1.1061 => 1.1532, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.24% (1.3813 => 1.4399, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.22% (0.7506 => 0.7823, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.15% (1.0594 => 1.1034, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (0.8310 => 0.8652, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.11% (1.3819 => 1.4387, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.11% (1.9270 => 2.0062, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.10% (0.5637 => 0.5868, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.07% (0.3246 => 0.3378, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.03% (7.2180 => 7.5091, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.99% (1.2292 => 1.2782, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.84% (0.2914 => 0.3026, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.83% (3.8646 => 4.0126, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.83% (1.3245 => 1.3752, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.71% (0.7460 => 0.7737, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.65% (0.3755 => 0.3892, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (4.3801 => 4.5362, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.55% (0.4791 => 0.4961, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.53% (3.6692 => 3.7987, std. dev.: 0.0096) MultiSource/Applications/siod/siod: 3.31% (2.1791 => 2.2513, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.28% (4.4433 => 4.5891, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 3.23% (0.3220 => 0.3324, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.15% (0.6283 => 0.6481, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.12% (4.9865 => 5.1420, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.10% (0.8698 => 0.8968, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.95% (1.1333 => 1.1667, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.87% (3.1889 => 3.2805, std. dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.72% (0.6135 => 0.6302, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 2.58% (16.2614 => 16.6807, std. dev.: 0.0299) MultiSource/Applications/JM/ldecod/ldecod: 2.54% (6.5754 => 6.7427, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 2.54% (14.8535 => 15.2313, std. dev.: 0.0116) MultiSource/Benchmarks/mafft/pairlocalalign: 2.44% (8.4961 => 8.7034, std. dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: 2.40% (14.5298 => 14.8781, std. dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.05% (3.2742 => 3.3412, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.1007 => 2.1436, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.90% (4.6629 => 4.7516, std. dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.78% (1.5188 => 1.5458, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.65% (0.6250 => 0.6353, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.24% (1.0313 => 1.0441, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.22% (0.9108 => 0.9219, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.19% (0.1824 => 0.3232, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 56.58% (0.1322 => 0.2070, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.83% (1.8175 => 2.3051, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3807, std. dev.: 0.0088) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.98% (1.5824 => 1.6771, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.89% (0.9996 => 1.0485, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: 4.24% (7.4271 => 7.7423, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7324, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.21% (12.4560 => 12.8561, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4750, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.50% (1.7688 => 1.8131, std. dev.: 0.0164) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0310 => 1.0561, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.42% (2.8606 => 2.9297, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.17% (2.0200 => 2.0639, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 2.14% (2.5089 => 2.5626, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.11% (4.1080 => 4.1945, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 2.03% (0.6159 => 0.6284, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5330, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.54% (1.4298 => 1.4518, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 1.27% (2.4679 => 2.4992, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: 1.12% (1.9290 => 1.9506, std. dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 1.08% (10.7476 => 10.8641, std. dev.: 0.0110) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.39% (22.5627 => 21.1209, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2308 => 1.1019, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -4.77% (2.6470 => 2.5207, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3147, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9822, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.38% (1.9762 => 1.9095, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9480, std. dev.: 0.0097) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.57% (0.4867 => 0.4742, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.01% (20.3410 => 19.9325, std. dev.: 0.0457) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2318, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5067, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3456, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7606, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9963, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.38% (2.5254 => 2.4906, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.2225 => 27.8617, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2170, std. dev.: 0.0271) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2621, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 16:55:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 18:55:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120720235505.ACCA12A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2255?compare_to=2252&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2255, Order: 160582, Start Time: 2012-07-20 22:36:49, End Time: 2012-07-20 23:55:18 To: 2252, Order: 160567, Start Time: 2012-07-20 20:50:00, End Time: 2012-07-20 22:08:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (96 on baseline) Performance Improvements: 2 (29 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 927 (748 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (13.8228 => 14.0779, std. dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.47% (2.1004 => 2.1312, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.11% (1.2978 => 1.3122, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 189.88% (3.1352 => 9.0882, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel-2: 3.41% (1.3808 => 1.4279, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.45% (2.7292 => 2.5533, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.52% (4.8136 => 4.5958, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.79% (10.3673 => 14.0779, std. dev.: 0.0152) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.96% (0.3543 => 0.4002, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3473 => 0.3911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.41% (0.3497 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.40% (0.3516 => 0.3952, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 12.31% (0.3543 => 0.3979, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.30% (0.3561 => 0.3999, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.99% (0.3694 => 0.4137, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions: 11.65% (0.3828 => 0.4274, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.48% (0.3927 => 0.4378, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/property: 11.45% (0.3886 => 0.4331, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.41% (1.1194 => 1.2471, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.51% (2.2022 => 2.3895, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 8.03% (0.1432 => 0.1547, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.90% (1.7609 => 1.9000, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.21% (0.1622 => 0.1739, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.83% (0.6030 => 0.6442, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.82% (0.5925 => 0.6329, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.61% (0.7326 => 0.7737, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.57% (0.3177 => 0.3354, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.39% (0.1892 => 0.1994, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.34% (10.4361 => 10.9939, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/oourafft: 4.97% (0.3282 => 0.3445, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.79% (0.4615 => 0.4836, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.76% (0.7433 => 0.7787, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.47% (0.4879 => 0.5097, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.43% (7.0540 => 7.3668, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.88% (4.9449 => 5.1368, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.0018 => 5.1947, std. dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 3.74% (9.4845 => 9.8393, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.69% (0.5860 => 0.6076, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (0.4636 => 0.4806, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.65% (0.8172 => 0.8470, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.5569 => 0.5769, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (4.2646 => 4.4150, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.3180 => 0.3291, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.40% (0.3650 => 0.3774, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 3.30% (0.3422 => 0.3535, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.26% (14.3668 => 14.8357, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary: 3.25% (0.3232 => 0.3337, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.25% (0.3387 => 0.3497, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 3.22% (0.7835 => 0.8087, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.19% (8.1363 => 8.3960, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3423 => 0.3532, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.15% (0.4289 => 0.4424, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.13% (2.0665 => 2.1312, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.08% (0.3826 => 0.3944, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.05% (0.3603 => 0.3713, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.05% (0.4103 => 0.4228, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.05% (0.3283 => 0.3383, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.04% (5.7591 => 5.9343, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.01% (1.5603 => 1.6072, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.93% (1.3050 => 1.3433, std. dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.89% (1.1861 => 1.2204, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.89% (3.3354 => 3.4318, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.81% (0.8067 => 0.8294, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (0.4064 => 0.4177, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.72% (0.3935 => 0.4042, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 2.71% (0.3684 => 0.3784, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.62% (0.6456 => 0.6625, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.62% (0.4203 => 0.4313, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.60% (1.5415 => 1.5816, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.59% (0.5105 => 0.5237, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.57% (2.0273 => 2.0795, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 2.53% (1.1642 => 1.1937, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash2: 2.51% (0.4620 => 0.4736, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.47% (0.4048 => 0.4148, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.23% (0.6675 => 0.6824, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.22% (0.9765 => 0.9982, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 2.19% (3.8723 => 3.9572, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 2.18% (1.2842 => 1.3122, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.15% (2.2024 => 2.2498, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.95% (1.5859 => 1.6168, std. dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 1.85% (17.1811 => 17.4997, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.79% (0.5981 => 0.6088, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.75% (1.4186 => 1.4434, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 1.68% (0.8921 => 0.9071, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: 1.55% (0.7115 => 0.7225, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.46% (1.1840 => 1.2013, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.45% (2.2969 => 2.3303, std. dev.: 0.0035) MultiSource/Applications/lemon/lemon: 1.10% (1.0722 => 1.0840, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9755, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.56% (5.3999 => 5.7540, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (3.6395 => 3.7599, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (1.5086 => 1.5365, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 1.71% (3.1578 => 3.2117, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8410, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6899, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2269, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.05% (3.2416 => 3.2755, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.02% (6.6465 => 6.7143, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.49% (0.8651 => 0.1688, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.47% (5.2763 => 3.1411, std. dev.: 0.0108) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.46% (5.3855 => 3.6911, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.75% (5.3526 => 3.7067, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.54% (2.9384 => 2.5406, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -10.16% (22.1758 => 19.9220, std. dev.: 0.0196) SingleSource/UnitTests/Vector/constpool: -5.14% (54.1659 => 51.3798, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.20% (3.8922 => 3.8454, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.93% (1.2373 => 1.1144, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -7.12% (1.5373 => 1.4279, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.45% (2.7294 => 2.5533, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.31% (8.1563 => 7.8867, std. dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4702, std. dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4151, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.31% (1.7254 => 1.6855, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.13% (10.2830 => 10.0635, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.59% (2.0866 => 2.0534, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.54% (1.3677 => 1.3466, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: -1.41% (12.5348 => 12.3579, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.30% (4.2280 => 4.1730, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.00% (1.8329 => 1.8145, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 18:19:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 20:19:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120721011917.ABBED2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2256?compare_to=2254&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2256, Order: 160590, Start Time: 2012-07-21 00:05:23, End Time: 2012-07-21 01:19:32 To: 2254, Order: 160581, Start Time: 2012-07-20 22:23:25, End Time: 2012-07-20 23:37:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (141 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.81% (1.3807 => 1.4195, std. dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.78% (2.0176 => 2.3158, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.25% (0.5818 => 0.6356, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.12% (0.7061 => 0.7705, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 8.98% (0.5748 => 0.6264, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3578 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.50% (0.3646 => 0.3956, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 8.50% (0.3601 => 0.3907, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 8.42% (0.3789 => 0.4108, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.41% (0.3650 => 0.3957, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 8.35% (0.3663 => 0.3969, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.05% (0.3914 => 0.4229, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 8.04% (0.4003 => 0.4325, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 7.68% (1.3693 => 1.4745, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.65% (0.7038 => 0.7506, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 6.55% (0.4062 => 0.4328, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (0.4328 => 0.4607, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.45% (0.7710 => 0.8207, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (3.9660 => 4.2191, std. dev.: 0.0143) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.28% (0.2721 => 0.2892, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.5265 => 0.5594, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.21% (0.1819 => 0.1932, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2596 => 0.2757, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.72% (0.4390 => 0.4641, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.67% (1.9828 => 2.0953, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 5.65% (0.2760 => 0.2916, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.64% (0.2782 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2607 => 0.2754, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.61% (0.2690 => 0.2841, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.58% (0.2726 => 0.2878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 5.52% (0.2628 => 0.2773, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.51% (0.3899 => 0.4114, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2765 => 0.2917, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.47% (0.3580 => 0.3776, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2761 => 0.2912, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.3107 => 0.3275, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.40% (0.6959 => 0.7335, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.39% (0.9199 => 0.9695, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.3149 => 0.3318, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.28% (0.3485 => 0.3669, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.23% (0.4379 => 0.4608, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 5.15% (0.2988 => 0.3142, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.13% (1.2193 => 1.2819, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.04% (0.3192 => 0.3353, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.95% (0.3534 => 0.3709, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.92% (13.8202 => 14.5005, std. dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/sieve: 4.89% (0.3453 => 0.3622, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.82% (0.5577 => 0.5846, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 4.74% (16.6129 => 17.4000, std. dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/lists: 4.74% (0.3293 => 0.3449, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 4.73% (0.3868 => 0.4051, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.71% (0.3756 => 0.3933, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.4016 => 0.4205, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.66% (13.2842 => 13.9031, std. dev.: 0.0071) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.49% (1.4563 => 1.5217, std. dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.40% (1.1364 => 1.1864, std. dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.39% (0.2914 => 0.3042, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.31% (0.5637 => 0.5880, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.31% (1.3813 => 1.4408, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.25% (0.3246 => 0.3384, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.22% (7.2180 => 7.5226, std. dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.0594 => 1.1037, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.16% (1.3819 => 1.4394, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 4.15% (0.8310 => 0.8655, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.12% (1.1061 => 1.1517, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 4.12% (3.8646 => 4.0239, std. dev.: 0.0046) MultiSource/Applications/spiff/spiff: 4.10% (0.7506 => 0.7814, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.01% (1.9270 => 2.0042, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.98% (0.7460 => 0.7757, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.96% (1.3245 => 1.3769, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.73% (1.2292 => 1.2751, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.67% (4.3801 => 4.5407, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.63% (3.6692 => 3.8025, std. dev.: 0.0143) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.48% (4.4433 => 4.5980, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.46% (0.4791 => 0.4957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3755 => 0.3883, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3220 => 0.3329, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.34% (0.2995 => 0.3095, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.24% (2.1791 => 2.2497, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.18% (4.9865 => 5.1450, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.98% (0.8698 => 0.8957, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.89% (1.1333 => 1.1660, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 2.82% (3.1889 => 3.2787, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.80% (0.6135 => 0.6307, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 2.58% (0.4113 => 0.4219, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.57% (6.5754 => 6.7442, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.49% (14.8535 => 15.2238, std. dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 2.43% (8.4961 => 8.7022, std. dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: 2.41% (14.5298 => 14.8805, std. dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 2.26% (16.2614 => 16.6297, std. dev.: 0.0165) MultiSource/Applications/oggenc/oggenc: 2.23% (4.6629 => 4.7671, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.21% (2.1007 => 2.1471, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.16% (3.2742 => 3.3449, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.88% (1.5188 => 1.5474, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.30% (0.9108 => 0.9226, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.08% (1.0313 => 1.0424, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.19% (0.1824 => 0.3232, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 56.58% (0.1322 => 0.2070, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.22% (1.8175 => 2.2759, std. dev.: 0.0500) SingleSource/Benchmarks/Misc/mandel-2: 9.21% (1.2998 => 1.4195, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.98% (1.5824 => 1.6770, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.13% (0.9996 => 1.0509, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.02% (0.2093 => 0.2198, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 4.30% (7.4271 => 7.7461, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7315, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (12.4560 => 12.8570, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4757, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.40% (2.8606 => 2.9292, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.37% (1.7688 => 1.8107, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.18% (2.0200 => 2.0640, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5624, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.10% (4.1080 => 4.1943, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: 2.05% (0.6159 => 0.6285, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5343, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9588, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 1.26% (2.4679 => 2.4991, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.37% (22.5627 => 21.1253, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1126, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -4.84% (2.6470 => 2.5189, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.30% (1.3780 => 1.3187, std. dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9822, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.39% (1.9762 => 1.9092, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9447, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.55% (0.4867 => 0.4743, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.25% (6.3560 => 6.2132, std. dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9546, std. dev.: 0.0372) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5090, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7604, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.59% (7.1097 => 6.9966, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.35% (2.5254 => 2.4912, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.2225 => 27.8626, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2534, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8717, std. dev.: 0.0053) MultiSource/Applications/lua/lua: -1.10% (26.5159 => 26.2241, std. dev.: 0.0539) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 18:41:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 20:41:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120721014141.330892A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2257?compare_to=2255&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2257, Order: 160590, Start Time: 2012-07-21 00:23:21, End Time: 2012-07-21 01:41:56 To: 2255, Order: 160582, Start Time: 2012-07-20 22:36:49, End Time: 2012-07-20 23:55:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (79 on baseline) Performance Improvements: 1 (30 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.71% (14.0779 => 13.8378, std. dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.48% (10.3673 => 13.8378, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: 12.53% (0.3473 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.35% (0.3497 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.26% (0.3516 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.25% (0.3543 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.22% (0.3543 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.08% (0.3561 => 0.3991, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.78% (0.3694 => 0.4129, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.69% (1.1194 => 1.2503, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.30% (0.3886 => 0.4325, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.26% (0.3927 => 0.4369, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.85% (0.3817 => 0.4231, std. dev.: 0.0120) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.10% (2.2022 => 2.4025, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.59% (1.7609 => 1.9121, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 7.58% (0.1622 => 0.1745, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.58% (0.6030 => 0.6427, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.45% (0.5925 => 0.6307, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.00% (0.2065 => 0.2189, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.73% (0.3177 => 0.3359, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1906 => 0.2010, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 5.35% (0.7326 => 0.7718, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.29% (0.4615 => 0.4859, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 5.22% (10.4361 => 10.9811, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3282 => 0.3446, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.75% (7.0540 => 7.3888, std. dev.: 0.0281) MultiSource/Applications/lambda-0_1_3/lambda: 4.09% (0.7433 => 0.7737, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.88% (4.9449 => 5.1369, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (5.0018 => 5.1958, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 3.71% (9.4845 => 9.8366, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.57% (0.5569 => 0.5768, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.50% (0.5860 => 0.6065, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.49% (0.8172 => 0.8457, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.35% (8.1363 => 8.4087, std. dev.: 0.0090) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (4.2646 => 4.4054, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.21% (14.3668 => 14.8286, std. dev.: 0.0095) MultiSource/Benchmarks/McCat/09-vor/vor: 3.18% (0.3180 => 0.3281, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.06% (0.4636 => 0.4778, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.03% (1.5603 => 1.6076, std. dev.: 0.0056) MultiSource/Applications/spiff/spiff: 3.02% (0.7835 => 0.8072, std. dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 3.01% (0.3387 => 0.3489, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.01% (0.3423 => 0.3526, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.95% (1.3050 => 1.3435, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 2.91% (5.7591 => 5.9269, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (1.1861 => 1.2195, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.71% (3.3354 => 3.4258, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.55% (2.0665 => 2.1192, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.53% (1.5415 => 1.5805, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 2.52% (0.4289 => 0.4397, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.49% (0.4103 => 0.4205, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.41% (1.1642 => 1.1922, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.35% (2.0273 => 2.0749, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.32% (0.8067 => 0.8254, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.19% (0.5105 => 0.5217, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.04% (0.6456 => 0.6588, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.00% (3.8723 => 3.9496, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.96% (0.9765 => 0.9956, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.89% (0.6675 => 0.6801, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.81% (1.2842 => 1.3074, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.80% (0.6450 => 0.6566, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.69% (1.4186 => 1.4426, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.65% (17.1811 => 17.4648, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.64% (1.5859 => 1.6119, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.49% (1.1840 => 1.2016, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 1.46% (0.8921 => 0.9051, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.13% (2.6778 => 2.9758, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.62% (5.3999 => 5.7572, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.35% (3.6395 => 3.7614, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.36% (1.0313 => 1.0556, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (1.5086 => 1.5347, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8421, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.51% (3.1578 => 3.2055, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.38% (2.6546 => 2.6912, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.14% (3.2416 => 3.2786, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.04% (6.6465 => 6.7153, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.38% (5.2763 => 3.1459, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.23% (5.3855 => 3.7034, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.44% (5.3526 => 3.7235, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.33% (2.9384 => 2.5467, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -10.09% (22.1758 => 19.9386, std. dev.: 0.0120) SingleSource/UnitTests/Vector/constpool: -4.87% (54.1659 => 51.5281, std. dev.: 0.0383) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.28% (3.8922 => 3.8425, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2373 => 1.1078, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -7.96% (1.5373 => 1.4149, std. dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.45% (2.7294 => 2.5533, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5956, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4664, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.12% (8.1563 => 7.9021, std. dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4226, std. dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.31% (1.7254 => 1.6856, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.16% (10.2830 => 10.0612, std. dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.57% (2.0866 => 2.0538, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.56% (1.3677 => 1.3463, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3742, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.45% (4.2280 => 4.1668, std. dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -1.43% (2.5528 => 2.5164, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -1.40% (12.5348 => 12.3593, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.05% (1.8329 => 1.8136, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 19:27:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 21:27:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120721022739.1C08F2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2258?compare_to=2253&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2258, Order: 160589, Start Time: 2012-07-20 23:43:00, End Time: 2012-07-21 02:27:52 To: 2253, Order: 160567, Start Time: 2012-07-20 20:29:35, End Time: 2012-07-20 23:14:14 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (82 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (804 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.40% (2.0641 => 2.0929, std. dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.80% (0.3465 => 0.3943, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 13.65% (0.3442 => 0.3912, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.58% (0.3446 => 0.3914, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.53% (0.3460 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.50% (0.3488 => 0.3959, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 13.47% (0.3496 => 0.3967, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 13.40% (0.3469 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.98% (0.3643 => 0.4116, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.85% (0.3650 => 0.4119, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.67% (0.3724 => 0.4196, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.1620 => 0.1748, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.42% (0.5826 => 0.6258, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 7.06% (0.5889 => 0.6305, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.48% (0.7171 => 0.7564, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.37% (1.6211 => 1.7082, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.35% (0.4994 => 0.5261, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 5.32% (1.5932 => 1.6779, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.29% (3.5627 => 3.7510, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 4.79% (0.4029 => 0.4222, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.71% (0.5900 => 0.6178, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.70% (0.5026 => 0.5262, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.56% (0.4361 => 0.4560, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.43% (1.3152 => 1.3735, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.32% (0.5000 => 0.5216, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.30% (0.3930 => 0.4099, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.27% (0.2738 => 0.2855, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 4.02% (1.0781 => 1.1214, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 3.97% (4.2109 => 4.3782, std. dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.95% (2.7292 => 2.8369, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.56% (0.2866 => 0.2968, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.55% (1.9694 => 2.0393, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash: 3.55% (0.4146 => 0.4293, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.51% (0.2875 => 0.2976, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 3.38% (5.5417 => 5.7290, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.35% (0.4658 => 0.4814, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.32% (1.9966 => 2.0628, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3124 => 0.3226, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.24% (2.0673 => 2.1342, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.23% (0.3096 => 0.3196, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.23% (0.3903 => 0.4029, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (0.3625 => 0.3741, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.18% (0.3362 => 0.3469, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.15% (0.9909 => 1.0221, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 3.12% (0.3267 => 0.3369, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.12% (0.3845 => 0.3965, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.07% (4.4195 => 4.5552, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 3.07% (0.3258 => 0.3358, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.06% (0.3890 => 0.4009, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 2.97% (2.1013 => 2.1637, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.94% (1.8794 => 1.9347, std. dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 2.91% (4.6177 => 4.7522, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/lists1: 2.88% (0.3477 => 0.3577, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.85% (0.3678 => 0.3783, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 2.82% (0.3726 => 0.3831, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.73% (0.4139 => 0.4252, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.71% (2.1653 => 2.2240, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 2.39% (0.9697 => 0.9929, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.38% (0.6634 => 0.6792, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.35% (0.7875 => 0.8060, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 2.32% (1.4269 => 1.4600, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.06% (0.5546 => 0.5660, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 2.05% (23.5202 => 24.0029, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.6435 => 0.6553, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.39% (5.2852 => 11.7539, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 54.95% (0.2162 => 0.3350, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.93% (10.7630 => 13.6614, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/objinst: 19.72% (9.4436 => 11.3060, std. dev.: 0.0366) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.50% (0.5589 => 0.6679, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 13.47% (32.9687 => 37.4096, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 6.98% (15.4430 => 16.5216, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.74% (3.3903 => 3.6189, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: 5.41% (19.6305 => 20.6933, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 5.32% (2.8036 => 2.9528, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-2: 5.05% (1.8057 => 1.8968, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.07% (2.2962 => 2.3896, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.34% (3.1722 => 3.2465, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.24% (3.1728 => 3.2439, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 1.90% (15.8721 => 16.1736, std. dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/fldry: 1.82% (17.2379 => 17.5520, std. dev.: 0.1018) MultiSource/Applications/sgefa/sgefa: 1.42% (1.5554 => 1.5775, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.33% (2.4764 => 2.3939, std. dev.: 0.0097) MultiSource/Applications/kimwitu++/kc: -1.90% (11.9555 => 11.7282, std. dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.84% (6.2401 => 4.1282, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -8.91% (0.2402 => 0.2188, std. dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: -4.54% (14.0481 => 13.4101, std. dev.: 0.0450) SingleSource/Benchmarks/Misc/salsa20: -3.83% (35.5013 => 34.1401, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: -2.77% (12.0509 => 11.7172, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5754, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 20:34:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 22:34:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120721033453.1F63C2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2259?compare_to=2256&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2259, Order: 160595, Start Time: 2012-07-21 02:20:57, End Time: 2012-07-21 03:35:08 To: 2256, Order: 160590, Start Time: 2012-07-21 00:05:23, End Time: 2012-07-21 01:19:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (141 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.92% (3.7666 => 3.8389, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ary3: 1.14% (3.7088 => 3.7509, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -2.78% (1.4195 => 1.3800, std. dev.: 0.0118) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.84% (2.0176 => 2.3170, std. dev.: 0.0121) SingleSource/UnitTests/ObjC++/property-reference-object: 9.26% (0.5818 => 0.6357, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.18% (0.7061 => 0.7709, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.01% (0.5748 => 0.6266, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3578 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.58% (0.3601 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.50% (0.3646 => 0.3956, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.35% (0.3663 => 0.3969, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3789 => 0.4104, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.30% (0.3650 => 0.3953, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3623 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.19% (0.4003 => 0.4331, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.02% (0.3914 => 0.4228, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.92% (0.3940 => 0.4252, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 7.60% (1.3693 => 1.4733, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.20% (0.1986 => 0.2129, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.63% (0.7710 => 0.8221, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.62% (0.7038 => 0.7504, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 6.57% (0.4062 => 0.4329, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.44% (3.9660 => 4.2214, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.19% (0.5265 => 0.5591, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.08% (0.2781 => 0.2950, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.87% (0.3899 => 0.4128, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.82% (0.3022 => 0.3198, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.82% (0.2782 => 0.2944, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.82% (0.2628 => 0.2781, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3580 => 0.3788, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.77% (1.9828 => 2.0973, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.3107 => 0.3284, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2607 => 0.2753, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.54% (0.2726 => 0.2877, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3489 => 0.3682, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2761 => 0.2912, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.46% (0.6959 => 0.7339, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.44% (0.4390 => 0.4629, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2696 => 0.2839, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.30% (0.4379 => 0.4611, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.22% (0.3485 => 0.3667, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 5.15% (0.2988 => 0.3142, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.15% (0.3534 => 0.3716, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.14% (1.2193 => 1.2820, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.03% (0.9199 => 0.9662, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.97% (13.8202 => 14.5064, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/moments: 4.89% (0.3868 => 0.4057, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.87% (0.3453 => 0.3621, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.78% (0.4016 => 0.4208, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.74% (16.6129 => 17.3996, std. dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3756 => 0.3932, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3293 => 0.3447, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (13.2842 => 13.8988, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.61% (0.5577 => 0.5834, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.42% (1.4563 => 1.5207, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.39% (1.3819 => 1.4425, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 4.37% (3.8646 => 4.0333, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.36% (0.2914 => 0.3041, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.34% (1.3813 => 1.4413, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.34% (1.1364 => 1.1857, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.33% (0.5637 => 0.5881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.24% (0.2945 => 0.3070, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.21% (1.0594 => 1.1040, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.14% (7.2180 => 7.5167, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (0.8310 => 0.8652, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.11% (1.3245 => 1.3790, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.10% (1.1061 => 1.1514, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.01% (0.7506 => 0.7807, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.99% (0.7460 => 0.7758, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.96% (1.9270 => 2.0034, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.80% (3.6692 => 3.8088, std. dev.: 0.0110) MultiSource/Applications/hexxagon/hexxagon: 3.77% (1.2292 => 1.2755, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 3.66% (0.3220 => 0.3338, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.66% (4.3801 => 4.5406, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.59% (0.4791 => 0.4963, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.44% (4.4433 => 4.5962, std. dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: 3.41% (0.2995 => 0.3097, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.38% (0.3755 => 0.3882, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.29% (2.1791 => 2.2509, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.19% (4.9865 => 5.1456, std. dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.09% (0.6283 => 0.6477, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.04% (0.8698 => 0.8962, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.94% (1.1333 => 1.1666, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.79% (0.6135 => 0.6306, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.74% (3.1889 => 3.2764, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 2.58% (0.4113 => 0.4219, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.51% (6.5754 => 6.7403, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 2.47% (8.4961 => 8.7057, std. dev.: 0.0188) MultiSource/Applications/JM/lencod/lencod: 2.47% (14.8535 => 15.2197, std. dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: 2.34% (14.5298 => 14.8697, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.33% (2.1007 => 2.1497, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 2.23% (16.2614 => 16.6248, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.19% (3.2742 => 3.3459, std. dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.99% (1.5188 => 1.5490, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.95% (4.6629 => 4.7539, std. dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.27% (0.9108 => 0.9224, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.05% (1.0313 => 1.0421, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.14% (0.1824 => 0.3231, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 56.43% (0.1322 => 0.2068, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 26.23% (1.8175 => 2.2943, std. dev.: 0.0317) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.17% (1.2998 => 1.3800, std. dev.: 0.0118) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.93% (1.5824 => 1.6763, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.91% (0.9996 => 1.0487, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/salsa20: 4.30% (7.4271 => 7.7464, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7310, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.25% (12.4560 => 12.8603, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4753, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.42% (1.7688 => 1.8116, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.41% (2.8606 => 2.9295, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.18% (2.0200 => 2.0641, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5624, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.12% (4.1080 => 4.1952, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 2.06% (0.6159 => 0.6286, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5089 => 1.5360, std. dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 1.74% (3.7731 => 3.8389, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5122, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.28% (9.0760 => 9.1924, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 1.28% (3.1736 => 3.2141, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 1.27% (2.4679 => 2.4992, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.31% (22.5627 => 21.1390, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.44% (0.0997 => 0.0853, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.73% (1.2308 => 1.1111, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -4.90% (2.6470 => 2.5172, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.77% (1.3780 => 1.3123, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9822, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.34% (1.9762 => 1.9102, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.67% (3.0263 => 2.9454, std. dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.57% (0.4867 => 0.4742, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9349, std. dev.: 0.0224) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2344, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5132, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7611, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9963, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8571, std. dev.: 0.0114) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.34% (2.5254 => 2.4916, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.2225 => 27.8617, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2554, std. dev.: 0.0030) MultiSource/Applications/lua/lua: -1.09% (26.5159 => 26.2257, std. dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8465, std. dev.: 0.0052) MultiSource/Applications/minisat/minisat: -1.00% (9.3358 => 9.2423, std. dev.: 0.0332) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 20:39:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 20 Jul 2012 22:39:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120721033917.B29532A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2260?compare_to=2257&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2260, Order: 160595, Start Time: 2012-07-21 02:20:58, End Time: 2012-07-21 03:39:32 To: 2257, Order: 160590, Start Time: 2012-07-21 00:23:21, End Time: 2012-07-21 01:41:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (83 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (761 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.60% (10.3673 => 13.8506, std. dev.: 0.0084) SingleSource/UnitTests/ObjC/trivial-interface: 12.78% (0.3473 => 0.3917, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: 12.58% (0.3497 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.53% (0.3543 => 0.3987, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 12.36% (0.3561 => 0.4001, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.34% (0.3516 => 0.3950, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.28% (0.3543 => 0.3978, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 12.05% (0.3694 => 0.4139, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.66% (1.1194 => 1.2499, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.52% (0.3828 => 0.4269, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3927 => 0.4372, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 11.32% (0.3886 => 0.4326, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.98% (2.2022 => 2.3999, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.52% (1.7609 => 1.9110, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 7.58% (0.1622 => 0.1745, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.52% (0.6030 => 0.6423, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.45% (0.5925 => 0.6307, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.34% (0.7326 => 0.7717, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.27% (0.4879 => 0.5136, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.23% (10.4361 => 10.9817, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/oourafft: 5.03% (0.3282 => 0.3447, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.01% (7.0540 => 7.4075, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.59% (0.4615 => 0.4827, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.99% (4.9449 => 5.1423, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 3.97% (0.7433 => 0.7728, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.90% (5.0018 => 5.1969, std. dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 3.75% (9.4845 => 9.8403, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.57% (0.8172 => 0.8464, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.47% (0.4636 => 0.4797, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.45% (0.5569 => 0.5761, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.36% (4.2646 => 4.4078, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.27% (8.1363 => 8.4025, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.26% (0.5860 => 0.6051, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 3.24% (0.7835 => 0.8089, std. dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.20% (0.3121 => 0.3221, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.18% (0.3180 => 0.3281, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.16% (14.3668 => 14.8202, std. dev.: 0.0111) MultiSource/Applications/hbd/hbd: 3.03% (1.5603 => 1.6075, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 3.01% (0.3423 => 0.3526, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 2.98% (0.3387 => 0.3488, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.82% (0.3826 => 0.3934, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.81% (5.7591 => 5.9211, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.80% (1.1861 => 1.2193, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.77% (1.3050 => 1.3412, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.74% (0.3650 => 0.3750, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 2.70% (3.3354 => 3.4256, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.70% (2.0665 => 2.1223, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.61% (0.3865 => 0.3966, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 2.59% (0.4289 => 0.4400, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.54% (1.5415 => 1.5806, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.49% (0.5105 => 0.5232, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.40% (2.0273 => 2.0759, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 2.37% (1.1642 => 1.1918, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.33% (0.8067 => 0.8255, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (0.4620 => 0.4721, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.12% (0.6456 => 0.6593, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.06% (0.9765 => 0.9966, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.05% (0.6675 => 0.6812, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.05% (3.8723 => 3.9515, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6450 => 0.6574, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.90% (2.2024 => 2.2443, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.84% (1.2842 => 1.3078, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.73% (1.5859 => 1.6134, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.64% (1.4186 => 1.4419, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.63% (17.1811 => 17.4620, std. dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/football/football: 1.50% (0.8921 => 0.9055, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.37% (1.1840 => 1.2002, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.13% (2.6778 => 2.9759, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.59% (5.3999 => 5.7560, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.36% (3.6395 => 3.7618, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5086 => 1.5351, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8420, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.0554 => 1.0730, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.65% (3.1578 => 3.2099, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2461, std. dev.: 0.0206) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.22% (2.6546 => 2.6869, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.03% (3.2416 => 3.2751, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.36% (5.2763 => 3.1467, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.24% (5.3855 => 3.7030, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.42% (5.3526 => 3.7242, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.30% (2.9384 => 2.5475, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -10.15% (22.1758 => 19.9246, std. dev.: 0.0279) SingleSource/UnitTests/Vector/constpool: -4.95% (54.1659 => 51.4845, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.21% (3.8922 => 3.8450, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.59% (1.1492 => 0.7632, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.36% (1.2373 => 1.1091, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -8.16% (1.5373 => 1.4119, std. dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.45% (2.7294 => 2.5533, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.20% (8.1563 => 7.8951, std. dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4912, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.11% (8.6802 => 8.4103, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.35% (1.7254 => 1.6848, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.13% (10.2830 => 10.0639, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.59% (1.3677 => 1.3460, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.59% (2.0866 => 2.0535, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.47% (2.5528 => 2.5154, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.41% (4.2280 => 4.1682, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: -1.40% (12.5348 => 12.3592, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 22:17:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 21 Jul 2012 00:17:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120721051702.F17072A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2261?compare_to=2259&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2261, Order: 160600, Start Time: 2012-07-21 04:03:07, End Time: 2012-07-21 05:17:18 To: 2259, Order: 160595, Start Time: 2012-07-21 02:20:57, End Time: 2012-07-21 03:35:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (140 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.00% (9.0270 => 9.1173, std. dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -1.30% (3.7509 => 3.7023, std. dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.60% (2.0176 => 2.3122, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.80% (0.5818 => 0.6388, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.57% (0.5748 => 0.6298, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.43% (0.7061 => 0.7727, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 9.00% (0.3578 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.85% (0.3650 => 0.3973, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 8.80% (0.3601 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.72% (0.3646 => 0.3964, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3663 => 0.3981, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.61% (0.3623 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.60% (0.3789 => 0.4115, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.54% (0.4003 => 0.4345, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.51% (0.3914 => 0.4247, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.43% (0.3940 => 0.4272, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.38% (1.3693 => 1.4703, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.15% (0.1986 => 0.2128, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.65% (0.2721 => 0.2902, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (0.4328 => 0.4612, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.37% (0.7710 => 0.8201, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.37% (3.9660 => 4.2185, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 6.35% (0.7038 => 0.7485, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 6.28% (0.4062 => 0.4317, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.27% (0.5265 => 0.5595, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2596 => 0.2757, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.11% (0.2781 => 0.2951, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.99% (0.3022 => 0.3203, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2655 => 0.2813, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.90% (0.2782 => 0.2946, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.69% (1.9828 => 2.0956, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.65% (0.2760 => 0.2916, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 5.61% (0.2761 => 0.2916, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.59% (0.2628 => 0.2775, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3489 => 0.3682, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.3107 => 0.3277, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.46% (0.3149 => 0.3321, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.44% (0.3899 => 0.4111, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.39% (0.3580 => 0.3773, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.31% (0.3485 => 0.3670, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.23% (0.4379 => 0.4608, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.20% (0.6959 => 0.7321, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.13% (0.4390 => 0.4615, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.11% (1.2193 => 1.2816, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 5.09% (13.8202 => 14.5230, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.98% (0.4016 => 0.4216, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 4.95% (0.3534 => 0.3709, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.94% (0.9199 => 0.9653, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: 4.89% (0.3868 => 0.4057, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.82% (16.6129 => 17.4141, std. dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (0.3756 => 0.3935, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.5577 => 0.5838, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.61% (13.2842 => 13.8966, std. dev.: 0.0181) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.60% (1.3813 => 1.4449, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.58% (1.3819 => 1.4452, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.41% (0.2925 => 0.3054, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.41% (1.4563 => 1.5205, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 4.35% (1.1061 => 1.1542, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.29% (0.5637 => 0.5879, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.22% (1.1364 => 1.1844, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.19% (0.2914 => 0.3036, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 4.17% (3.8646 => 4.0258, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.16% (0.7460 => 0.7770, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.15% (7.2180 => 7.5178, std. dev.: 0.0120) MultiSource/Benchmarks/nbench/nbench: 4.14% (1.0594 => 1.1033, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.3245 => 1.3793, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.13% (0.3246 => 0.3380, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.00% (0.7506 => 0.7806, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 3.98% (0.8310 => 0.8641, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 3.92% (1.9270 => 2.0026, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 3.90% (1.2292 => 1.2771, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.62% (4.3801 => 4.5385, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.60% (3.6692 => 3.8013, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.59% (0.4791 => 0.4963, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 3.57% (0.3220 => 0.3335, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.54% (4.4433 => 4.6007, std. dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3755 => 0.3888, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 3.40% (2.1791 => 2.2531, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.33% (4.9865 => 5.1527, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.23% (0.6283 => 0.6486, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.12% (0.8698 => 0.8969, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.02% (0.6135 => 0.6320, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.94% (1.1333 => 1.1666, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.92% (3.1889 => 3.2819, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 2.74% (6.5754 => 6.7553, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 2.51% (8.4961 => 8.7095, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 2.39% (14.8535 => 15.2089, std. dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: 2.39% (16.2614 => 16.6499, std. dev.: 0.0244) MultiSource/Applications/ClamAV/clamscan: 2.35% (14.5298 => 14.8716, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.25% (2.1007 => 2.1479, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 2.25% (4.6629 => 4.7676, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.01% (1.5188 => 1.5493, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (3.2742 => 3.3364, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.16% (0.9108 => 0.9214, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.03% (0.1824 => 0.3229, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 56.73% (0.1322 => 0.2072, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 26.35% (1.8175 => 2.2964, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/mandel-2: 7.56% (1.2998 => 1.3980, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.98% (1.5824 => 1.6771, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.33% (0.9996 => 1.0529, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 4.25% (7.4271 => 7.7425, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7324, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (12.4560 => 12.8575, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4753, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0006) MultiSource/Benchmarks/llubenchmark/llu: 2.45% (3.7731 => 3.8654, std. dev.: 0.0284) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0560, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.41% (2.8606 => 2.9296, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.36% (1.7688 => 1.8106, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.18% (2.0200 => 2.0640, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5624, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.09% (4.1080 => 4.1938, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 2.06% (0.6159 => 0.6286, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5089 => 1.5363, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 1.27% (2.4679 => 2.4992, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.17% (1.9290 => 1.9516, std. dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.17% (22.5627 => 21.1713, std. dev.: 0.0132) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2308 => 1.1107, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3075, std. dev.: 0.0071) SingleSource/UnitTests/Vector/multiplies: -4.87% (2.6470 => 2.5181, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9822, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.41% (1.9762 => 1.9089, std. dev.: 0.0031) MultiSource/Applications/spiff/spiff: -2.58% (3.0263 => 2.9481, std. dev.: 0.0101) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.57% (0.4867 => 0.4742, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.33% (0.8342 => 0.8148, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2295, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9392, std. dev.: 0.0438) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5068, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7607, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.59% (7.1097 => 6.9968, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.5254 => 2.4901, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.2225 => 27.8610, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2169, std. dev.: 0.0048) MultiSource/Applications/lua/lua: -1.17% (26.5159 => 26.2061, std. dev.: 0.0366) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2593, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 22:26:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 21 Jul 2012 00:26:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120721052648.863AE2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2262?compare_to=2260&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2262, Order: 160601, Start Time: 2012-07-21 04:08:35, End Time: 2012-07-21 05:27:03 To: 2260, Order: 160595, Start Time: 2012-07-21 02:20:58, End Time: 2012-07-21 03:39:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (73 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (771 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.18% (55.2513 => 56.4532, std. dev.: 0.1052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.03% (13.8506 => 13.5691, std. dev.: 0.0086) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.88% (10.3673 => 13.5691, std. dev.: 0.0086) SingleSource/UnitTests/ObjC/trivial-interface: 12.44% (0.3473 => 0.3905, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.35% (0.3497 => 0.3929, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.22% (0.3543 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3516 => 0.3944, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.11% (0.3543 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.02% (0.3561 => 0.3989, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2483, std. dev.: 0.0096) SingleSource/UnitTests/ObjC/exceptions: 11.36% (0.3828 => 0.4263, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.22% (0.3886 => 0.4322, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.61% (2.2022 => 2.3919, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.27% (1.7609 => 1.9065, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.97% (0.1622 => 0.1735, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.67% (0.6030 => 0.6432, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.48% (0.5925 => 0.6309, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.34% (0.1892 => 0.2012, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.32% (0.7326 => 0.7716, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.32% (0.3177 => 0.3346, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.80% (10.4361 => 10.9372, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.53% (7.0540 => 7.3736, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.3282 => 0.3429, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.44% (0.4615 => 0.4820, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.35% (0.4879 => 0.5091, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (4.9449 => 5.1363, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 3.83% (0.7433 => 0.7718, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.50% (5.0018 => 5.1768, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.48% (0.5569 => 0.5763, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (9.4845 => 9.8066, std. dev.: 0.0125) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.30% (0.8172 => 0.8442, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.29% (0.5860 => 0.6053, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.08% (8.1363 => 8.3869, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.05% (4.2646 => 4.3948, std. dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.98% (0.4636 => 0.4774, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.83% (14.3668 => 14.7727, std. dev.: 0.0041) MultiSource/Applications/spiff/spiff: 2.81% (0.7835 => 0.8055, std. dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 2.70% (5.7591 => 5.9146, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.62% (1.5603 => 1.6012, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.60% (3.3354 => 3.4221, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.59% (1.3050 => 1.3388, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.56% (1.5415 => 1.5809, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.44% (1.1861 => 1.2151, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.34% (2.0273 => 2.0747, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.23% (2.0665 => 2.1126, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.16% (1.1642 => 1.1894, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.03% (0.8067 => 0.8231, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.98% (0.5105 => 0.5206, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 1.86% (0.6456 => 0.6576, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.85% (0.9765 => 0.9946, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 1.85% (3.8723 => 3.9440, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.77% (0.6450 => 0.6564, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (0.6675 => 0.6790, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.60% (17.1811 => 17.4559, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.58% (2.2024 => 2.2373, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.58% (1.2842 => 1.3045, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.46% (1.4186 => 1.4393, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.45% (1.5859 => 1.6089, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.07% (1.1840 => 1.1967, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9756, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.66% (5.3999 => 5.7596, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.37% (3.6395 => 3.7623, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.01% (1.0313 => 1.0520, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5357, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8414, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.60% (3.1578 => 3.2083, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.44% (2.6546 => 2.6927, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2193, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.04% (3.2416 => 3.2752, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.02% (6.6465 => 6.7144, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1299, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.51% (5.2763 => 3.1387, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.41% (5.3855 => 3.6939, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.69% (5.3526 => 3.7098, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.41% (2.9384 => 2.5445, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -10.27% (22.1758 => 19.8984, std. dev.: 0.0218) SingleSource/UnitTests/Vector/constpool: -4.92% (54.1659 => 51.5011, std. dev.: 0.0320) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.42% (3.8922 => 3.8369, std. dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.59% (1.1492 => 0.7632, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2373 => 1.1061, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -7.44% (1.5373 => 1.4230, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.45% (2.7294 => 2.5533, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.23% (8.1563 => 7.8926, std. dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4829, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4124, std. dev.: 0.0068) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.39% (0.4808 => 0.4693, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.28% (1.7254 => 1.6860, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.18% (10.2830 => 10.0593, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.66% (1.3677 => 1.3450, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.59% (2.0866 => 2.0535, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.48% (2.5528 => 2.5151, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.46% (12.5348 => 12.3523, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.43% (4.2280 => 4.1677, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 22:40:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 21 Jul 2012 00:40:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120721054014.ABC242A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2263?compare_to=2258&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2263, Order: 160597, Start Time: 2012-07-21 02:55:54, End Time: 2012-07-21 05:40:30 To: 2258, Order: 160589, Start Time: 2012-07-20 23:43:00, End Time: 2012-07-21 02:27:52 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (83 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (803 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.48% (0.3465 => 0.3932, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-3: 13.38% (0.3460 => 0.3923, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.38% (0.3446 => 0.3907, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.34% (0.3442 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.27% (0.3488 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.27% (0.3496 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.26% (0.3469 => 0.3929, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 12.66% (0.3650 => 0.4112, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.63% (0.3643 => 0.4103, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.33% (0.3724 => 0.4183, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5826 => 0.6251, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.93% (0.5889 => 0.6297, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 6.16% (1.5932 => 1.6914, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 5.47% (0.7171 => 0.7563, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.37% (1.6211 => 1.7082, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.27% (3.5627 => 3.7503, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.76% (0.5026 => 0.5265, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.75% (0.4994 => 0.5231, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.70% (0.4361 => 0.4566, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.69% (0.5900 => 0.6177, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.56% (0.5000 => 0.5228, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.53% (0.3930 => 0.4108, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.47% (0.4029 => 0.4209, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.46% (1.3152 => 1.3738, std. dev.: 0.0030) MultiSource/Applications/d/make_dparser: 4.37% (1.0781 => 1.1252, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.30% (2.7292 => 2.8466, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.2866 => 0.2987, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.16% (0.2738 => 0.2852, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.09% (4.2109 => 4.3833, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (1.9694 => 2.0468, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.62% (0.2875 => 0.2979, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.61% (0.2823 => 0.2925, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 3.52% (5.5417 => 5.7368, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.51% (0.3362 => 0.3480, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (0.4658 => 0.4819, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (1.9966 => 2.0654, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.36% (2.0673 => 2.1368, std. dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 3.31% (0.9909 => 1.0237, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/wc: 3.29% (0.3096 => 0.3198, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.29% (1.8794 => 1.9413, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.19% (4.4195 => 4.5607, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.16% (0.3890 => 0.4013, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.15% (0.3267 => 0.3370, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.15% (0.3845 => 0.3966, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.12% (2.1013 => 2.1669, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary: 3.07% (0.3258 => 0.3358, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.02% (2.1653 => 2.2307, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 2.86% (4.6177 => 4.7499, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.84% (0.3903 => 0.4014, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.83% (0.9697 => 0.9971, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (0.3625 => 0.3727, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 2.80% (0.3678 => 0.3781, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 2.79% (0.3726 => 0.3830, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.76% (0.7875 => 0.8092, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.67% (0.6634 => 0.6811, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.63% (0.4139 => 0.4248, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 2.63% (0.4146 => 0.4255, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 2.49% (1.4269 => 1.4624, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 2.45% (0.4251 => 0.4355, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.34% (23.5202 => 24.0709, std. dev.: 0.0044) MultiSource/Applications/Burg/burg: 2.25% (0.5546 => 0.5671, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.85% (0.6435 => 0.6554, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.21% (2.0346 => 2.0592, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.40% (5.2852 => 11.7544, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.27% (0.2162 => 0.3357, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.93% (10.7630 => 13.6610, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.81% (0.5589 => 0.6696, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/objinst: 19.23% (9.4436 => 11.2594, std. dev.: 0.0437) SingleSource/Benchmarks/Shootout/lists: 13.46% (32.9687 => 37.4057, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 7.03% (15.4430 => 16.5280, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.76% (3.3903 => 3.6195, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/whetstone: 5.68% (2.8036 => 2.9628, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout/matrix: 5.41% (19.6305 => 20.6928, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8943, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.07% (2.2962 => 2.3897, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.35% (3.1722 => 3.2469, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (3.1728 => 3.2442, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 1.92% (15.8721 => 16.1770, std. dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 1.41% (1.5554 => 1.5774, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.19% (17.2379 => 17.4434, std. dev.: 0.0477) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.09% (2.4764 => 2.3998, std. dev.: 0.0116) MultiSource/Applications/kimwitu++/kc: -1.68% (11.9555 => 11.7545, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.80% (6.2401 => 4.1309, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -9.33% (0.2402 => 0.2178, std. dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: -4.26% (14.0481 => 13.4502, std. dev.: 0.0236) SingleSource/Benchmarks/Misc/salsa20: -3.82% (35.5013 => 34.1440, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: -3.03% (12.0509 => 11.6863, std. dev.: 0.0411) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5754, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 20 23:59:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 21 Jul 2012 01:59:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120721065920.F0A4A2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2264?compare_to=2261&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2264, Order: 160601, Start Time: 2012-07-21 05:45:21, End Time: 2012-07-21 06:59:36 To: 2261, Order: 160600, Start Time: 2012-07-21 04:03:07, End Time: 2012-07-21 05:17:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (137 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.4935 => 56.5226, std. dev.: 0.0811) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.49% (2.0176 => 2.3100, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.63% (0.5818 => 0.6378, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.38% (0.7061 => 0.7723, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 9.34% (0.5748 => 0.6285, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3578 => 0.3887, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3601 => 0.3904, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.26% (0.3646 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.25% (0.3650 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.16% (0.3663 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.14% (0.3623 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.08% (0.3789 => 0.4095, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.89% (0.3914 => 0.4223, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.4003 => 0.4318, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.84% (0.3940 => 0.4249, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.70% (0.3130 => 0.3371, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.64% (1.3693 => 1.4739, std. dev.: 0.0283) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (0.4328 => 0.4616, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.62% (0.7038 => 0.7504, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.42% (3.9660 => 4.2205, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.33% (0.7710 => 0.8198, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.21% (0.1819 => 0.1932, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2596 => 0.2757, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 6.18% (0.2781 => 0.2953, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.17% (0.5265 => 0.5590, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.11% (0.4062 => 0.4310, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 5.98% (0.2607 => 0.2763, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.86% (0.2782 => 0.2945, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.80% (0.2726 => 0.2884, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.79% (0.2937 => 0.3107, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.3107 => 0.3284, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.69% (0.2760 => 0.2917, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.68% (0.3149 => 0.3328, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.67% (1.9828 => 2.0953, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.2655 => 0.2804, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 5.59% (0.2628 => 0.2775, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.49% (0.2696 => 0.2844, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.37% (0.3485 => 0.3672, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.31% (0.3899 => 0.4106, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.23% (1.2193 => 1.2831, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.23% (0.6959 => 0.7323, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.14% (0.3192 => 0.3356, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.13% (0.4390 => 0.4615, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.07% (0.4379 => 0.4601, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.96% (0.4016 => 0.4215, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.93% (13.8202 => 14.5011, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.91% (0.9199 => 0.9651, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (0.3756 => 0.3939, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 4.78% (0.3868 => 0.4053, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.72% (13.2842 => 13.9115, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.5577 => 0.5838, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.60% (1.4563 => 1.5233, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.50% (1.3813 => 1.4434, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 4.46% (16.6129 => 17.3539, std. dev.: 0.0175) MultiSource/Benchmarks/McCat/09-vor/vor: 4.41% (0.2925 => 0.3054, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.35% (0.5637 => 0.5882, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.34% (0.3246 => 0.3387, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.34% (1.3819 => 1.4419, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.34% (1.1364 => 1.1857, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.21% (1.1061 => 1.1527, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 4.18% (0.8310 => 0.8657, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.17% (7.2180 => 7.5188, std. dev.: 0.0062) MultiSource/Applications/spiff/spiff: 4.10% (0.7506 => 0.7814, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.10% (1.0594 => 1.1028, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.02% (1.9270 => 2.0045, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.02% (0.7460 => 0.7760, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.98% (0.2914 => 0.3030, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.96% (3.8646 => 4.0177, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.93% (1.3245 => 1.3766, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.64% (3.6692 => 3.8028, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (4.3801 => 4.5393, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3755 => 0.3890, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.56% (4.4433 => 4.6016, std. dev.: 0.0046) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3220 => 0.3330, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.34% (0.4791 => 0.4951, std. dev.: 0.0044) MultiSource/Applications/siod/siod: 3.23% (2.1791 => 2.2494, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.06% (0.8698 => 0.8964, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.99% (4.9865 => 5.1354, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.98% (1.1333 => 1.1671, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.87% (0.6135 => 0.6311, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 2.80% (3.1889 => 3.2782, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 2.68% (6.5754 => 6.7516, std. dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 2.51% (14.8535 => 15.2257, std. dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 2.46% (8.4961 => 8.7054, std. dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 2.44% (14.5298 => 14.8837, std. dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 2.39% (16.2614 => 16.6507, std. dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.38% (2.1007 => 2.1506, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.06% (3.2742 => 3.3417, std. dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 2.02% (4.6629 => 4.7571, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.84% (1.5188 => 1.5468, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.21% (0.9108 => 0.9218, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 76.92% (0.1824 => 0.3227, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/mst/mst: 56.66% (0.1322 => 0.2071, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 26.14% (1.8175 => 2.2926, std. dev.: 0.0503) SingleSource/Benchmarks/Misc/mandel-2: 8.39% (1.2998 => 1.4089, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.97% (1.5824 => 1.6768, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.04% (0.9996 => 1.0500, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 4.26% (7.4271 => 7.7433, std. dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7323, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (12.4560 => 12.8567, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4754, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.54% (2.8606 => 2.9332, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.41% (1.7688 => 1.8115, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.17% (2.0200 => 2.0638, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5624, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.10% (4.1080 => 4.1941, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.81% (1.5089 => 1.5362, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.56% (1.4298 => 1.4521, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 1.36% (0.7499 => 0.7601, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1969, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 1.27% (2.4679 => 2.4993, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.24% (0.8239 => 0.8341, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.09% (3.1736 => 3.2082, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.26% (22.5627 => 21.1501, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.52% (1.2308 => 1.1013, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3079, std. dev.: 0.0065) SingleSource/UnitTests/Vector/multiplies: -4.78% (2.6470 => 2.5205, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.37% (1.9762 => 1.9096, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9449, std. dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.59% (0.4867 => 0.4741, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2188, std. dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9460, std. dev.: 0.0409) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7605, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.59% (7.1097 => 6.9965, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8663, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.2225 => 27.8613, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4935, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2551, std. dev.: 0.0049) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2351, std. dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8471, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 21 01:56:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 21 Jul 2012 03:56:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120721085659.4F9672A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2265?compare_to=2263&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2265, Order: 160601, Start Time: 2012-07-21 06:08:31, End Time: 2012-07-21 08:57:14 To: 2263, Order: 160597, Start Time: 2012-07-21 02:55:54, End Time: 2012-07-21 05:40:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (70 on baseline) Performance Improvements: 0 (7 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (817 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 4.64% (0.2178 => 0.2279, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.72% (2.0735 => 2.1091, std. dev.: 0.0130) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 39.53% (0.3792 => 0.5291, std. dev.: 0.0284) SingleSource/UnitTests/ObjC/exceptions-4: 13.45% (0.3465 => 0.3931, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/exceptions-2: 13.35% (0.3446 => 0.3906, std. dev.: 0.0080) SingleSource/UnitTests/ObjC/exceptions-3: 13.24% (0.3460 => 0.3918, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.22% (0.3488 => 0.3949, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/for-in: 13.22% (0.3496 => 0.3958, std. dev.: 0.0080) SingleSource/UnitTests/ObjC/trivial-interface: 13.19% (0.3442 => 0.3896, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/synchronized: 13.17% (0.3469 => 0.3926, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/property: 12.58% (0.3650 => 0.4109, std. dev.: 0.0076) SingleSource/UnitTests/ObjC/exceptions: 12.57% (0.3643 => 0.4101, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/parameter-passing: 12.30% (0.3724 => 0.4182, std. dev.: 0.0059) SingleSource/UnitTests/ObjC++/Hello: 7.12% (0.5826 => 0.6241, std. dev.: 0.0132) SingleSource/UnitTests/ObjC++/property-reference-object: 6.93% (0.5889 => 0.6297, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.48% (0.1620 => 0.1725, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 6.41% (0.7171 => 0.7631, std. dev.: 0.0148) MultiSource/Applications/oggenc/oggenc: 5.52% (1.5932 => 1.6811, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.37% (0.3930 => 0.4141, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.17% (3.5627 => 3.7470, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.11% (1.6211 => 1.7040, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.07% (0.5900 => 0.6199, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.84% (0.4361 => 0.4572, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.81% (0.5026 => 0.5268, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.53% (1.3152 => 1.3748, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.51% (0.4994 => 0.5219, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.34% (0.5000 => 0.5217, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 4.23% (4.2109 => 4.3889, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 4.12% (0.4029 => 0.4195, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.07% (2.7292 => 2.8403, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 4.01% (1.0781 => 1.1213, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.98% (0.2866 => 0.2980, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.76% (1.9694 => 2.0434, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.43% (1.9966 => 2.0651, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 3.33% (0.3096 => 0.3199, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.29% (0.3890 => 0.4018, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.29% (5.5417 => 5.7238, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.27% (4.4195 => 4.5640, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.18% (0.3362 => 0.3469, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.12% (0.6634 => 0.6841, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.07% (0.4658 => 0.4801, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.07% (2.0673 => 2.1307, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.06% (0.9909 => 1.0212, std. dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 2.89% (2.1653 => 2.2279, std. dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 2.83% (4.6177 => 4.7486, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.3903 => 0.4013, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 2.77% (1.8794 => 1.9314, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 2.65% (0.7875 => 0.8084, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.49% (0.4139 => 0.4242, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 2.37% (1.4269 => 1.4607, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 2.26% (0.9697 => 0.9916, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 2.15% (0.5546 => 0.5665, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.72% (0.6435 => 0.6546, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.40% (5.2852 => 11.7541, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.55% (0.2162 => 0.3363, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.92% (10.7630 => 13.6607, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.15% (0.5589 => 0.6715, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/objinst: 19.33% (9.4436 => 11.2689, std. dev.: 0.0495) SingleSource/Benchmarks/Shootout/lists: 13.41% (32.9687 => 37.3899, std. dev.: 0.0232) SingleSource/Benchmarks/Misc/flops: 7.00% (15.4430 => 16.5236, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.73% (3.3903 => 3.6186, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: 5.41% (19.6305 => 20.6919, std. dev.: 0.0290) SingleSource/Benchmarks/Misc/flops-2: 4.95% (1.8057 => 1.8950, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/whetstone: 4.64% (2.8036 => 2.9336, std. dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.08% (2.2962 => 2.3899, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.48% (3.1722 => 3.2508, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (3.1728 => 3.2463, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 1.92% (15.8721 => 16.1775, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: 1.76% (17.2379 => 17.5415, std. dev.: 0.0519) MultiSource/Applications/sgefa/sgefa: 1.43% (1.5554 => 1.5776, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.84% (11.9555 => 11.7357, std. dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.82% (6.2401 => 4.1294, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -5.12% (0.2402 => 0.2279, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: -4.25% (14.0481 => 13.4509, std. dev.: 0.1781) SingleSource/Benchmarks/Misc/salsa20: -3.79% (35.5013 => 34.1573, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: -2.89% (12.0509 => 11.7023, std. dev.: 0.0216) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5754, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 21 03:24:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 21 Jul 2012 05:24:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120721102426.DC94E2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2266?compare_to=2264&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2266, Order: 160602, Start Time: 2012-07-21 09:09:04, End Time: 2012-07-21 10:24:41 To: 2264, Order: 160601, Start Time: 2012-07-21 05:45:21, End Time: 2012-07-21 06:59:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (135 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (725 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.48% (2.0176 => 2.3299, std. dev.: 0.0425) SingleSource/UnitTests/ObjC++/property-reference-object: 8.99% (0.5818 => 0.6341, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.92% (0.5748 => 0.6261, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.78% (0.3578 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.58% (0.3646 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.58% (0.3601 => 0.3910, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.47% (0.3650 => 0.3959, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 8.46% (0.3663 => 0.3973, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3789 => 0.4107, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3623 => 0.3926, std. dev.: 0.0080) SingleSource/UnitTests/ObjC/parameter-passing: 8.27% (0.4003 => 0.4334, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3914 => 0.4236, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.17% (0.3940 => 0.4262, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.11% (0.7061 => 0.7634, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.2721 => 0.2908, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 6.86% (1.3693 => 1.4633, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 6.79% (0.7038 => 0.7516, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.73% (3.9660 => 4.2328, std. dev.: 0.0554) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.65% (0.5265 => 0.5615, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.34% (0.7710 => 0.8199, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.28% (0.2596 => 0.2759, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.21% (0.1819 => 0.1932, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 6.15% (0.4328 => 0.4594, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.71% (0.4062 => 0.4294, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.68% (0.6959 => 0.7354, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.54% (0.5577 => 0.5886, std. dev.: 0.0057) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2781 => 0.2933, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.45% (1.2193 => 1.2858, std. dev.: 0.0172) MultiSource/Applications/SPASS/SPASS: 5.35% (13.8202 => 14.5599, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.33% (0.9199 => 0.9689, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.28% (0.3899 => 0.4105, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: 5.22% (0.2760 => 0.2904, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.21% (0.2782 => 0.2927, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.17% (0.3580 => 0.3765, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2655 => 0.2790, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.07% (0.3489 => 0.3666, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.06% (0.2765 => 0.2905, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.06% (0.2726 => 0.2864, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.06% (13.2842 => 13.9559, std. dev.: 0.2302) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.02% (1.3813 => 1.4507, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/fibo: 5.02% (0.2628 => 0.2760, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.02% (0.2690 => 0.2825, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.99% (0.2966 => 0.3114, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.96% (0.3485 => 0.3658, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.95% (0.3149 => 0.3305, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.93% (16.6129 => 17.4313, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/methcall: 4.93% (0.2761 => 0.2897, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.92% (0.3107 => 0.3260, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (1.3819 => 1.4492, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.2988 => 0.3133, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.83% (0.2937 => 0.3079, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.82% (0.2696 => 0.2826, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.75% (0.2127 => 0.2228, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.65% (1.1364 => 1.1892, std. dev.: 0.0166) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.55% (1.4563 => 1.5226, std. dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/ary2: 4.54% (0.3192 => 0.3337, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3246 => 0.3393, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 4.52% (0.3453 => 0.3609, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.49% (7.2180 => 7.5421, std. dev.: 0.0651) MultiSource/Benchmarks/MallocBench/gs/gs: 4.45% (3.8646 => 4.0365, std. dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/lists: 4.43% (0.3293 => 0.3439, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4390 => 0.4584, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.41% (0.4016 => 0.4193, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.40% (0.5637 => 0.5885, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.39% (0.2914 => 0.3042, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.39% (1.0594 => 1.1059, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/football/football: 4.38% (0.8310 => 0.8674, std. dev.: 0.0058) MultiSource/Applications/Burg/burg: 4.37% (1.1061 => 1.1544, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.37% (0.3756 => 0.3920, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.33% (0.3534 => 0.3687, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.28% (0.7506 => 0.7827, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.26% (1.3245 => 1.3809, std. dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/moments: 4.24% (0.3868 => 0.4032, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.22% (1.9270 => 2.0084, std. dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.14% (0.7460 => 0.7769, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (4.3801 => 4.5483, std. dev.: 0.0371) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (3.6692 => 3.8091, std. dev.: 0.0415) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.2945 => 0.3054, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.69% (0.4791 => 0.4968, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.64% (2.1791 => 2.2585, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.62% (4.4433 => 4.6040, std. dev.: 0.0358) MultiSource/Applications/hexxagon/hexxagon: 3.44% (1.2292 => 1.2715, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.41% (4.9865 => 5.1564, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.33% (0.6283 => 0.6492, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.28% (1.1333 => 1.1705, std. dev.: 0.0102) MultiSource/Applications/d/make_dparser: 3.14% (3.1889 => 3.2891, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.04% (0.3755 => 0.3869, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (6.5754 => 6.7695, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.90% (0.6135 => 0.6313, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.89% (0.8698 => 0.8949, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.77% (16.2614 => 16.7117, std. dev.: 0.0194) MultiSource/Applications/JM/lencod/lencod: 2.74% (14.8535 => 15.2607, std. dev.: 0.0189) MultiSource/Benchmarks/mafft/pairlocalalign: 2.72% (8.4961 => 8.7272, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 2.64% (14.5298 => 14.9127, std. dev.: 0.0116) MultiSource/Applications/oggenc/oggenc: 2.40% (4.6629 => 4.7748, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.38% (2.1007 => 2.1506, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.26% (3.2742 => 3.3482, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.15% (1.5188 => 1.5515, std. dev.: 0.0051) MultiSource/Applications/lemon/lemon: 1.51% (1.0313 => 1.0469, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.25% (0.1824 => 0.3233, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/mst/mst: 56.58% (0.1322 => 0.2070, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 26.35% (1.8175 => 2.2965, std. dev.: 0.0351) SingleSource/Benchmarks/Misc/mandel-2: 6.58% (1.2998 => 1.3853, std. dev.: 0.0164) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.95% (1.5824 => 1.6765, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.92% (0.9996 => 1.0488, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 4.39% (7.4271 => 7.7530, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.2619 => 11.7306, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.21% (12.4560 => 12.8560, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4744, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.41% (2.8606 => 2.9294, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.39% (1.7688 => 1.8111, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.37% (1.0310 => 1.0554, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.17% (2.0200 => 2.0639, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5624, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.13% (4.1080 => 4.1954, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 2.05% (0.6159 => 0.6285, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0076) MultiSource/Applications/lemon/lemon: 1.56% (1.4298 => 1.4521, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5105, std. dev.: 0.0323) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 1.26% (2.4679 => 2.4991, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 1.14% (3.1736 => 3.2097, std. dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.02% (22.5627 => 21.2045, std. dev.: 0.0414) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.75% (0.0997 => 0.0840, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -9.98% (1.2308 => 1.1080, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3092, std. dev.: 0.0074) SingleSource/UnitTests/Vector/multiplies: -4.87% (2.6470 => 2.5180, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.37% (1.9762 => 1.9097, std. dev.: 0.0231) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9480, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.55% (0.4867 => 0.4743, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4995, std. dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.97% (20.3410 => 19.9399, std. dev.: 0.0318) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2350, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7603, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9961, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.2225 => 27.8606, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8671, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4932, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.17% (26.5159 => 26.2069, std. dev.: 0.0236) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2595, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2368, std. dev.: 0.0201) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 21 03:27:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 21 Jul 2012 05:27:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120721102740.6C3782A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2267?compare_to=2262&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2267, Order: 160602, Start Time: 2012-07-21 09:08:57, End Time: 2012-07-21 10:27:56 To: 2262, Order: 160601, Start Time: 2012-07-21 04:08:35, End Time: 2012-07-21 05:27:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (64 on baseline) Performance Improvements: 2 (29 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (780 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.80% (13.5691 => 13.8132, std. dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.01% (1.3172 => 1.3305, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.06% (2.1126 => 2.0903, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.04% (3.7322 => 3.6935, std. dev.: 0.0097) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.24% (10.3673 => 13.8132, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.88% (1.1194 => 1.2524, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 11.81% (0.3473 => 0.3883, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3497 => 0.3902, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3543 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.52% (0.3543 => 0.3951, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 11.41% (0.3516 => 0.3917, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.35% (0.3561 => 0.3965, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.04% (0.3694 => 0.4102, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.3927 => 0.4346, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.48% (1.7609 => 1.9102, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.03% (2.2022 => 2.3790, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.81% (0.2065 => 0.2185, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference-object: 5.66% (0.6030 => 0.6371, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 5.64% (0.5925 => 0.6259, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 4.99% (10.4361 => 10.9571, std. dev.: 0.0215) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.66% (0.4615 => 0.4830, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.65% (0.4879 => 0.5106, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.60% (7.0540 => 7.3788, std. dev.: 0.0083) SingleSource/UnitTests/ObjC++/property-reference: 4.52% (0.7326 => 0.7657, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 3.67% (0.7433 => 0.7706, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.51% (0.8172 => 0.8459, std. dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 3.48% (9.4845 => 9.8147, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.48% (4.9449 => 5.1169, std. dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.35% (5.0018 => 5.1695, std. dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.31% (0.5860 => 0.6054, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.12% (0.5569 => 0.5743, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.90% (8.1363 => 8.3719, std. dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.76% (4.2646 => 4.3822, std. dev.: 0.0057) MultiSource/Applications/spiff/spiff: 2.76% (0.7835 => 0.8051, std. dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: 2.58% (5.7591 => 5.9075, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.56% (14.3668 => 14.7345, std. dev.: 0.0238) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.37% (1.1861 => 1.2142, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.29% (1.3050 => 1.3349, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 2.17% (3.3354 => 3.4078, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.10% (0.5105 => 0.5212, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.02% (1.5415 => 1.5726, std. dev.: 0.0054) MultiSource/Applications/treecc/treecc: 2.00% (2.0273 => 2.0678, std. dev.: 0.0127) MultiSource/Applications/hbd/hbd: 1.95% (1.5603 => 1.5907, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.70% (0.9765 => 0.9931, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.57% (0.6675 => 0.6780, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.2024 => 2.2366, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.55% (0.6450 => 0.6550, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 1.50% (3.8723 => 3.9304, std. dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.36% (1.4186 => 1.4379, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.34% (1.5859 => 1.6072, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.30% (17.1811 => 17.4044, std. dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.15% (2.0665 => 2.0903, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9756, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.60% (5.3999 => 5.7561, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7529, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5086 => 1.5346, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8418, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.68% (3.1578 => 3.2108, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.43% (2.6546 => 2.6926, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.09% (9.1159 => 9.2154, std. dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.03% (3.2416 => 3.2751, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.23% (5.2763 => 3.1539, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.36% (5.3855 => 3.6968, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.68% (5.3526 => 3.7102, std. dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.93% (2.9384 => 2.5585, std. dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: -10.43% (22.1758 => 19.8632, std. dev.: 0.0461) SingleSource/UnitTests/Vector/constpool: -4.85% (54.1659 => 51.5395, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.60% (3.8922 => 3.8298, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.68% (1.2373 => 1.1052, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: -7.60% (1.5373 => 1.4205, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.46% (2.7294 => 2.5532, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.20% (8.1563 => 7.8956, std. dev.: 0.0058) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4820, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4240, std. dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.48% (0.4808 => 0.4689, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.32% (1.7254 => 1.6853, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.13% (10.2830 => 10.0640, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.68% (1.3677 => 1.3447, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.58% (2.0866 => 2.0537, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5136, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -1.42% (12.5348 => 12.3573, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.39% (4.2280 => 4.1694, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 21 05:06:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 21 Jul 2012 07:06:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120721120646.C95B32A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2268?compare_to=2266&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2268, Order: 160603, Start Time: 2012-07-21 10:52:50, End Time: 2012-07-21 12:07:03 To: 2266, Order: 160602, Start Time: 2012-07-21 09:09:04, End Time: 2012-07-21 10:24:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (142 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.63% (1.3853 => 1.4079, std. dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.03% (55.9090 => 56.4854, std. dev.: 0.1256) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.58% (2.0176 => 2.3118, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.69% (0.5818 => 0.6382, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.48% (0.5748 => 0.6293, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.61% (0.3578 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.51% (0.7061 => 0.7662, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-2: 8.33% (0.3601 => 0.3901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.23% (0.3646 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.19% (0.3650 => 0.3949, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 8.19% (0.3663 => 0.3963, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.18% (0.3789 => 0.4099, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.14% (0.3623 => 0.3918, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.97% (0.3914 => 0.4226, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.4003 => 0.4318, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.82% (0.3940 => 0.4248, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.65% (1.3693 => 1.4740, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.25% (0.1986 => 0.2130, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (3.9660 => 4.2218, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.41% (0.7038 => 0.7489, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.39% (0.7710 => 0.8203, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 6.38% (0.4062 => 0.4321, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 6.22% (0.2781 => 0.2954, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.19% (0.5265 => 0.5591, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.12% (0.2596 => 0.2755, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.03% (0.2655 => 0.2815, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.00% (0.2782 => 0.2949, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.96% (0.3022 => 0.3202, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.83% (0.2607 => 0.2759, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.80% (0.2690 => 0.2846, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.77% (0.1819 => 0.1924, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2726 => 0.2883, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.76% (0.2761 => 0.2920, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.73% (0.3489 => 0.3689, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.69% (1.9828 => 2.0956, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 5.67% (0.2628 => 0.2777, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.65% (0.2937 => 0.3103, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.63% (0.3107 => 0.3282, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.53% (0.3149 => 0.3323, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.50% (0.3580 => 0.3777, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.49% (0.2696 => 0.2844, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.46% (0.6959 => 0.7339, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (0.3485 => 0.3675, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.39% (0.3192 => 0.3364, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.36% (0.3899 => 0.4108, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.33% (1.2193 => 1.2843, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 5.33% (0.3453 => 0.3637, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.25% (0.4379 => 0.4609, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.20% (0.5577 => 0.5867, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.17% (0.2127 => 0.2237, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 5.10% (0.3293 => 0.3461, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.08% (0.4016 => 0.4220, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.07% (0.9199 => 0.9665, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 5.06% (13.8202 => 14.5201, std. dev.: 0.0072) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4390 => 0.4607, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.93% (0.3756 => 0.3941, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.83% (0.3868 => 0.4055, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.76% (13.2842 => 13.9167, std. dev.: 0.0180) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.65% (1.4563 => 1.5240, std. dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 4.54% (16.6129 => 17.3679, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3246 => 0.3393, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.52% (1.1364 => 1.1878, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.45% (1.3813 => 1.4428, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 4.38% (1.1061 => 1.1546, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.36% (0.5637 => 0.5883, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.35% (7.2180 => 7.5319, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.29% (1.3819 => 1.4412, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 4.24% (0.8310 => 0.8662, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.0594 => 1.1037, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.15% (0.2914 => 0.3035, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.11% (1.3245 => 1.3790, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: 4.10% (0.7506 => 0.7814, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.09% (1.9270 => 2.0058, std. dev.: 0.0141) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.09% (0.7460 => 0.7765, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 3.99% (3.8646 => 4.0188, std. dev.: 0.0103) MultiSource/Applications/hexxagon/hexxagon: 3.96% (1.2292 => 1.2779, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.77% (3.6692 => 3.8074, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.74% (4.3801 => 4.5441, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.58% (4.4433 => 4.6023, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 3.57% (0.3220 => 0.3335, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3755 => 0.3887, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.49% (0.4791 => 0.4958, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.22% (2.1791 => 2.2493, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.1333 => 1.1694, std. dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.17% (0.8698 => 0.8974, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.14% (0.6283 => 0.6480, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.07% (4.9865 => 5.1397, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.98% (0.6135 => 0.6318, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.84% (3.1889 => 3.2796, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (6.5754 => 6.7591, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 2.54% (14.8535 => 15.2307, std. dev.: 0.0200) MultiSource/Benchmarks/mafft/pairlocalalign: 2.47% (8.4961 => 8.7060, std. dev.: 0.0163) MultiSource/Applications/ClamAV/clamscan: 2.46% (14.5298 => 14.8872, std. dev.: 0.0126) MultiSource/Applications/sqlite3/sqlite3: 2.39% (16.2614 => 16.6507, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.38% (2.1007 => 2.1506, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.25% (3.2742 => 3.3480, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 2.09% (4.6629 => 4.7603, std. dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.05% (1.5188 => 1.5500, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 1.60% (0.6250 => 0.6350, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (0.9108 => 0.9235, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.24% (1.0313 => 1.0441, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.14% (0.1824 => 0.3231, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 56.51% (0.1322 => 0.2069, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.87% (1.8175 => 2.2876, std. dev.: 0.0386) SingleSource/Benchmarks/Misc/mandel-2: 8.32% (1.2998 => 1.4079, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.99% (1.5824 => 1.6772, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.88% (0.9996 => 1.0484, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 4.25% (7.4271 => 7.7428, std. dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7313, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (12.4560 => 12.8586, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4746, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.41% (2.8606 => 2.9296, std. dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.41% (1.7688 => 1.8114, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.15% (2.0200 => 2.0635, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 2.14% (0.6159 => 0.6291, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 2.14% (2.5089 => 2.5625, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.11% (4.1080 => 4.1947, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5348, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 1.26% (2.4679 => 2.4991, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.26% (3.1736 => 3.2137, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.10% (10.7476 => 10.8653, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: 1.07% (1.9290 => 1.9497, std. dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.22% (22.5627 => 21.1588, std. dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.86% (1.2308 => 1.1094, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -4.78% (2.6470 => 2.5205, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.62% (1.3780 => 1.3143, std. dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.41% (1.9762 => 1.9088, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9474, std. dev.: 0.0097) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.57% (0.4867 => 0.4742, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.12% (20.3410 => 19.9105, std. dev.: 0.0193) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2297, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5004, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7608, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -1.59% (7.1097 => 6.9965, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.35% (2.5254 => 2.4913, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.2225 => 27.8620, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8676, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2371, std. dev.: 0.0345) MultiSource/Applications/lambda-0_1_3/lambda: -1.00% (5.3167 => 5.2634, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 21 05:11:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 21 Jul 2012 07:11:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120721121110.C2B122A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2269?compare_to=2265&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2269, Order: 160602, Start Time: 2012-07-21 09:25:45, End Time: 2012-07-21 12:11:28 To: 2265, Order: 160601, Start Time: 2012-07-21 06:08:31, End Time: 2012-07-21 08:57:14 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (71 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (815 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 40.90% (0.3792 => 0.5343, std. dev.: 0.0195) SingleSource/UnitTests/ObjC/exceptions-2: 13.06% (0.3446 => 0.3896, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.99% (0.3488 => 0.3941, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 12.99% (0.3465 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.93% (0.3442 => 0.3887, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-3: 12.92% (0.3460 => 0.3907, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.81% (0.3496 => 0.3944, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.80% (0.3469 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.19% (0.3650 => 0.4095, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.19% (0.3643 => 0.4087, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.90% (0.3724 => 0.4167, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.85% (0.5826 => 0.6225, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.61% (0.5889 => 0.6278, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.1620 => 0.1722, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.83% (0.7171 => 0.7589, std. dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 5.32% (1.5932 => 1.6779, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.02% (1.6211 => 1.7024, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.87% (3.5627 => 3.7361, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.85% (0.5026 => 0.5270, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.80% (0.5900 => 0.6183, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.61% (0.4994 => 0.5224, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.54% (0.4361 => 0.4559, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.52% (1.3152 => 1.3746, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.43% (0.3930 => 0.4104, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.20% (0.5000 => 0.5210, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.19% (0.2866 => 0.2986, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.17% (0.4029 => 0.4197, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.08% (2.7292 => 2.8405, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 4.04% (1.0781 => 1.1217, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 4.04% (4.2109 => 4.3811, std. dev.: 0.0226) MultiSource/Applications/hexxagon/hexxagon: 3.72% (0.9909 => 1.0278, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.48% (1.9694 => 2.0379, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.36% (1.9966 => 2.0636, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.23% (4.4195 => 4.5623, std. dev.: 0.0101) MultiSource/Applications/SPASS/SPASS: 3.15% (5.5417 => 5.7161, std. dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: 3.05% (2.1653 => 2.2314, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.03% (0.4658 => 0.4799, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.01% (0.3890 => 0.4007, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.90% (4.6177 => 4.7517, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.85% (0.4139 => 0.4257, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.77% (1.8794 => 1.9315, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.3845 => 0.3950, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.72% (0.3903 => 0.4009, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.70% (0.6634 => 0.6813, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 2.60% (0.4146 => 0.4254, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.59% (2.0673 => 2.1208, std. dev.: 0.0110) MultiSource/Applications/treecc/treecc: 2.57% (0.7875 => 0.8077, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.42% (0.9697 => 0.9932, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.33% (1.4269 => 1.4601, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 2.13% (0.5546 => 0.5664, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.09% (2.0346 => 2.0568, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.39% (5.2852 => 11.7540, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.64% (0.2162 => 0.3365, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.94% (10.7630 => 13.6628, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.79% (0.5589 => 0.6751, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/objinst: 19.15% (9.4436 => 11.2517, std. dev.: 0.0552) SingleSource/Benchmarks/Shootout/lists: 13.45% (32.9687 => 37.4016, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 7.00% (15.4430 => 16.5235, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.85% (3.3903 => 3.6225, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 5.42% (2.8036 => 2.9555, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: 5.40% (19.6305 => 20.6908, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-2: 5.17% (1.8057 => 1.8991, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.19% (2.2962 => 2.3924, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.35% (3.1722 => 3.2469, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (3.1728 => 3.2462, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 1.95% (15.8721 => 16.1809, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: 1.66% (17.2379 => 17.5234, std. dev.: 0.1051) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.56% (2.0820 => 2.1144, std. dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 1.42% (1.5554 => 1.5775, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.42% (1.0142 => 1.0286, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.31% (2.4764 => 2.4191, std. dev.: 0.0149) MultiSource/Applications/kimwitu++/kc: -2.05% (11.9555 => 11.7105, std. dev.: 0.0214) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.83% (6.2401 => 4.1292, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -7.08% (0.2402 => 0.2232, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: -4.56% (14.0481 => 13.4073, std. dev.: 0.0428) SingleSource/Benchmarks/Misc/salsa20: -3.81% (35.5013 => 34.1475, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/objinst: -3.11% (12.0509 => 11.6758, std. dev.: 0.0324) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5754, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 21 05:14:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 21 Jul 2012 07:14:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120721121427.953802A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2270?compare_to=2267&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2270, Order: 160603, Start Time: 2012-07-21 10:56:17, End Time: 2012-07-21 12:14:42 To: 2267, Order: 160602, Start Time: 2012-07-21 09:08:57, End Time: 2012-07-21 10:27:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (74 on baseline) Performance Improvements: 2 (29 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (770 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.08% (2.0903 => 2.1129, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.31% (55.1595 => 56.4357, std. dev.: 0.1131) SingleSource/Benchmarks/McGill/chomp: 1.00% (1.1052 => 1.1163, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.77% (13.8132 => 13.5685, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.79% (1.4205 => 1.3951, std. dev.: 0.0097) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.88% (10.3673 => 13.5685, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 12.50% (0.3473 => 0.3907, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.31% (0.3543 => 0.3979, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3497 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3516 => 0.3944, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.11% (0.3543 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.02% (0.3561 => 0.3989, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.78% (0.3694 => 0.4129, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.49% (1.1194 => 1.2480, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3828 => 0.4262, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.66% (2.2022 => 2.3929, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.23% (1.7609 => 1.9059, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 6.52% (0.6030 => 0.6423, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.43% (0.5925 => 0.6306, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.24% (0.1892 => 0.2010, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.91% (0.2065 => 0.2187, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.26% (0.7326 => 0.7711, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.82% (10.4361 => 10.9395, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: 4.54% (0.3282 => 0.3431, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.45% (7.0540 => 7.3680, std. dev.: 0.0137) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.4879 => 0.5094, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.36% (0.4615 => 0.4816, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.97% (0.7433 => 0.7728, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.93% (0.8172 => 0.8493, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.77% (4.9449 => 5.1314, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.69% (5.0018 => 5.1865, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.45% (0.5569 => 0.5761, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 3.44% (9.4845 => 9.8105, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.40% (0.5860 => 0.6059, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.13% (8.1363 => 8.3908, std. dev.: 0.0138) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.10% (4.2646 => 4.3967, std. dev.: 0.0097) MultiSource/Benchmarks/McCat/18-imp/imp: 3.01% (0.3423 => 0.3526, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.86% (0.7835 => 0.8059, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.78% (14.3668 => 14.7669, std. dev.: 0.0127) MultiSource/Applications/oggenc/oggenc: 2.72% (5.7591 => 5.9157, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.69% (1.3050 => 1.3401, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.60% (1.5603 => 1.6009, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.56% (1.1861 => 1.2165, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.56% (1.5415 => 1.5809, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.48% (3.3354 => 3.4182, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.43% (0.8067 => 0.8263, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.33% (0.4636 => 0.4744, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.31% (2.0273 => 2.0741, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.25% (2.0665 => 2.1129, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 2.22% (1.1642 => 1.1900, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.00% (0.5105 => 0.5207, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.98% (0.9765 => 0.9958, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (0.6675 => 0.6800, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 1.86% (3.8723 => 3.9444, std. dev.: 0.0206) SingleSource/Benchmarks/Misc-C++/bigfib: 1.75% (0.6456 => 0.6569, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.66% (0.6450 => 0.6557, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.63% (17.1811 => 17.4620, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.63% (2.2024 => 2.2384, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.51% (1.5859 => 1.6098, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.50% (1.2842 => 1.3034, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.49% (1.4186 => 1.4398, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 1.28% (0.8921 => 0.9035, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.11% (1.1840 => 1.1972, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9755, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.59% (5.3999 => 5.7555, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7510, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.69% (11.6436 => 11.8402, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/whetstone: 1.64% (1.0554 => 1.0727, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.61% (3.1578 => 3.2086, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.59% (1.5086 => 1.5326, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.39% (2.6546 => 2.6915, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: 1.12% (9.1159 => 9.2176, std. dev.: 0.0373) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.03% (3.2416 => 3.2750, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 1.01% (6.6465 => 6.7133, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.44% (5.2763 => 3.1427, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.39% (5.3855 => 3.6948, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.71% (5.3526 => 3.7090, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.34% (2.9384 => 2.5465, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -10.22% (22.1758 => 19.9101, std. dev.: 0.0166) SingleSource/UnitTests/Vector/constpool: -4.88% (54.1659 => 51.5233, std. dev.: 0.0322) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.48% (3.8922 => 3.8346, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.59% (1.1492 => 0.7632, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.23% (0.0998 => 0.0846, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.78% (1.2373 => 1.1163, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -9.25% (1.5373 => 1.3951, std. dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.45% (2.7294 => 2.5533, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5956, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4857, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9043, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4162, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.31% (1.7254 => 1.6856, std. dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -2.14% (10.2830 => 10.0630, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.62% (1.3677 => 1.3455, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.61% (2.0866 => 2.0531, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.46% (4.2280 => 4.1662, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists: -1.40% (12.5348 => 12.3589, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 21 08:24:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 21 Jul 2012 10:24:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120721152418.913C12A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2271?compare_to=2269&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2271, Order: 160603, Start Time: 2012-07-21 12:39:50, End Time: 2012-07-21 15:24:35 To: 2269, Order: 160602, Start Time: 2012-07-21 09:25:45, End Time: 2012-07-21 12:11:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (72 on baseline) Performance Improvements: 1 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (814 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.14% (54.2119 => 54.8282, std. dev.: 0.0772) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.21% (2.4191 => 2.3899, std. dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.54% (0.3465 => 0.3934, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 13.35% (0.3469 => 0.3932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.30% (0.3496 => 0.3961, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.29% (0.3446 => 0.3904, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.28% (0.3442 => 0.3899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.27% (0.3460 => 0.3919, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.25% (0.3488 => 0.3950, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 12.66% (0.3650 => 0.4112, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 12.65% (0.3643 => 0.4104, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/parameter-passing: 12.30% (0.3724 => 0.4182, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.05% (0.5826 => 0.6237, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 7.01% (0.5889 => 0.6302, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.42% (0.1620 => 0.1724, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 5.80% (1.5932 => 1.6856, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.38% (0.7171 => 0.7557, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.33% (0.4994 => 0.5260, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.18% (3.5627 => 3.7474, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.17% (0.5026 => 0.5286, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.06% (1.6211 => 1.7032, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.92% (0.5900 => 0.6190, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.84% (0.4361 => 0.4572, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.69% (0.4029 => 0.4218, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.64% (0.5000 => 0.5232, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.50% (1.3152 => 1.3744, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.40% (0.3930 => 0.4103, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 4.30% (1.0781 => 1.1245, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.13% (0.2738 => 0.2851, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.03% (4.2109 => 4.3804, std. dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.94% (2.7292 => 2.8368, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.80% (0.2866 => 0.2975, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.72% (1.9694 => 2.0426, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (1.9966 => 2.0655, std. dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: 3.42% (5.5417 => 5.7311, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.31% (0.3903 => 0.4032, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.30% (4.4195 => 4.5652, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.28% (0.3845 => 0.3971, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.24% (0.9909 => 1.0230, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (0.4658 => 0.4808, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.21% (0.3890 => 0.4015, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.13% (2.0673 => 2.1321, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 3.06% (2.1013 => 2.1655, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 2.99% (2.1653 => 2.2300, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 2.91% (1.8794 => 1.9340, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 2.88% (4.6177 => 4.7509, std. dev.: 0.0080) MultiSource/Applications/treecc/treecc: 2.88% (0.7875 => 0.8102, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.54% (0.9697 => 0.9943, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.51% (0.4139 => 0.4243, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.40% (1.4269 => 1.4611, std. dev.: 0.0052) MultiSource/Applications/Burg/burg: 2.11% (0.5546 => 0.5663, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.81% (0.6634 => 0.6754, std. dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 1.73% (23.5202 => 23.9265, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.63% (0.6435 => 0.6540, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.15% (2.0346 => 2.0579, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.40% (5.2852 => 11.7543, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.55% (0.2162 => 0.3363, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.92% (10.7630 => 13.6609, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.13% (0.5589 => 0.6714, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/objinst: 18.96% (9.4436 => 11.2345, std. dev.: 0.0169) SingleSource/Benchmarks/Shootout/lists: 13.43% (32.9687 => 37.3952, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 7.00% (15.4430 => 16.5234, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.86% (3.3903 => 3.6230, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/matrix: 5.40% (19.6305 => 20.6902, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: 5.18% (2.8036 => 2.9489, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-2: 5.18% (1.8057 => 1.8992, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.08% (2.2962 => 2.3899, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.54% (3.1722 => 3.2529, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.23% (3.1728 => 3.2436, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 1.91% (15.8721 => 16.1749, std. dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 1.43% (1.5554 => 1.5776, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.28% (17.2379 => 17.4591, std. dev.: 0.0541) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.28% (1.0142 => 1.0272, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.49% (2.4764 => 2.3899, std. dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: -1.96% (11.9555 => 11.7207, std. dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.81% (6.2401 => 4.1302, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.54% (0.2402 => 0.2245, std. dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -4.18% (14.0481 => 13.4613, std. dev.: 0.0444) SingleSource/Benchmarks/Misc/salsa20: -3.82% (35.5013 => 34.1469, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: -2.63% (12.0509 => 11.7339, std. dev.: 0.0274) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5755, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 21 21:56:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 21 Jul 2012 23:56:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120722045614.0A35B2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2272?compare_to=2268&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2272, Order: 160610, Start Time: 2012-07-22 03:42:30, End Time: 2012-07-22 04:56:30 To: 2268, Order: 160603, Start Time: 2012-07-21 10:52:50, End Time: 2012-07-21 12:07:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (139 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.55% (2.0176 => 2.3111, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.54% (0.5818 => 0.6373, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.41% (0.5748 => 0.6289, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.55% (0.3578 => 0.3884, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.51% (0.7061 => 0.7662, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-2: 8.33% (0.3601 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.26% (0.3646 => 0.3947, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.25% (0.3650 => 0.3951, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 8.17% (0.3623 => 0.3919, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.16% (0.3663 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.13% (0.3789 => 0.4097, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.92% (0.4003 => 0.4320, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.89% (0.3914 => 0.4223, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.74% (0.3940 => 0.4245, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.49% (1.3693 => 1.4719, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.2721 => 0.2908, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 6.70% (0.4062 => 0.4334, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (0.4328 => 0.4612, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.38% (0.7038 => 0.7487, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.34% (3.9660 => 4.2174, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.21% (0.5265 => 0.5592, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 6.15% (0.2781 => 0.2952, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.12% (0.2596 => 0.2755, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.11% (0.7710 => 0.8181, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.90% (0.2782 => 0.2946, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.77% (0.2966 => 0.3137, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.76% (0.3022 => 0.3196, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.72% (0.2760 => 0.2918, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.72% (0.1819 => 0.1923, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.65% (0.2726 => 0.2880, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.2655 => 0.2804, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.59% (1.9828 => 2.0936, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3489 => 0.3683, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.56% (0.3580 => 0.3779, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.54% (0.2761 => 0.2914, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.53% (0.3149 => 0.3323, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.52% (0.2628 => 0.2773, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.52% (0.2937 => 0.3099, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.35% (0.2988 => 0.3148, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.35% (0.6959 => 0.7331, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.33% (0.3899 => 0.4107, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.31% (0.3485 => 0.3670, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.28% (0.4379 => 0.4610, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.21% (1.2193 => 1.2828, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 5.15% (0.3453 => 0.3631, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.01% (0.9199 => 0.9660, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.00% (0.4016 => 0.4217, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.95% (0.3756 => 0.3942, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.94% (13.8202 => 14.5026, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/moments: 4.83% (0.3868 => 0.4055, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.77% (0.3293 => 0.3450, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.73% (0.5577 => 0.5841, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.73% (0.3534 => 0.3701, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.70% (13.2842 => 13.9079, std. dev.: 0.0101) MultiSource/Benchmarks/McCat/09-vor/vor: 4.55% (0.2925 => 0.3058, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 4.48% (16.6129 => 17.3578, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.41% (0.3246 => 0.3389, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.39% (1.4563 => 1.5202, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.37% (1.1364 => 1.1861, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.33% (0.5637 => 0.5881, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.31% (1.3813 => 1.4409, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.26% (0.2914 => 0.3038, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.21% (7.2180 => 7.5220, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.20% (1.3819 => 1.4400, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.15% (0.8310 => 0.8655, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.11% (3.8646 => 4.0233, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 4.10% (1.0594 => 1.1028, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.00% (1.1061 => 1.1503, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.99% (1.3245 => 1.3774, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.96% (0.7506 => 0.7803, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.95% (1.9270 => 2.0031, std. dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 3.88% (1.2292 => 1.2769, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.85% (0.7460 => 0.7747, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (4.3801 => 4.5370, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.53% (3.6692 => 3.7989, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3755 => 0.3886, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.48% (4.4433 => 4.5981, std. dev.: 0.0072) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3220 => 0.3330, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.36% (0.4791 => 0.4952, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.30% (2.1791 => 2.2510, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.10% (0.6283 => 0.6478, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.06% (4.9865 => 5.1392, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.06% (0.8698 => 0.8964, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.03% (1.1333 => 1.1676, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 2.82% (3.1889 => 3.2787, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.73% (6.5754 => 6.7549, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.72% (0.6135 => 0.6302, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.51% (14.8535 => 15.2260, std. dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: 2.43% (14.5298 => 14.8826, std. dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: 2.41% (16.2614 => 16.6527, std. dev.: 0.0163) MultiSource/Benchmarks/mafft/pairlocalalign: 2.39% (8.4961 => 8.6993, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.37% (2.1007 => 2.1505, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (3.2742 => 3.3488, std. dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 2.05% (4.6629 => 4.7585, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.01% (1.5188 => 1.5493, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.26% (0.9108 => 0.9223, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.19% (0.1824 => 0.3232, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 56.51% (0.1322 => 0.2069, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.02% (1.8175 => 2.2905, std. dev.: 0.0476) SingleSource/Benchmarks/Misc/mandel-2: 8.65% (1.2998 => 1.4122, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.96% (1.5824 => 1.6767, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.92% (0.9996 => 1.0488, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: 4.26% (7.4271 => 7.7433, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7314, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.24% (12.4560 => 12.8590, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4751, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.41% (2.8606 => 2.9296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.37% (1.7688 => 1.8107, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.17% (2.0200 => 2.0639, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5624, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.12% (4.1080 => 4.1952, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 2.05% (0.6159 => 0.6285, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5089 => 1.5325, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.55% (1.9290 => 1.9589, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5107, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1966, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 1.27% (2.4679 => 2.4992, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.23% (3.1736 => 3.2127, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.14% (10.7476 => 10.8697, std. dev.: 0.0413) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.28% (22.5627 => 21.1449, std. dev.: 0.0182) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.44% (0.0997 => 0.0853, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.19% (1.2308 => 1.1054, std. dev.: 0.0101) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.16% (1.3780 => 1.3069, std. dev.: 0.0060) SingleSource/UnitTests/Vector/multiplies: -4.81% (2.6470 => 2.5196, std. dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.40% (1.9762 => 1.9090, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.67% (3.0263 => 2.9456, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2194, std. dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (20.3410 => 19.9525, std. dev.: 0.0457) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5064, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7607, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9962, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.35% (2.5254 => 2.4913, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8645, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: -1.27% (28.2225 => 27.8628, std. dev.: 0.0012) MultiSource/Applications/lua/lua: -1.15% (26.5159 => 26.2105, std. dev.: 0.0313) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2571, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 21 22:00:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 22 Jul 2012 00:00:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120722050054.C01CF2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2273?compare_to=2270&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2273, Order: 160610, Start Time: 2012-07-22 03:42:32, End Time: 2012-07-22 05:01:10 To: 2270, Order: 160603, Start Time: 2012-07-21 10:56:17, End Time: 2012-07-21 12:14:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (70 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (773 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.47% (1.3951 => 1.4296, std. dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.39% (79.1696 => 80.2719, std. dev.: 0.3814) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.03% (10.3673 => 13.5847, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/trivial-interface: 12.53% (0.3473 => 0.3908, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 12.32% (0.3497 => 0.3928, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions-4: 12.19% (0.3543 => 0.3975, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3543 => 0.3974, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 12.12% (0.3516 => 0.3942, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 12.10% (0.3561 => 0.3992, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 11.69% (0.3694 => 0.4126, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.51% (1.1194 => 1.2482, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3828 => 0.4261, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 11.23% (0.3927 => 0.4368, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.65% (2.2022 => 2.3928, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.38% (1.7609 => 1.9084, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.63% (0.6030 => 0.6430, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.51% (0.5925 => 0.6311, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.91% (0.2065 => 0.2187, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.32% (0.3177 => 0.3346, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.26% (0.7326 => 0.7711, std. dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 4.73% (10.4361 => 10.9294, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.54% (7.0540 => 7.3744, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.39% (0.4879 => 0.5093, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.36% (0.4615 => 0.4816, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (4.9449 => 5.1385, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 3.75% (0.7433 => 0.7712, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.54% (5.0018 => 5.1789, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.52% (0.5569 => 0.5765, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (9.4845 => 9.8021, std. dev.: 0.0226) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.34% (0.8172 => 0.8445, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.13% (8.1363 => 8.3908, std. dev.: 0.0089) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.12% (4.2646 => 4.3978, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.09% (0.5860 => 0.6041, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (14.3668 => 14.7970, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.94% (0.7835 => 0.8065, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.80% (1.3050 => 1.3416, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 2.77% (5.7591 => 5.9184, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 2.66% (1.5603 => 1.6018, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.61% (1.1861 => 1.2171, std. dev.: 0.0104) MultiSource/Applications/d/make_dparser: 2.58% (3.3354 => 3.4213, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (1.5415 => 1.5792, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.31% (0.4636 => 0.4743, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.23% (2.0273 => 2.0726, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.17% (2.0665 => 2.1114, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 2.13% (1.1642 => 1.1890, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.13% (0.9765 => 0.9973, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.06% (0.8067 => 0.8233, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 1.85% (3.8723 => 3.9441, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.84% (0.6675 => 0.6798, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 1.72% (0.6456 => 0.6567, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.72% (17.1811 => 17.4759, std. dev.: 0.0178) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.69% (0.6450 => 0.6559, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.62% (2.2024 => 2.2381, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.59% (1.2842 => 1.3046, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.50% (1.4186 => 1.4399, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.46% (1.5859 => 1.6091, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 1.35% (0.8921 => 0.9041, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9757, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.61% (5.3999 => 5.7569, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.13% (3.6395 => 3.7535, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.23% (1.0313 => 1.0543, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (1.5086 => 1.5368, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.69% (11.6436 => 11.8402, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.65% (3.1578 => 3.2098, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.36% (2.6546 => 2.6906, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2268, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.03% (3.2416 => 3.2749, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: 1.02% (6.6465 => 6.7145, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.47% (5.2763 => 3.1410, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.44% (5.3855 => 3.6925, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.73% (5.3526 => 3.7076, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.27% (2.9384 => 2.5485, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.25% (22.1758 => 19.9021, std. dev.: 0.0124) SingleSource/UnitTests/Vector/constpool: -4.95% (54.1659 => 51.4844, std. dev.: 0.0439) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.54% (3.8922 => 3.8323, std. dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.63% (0.0998 => 0.0842, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2373 => 1.1095, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: -7.01% (1.5373 => 1.4296, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.46% (2.7294 => 2.5532, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4755, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.15% (8.1563 => 7.8992, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4206, std. dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.35% (1.7254 => 1.6848, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.14% (10.2830 => 10.0630, std. dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.62% (1.3677 => 1.3455, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.60% (2.0866 => 2.0533, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.48% (2.5528 => 2.5149, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: -1.46% (12.5348 => 12.3517, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.22% (4.2280 => 4.1766, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2283, std. dev.: 0.0165) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 21 23:27:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 22 Jul 2012 01:27:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120722062710.526F52A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2274?compare_to=2271&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2274, Order: 160610, Start Time: 2012-07-22 03:42:36, End Time: 2012-07-22 06:27:28 To: 2271, Order: 160603, Start Time: 2012-07-21 12:39:50, End Time: 2012-07-21 15:24:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (70 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (816 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 20.57% (0.4386 => 0.5288, std. dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.31% (124.5883 => 131.2010, std. dev.: 0.4301) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 39.45% (0.3792 => 0.5288, std. dev.: 0.0087) SingleSource/UnitTests/ObjC/exceptions-2: 12.74% (0.3446 => 0.3885, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3465 => 0.3904, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3442 => 0.3876, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3460 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.56% (0.3488 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.54% (0.3469 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.50% (0.3496 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.97% (0.3650 => 0.4087, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.97% (0.3643 => 0.4079, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.65% (0.3724 => 0.4158, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.59% (0.5826 => 0.6210, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.42% (0.5889 => 0.6267, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.22% (1.5932 => 1.6764, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.01% (1.6211 => 1.7023, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.91% (3.5627 => 3.7378, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 4.88% (0.7171 => 0.7521, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.77% (0.4994 => 0.5232, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.45% (0.4361 => 0.4555, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.33% (1.3152 => 1.3722, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.29% (0.5900 => 0.6153, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.28% (0.5000 => 0.5214, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.12% (0.3930 => 0.4092, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 3.97% (0.4029 => 0.4189, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.94% (0.5026 => 0.5224, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 3.79% (1.0781 => 1.1190, std. dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: 3.75% (4.2109 => 4.3690, std. dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.73% (2.7292 => 2.8309, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.68% (1.9694 => 2.0419, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.33% (1.9966 => 2.0630, std. dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 3.25% (5.5417 => 5.7219, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.18% (0.4658 => 0.4806, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.09% (2.1013 => 2.1662, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (4.4195 => 4.5498, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.92% (0.4139 => 0.4260, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (0.3890 => 0.4003, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.82% (2.1653 => 2.2263, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.3845 => 0.3951, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (1.8794 => 1.9309, std. dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: 2.74% (4.6177 => 4.7442, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 2.59% (0.9909 => 1.0166, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.59% (0.3903 => 0.4004, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.55% (2.0673 => 2.1201, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 2.54% (0.7875 => 0.8075, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.37% (0.6634 => 0.6791, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.25% (1.4269 => 1.4590, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.06% (0.5546 => 0.5660, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.97% (0.9697 => 0.9888, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 1.47% (23.5202 => 23.8664, std. dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 1.02% (2.0346 => 2.0554, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.40% (5.2852 => 11.7543, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 54.26% (0.2162 => 0.3335, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.94% (10.7630 => 13.6622, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.09% (0.5589 => 0.6712, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/objinst: 18.91% (9.4436 => 11.2296, std. dev.: 0.0246) SingleSource/Benchmarks/Shootout/lists: 13.46% (32.9687 => 37.4049, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 7.01% (15.4430 => 16.5256, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.80% (3.3903 => 3.6210, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: 5.41% (19.6305 => 20.6933, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8945, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: 4.73% (2.8036 => 2.9362, std. dev.: 0.0218) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.08% (2.2962 => 2.3898, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.50% (3.1722 => 3.2515, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (3.1728 => 3.2443, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 1.95% (15.8721 => 16.1816, std. dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 1.43% (1.5554 => 1.5776, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.15% (17.2379 => 17.4368, std. dev.: 0.0265) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.55% (2.4764 => 2.3885, std. dev.: 0.0237) MultiSource/Applications/kimwitu++/kc: -2.17% (11.9555 => 11.6962, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.82% (6.2401 => 4.1294, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: -5.83% (0.2402 => 0.2262, std. dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: -4.55% (14.0481 => 13.4087, std. dev.: 0.0158) SingleSource/Benchmarks/Misc/salsa20: -3.79% (35.5013 => 34.1573, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/objinst: -2.94% (12.0509 => 11.6970, std. dev.: 0.0327) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5753, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 22 00:08:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 22 Jul 2012 02:08:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120722070841.5D9F82A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2275?compare_to=2272&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2275, Order: 160611, Start Time: 2012-07-22 05:52:39, End Time: 2012-07-22 07:08:56 To: 2272, Order: 160610, Start Time: 2012-07-22 03:42:30, End Time: 2012-07-22 04:56:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (109 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.17% (7.9707 => 8.0638, std. dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.53% (2.0176 => 2.3108, std. dev.: 0.0602) SingleSource/UnitTests/ObjC++/property-reference-object: 9.57% (0.5818 => 0.6375, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 9.34% (0.5748 => 0.6285, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.94% (0.7061 => 0.7692, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 8.55% (0.3578 => 0.3884, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.39% (0.3601 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.34% (0.3646 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.22% (0.3650 => 0.3950, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: 8.11% (0.3663 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.06% (0.3623 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.02% (0.3789 => 0.4093, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.87% (0.3914 => 0.4222, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.4003 => 0.4314, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.69% (0.3940 => 0.4243, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.44% (1.3693 => 1.4712, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 6.62% (0.4062 => 0.4331, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4328 => 0.4610, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 6.45% (0.7038 => 0.7492, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.44% (3.9660 => 4.2216, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.29% (0.5265 => 0.5596, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 6.18% (0.2781 => 0.2953, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.86% (0.2782 => 0.2945, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.80% (0.2726 => 0.2884, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.72% (0.2760 => 0.2918, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.61% (0.2690 => 0.2841, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.49% (0.3149 => 0.3322, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.49% (0.4390 => 0.4631, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.3107 => 0.3277, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.37% (0.3485 => 0.3672, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.25% (0.2988 => 0.3145, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary2: 5.20% (0.3192 => 0.3358, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.19% (1.2193 => 1.2826, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.91% (0.4016 => 0.4213, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.90% (0.3756 => 0.3940, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.83% (0.3868 => 0.4055, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.83% (0.3293 => 0.3452, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.78% (13.8202 => 14.4807, std. dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 4.54% (16.6129 => 17.3666, std. dev.: 0.0186) MultiSource/Benchmarks/McCat/09-vor/vor: 4.48% (0.2925 => 0.3056, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.30% (0.7506 => 0.7829, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.20% (7.2180 => 7.5208, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.02% (1.3245 => 1.3778, std. dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: 3.96% (3.8646 => 4.0175, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 3.95% (1.1061 => 1.1498, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 3.92% (1.9270 => 2.0026, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.87% (1.2292 => 1.2768, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.79% (0.7460 => 0.7743, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 3.57% (0.3220 => 0.3335, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3755 => 0.3885, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.34% (0.4791 => 0.4951, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.21% (2.1791 => 2.2491, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.10% (0.8698 => 0.8968, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.01% (1.1333 => 1.1674, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.99% (4.9865 => 5.1354, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.93% (0.6283 => 0.6467, std. dev.: 0.0066) MultiSource/Applications/d/make_dparser: 2.84% (3.1889 => 3.2796, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.72% (0.6135 => 0.6302, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 2.58% (6.5754 => 6.7449, std. dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 2.56% (14.8535 => 15.2344, std. dev.: 0.0113) MultiSource/Applications/ClamAV/clamscan: 2.48% (14.5298 => 14.8902, std. dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: 2.36% (16.2614 => 16.6446, std. dev.: 0.0262) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.13% (2.1007 => 2.1454, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.01% (3.2742 => 3.3401, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 1.98% (4.6629 => 4.7551, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.81% (1.5188 => 1.5463, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.22% (0.9108 => 0.9219, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.09% (1.0313 => 1.0425, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.08% (0.1824 => 0.3230, std. dev.: 0.0129) MultiSource/Benchmarks/Olden/mst/mst: 56.73% (0.1322 => 0.2072, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.71% (1.8175 => 2.3030, std. dev.: 0.0201) SingleSource/Benchmarks/Misc/mandel-2: 7.54% (1.2998 => 1.3978, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.94% (1.5824 => 1.6764, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.97% (0.9996 => 1.0493, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 4.28% (7.4271 => 7.7450, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.2619 => 11.7304, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.26% (12.4560 => 12.8626, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4746, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.42% (2.8606 => 2.9297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.30% (1.7688 => 1.8095, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.17% (2.0200 => 2.0639, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5624, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.08% (4.1080 => 4.1934, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.07% (1.0310 => 1.0523, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 2.03% (0.6159 => 0.6284, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0397) MultiSource/Applications/lemon/lemon: 1.34% (1.4298 => 1.4490, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 1.30% (10.7476 => 10.8872, std. dev.: 0.0473) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 1.27% (2.4679 => 2.4992, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2142, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.02% (3.1736 => 3.2060, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.29% (22.5627 => 21.1427, std. dev.: 0.4785) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.86% (1.2308 => 1.1095, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.36% (1.3780 => 1.3041, std. dev.: 0.0101) SingleSource/UnitTests/Vector/multiplies: -4.87% (2.6470 => 2.5182, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9821, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.44% (1.9762 => 1.9083, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9477, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.55% (0.4867 => 0.4743, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2305, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0151) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.83% (20.3410 => 19.9691, std. dev.: 0.0393) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.61% (9.9194 => 9.7599, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.59% (7.1097 => 6.9964, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0165) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.5254 => 2.4926, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.2225 => 27.8626, std. dev.: 0.0355) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2221, std. dev.: 0.0064) MultiSource/Applications/lua/lua: -1.11% (26.5159 => 26.2226, std. dev.: 0.0208) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 22 00:13:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 22 Jul 2012 02:13:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120722071321.D72442A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2276?compare_to=2273&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2276, Order: 160611, Start Time: 2012-07-22 05:52:35, End Time: 2012-07-22 07:13:39 To: 2273, Order: 160610, Start Time: 2012-07-22 03:42:32, End Time: 2012-07-22 05:01:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (50 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (794 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.89% (10.3673 => 13.5696, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/trivial-interface: 12.53% (0.3473 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.35% (0.3497 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.28% (0.3543 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.25% (0.3543 => 0.3977, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3516 => 0.3945, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.19% (0.3561 => 0.3995, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.88% (0.3694 => 0.4133, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.61% (1.1194 => 1.2494, std. dev.: 0.0248) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3828 => 0.4262, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.32% (0.3886 => 0.4326, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.65% (2.2022 => 2.3928, std. dev.: 0.0398) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.26% (1.7609 => 1.9064, std. dev.: 0.0267) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.97% (0.1622 => 0.1735, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.60% (0.6030 => 0.6428, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.60% (0.5925 => 0.6316, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.61% (0.7326 => 0.7737, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.57% (0.3177 => 0.3354, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 4.72% (10.4361 => 10.9282, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/oourafft: 4.54% (0.3282 => 0.3431, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.40% (0.4615 => 0.4818, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.4879 => 0.5092, std. dev.: 0.0073) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.48% (0.8172 => 0.8456, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 3.39% (9.4845 => 9.8057, std. dev.: 0.0144) MultiSource/Applications/spiff/spiff: 3.00% (0.7835 => 0.8070, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 2.70% (5.7591 => 5.9147, std. dev.: 0.0138) MultiSource/Applications/d/make_dparser: 2.58% (3.3354 => 3.4216, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.50% (0.4636 => 0.4752, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.41% (2.0665 => 2.1162, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash: 2.38% (0.4289 => 0.4391, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.27% (2.0273 => 2.0733, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 2.22% (1.1642 => 1.1901, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.98% (0.5105 => 0.5206, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 1.81% (0.6456 => 0.6573, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.78% (0.6675 => 0.6794, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.63% (2.2024 => 2.2384, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.58% (17.1811 => 17.4522, std. dev.: 0.0840) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.56% (1.5859 => 1.6106, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9743, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 6.64% (5.3999 => 5.7586, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.22% (3.6395 => 3.7566, std. dev.: 0.0195) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0313 => 1.0559, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8424, std. dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/hash2: 1.70% (3.1578 => 3.2115, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (2.6546 => 2.6919, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.03% (6.6465 => 6.7150, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.03% (3.2416 => 3.2750, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1259, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.50% (5.2763 => 3.1393, std. dev.: 0.0206) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.30% (5.3855 => 3.6999, std. dev.: 0.0538) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.66% (5.3526 => 3.7115, std. dev.: 0.0593) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.28% (2.9384 => 2.5483, std. dev.: 0.0685) MultiSource/Applications/ClamAV/clamscan: -10.26% (22.1758 => 19.8996, std. dev.: 0.0196) SingleSource/UnitTests/Vector/constpool: -4.97% (54.1659 => 51.4738, std. dev.: 0.0569) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.51% (3.8922 => 3.8333, std. dev.: 0.0147) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.63% (0.0998 => 0.0832, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.05% (1.2373 => 1.1130, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -7.71% (1.5373 => 1.4188, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.45% (2.7294 => 2.5534, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.22% (8.1563 => 7.8937, std. dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4767, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4237, std. dev.: 0.0544) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.32% (1.7254 => 1.6854, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.12% (10.2830 => 10.0653, std. dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.61% (1.3677 => 1.3457, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.59% (2.0866 => 2.0535, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5141, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -1.39% (12.5348 => 12.3606, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.36% (4.2280 => 4.1707, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 22 02:41:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 22 Jul 2012 04:41:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120722094116.E52242A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2277?compare_to=2274&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2277, Order: 160611, Start Time: 2012-07-22 06:55:32, End Time: 2012-07-22 09:41:33 To: 2274, Order: 160610, Start Time: 2012-07-22 03:42:36, End Time: 2012-07-22 06:27:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (71 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (815 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 6.79% (0.5288 => 0.5647, std. dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 48.92% (0.3792 => 0.5647, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions-2: 12.74% (0.3446 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.70% (0.3465 => 0.3905, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.64% (0.3496 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.63% (0.3460 => 0.3897, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3442 => 0.3876, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.47% (0.3488 => 0.3923, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 12.45% (0.3469 => 0.3901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.11% (0.3650 => 0.4092, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/exceptions: 11.94% (0.3643 => 0.4078, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.65% (0.3724 => 0.4158, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.64% (0.5826 => 0.6213, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.1620 => 0.1726, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 6.50% (0.5889 => 0.6272, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.99% (1.6211 => 1.7020, std. dev.: 0.0081) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.98% (0.5900 => 0.6194, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 4.96% (0.7171 => 0.7527, std. dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 4.91% (1.5932 => 1.6715, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.88% (3.5627 => 3.7367, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.71% (0.4994 => 0.5229, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.59% (0.4361 => 0.4561, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.38% (0.5000 => 0.5219, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.36% (0.5026 => 0.5245, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.32% (1.3152 => 1.3720, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.31% (0.2736 => 0.2854, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.17% (0.3930 => 0.4094, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.07% (0.4029 => 0.4193, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 3.93% (4.2109 => 4.3765, std. dev.: 0.0056) MultiSource/Applications/d/make_dparser: 3.79% (1.0781 => 1.1190, std. dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.76% (2.7292 => 2.8318, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.56% (0.2866 => 0.2968, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.54% (1.9694 => 2.0391, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.27% (1.9966 => 2.0619, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.18% (0.3362 => 0.3469, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.09% (2.1013 => 2.1663, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.07% (0.4658 => 0.4801, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.93% (5.5417 => 5.7042, std. dev.: 0.0154) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.93% (0.3890 => 0.4004, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.92% (0.4139 => 0.4260, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.84% (0.3903 => 0.4014, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.84% (4.4195 => 4.5450, std. dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (2.1653 => 2.2265, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 2.68% (4.6177 => 4.7415, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 2.61% (1.8794 => 1.9284, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 2.55% (0.7875 => 0.8076, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.53% (2.0673 => 2.1195, std. dev.: 0.0042) MultiSource/Applications/hbd/hbd: 2.34% (0.9697 => 0.9924, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.34% (1.4269 => 1.4603, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.09% (0.5546 => 0.5662, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.86% (0.6435 => 0.6555, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 1.46% (23.5202 => 23.8628, std. dev.: 0.0669) MultiSource/Applications/sqlite3/sqlite3: 1.02% (2.0346 => 2.0553, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.43% (5.2852 => 11.7557, std. dev.: 0.0148) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.64% (0.2162 => 0.3365, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.95% (10.7630 => 13.6638, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.63% (0.5589 => 0.6742, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout/objinst: 19.52% (9.4436 => 11.2867, std. dev.: 0.0332) SingleSource/Benchmarks/Shootout/lists: 13.48% (32.9687 => 37.4115, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 6.98% (15.4430 => 16.5205, std. dev.: 0.0572) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.75% (3.3903 => 3.6191, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: 5.40% (19.6305 => 20.6905, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/whetstone: 5.28% (2.8036 => 2.9517, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 4.52% (1.8057 => 1.8874, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.08% (2.2962 => 2.3898, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.35% (3.1722 => 3.2468, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (3.1728 => 3.2441, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 1.69% (15.8721 => 16.1408, std. dev.: 0.0202) SingleSource/Benchmarks/Dhrystone/fldry: 1.67% (17.2379 => 17.5261, std. dev.: 0.0437) MultiSource/Applications/sgefa/sgefa: 1.42% (1.5554 => 1.5775, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.41% (1.0142 => 1.0285, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.39% (1.0927 => 1.1079, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.57% (2.4764 => 2.3881, std. dev.: 0.0308) MultiSource/Applications/kimwitu++/kc: -2.17% (11.9555 => 11.6961, std. dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.82% (6.2401 => 4.1297, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: -9.20% (0.2402 => 0.2181, std. dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: -4.64% (14.0481 => 13.3964, std. dev.: 0.0476) SingleSource/Benchmarks/Misc/salsa20: -3.83% (35.5013 => 34.1408, std. dev.: 0.1186) SingleSource/Benchmarks/Shootout-C++/objinst: -2.87% (12.0509 => 11.7050, std. dev.: 0.0929) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5755, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 22 06:21:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 22 Jul 2012 08:21:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120722132112.5FF8B2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2278?compare_to=2275&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2278, Order: 160612, Start Time: 2012-07-22 12:06:59, End Time: 2012-07-22 13:21:31 To: 2275, Order: 160611, Start Time: 2012-07-22 05:52:39, End Time: 2012-07-22 07:08:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (151 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.99% (55.3517 => 56.4526, std. dev.: 0.0553) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.62% (2.0176 => 2.3327, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.78% (0.5818 => 0.6387, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.71% (0.5748 => 0.6306, std. dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.51% (0.1072 => 0.1174, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.28% (0.3578 => 0.3910, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.10% (0.3650 => 0.3982, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 9.08% (0.3601 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.02% (0.3646 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.97% (0.3623 => 0.3948, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.93% (0.3663 => 0.3990, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.87% (0.3789 => 0.4125, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.79% (0.4003 => 0.4355, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 8.78% (0.7061 => 0.7681, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: 8.71% (0.3914 => 0.4255, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.58% (0.3940 => 0.4278, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.43% (0.3130 => 0.3394, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 7.40% (1.3693 => 1.4706, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.2721 => 0.2919, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.10% (0.7038 => 0.7538, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.10% (3.9660 => 4.2475, std. dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (0.4328 => 0.4635, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.76% (0.5265 => 0.5621, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.67% (0.7710 => 0.8224, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.4062 => 0.4320, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 6.26% (0.2781 => 0.2955, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.21% (0.2607 => 0.2769, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.09% (0.3022 => 0.3206, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.98% (0.2726 => 0.2889, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.98% (0.2760 => 0.2925, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.97% (0.2782 => 0.2948, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.89% (0.3580 => 0.3791, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.89% (0.6959 => 0.7369, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 5.89% (0.2937 => 0.3110, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.87% (0.2966 => 0.3140, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.84% (0.3149 => 0.3333, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.82% (0.3899 => 0.4126, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 5.80% (0.2690 => 0.2846, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.79% (0.3489 => 0.3691, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.74% (1.9828 => 2.0967, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 5.72% (0.2761 => 0.2919, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.62% (0.2988 => 0.3156, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.58% (1.2193 => 1.2873, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (0.3485 => 0.3678, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.53% (13.8202 => 14.5838, std. dev.: 0.0131) MultiSource/Applications/kimwitu++/kc: 5.51% (16.6129 => 17.5280, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.45% (0.2696 => 0.2843, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: 5.39% (0.3453 => 0.3639, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.37% (0.9199 => 0.9693, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.31% (13.2842 => 13.9900, std. dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (0.3756 => 0.3955, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.26% (0.3192 => 0.3360, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.26% (0.4390 => 0.4621, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.24% (0.5577 => 0.5869, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.23% (0.4016 => 0.4226, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (0.2925 => 0.3074, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 5.01% (0.3534 => 0.3711, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.98% (0.3293 => 0.3457, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 4.94% (0.3868 => 0.4059, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.89% (1.3813 => 1.4488, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.85% (1.4563 => 1.5269, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.80% (1.3819 => 1.4483, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 4.75% (1.1061 => 1.1586, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.72% (1.3245 => 1.3870, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.72% (1.1364 => 1.1900, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.71% (0.3246 => 0.3399, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.70% (0.2914 => 0.3051, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5637 => 0.5902, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 4.69% (0.8310 => 0.8700, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.68% (7.2180 => 7.5555, std. dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 4.66% (1.0594 => 1.1088, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.62% (3.8646 => 4.0430, std. dev.: 0.0280) MultiSource/Applications/treecc/treecc: 4.48% (1.9270 => 2.0134, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.41% (0.7460 => 0.7789, std. dev.: 0.0055) MultiSource/Applications/spiff/spiff: 4.38% (0.7506 => 0.7835, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.19% (4.3801 => 4.5637, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.13% (0.4791 => 0.4989, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (3.6692 => 3.8198, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 4.08% (1.2292 => 1.2793, std. dev.: 0.0043) MultiSource/Applications/siod/siod: 4.00% (2.1791 => 2.2662, std. dev.: 0.0131) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (4.4433 => 4.6193, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3755 => 0.3902, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.86% (3.1889 => 3.3120, std. dev.: 0.0076) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.83% (4.9865 => 5.1776, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.80% (0.6283 => 0.6522, std. dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 3.57% (0.2995 => 0.3102, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.51% (0.3131 => 0.3241, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.51% (1.1333 => 1.1731, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.43% (0.8698 => 0.8996, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.20% (6.5754 => 6.7859, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.11% (0.6135 => 0.6326, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 3.10% (14.8535 => 15.3136, std. dev.: 0.0205) MultiSource/Applications/sqlite3/sqlite3: 2.83% (16.2614 => 16.7214, std. dev.: 0.0167) MultiSource/Benchmarks/mafft/pairlocalalign: 2.82% (8.4961 => 8.7360, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 2.82% (14.5298 => 14.9399, std. dev.: 0.0074) MultiSource/Benchmarks/McCat/05-eks/eks: 2.70% (0.4113 => 0.4224, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.67% (2.1007 => 2.1567, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.43% (3.2742 => 3.3536, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.39% (1.5188 => 1.5551, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.37% (4.6629 => 4.7733, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 1.82% (0.6250 => 0.6364, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.68% (0.6744 => 0.6857, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.67% (0.9108 => 0.9260, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.66% (1.0313 => 1.0484, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.26% (3.7467 => 3.7940, std. dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.05% (6.2785 => 6.3446, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.08% (0.1824 => 0.3230, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/mst/mst: 56.51% (0.1322 => 0.2069, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 25.98% (1.8175 => 2.2897, std. dev.: 0.0207) SingleSource/Benchmarks/Misc/mandel-2: 7.66% (1.2998 => 1.3993, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.95% (1.5824 => 1.6766, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.92% (0.9996 => 1.0488, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 4.24% (7.4271 => 7.7417, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7316, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (12.4560 => 12.8577, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4756, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.42% (1.7688 => 1.8116, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.41% (2.8606 => 2.9294, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.38% (1.0310 => 1.0555, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.18% (2.0200 => 2.0640, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5624, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.09% (4.1080 => 4.1939, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 2.03% (0.6159 => 0.6284, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1943, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.28% (10.7476 => 10.8849, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sieve: 1.26% (2.4679 => 2.4991, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 1.03% (3.1736 => 3.2063, std. dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.65% (22.5627 => 21.2888, std. dev.: 0.0161) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.98% (0.2670 => 0.2537, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1021, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3070, std. dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -4.84% (2.6470 => 2.5189, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9821, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.37% (1.9762 => 1.9097, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9449, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.57% (0.4867 => 0.4742, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.35% (20.3410 => 19.8622, std. dev.: 0.0338) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5033, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2386, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7607, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9961, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8608, std. dev.: 0.0090) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.31% (2.5254 => 2.4923, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.2225 => 27.8618, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2209, std. dev.: 0.0062) MultiSource/Applications/lua/lua: -1.11% (26.5159 => 26.2224, std. dev.: 0.0176) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2582, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 22 06:25:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 22 Jul 2012 08:25:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120722132550.CBB1A2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2279?compare_to=2276&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2279, Order: 160612, Start Time: 2012-07-22 12:07:18, End Time: 2012-07-22 13:26:10 To: 2276, Order: 160611, Start Time: 2012-07-22 05:52:35, End Time: 2012-07-22 07:13:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (72 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (772 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (13.5696 => 13.8047, std. dev.: 0.0113) MultiSource/Applications/JM/ldecod/ldecod: 1.19% (10.9282 => 11.0581, std. dev.: 0.0330) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.66% (54.6821 => 56.6814, std. dev.: 0.0151) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.16% (10.3673 => 13.8047, std. dev.: 0.0113) SingleSource/UnitTests/ObjC/trivial-interface: 11.83% (0.3473 => 0.3884, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.76% (1.1194 => 1.2510, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 11.69% (0.3516 => 0.3927, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.64% (0.3497 => 0.3904, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.60% (0.3543 => 0.3954, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 11.49% (0.3561 => 0.3970, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3694 => 0.4107, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.87% (0.3828 => 0.4244, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.15% (2.2022 => 2.4036, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.34% (1.7609 => 1.9077, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 8.10% (0.1432 => 0.1548, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (0.1622 => 0.1733, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.99% (0.5925 => 0.6280, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 5.99% (0.6030 => 0.6391, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.96% (10.4361 => 11.0581, std. dev.: 0.0330) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.73% (0.3177 => 0.3359, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 5.18% (0.3282 => 0.3452, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 4.78% (0.7326 => 0.7676, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.77% (7.0540 => 7.3904, std. dev.: 0.0151) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.38% (0.4615 => 0.4817, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 3.87% (0.7433 => 0.7721, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (4.9449 => 5.1323, std. dev.: 0.0087) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.72% (0.8172 => 0.8476, std. dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 3.70% (9.4845 => 9.8357, std. dev.: 0.0219) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.0018 => 5.1848, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.36% (0.5860 => 0.6057, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.31% (4.2646 => 4.4059, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5569 => 0.5750, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.11% (8.1363 => 8.3896, std. dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 3.10% (5.7591 => 5.9374, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.96% (14.3668 => 14.7920, std. dev.: 0.0155) MultiSource/Benchmarks/sim/sim: 2.95% (0.3387 => 0.3487, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.73% (0.7835 => 0.8049, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.70% (1.3050 => 1.3403, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 2.70% (1.5603 => 1.6025, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.63% (1.1861 => 1.2173, std. dev.: 0.0097) MultiSource/Applications/d/make_dparser: 2.62% (3.3354 => 3.4229, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.5415 => 1.5785, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 2.35% (2.0273 => 2.0750, std. dev.: 0.0050) MultiSource/Applications/Burg/burg: 2.26% (1.1642 => 1.1905, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.5105 => 0.5218, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.01% (0.9765 => 0.9961, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.92% (0.6675 => 0.6803, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.90% (3.8723 => 3.9460, std. dev.: 0.0126) MultiSource/Applications/sqlite3/sqlite3: 1.87% (17.1811 => 17.5030, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (2.2024 => 2.2427, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.80% (0.6450 => 0.6566, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 1.69% (0.6456 => 0.6565, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.65% (1.4186 => 1.4420, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.61% (1.5859 => 1.6115, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.61% (2.0665 => 2.0997, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 1.36% (0.8921 => 0.9042, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 1.16% (1.2842 => 1.2991, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 1.01% (2.2969 => 2.3202, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9756, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.27% (5.3999 => 5.7384, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7511, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.76% (11.6436 => 11.8484, std. dev.: 0.0120) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5086 => 1.5351, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.0554 => 1.0730, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.65% (3.1578 => 3.2099, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.43% (2.6546 => 2.6925, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: 1.08% (9.1159 => 9.2143, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.05% (3.2416 => 3.2755, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.02% (6.6465 => 6.7143, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.09% (5.2763 => 3.1609, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.34% (5.3855 => 3.6976, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.58% (5.3526 => 3.7160, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.80% (2.9384 => 2.5622, std. dev.: 0.0108) MultiSource/Applications/ClamAV/clamscan: -10.33% (22.1758 => 19.8847, std. dev.: 0.0630) SingleSource/UnitTests/Vector/constpool: -4.82% (54.1659 => 51.5577, std. dev.: 0.0693) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.31% (3.8922 => 3.8411, std. dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.59% (1.1492 => 0.7632, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.35% (1.2373 => 1.1093, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -7.70% (1.5373 => 1.4189, std. dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.45% (2.7294 => 2.5533, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5956, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4747, std. dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.07% (8.1563 => 7.9060, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4220, std. dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.33% (1.7254 => 1.6852, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.15% (10.2830 => 10.0624, std. dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.64% (1.3677 => 1.3453, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.59% (2.0866 => 2.0534, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3741, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5141, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -1.42% (12.5348 => 12.3568, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.42% (4.2280 => 4.1681, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 22 07:51:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 22 Jul 2012 09:51:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120722145127.0A0BC2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2280?compare_to=2277&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2280, Order: 160612, Start Time: 2012-07-22 12:07:02, End Time: 2012-07-22 14:51:44 To: 2277, Order: 160611, Start Time: 2012-07-22 06:55:32, End Time: 2012-07-22 09:41:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (81 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (805 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.46% (54.0608 => 54.8487, std. dev.: 0.0777) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.18% (2.0765 => 2.1011, std. dev.: 0.0080) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.07% (0.3465 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.04% (0.3442 => 0.3891, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 13.03% (0.3446 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.93% (0.3488 => 0.3939, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 12.86% (0.3460 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.83% (0.3469 => 0.3914, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.79% (0.3496 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.27% (0.3650 => 0.4098, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.24% (0.3643 => 0.4089, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.98% (0.3724 => 0.4170, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.97% (0.5826 => 0.6232, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.61% (0.5889 => 0.6278, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.48% (0.1620 => 0.1725, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.28% (1.5932 => 1.6773, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.10% (0.5900 => 0.6201, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 5.09% (0.7171 => 0.7536, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.09% (0.4994 => 0.5248, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.98% (1.6211 => 1.7018, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.91% (3.5627 => 3.7375, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.81% (0.5026 => 0.5268, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.65% (0.4361 => 0.4564, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.60% (0.5000 => 0.5230, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.35% (1.3152 => 1.3724, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.29% (0.4029 => 0.4202, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.25% (0.3930 => 0.4097, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.09% (0.2736 => 0.2848, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 4.03% (1.0781 => 1.1216, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 3.86% (4.2109 => 4.3735, std. dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.76% (2.7292 => 2.8319, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.66% (0.2866 => 0.2971, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.58% (0.2875 => 0.2978, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.55% (1.9694 => 2.0393, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: 3.52% (0.3096 => 0.3205, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.47% (1.9966 => 2.0658, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 3.40% (0.3267 => 0.3378, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.37% (2.0673 => 2.1370, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3362 => 0.3475, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.35% (0.9697 => 1.0022, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.29% (0.9909 => 1.0235, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.17% (5.5417 => 5.7172, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.12% (0.4139 => 0.4268, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.09% (0.3845 => 0.3964, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 3.08% (0.3317 => 0.3419, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.01% (0.3890 => 0.4007, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.96% (0.4658 => 0.4796, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 2.90% (0.3477 => 0.3578, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 2.90% (0.3726 => 0.3834, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.90% (4.4195 => 4.5476, std. dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 2.84% (4.6177 => 4.7489, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.3903 => 0.4013, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (2.1653 => 2.2260, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/moments: 2.80% (0.3678 => 0.3781, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.78% (2.1013 => 2.1597, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 2.78% (1.8794 => 1.9316, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 2.61% (0.4251 => 0.4362, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.60% (0.4146 => 0.4254, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.55% (0.7875 => 0.8076, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.23% (0.6634 => 0.6782, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 2.20% (0.5546 => 0.5668, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.10% (1.4269 => 1.4568, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.96% (0.6435 => 0.6561, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 1.73% (23.5202 => 23.9281, std. dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 1.23% (2.0346 => 2.0596, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.40% (5.2852 => 11.7542, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.83% (0.2162 => 0.3369, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.92% (10.7630 => 13.6600, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.36% (0.5589 => 0.6671, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout/objinst: 19.34% (9.4436 => 11.2704, std. dev.: 0.0301) SingleSource/Benchmarks/Shootout/lists: 13.49% (32.9687 => 37.4161, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 7.01% (15.4430 => 16.5254, std. dev.: 0.0231) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.77% (3.3903 => 3.6198, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: 5.41% (19.6305 => 20.6933, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 5.06% (2.8036 => 2.9454, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8918, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.08% (2.2962 => 2.3898, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.34% (3.1722 => 3.2464, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (3.1728 => 3.2465, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 1.96% (15.8721 => 16.1835, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 1.41% (1.5554 => 1.5774, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.44% (2.4764 => 2.3913, std. dev.: 0.0069) MultiSource/Applications/kimwitu++/kc: -1.90% (11.9555 => 11.7284, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.84% (6.2401 => 4.1287, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -7.87% (0.2402 => 0.2213, std. dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/dry: -4.29% (14.0481 => 13.4453, std. dev.: 0.0327) SingleSource/Benchmarks/Misc/salsa20: -3.81% (35.5013 => 34.1484, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/objinst: -2.70% (12.0509 => 11.7250, std. dev.: 0.0287) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5754, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 22 10:00:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 22 Jul 2012 12:00:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120722170029.801CC2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2281?compare_to=2278&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2281, Order: 160613, Start Time: 2012-07-22 15:46:34, End Time: 2012-07-22 17:00:46 To: 2278, Order: 160612, Start Time: 2012-07-22 12:06:59, End Time: 2012-07-22 13:21:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (153 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (704 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.21% (1.5532 => 1.5344, std. dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.76% (2.0176 => 2.3356, std. dev.: 0.0157) SingleSource/UnitTests/ObjC++/property-reference-object: 10.67% (0.5818 => 0.6439, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.47% (0.5748 => 0.6350, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.64% (0.3578 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.53% (0.7061 => 0.7734, std. dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.51% (0.1072 => 0.1174, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.44% (0.3601 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.38% (0.3646 => 0.3988, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.36% (0.3663 => 0.4006, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.32% (0.3650 => 0.3990, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions-3: 9.30% (0.3623 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.29% (0.3789 => 0.4141, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 9.09% (0.4003 => 0.4367, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.02% (0.3914 => 0.4267, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.91% (0.3940 => 0.4291, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.53% (0.3130 => 0.3397, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 7.87% (1.3693 => 1.4770, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.44% (0.4328 => 0.4650, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.39% (0.2721 => 0.2922, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 7.18% (0.7038 => 0.7543, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (3.9660 => 4.2480, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.05% (0.2781 => 0.2977, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.92% (0.4062 => 0.4343, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.75% (0.3022 => 0.3226, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.72% (0.2782 => 0.2969, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.67% (0.5265 => 0.5616, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.65% (0.7710 => 0.8223, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 6.64% (0.2607 => 0.2780, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.62% (0.2690 => 0.2868, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.59% (0.2760 => 0.2942, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.59% (0.2655 => 0.2830, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.58% (0.2765 => 0.2947, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2726 => 0.2905, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.44% (0.3899 => 0.4150, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.44% (1.9828 => 2.1104, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.44% (0.2937 => 0.3126, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.2966 => 0.3156, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.40% (0.3580 => 0.3809, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2628 => 0.2796, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.39% (0.3489 => 0.3712, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.34% (0.2696 => 0.2867, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.34% (0.2761 => 0.2936, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.28% (0.3485 => 0.3704, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 6.24% (0.3107 => 0.3301, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.22% (0.3149 => 0.3345, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.20% (0.3453 => 0.3667, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/matrix: 6.09% (0.2988 => 0.3170, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.6959 => 0.7380, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.05% (0.3192 => 0.3385, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.82% (0.4379 => 0.4634, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.75% (0.4016 => 0.4247, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.72% (0.4390 => 0.4641, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.71% (13.8202 => 14.6100, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.70% (0.3756 => 0.3970, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.69% (0.3534 => 0.3735, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 5.67% (16.6129 => 17.5550, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/lists: 5.65% (0.3293 => 0.3479, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.64% (1.2193 => 1.2881, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.3868 => 0.4083, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.49% (0.9199 => 0.9704, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.42% (13.2842 => 14.0037, std. dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.31% (0.5577 => 0.5873, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (0.2945 => 0.3099, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.2925 => 0.3076, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.03% (0.2127 => 0.2234, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.98% (1.1364 => 1.1930, std. dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.97% (1.4563 => 1.5287, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.88% (0.5637 => 0.5912, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.86% (1.3819 => 1.4491, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.86% (7.2180 => 7.5685, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.84% (0.3246 => 0.3403, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.84% (1.3813 => 1.4481, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.79% (3.8646 => 4.0498, std. dev.: 0.0097) MultiSource/Benchmarks/nbench/nbench: 4.68% (1.0594 => 1.1090, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.66% (1.1061 => 1.1576, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.2292 => 1.2859, std. dev.: 0.0044) MultiSource/Applications/treecc/treecc: 4.57% (1.9270 => 2.0150, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.56% (0.8310 => 0.8689, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.53% (0.7506 => 0.7846, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.47% (1.3245 => 1.3837, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.42% (0.3755 => 0.3921, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.27% (4.3801 => 4.5672, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.26% (0.7460 => 0.7778, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.24% (0.4791 => 0.4994, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.16% (3.6692 => 3.8217, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (4.4433 => 4.6240, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.92% (2.1791 => 2.2646, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.90% (4.9865 => 5.1812, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.71% (0.6283 => 0.6516, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 3.67% (0.2859 => 0.2964, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.66% (0.8698 => 0.9016, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.64% (0.3131 => 0.3245, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.61% (0.2995 => 0.3103, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.55% (1.1333 => 1.1735, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 3.43% (3.1889 => 3.2983, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 3.26% (6.5754 => 6.7898, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 3.15% (14.8535 => 15.3219, std. dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.13% (0.6135 => 0.6327, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (8.4961 => 8.7572, std. dev.: 0.0076) MultiSource/Applications/ClamAV/clamscan: 2.93% (14.5298 => 14.9562, std. dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: 2.82% (16.2614 => 16.7199, std. dev.: 0.0134) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4113 => 0.4227, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.1007 => 2.1569, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.47% (3.2742 => 3.3550, std. dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.43% (1.5188 => 1.5557, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.27% (0.6250 => 0.6392, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.17% (4.6629 => 4.7641, std. dev.: 0.0133) MultiSource/Applications/minisat/minisat: 1.79% (0.6744 => 0.6865, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.76% (0.9108 => 0.9268, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.68% (1.0313 => 1.0486, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.29% (3.7467 => 3.7949, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (6.2785 => 6.3554, std. dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 1.20% (33.2944 => 33.6951, std. dev.: 0.0108) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.03% (0.1824 => 0.3229, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 56.73% (0.1322 => 0.2072, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.07% (1.8175 => 2.2913, std. dev.: 0.0201) SingleSource/Benchmarks/Misc/mandel-2: 6.82% (1.2998 => 1.3885, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.98% (1.5824 => 1.6770, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.96% (0.9996 => 1.0492, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 4.23% (7.4271 => 7.7409, std. dev.: 0.0085) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7323, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.24% (12.4560 => 12.8601, std. dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4759, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.41% (2.8606 => 2.9294, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.36% (1.7688 => 1.8106, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.17% (2.0200 => 2.0639, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 2.14% (2.5089 => 2.5625, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 2.11% (0.6159 => 0.6289, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.09% (4.1080 => 4.1940, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (1.5089 => 1.5344, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std. dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5151, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (1.9290 => 1.9570, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 1.27% (2.4679 => 2.4992, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 1.06% (3.1736 => 3.2071, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.00% (0.4657 => 0.4005, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.60% (22.5627 => 21.2995, std. dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.02% (0.2670 => 0.2536, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.27% (1.2308 => 1.1044, std. dev.: 0.0099) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.37% (1.3780 => 1.3040, std. dev.: 0.0087) SingleSource/UnitTests/Vector/multiplies: -4.83% (2.6470 => 2.5191, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9820, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.37% (1.9762 => 1.9097, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.62% (3.0263 => 2.9469, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.55% (0.4867 => 0.4743, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2249, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9351, std. dev.: 0.0624) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5060, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7604, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9962, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.38% (2.5254 => 2.4905, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2126, std. dev.: 0.0445) MultiSource/Benchmarks/mafft/pairlocalalign: -1.28% (28.2225 => 27.8617, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2541, std. dev.: 0.0047) MultiSource/Applications/lua/lua: -1.13% (26.5159 => 26.2171, std. dev.: 0.0187) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 22 10:04:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 22 Jul 2012 12:04:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120722170448.8F74C2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2282?compare_to=2279&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2282, Order: 160613, Start Time: 2012-07-22 15:46:43, End Time: 2012-07-22 17:05:07 To: 2279, Order: 160612, Start Time: 2012-07-22 12:07:18, End Time: 2012-07-22 13:26:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (70 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (774 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.21% (79.2734 => 80.2296, std. dev.: 0.2654) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.17% (10.3673 => 13.8057, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/trivial-interface: 11.69% (0.3473 => 0.3879, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.65% (1.1194 => 1.2498, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3497 => 0.3902, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 11.43% (0.3543 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.41% (0.3516 => 0.3917, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.40% (0.3543 => 0.3947, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.32% (0.3561 => 0.3964, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.07% (0.3694 => 0.4103, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.63% (0.3886 => 0.4299, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.62% (0.3927 => 0.4344, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.27% (2.2022 => 2.4064, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.74% (1.7609 => 1.9148, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 8.10% (0.1432 => 0.1548, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.78% (0.1622 => 0.1732, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.50% (0.6030 => 0.6422, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 6.50% (0.5925 => 0.6310, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.01% (10.4361 => 11.0628, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.91% (0.2065 => 0.2187, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3282 => 0.3457, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.30% (0.7326 => 0.7714, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.02% (7.0540 => 7.4078, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.44% (0.4615 => 0.4820, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.7433 => 0.7720, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.76% (4.9449 => 5.1308, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.71% (9.4845 => 9.8366, std. dev.: 0.0132) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.0018 => 5.1849, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.54% (0.5569 => 0.5766, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.32% (0.8172 => 0.8443, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.15% (8.1363 => 8.3922, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.09% (0.5860 => 0.6041, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.06% (4.2646 => 4.3953, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.87% (14.3668 => 14.7795, std. dev.: 0.0178) MultiSource/Applications/spiff/spiff: 2.87% (0.7835 => 0.8060, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 2.84% (5.7591 => 5.9228, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.69% (1.3050 => 1.3401, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 2.65% (1.5603 => 1.6016, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.64% (0.8067 => 0.8280, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.60% (1.1861 => 1.2169, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 2.52% (3.3354 => 3.4194, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (1.5415 => 1.5793, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.23% (2.0273 => 2.0725, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 2.17% (1.1642 => 1.1895, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.08% (0.5105 => 0.5211, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.89% (3.8723 => 3.9456, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.88% (0.9765 => 0.9949, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6675 => 0.6799, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.82% (2.0665 => 2.1041, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.77% (17.1811 => 17.4849, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.71% (2.2024 => 2.2400, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 1.66% (0.6456 => 0.6563, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.50% (1.4186 => 1.4399, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.42% (1.5859 => 1.6084, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.39% (1.2842 => 1.3021, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 1.26% (0.8921 => 0.9033, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9757, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.61% (5.3999 => 5.7571, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7474, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5086 => 1.5353, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8413, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.56% (3.1578 => 3.2071, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.35% (2.6546 => 2.6905, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2321, std. dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.04% (3.2416 => 3.2753, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.03% (6.6465 => 6.7151, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.20% (5.2763 => 3.1553, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.25% (5.3855 => 3.7025, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.50% (5.3526 => 3.7202, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.05% (2.9384 => 2.5550, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -10.23% (22.1758 => 19.9075, std. dev.: 0.0155) SingleSource/UnitTests/Vector/constpool: -4.91% (54.1659 => 51.5080, std. dev.: 0.0232) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.36% (3.8922 => 3.8394, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.59% (1.1492 => 0.7632, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.03% (1.5373 => 1.3831, std. dev.: 0.0306) SingleSource/Benchmarks/McGill/chomp: -9.73% (1.2373 => 1.1169, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.45% (2.7294 => 2.5534, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.19% (8.1563 => 7.8965, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4850, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.6802 => 8.4314, std. dev.: 0.0090) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.39% (0.4808 => 0.4693, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.33% (1.7254 => 1.6852, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.14% (10.2830 => 10.0630, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.63% (1.3677 => 1.3454, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.62% (2.0866 => 2.0529, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3741, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.41% (2.5528 => 2.5167, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.41% (12.5348 => 12.3581, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.24% (4.2280 => 4.1756, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 22 11:31:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 22 Jul 2012 13:31:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120722183115.30B542A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2283?compare_to=2280&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2283, Order: 160613, Start Time: 2012-07-22 15:46:48, End Time: 2012-07-22 18:31:34 To: 2280, Order: 160612, Start Time: 2012-07-22 12:07:02, End Time: 2012-07-22 14:51:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (104 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (782 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.26% (124.2881 => 129.5864, std. dev.: 1.0943) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.06% (0.3446 => 0.3896, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: 13.02% (0.3465 => 0.3916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.99% (0.3442 => 0.3889, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.92% (0.3460 => 0.3907, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.87% (0.3496 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.84% (0.3488 => 0.3936, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 12.77% (0.3469 => 0.3912, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/property: 12.38% (0.3650 => 0.4102, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 12.30% (0.3643 => 0.4091, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.92% (0.3724 => 0.4168, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5826 => 0.6256, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.11% (0.5889 => 0.6308, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.1620 => 0.1728, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.68% (0.7171 => 0.7578, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.26% (1.6211 => 1.7064, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.07% (3.5627 => 3.7434, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 4.79% (0.4029 => 0.4222, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.77% (0.4361 => 0.4569, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.66% (0.5900 => 0.6175, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.58% (0.5000 => 0.5229, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.53% (1.3152 => 1.3748, std. dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 4.43% (1.5932 => 1.6637, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.36% (0.5026 => 0.5245, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.27% (0.4994 => 0.5207, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.25% (0.3930 => 0.4097, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.24% (0.2738 => 0.2854, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.20% (2.7292 => 2.8439, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.13% (0.2714 => 0.2826, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.10% (0.2875 => 0.2993, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.03% (0.2729 => 0.2839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.00% (0.2803 => 0.2915, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (2.0673 => 2.1486, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 3.93% (4.2109 => 4.3763, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.91% (0.3096 => 0.3217, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.90% (0.2792 => 0.2901, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2750 => 0.2857, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.84% (0.2813 => 0.2921, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.78% (0.9909 => 1.0284, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 3.78% (1.0781 => 1.1188, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/objinst: 3.75% (0.2823 => 0.2929, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 3.74% (0.2811 => 0.2916, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.73% (0.2866 => 0.2973, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 3.71% (0.2780 => 0.2883, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.70% (0.3625 => 0.3759, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.69% (0.2736 => 0.2837, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.65% (0.3124 => 0.3238, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.2911 => 0.3017, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.62% (1.9694 => 2.0407, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 3.61% (0.3267 => 0.3385, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.57% (0.3195 => 0.3309, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.53% (0.3258 => 0.3373, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.53% (0.3317 => 0.3434, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.51% (0.3362 => 0.3480, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.47% (1.9966 => 2.0659, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (0.4658 => 0.4819, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 3.41% (0.9697 => 1.0028, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.37% (0.3060 => 0.3163, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.36% (0.3845 => 0.3974, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 3.32% (0.3678 => 0.3800, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.28% (0.3477 => 0.3591, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.25% (4.6177 => 4.7677, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 3.25% (0.3726 => 0.3847, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.23% (0.3282 => 0.3388, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (0.3348 => 0.3456, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.22% (5.5417 => 5.7204, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash: 3.14% (0.4146 => 0.4276, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.06% (1.8794 => 1.9370, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.06% (0.3890 => 0.4009, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.05% (2.1013 => 2.1653, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 3.01% (2.1653 => 2.2305, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.01% (0.3690 => 0.3801, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.92% (4.4195 => 4.5484, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 2.89% (0.4251 => 0.4374, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.3903 => 0.4013, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.67% (0.7875 => 0.8085, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.66% (0.3981 => 0.4087, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.51% (0.4139 => 0.4243, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.40% (1.4269 => 1.4612, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 2.22% (0.5546 => 0.5669, std. dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: 2.18% (23.5202 => 24.0335, std. dev.: 0.0240) SingleSource/Benchmarks/Misc-C++/bigfib: 2.17% (0.5012 => 0.5121, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.14% (0.6435 => 0.6573, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 1.96% (0.6634 => 0.6764, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.03% (2.0346 => 2.0556, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.40% (5.2852 => 11.7542, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.37% (0.2162 => 0.3359, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.93% (10.7630 => 13.6617, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/objinst: 19.73% (9.4436 => 11.3066, std. dev.: 0.0318) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.57% (0.5589 => 0.6683, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: 13.43% (32.9687 => 37.3975, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops: 6.99% (15.4430 => 16.5232, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.74% (3.3903 => 3.6188, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: 5.42% (19.6305 => 20.6941, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: 4.98% (2.8036 => 2.9433, std. dev.: 0.0210) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8915, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.08% (2.2962 => 2.3898, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (3.1728 => 3.2441, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.24% (3.1722 => 3.2432, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 1.91% (15.8721 => 16.1755, std. dev.: 0.0650) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (17.2379 => 17.5165, std. dev.: 0.0603) MultiSource/Applications/sgefa/sgefa: 1.43% (1.5554 => 1.5776, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.21% (1.0142 => 1.0265, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.45% (2.4764 => 2.3909, std. dev.: 0.0174) MultiSource/Applications/kimwitu++/kc: -1.75% (11.9555 => 11.7458, std. dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.84% (6.2401 => 4.1287, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -5.08% (0.2402 => 0.2280, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (14.0481 => 13.4789, std. dev.: 0.0186) SingleSource/Benchmarks/Misc/salsa20: -3.84% (35.5013 => 34.1395, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: -2.64% (12.0509 => 11.7329, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5754, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 22 18:38:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 22 Jul 2012 20:38:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120723013847.463DE2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2285?compare_to=2282&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2285, Order: 160614, Start Time: 2012-07-23 00:20:43, End Time: 2012-07-23 01:39:05 To: 2282, Order: 160613, Start Time: 2012-07-22 15:46:43, End Time: 2012-07-22 17:05:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (73 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (770 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.64% (53.0108 => 56.5326, std. dev.: 0.1827) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.42% (10.3673 => 13.7288, std. dev.: 0.0204) SingleSource/UnitTests/ObjC/trivial-interface: 11.98% (0.3473 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.81% (0.3497 => 0.3910, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.77% (1.1194 => 1.2511, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 11.69% (0.3516 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.69% (0.3543 => 0.3957, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3543 => 0.3956, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.57% (0.3561 => 0.3973, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.26% (0.3694 => 0.4110, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.87% (0.3828 => 0.4244, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3927 => 0.4350, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.83% (2.2022 => 2.3967, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.03% (1.7609 => 1.9023, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.62% (0.6030 => 0.6429, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 6.57% (0.5925 => 0.6314, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 5.85% (10.4361 => 11.0463, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.63% (0.3177 => 0.3356, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.31% (0.7326 => 0.7715, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 4.84% (0.3282 => 0.3441, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.81% (7.0540 => 7.3935, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.65% (0.4879 => 0.5106, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.49% (0.4615 => 0.4822, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.7433 => 0.7720, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.71% (4.9449 => 5.1286, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.64% (5.0018 => 5.1839, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.5569 => 0.5769, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 3.55% (9.4845 => 9.8216, std. dev.: 0.0148) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.55% (0.8172 => 0.8462, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.16% (8.1363 => 8.3933, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.14% (0.5860 => 0.6044, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.06% (4.2646 => 4.3950, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (14.3668 => 14.7880, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/18-imp/imp: 2.92% (0.3423 => 0.3523, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 2.90% (1.5603 => 1.6055, std. dev.: 0.0068) MultiSource/Applications/spiff/spiff: 2.88% (0.7835 => 0.8061, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 2.72% (5.7591 => 5.9156, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.3050 => 1.3399, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.61% (3.3354 => 3.4225, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.59% (1.1861 => 1.2168, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 2.52% (0.4289 => 0.4397, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.39% (1.5415 => 1.5784, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.36% (2.0665 => 2.1152, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.35% (0.4636 => 0.4745, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.31% (2.0273 => 2.0741, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.30% (1.1642 => 1.1910, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.29% (0.8067 => 0.8252, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.99% (0.9765 => 0.9959, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 1.98% (0.6456 => 0.6584, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.90% (3.8723 => 3.9458, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.81% (0.6450 => 0.6567, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6675 => 0.6792, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.64% (1.4186 => 1.4419, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 1.63% (1.2842 => 1.3051, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.59% (17.1811 => 17.4550, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.2024 => 2.2365, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.44% (1.5859 => 1.6088, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 1.21% (0.8921 => 0.9029, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.13% (2.6778 => 2.9758, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.66% (5.3999 => 5.7594, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.24% (3.6395 => 3.7575, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.37% (1.0313 => 1.0557, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (1.5086 => 1.5347, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 1.70% (3.1578 => 3.2115, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8414, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/whetstone: 1.64% (1.0554 => 1.0727, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.36% (2.6546 => 2.6906, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: 1.09% (9.1159 => 9.2149, std. dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.02% (3.2416 => 3.2748, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 1.02% (6.6465 => 6.7145, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.06% (5.2763 => 3.1627, std. dev.: 0.0127) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.47% (5.3855 => 3.6909, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7092, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.99% (2.9384 => 2.5566, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.34% (22.1758 => 19.8830, std. dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -4.87% (54.1659 => 51.5280, std. dev.: 0.0309) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.48% (3.8922 => 3.8346, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -9.62% (1.2373 => 1.1183, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/mandel-2: -7.31% (1.5373 => 1.4249, std. dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.45% (2.7294 => 2.5533, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5956, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.25% (8.1563 => 7.8916, std. dev.: 0.0164) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4745, std. dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4122, std. dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.32% (1.7254 => 1.6854, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -2.12% (10.2830 => 10.0651, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.57% (2.0866 => 2.0538, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3741, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.52% (1.3677 => 1.3469, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.43% (12.5348 => 12.3550, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.40% (4.2280 => 4.1686, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.03% (1.8329 => 1.8141, std. dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 22 18:34:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 22 Jul 2012 20:34:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120723013410.D6A822A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2284?compare_to=2281&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2284, Order: 160614, Start Time: 2012-07-23 00:20:35, End Time: 2012-07-23 01:34:29 To: 2281, Order: 160613, Start Time: 2012-07-22 15:46:34, End Time: 2012-07-22 17:00:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (147 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.25% (1.3885 => 1.4059, std. dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.15% (2.0176 => 2.3232, std. dev.: 0.0064) SingleSource/UnitTests/ObjC++/property-reference-object: 9.78% (0.5818 => 0.6387, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.67% (0.5748 => 0.6304, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.84% (0.7061 => 0.7685, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 8.38% (0.3578 => 0.3878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 8.08% (0.3601 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.08% (0.3789 => 0.4095, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.06% (0.3646 => 0.3940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.05% (0.3650 => 0.3944, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.03% (0.3663 => 0.3957, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.4003 => 0.4318, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 7.84% (0.3940 => 0.4249, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.79% (0.3914 => 0.4219, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.30% (0.1986 => 0.2131, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.16% (1.3693 => 1.4674, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 7.02% (0.4328 => 0.4632, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.2721 => 0.2910, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 6.93% (0.7038 => 0.7526, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.79% (3.9660 => 4.2352, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.53% (0.5265 => 0.5609, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.47% (0.2596 => 0.2764, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.36% (0.7710 => 0.8200, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.18% (0.2781 => 0.2953, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.18% (0.2782 => 0.2954, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.15% (0.4062 => 0.4312, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.90% (0.3489 => 0.3695, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.83% (0.2760 => 0.2921, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 5.83% (0.2726 => 0.2885, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.76% (0.2655 => 0.2808, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.75% (0.3580 => 0.3786, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.75% (0.2628 => 0.2779, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.72% (0.2937 => 0.3105, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.70% (0.2966 => 0.3135, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.3107 => 0.3284, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.69% (0.2988 => 0.3158, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.64% (1.9828 => 2.0947, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.64% (0.3899 => 0.4119, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.63% (0.6959 => 0.7351, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 5.61% (0.2761 => 0.2916, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.53% (0.3149 => 0.3323, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.49% (0.2696 => 0.2844, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (0.3485 => 0.3675, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.44% (0.4379 => 0.4617, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.37% (1.2193 => 1.2848, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 5.24% (0.3453 => 0.3634, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.23% (13.8202 => 14.5431, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.20% (0.4016 => 0.4225, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.20% (0.9199 => 0.9677, std. dev.: 0.0063) MultiSource/Applications/kimwitu++/kc: 5.19% (16.6129 => 17.4753, std. dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.14% (0.3756 => 0.3949, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.12% (0.3534 => 0.3715, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.09% (0.3868 => 0.4065, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.08% (0.4390 => 0.4613, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.07% (0.3293 => 0.3460, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (13.2842 => 13.9439, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.95% (0.5577 => 0.5853, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.79% (0.2925 => 0.3065, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.65% (1.4563 => 1.5240, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3813 => 1.4455, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.58% (1.1364 => 1.1885, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.58% (1.3819 => 1.4452, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.53% (0.2914 => 0.3046, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.51% (0.5637 => 0.5891, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3246 => 0.3392, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.49% (1.0594 => 1.1070, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.45% (0.8310 => 0.8680, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.43% (7.2180 => 7.5377, std. dev.: 0.0111) MultiSource/Applications/Burg/burg: 4.42% (1.1061 => 1.1550, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.41% (3.8646 => 4.0349, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.33% (1.3245 => 1.3818, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.2945 => 0.3072, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.28% (0.7506 => 0.7827, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.26% (1.9270 => 2.0091, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.06% (0.7460 => 0.7763, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 3.95% (1.2292 => 1.2778, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.88% (0.4791 => 0.4977, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.88% (4.3801 => 4.5500, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.85% (3.6692 => 3.8103, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.81% (4.4433 => 4.6127, std. dev.: 0.0091) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.73% (0.3755 => 0.3895, std. dev.: 0.0039) MultiSource/Applications/siod/siod: 3.71% (2.1791 => 2.2599, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.57% (4.9865 => 5.1643, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.57% (0.6283 => 0.6507, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.41% (0.2995 => 0.3097, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.26% (1.1333 => 1.1703, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.19% (3.1889 => 3.2907, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.10% (0.6135 => 0.6325, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (6.5754 => 6.7724, std. dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 2.89% (14.8535 => 15.2825, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 2.65% (14.5298 => 14.9144, std. dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 2.62% (16.2614 => 16.6882, std. dev.: 0.0166) MultiSource/Benchmarks/mafft/pairlocalalign: 2.60% (8.4961 => 8.7173, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.55% (2.1007 => 2.1542, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 2.43% (0.4113 => 0.4213, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.26% (3.2742 => 3.3483, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (1.5188 => 1.5518, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 1.90% (4.6629 => 4.7513, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 1.70% (0.6250 => 0.6356, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.59% (0.6744 => 0.6851, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (0.9108 => 0.9243, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.40% (1.0313 => 1.0457, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.05% (3.7467 => 3.7861, std. dev.: 0.0097) MultiSource/Benchmarks/Bullet/bullet: 1.03% (33.2944 => 33.6365, std. dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 76.97% (0.1824 => 0.3228, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 56.43% (0.1322 => 0.2068, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/fbench: 26.49% (1.8175 => 2.2990, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/mandel-2: 8.16% (1.2998 => 1.4059, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.97% (1.5824 => 1.6768, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.11% (0.9996 => 1.0507, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: 4.31% (7.4271 => 7.7471, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7310, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.25% (12.4560 => 12.8606, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4759, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.46% (1.7688 => 1.8124, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.41% (2.8606 => 2.9295, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.16% (2.0200 => 2.0636, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: 2.14% (2.5089 => 2.5625, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.10% (4.1080 => 4.1944, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 2.01% (0.6159 => 0.6283, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (1.5089 => 1.5350, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (1.9290 => 1.9565, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 1.26% (2.4679 => 2.4991, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.24% (3.1736 => 3.2128, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2143, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.97% (0.4657 => 0.3960, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.83% (22.5627 => 21.2476, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.02% (0.2670 => 0.2536, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2308 => 1.1050, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.08% (1.3780 => 1.3080, std. dev.: 0.0058) SingleSource/UnitTests/Vector/multiplies: -4.84% (2.6470 => 2.5190, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.37% (1.9762 => 1.9096, std. dev.: 0.0087) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9447, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.57% (0.4867 => 0.4742, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2289, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5035, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.73% (20.3410 => 19.9898, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.61% (9.9194 => 9.7598, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9963, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.31% (2.5254 => 2.4924, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.29% (28.2225 => 27.8596, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2209, std. dev.: 0.0174) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2537, std. dev.: 0.0030) MultiSource/Applications/lua/lua: -1.08% (26.5159 => 26.2294, std. dev.: 0.0247) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 22 20:05:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 22 Jul 2012 22:05:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120723030509.7B8E12A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2286?compare_to=2283&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2286, Order: 160614, Start Time: 2012-07-23 00:20:46, End Time: 2012-07-23 03:05:28 To: 2283, Order: 160613, Start Time: 2012-07-22 15:46:48, End Time: 2012-07-22 18:31:34 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (93 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (793 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.32% (129.5864 => 131.2942, std. dev.: 0.0334) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.54% (0.3446 => 0.3878, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.50% (0.3465 => 0.3898, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 12.49% (0.3442 => 0.3872, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.49% (0.3460 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.44% (0.3496 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.42% (0.3469 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.39% (0.3488 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.00% (0.3643 => 0.4080, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/property: 11.89% (0.3650 => 0.4084, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.60% (0.3724 => 0.4156, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.02% (0.3792 => 0.4172, std. dev.: 0.0085) SingleSource/UnitTests/ObjC++/Hello: 7.04% (0.5826 => 0.6236, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.69% (0.5889 => 0.6283, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.42% (0.1620 => 0.1724, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.80% (0.7171 => 0.7587, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.95% (3.5627 => 3.7391, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.92% (1.6211 => 1.7008, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.70% (0.4361 => 0.4566, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.22% (0.5900 => 0.6149, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.21% (0.4994 => 0.5204, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.20% (0.3930 => 0.4095, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.18% (1.3152 => 1.3702, std. dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 4.16% (1.5932 => 1.6594, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.02% (0.4029 => 0.4191, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 3.89% (0.2725 => 0.2831, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.87% (2.7292 => 2.8348, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.83% (0.2738 => 0.2843, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 3.83% (0.2714 => 0.2818, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.83% (0.2875 => 0.2985, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2792 => 0.2898, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.76% (0.5000 => 0.5188, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.74% (0.2729 => 0.2831, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.72% (0.5026 => 0.5213, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 3.71% (1.0781 => 1.1181, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 3.67% (0.2803 => 0.2906, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.64% (4.2109 => 4.3642, std. dev.: 0.0038) MultiSource/Applications/hbd/hbd: 3.63% (0.9697 => 1.0049, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.2866 => 0.2970, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 3.59% (0.3096 => 0.3207, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.49% (2.0673 => 2.1395, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.46% (0.3124 => 0.3232, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.41% (0.9909 => 1.0247, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.40% (1.9694 => 2.0364, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.34% (1.9966 => 2.0632, std. dev.: 0.0053) SingleSource/Regression/C++/ofstream_ctor: 3.33% (0.3004 => 0.3104, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.28% (0.3258 => 0.3365, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.28% (0.3267 => 0.3374, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3317 => 0.3424, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.19% (0.3195 => 0.3297, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.18% (0.3362 => 0.3469, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.11% (0.3890 => 0.4011, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 2.99% (0.3348 => 0.3448, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.96% (0.3845 => 0.3959, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 2.93% (0.3726 => 0.3835, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 2.87% (2.1013 => 2.1616, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.83% (0.4658 => 0.4790, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (0.3625 => 0.3727, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (4.4195 => 4.5434, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 2.78% (2.1653 => 2.2254, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/moments: 2.77% (0.3678 => 0.3780, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.71% (5.5417 => 5.6920, std. dev.: 0.0126) MultiSource/Applications/JM/lencod/lencod: 2.68% (4.6177 => 4.7414, std. dev.: 0.0125) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (1.8794 => 1.9297, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.65% (0.4146 => 0.4256, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 2.56% (0.4251 => 0.4360, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.55% (23.5202 => 24.1199, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.51% (0.3981 => 0.4081, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.25% (0.7875 => 0.8052, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.11% (0.5546 => 0.5663, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.05% (1.4269 => 1.4561, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.02% (0.5012 => 0.5113, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.82% (0.6634 => 0.6755, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.68% (0.6435 => 0.6543, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.15% (2.0346 => 2.0579, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.40% (5.2852 => 11.7542, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.64% (0.2162 => 0.3365, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.92% (10.7630 => 13.6608, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.91% (0.5589 => 0.6702, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/objinst: 19.41% (9.4436 => 11.2768, std. dev.: 0.0410) SingleSource/Benchmarks/Shootout/lists: 13.42% (32.9687 => 37.3941, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops: 7.00% (15.4430 => 16.5237, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.83% (3.3903 => 3.6219, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: 5.40% (19.6305 => 20.6905, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 5.15% (2.8036 => 2.9481, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8915, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.07% (2.2962 => 2.3896, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.33% (3.1722 => 3.2461, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (3.1728 => 3.2464, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 1.96% (15.8721 => 16.1838, std. dev.: 0.0091) SingleSource/Benchmarks/Dhrystone/fldry: 1.93% (17.2379 => 17.5702, std. dev.: 0.0399) MultiSource/Applications/sgefa/sgefa: 1.43% (1.5554 => 1.5776, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.20% (2.4764 => 2.3724, std. dev.: 0.0284) MultiSource/Applications/kimwitu++/kc: -2.09% (11.9555 => 11.7058, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.83% (6.2401 => 4.1292, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -6.16% (0.2402 => 0.2254, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: -4.46% (14.0481 => 13.4213, std. dev.: 0.0493) SingleSource/Benchmarks/Misc/salsa20: -3.83% (35.5013 => 34.1433, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: -3.08% (12.0509 => 11.6794, std. dev.: 0.0464) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5755, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 22 23:10:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 01:10:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120723061016.6BBD92A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2287?compare_to=2284&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2287, Order: 160615, Start Time: 2012-07-23 04:56:37, End Time: 2012-07-23 06:10:34 To: 2284, Order: 160614, Start Time: 2012-07-23 00:20:35, End Time: 2012-07-23 01:34:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (146 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.39% (54.6518 => 56.5019, std. dev.: 0.0566) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.80% (78.9229 => 80.3400, std. dev.: 0.1884) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.12% (1.4059 => 1.3902, std. dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.09% (2.0176 => 2.3221, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 9.83% (0.5818 => 0.6390, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.67% (0.5748 => 0.6304, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.81% (0.7061 => 0.7683, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.33% (0.3578 => 0.3876, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.24% (0.3130 => 0.3388, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 8.11% (0.3623 => 0.3917, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.09% (0.3646 => 0.3941, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.08% (0.3601 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.02% (0.3789 => 0.4093, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.00% (0.3663 => 0.3956, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.97% (0.3650 => 0.3941, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.92% (0.3940 => 0.4252, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.4003 => 0.4318, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.79% (0.3914 => 0.4219, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 7.16% (1.3693 => 1.4674, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.98% (0.2721 => 0.2911, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.86% (0.4328 => 0.4625, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.80% (0.5265 => 0.5623, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.69% (3.9660 => 4.2315, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.69% (0.7710 => 0.8226, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.69% (0.7038 => 0.7509, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 6.28% (0.4062 => 0.4317, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.26% (0.2781 => 0.2955, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.21% (0.1819 => 0.1932, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.15% (0.3022 => 0.3208, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.93% (0.2782 => 0.2947, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.88% (0.2655 => 0.2811, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.86% (0.2765 => 0.2927, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.85% (0.3489 => 0.3693, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.84% (0.2690 => 0.2847, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 5.83% (0.2726 => 0.2885, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.78% (0.3580 => 0.3787, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.75% (0.2937 => 0.3106, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.75% (0.2628 => 0.2779, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.69% (0.3899 => 0.4121, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.69% (0.6959 => 0.7355, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 5.69% (0.2761 => 0.2918, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.66% (0.2966 => 0.3134, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.62% (0.4379 => 0.4625, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.59% (1.9828 => 2.0936, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3107 => 0.3280, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.56% (0.3149 => 0.3324, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.51% (0.3485 => 0.3677, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.45% (1.2193 => 1.2858, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.39% (0.2988 => 0.3149, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3192 => 0.3362, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.29% (0.9199 => 0.9686, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.24% (0.3453 => 0.3634, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.20% (16.6129 => 17.4773, std. dev.: 0.0320) MultiSource/Applications/SPASS/SPASS: 5.20% (13.8202 => 14.5392, std. dev.: 0.0159) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.08% (0.4390 => 0.4613, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.05% (0.4016 => 0.4219, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.04% (0.3534 => 0.3712, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (0.3756 => 0.3945, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.02% (0.5577 => 0.5857, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.01% (0.3293 => 0.3458, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.98% (13.2842 => 13.9464, std. dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/moments: 4.94% (0.3868 => 0.4059, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.79% (0.2925 => 0.3065, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (1.4563 => 1.5239, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.57% (1.3819 => 1.4450, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.56% (1.3813 => 1.4443, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.51% (1.1364 => 1.1877, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.46% (1.0594 => 1.1067, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.43% (7.2180 => 7.5377, std. dev.: 0.0089) MultiSource/Benchmarks/MallocBench/gs/gs: 4.41% (3.8646 => 4.0349, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.41% (0.3246 => 0.3389, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.5637 => 0.5884, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.37% (1.1061 => 1.1544, std. dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.36% (0.2914 => 0.3041, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.34% (0.7506 => 0.7832, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 4.22% (0.8310 => 0.8661, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.17% (1.9270 => 2.0073, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.3245 => 1.3793, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.06% (0.7460 => 0.7763, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (4.3801 => 4.5561, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.2292 => 1.2773, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.86% (0.4791 => 0.4976, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.80% (3.6692 => 3.8088, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3220 => 0.3341, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (4.4433 => 4.6099, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.73% (0.3755 => 0.3895, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.67% (2.1791 => 2.2591, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.61% (4.9865 => 5.1663, std. dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.52% (0.6283 => 0.6504, std. dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 3.37% (0.2995 => 0.3096, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.35% (0.3131 => 0.3236, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.29% (0.8698 => 0.8984, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.22% (3.1889 => 3.2917, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.13% (1.1333 => 1.1688, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.00% (0.6135 => 0.6319, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (6.5754 => 6.7726, std. dev.: 0.0142) MultiSource/Applications/JM/lencod/lencod: 2.88% (14.8535 => 15.2818, std. dev.: 0.0139) MultiSource/Applications/ClamAV/clamscan: 2.64% (14.5298 => 14.9135, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 2.61% (8.4961 => 8.7182, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.60% (16.2614 => 16.6850, std. dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.55% (2.1007 => 2.1543, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.23% (3.2742 => 3.3472, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.07% (1.5188 => 1.5503, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 1.84% (4.6629 => 4.7487, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 1.70% (0.6250 => 0.6356, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (0.9108 => 0.9243, std. dev.: 0.0037) MultiSource/Applications/lemon/lemon: 1.39% (1.0313 => 1.0456, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.04% (3.7467 => 3.7856, std. dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 76.97% (0.1824 => 0.3228, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 56.66% (0.1322 => 0.2071, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 26.42% (1.8175 => 2.2976, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel-2: 6.95% (1.2998 => 1.3902, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.97% (1.5824 => 1.6768, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.07% (0.9996 => 1.0503, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 4.25% (7.4271 => 7.7426, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7311, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (12.4560 => 12.8585, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4756, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.42% (2.8606 => 2.9297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.36% (1.7688 => 1.8106, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.16% (2.0200 => 2.0636, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5623, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.11% (4.1080 => 4.1946, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 2.01% (0.6159 => 0.6283, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5331, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 1.26% (2.4679 => 2.4991, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.25% (10.7476 => 10.8819, std. dev.: 0.0384) SingleSource/Benchmarks/Shootout-C++/hash2: 1.22% (3.1736 => 3.2124, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.97% (0.4657 => 0.3960, std. dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.90% (22.5627 => 21.2312, std. dev.: 0.0132) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2308 => 1.0966, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.88% (2.6470 => 2.5177, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9821, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.41% (1.9762 => 1.9089, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.58% (3.0263 => 2.9483, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4867 => 0.4748, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2243, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5051, std. dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.85% (20.3410 => 19.9643, std. dev.: 0.0385) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3456, std. dev.: 0.0127) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7609, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.59% (7.1097 => 6.9965, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.5254 => 2.4918, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8671, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -1.27% (28.2225 => 27.8644, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2206, std. dev.: 0.0074) MultiSource/Applications/lua/lua: -1.16% (26.5159 => 26.2079, std. dev.: 0.0369) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2585, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 22 23:14:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 01:14:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120723061454.845952A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2288?compare_to=2285&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2288, Order: 160615, Start Time: 2012-07-23 04:56:50, End Time: 2012-07-23 06:15:13 To: 2285, Order: 160614, Start Time: 2012-07-23 00:20:43, End Time: 2012-07-23 01:39:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (74 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (771 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.48% (10.3673 => 13.7348, std. dev.: 0.0105) SingleSource/UnitTests/ObjC/trivial-interface: 11.98% (0.3473 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.87% (0.3497 => 0.3912, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.86% (0.3516 => 0.3933, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.71% (1.1194 => 1.2505, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3543 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3561 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.32% (0.3694 => 0.4112, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.96% (0.3886 => 0.4312, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.82% (2.2022 => 2.3965, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.09% (1.7609 => 1.9033, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.73% (0.3817 => 0.4074, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.70% (0.6030 => 0.6434, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.65% (0.5925 => 0.6319, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.00% (0.2065 => 0.2189, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.77% (10.4361 => 11.0387, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.60% (0.3177 => 0.3355, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.50% (0.7326 => 0.7729, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 4.88% (0.3282 => 0.3442, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.74% (7.0540 => 7.3886, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.4879 => 0.5105, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.36% (0.4615 => 0.4816, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 3.91% (0.7433 => 0.7724, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.67% (4.9449 => 5.1265, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.60% (5.0018 => 5.1817, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.59% (0.8172 => 0.8465, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 3.55% (9.4845 => 9.8214, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.39% (0.5569 => 0.5758, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.15% (8.1363 => 8.3922, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 3.11% (0.7835 => 0.8079, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.11% (0.5860 => 0.6042, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.05% (4.2646 => 4.3945, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (14.3668 => 14.7996, std. dev.: 0.0054) MultiSource/Applications/hbd/hbd: 2.79% (1.5603 => 1.6038, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 2.72% (5.7591 => 5.9159, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.65% (1.3050 => 1.3396, std. dev.: 0.0040) MultiSource/Applications/d/make_dparser: 2.58% (3.3354 => 3.4215, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.56% (0.4103 => 0.4208, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 2.45% (0.4289 => 0.4394, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.43% (1.5415 => 1.5789, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.42% (2.0665 => 2.1166, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.33% (0.4636 => 0.4744, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.33% (1.1642 => 1.1913, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.26% (0.8067 => 0.8249, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.25% (2.0273 => 2.0730, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.10% (0.5105 => 0.5212, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.95% (0.9765 => 0.9955, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: 1.94% (0.6456 => 0.6581, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.83% (3.8723 => 3.9433, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.69% (0.5981 => 0.6082, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.68% (0.6675 => 0.6787, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.66% (17.1811 => 17.4664, std. dev.: 0.0500) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.66% (0.6450 => 0.6557, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.65% (1.2842 => 1.3054, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.53% (2.2024 => 2.2360, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.29% (1.5859 => 1.6063, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.28% (1.1840 => 1.1992, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 1.23% (0.8921 => 0.9031, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9756, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.66% (5.3999 => 5.7597, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.21% (3.6395 => 3.7564, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5086 => 1.5344, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8419, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.0554 => 1.0730, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.63% (3.1578 => 3.2094, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6891, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2258, std. dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.04% (3.2416 => 3.2754, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.10% (5.2763 => 3.1607, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.45% (5.3855 => 3.6917, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.65% (5.3526 => 3.7122, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.94% (2.9384 => 2.5581, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -10.28% (22.1758 => 19.8960, std. dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -4.80% (54.1659 => 51.5666, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.50% (3.8922 => 3.8338, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.70% (1.2373 => 1.1049, std. dev.: 0.0202) SingleSource/Benchmarks/Misc/mandel-2: -9.11% (1.5373 => 1.3973, std. dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.45% (2.7294 => 2.5533, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5957, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.21% (8.1563 => 7.8941, std. dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4793, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.16% (8.6802 => 8.4063, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.28% (1.7254 => 1.6861, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.14% (10.2830 => 10.0632, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.62% (1.3677 => 1.3455, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.58% (2.0866 => 2.0536, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.43% (2.5528 => 2.5163, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.41% (12.5348 => 12.3583, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.40% (4.2280 => 4.1687, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 00:42:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 02:42:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120723074213.CFF412A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2289?compare_to=2286&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2289, Order: 160615, Start Time: 2012-07-23 04:56:58, End Time: 2012-07-23 07:42:32 To: 2286, Order: 160614, Start Time: 2012-07-23 00:20:46, End Time: 2012-07-23 03:05:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (89 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (797 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.62% (0.3446 => 0.3881, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.61% (0.3465 => 0.3902, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.57% (0.3460 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.53% (0.3496 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.49% (0.3442 => 0.3872, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.44% (0.3488 => 0.3922, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.42% (0.3469 => 0.3900, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.97% (0.3650 => 0.4087, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3643 => 0.4076, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.57% (0.3724 => 0.4155, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.95% (0.5826 => 0.6231, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.79% (0.5889 => 0.6289, std. dev.: 0.0091) SingleSource/UnitTests/ObjC++/property-reference: 5.23% (0.7171 => 0.7546, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.16% (3.5627 => 3.7466, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.08% (1.6211 => 1.7035, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.64% (0.5000 => 0.5232, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.61% (0.4361 => 0.4562, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.55% (0.4994 => 0.5221, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (1.3152 => 1.3712, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.20% (0.5900 => 0.6148, std. dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 4.19% (1.5932 => 1.6600, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.17% (0.3930 => 0.4094, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 4.07% (0.2725 => 0.2836, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.05% (0.2738 => 0.2849, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 4.05% (0.2714 => 0.2824, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.98% (0.2792 => 0.2903, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.97% (2.7292 => 2.8376, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.93% (0.2875 => 0.2988, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.92% (0.4029 => 0.4187, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 3.87% (4.2109 => 4.3739, std. dev.: 0.0150) MultiSource/Applications/hbd/hbd: 3.84% (0.9697 => 1.0069, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.81% (0.2729 => 0.2833, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.80% (0.5026 => 0.5217, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/random: 3.78% (0.2803 => 0.2909, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.75% (0.3096 => 0.3212, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.74% (1.0781 => 1.1184, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 3.66% (0.9909 => 1.0272, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.2866 => 0.2970, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 3.63% (0.2813 => 0.2915, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.61% (1.9966 => 2.0687, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 3.58% (0.2823 => 0.2924, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.57% (2.0673 => 2.1412, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.49% (1.9694 => 2.0382, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 3.46% (0.3004 => 0.3108, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.41% (0.3317 => 0.3430, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.37% (0.3267 => 0.3377, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.33% (0.3124 => 0.3228, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.31% (0.3258 => 0.3366, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.24% (0.3362 => 0.3471, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.20% (0.4658 => 0.4807, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 3.06% (0.3726 => 0.3840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.05% (0.3348 => 0.3450, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.04% (4.4195 => 4.5537, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.98% (0.3890 => 0.4006, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 2.93% (2.1013 => 2.1628, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/moments: 2.91% (0.3678 => 0.3785, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 2.90% (0.3477 => 0.3578, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (2.1653 => 2.2281, std. dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 2.83% (4.6177 => 4.7486, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 2.83% (1.8794 => 1.9326, std. dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 2.80% (5.5417 => 5.6970, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3690 => 0.3791, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.4146 => 0.4257, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 2.63% (0.4251 => 0.4363, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.47% (23.5202 => 24.1023, std. dev.: 0.0223) MultiSource/Applications/siod/siod: 2.28% (0.6634 => 0.6785, std. dev.: 0.0037) MultiSource/Applications/treecc/treecc: 2.20% (0.7875 => 0.8048, std. dev.: 0.0033) MultiSource/Applications/lua/lua: 2.19% (1.4269 => 1.4582, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 1.98% (0.5546 => 0.5656, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.07% (2.0346 => 2.0563, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.40% (5.2852 => 11.7541, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.92% (0.2162 => 0.3371, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.93% (10.7630 => 13.6617, std. dev.: 0.0136) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.72% (0.5589 => 0.6691, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/objinst: 19.38% (9.4436 => 11.2739, std. dev.: 0.0445) SingleSource/Benchmarks/Shootout/lists: 13.47% (32.9687 => 37.4100, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 7.00% (15.4430 => 16.5244, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.78% (3.3903 => 3.6202, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout/matrix: 5.41% (19.6305 => 20.6928, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 4.97% (2.8036 => 2.9430, std. dev.: 0.0191) SingleSource/Benchmarks/Misc/flops-2: 4.97% (1.8057 => 1.8954, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.07% (2.2962 => 2.3896, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.46% (3.1722 => 3.2503, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.16% (3.1728 => 3.2413, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 1.90% (15.8721 => 16.1742, std. dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/fldry: 1.79% (17.2379 => 17.5465, std. dev.: 0.0647) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 1.14% (1.5554 => 1.5732, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.42% (2.4764 => 2.3918, std. dev.: 0.0101) MultiSource/Applications/kimwitu++/kc: -1.99% (11.9555 => 11.7174, std. dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.81% (6.2401 => 4.1306, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -7.74% (0.2402 => 0.2216, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: -4.24% (14.0481 => 13.4526, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/salsa20: -3.83% (35.5013 => 34.1424, std. dev.: 0.0422) SingleSource/Benchmarks/Shootout-C++/objinst: -3.23% (12.0509 => 11.6616, std. dev.: 0.0339) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5754, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 00:54:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 02:54:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120723075452.344652A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2290?compare_to=2287&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2290, Order: 160618, Start Time: 2012-07-23 06:38:24, End Time: 2012-07-23 07:55:10 To: 2287, Order: 160615, Start Time: 2012-07-23 04:56:37, End Time: 2012-07-23 06:10:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (138 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (723 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.50% (2.0176 => 2.3304, std. dev.: 0.0124) SingleSource/UnitTests/ObjC++/property-reference-object: 10.21% (0.5818 => 0.6412, std. dev.: 0.0107) SingleSource/UnitTests/ObjC++/Hello: 9.99% (0.5748 => 0.6322, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/trivial-interface: 8.66% (0.3578 => 0.3888, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-4: 8.45% (0.3646 => 0.3954, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-2: 8.44% (0.3601 => 0.3905, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.30% (0.3650 => 0.3953, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/for-in: 8.26% (0.3789 => 0.4102, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.24% (0.3130 => 0.3388, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.19% (0.3663 => 0.3963, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-3: 8.17% (0.3623 => 0.3919, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/parameter-passing: 7.97% (0.4003 => 0.4322, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions: 7.95% (0.3914 => 0.4225, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/property: 7.94% (0.3940 => 0.4253, std. dev.: 0.0074) MultiSource/Applications/hbd/hbd: 7.42% (1.3693 => 1.4709, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (0.4328 => 0.4639, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.2721 => 0.2916, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.15% (0.7710 => 0.8261, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (3.9660 => 4.2378, std. dev.: 0.0109) MultiSource/Applications/lambda-0_1_3/lambda: 6.78% (0.7038 => 0.7515, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.55% (0.5265 => 0.5610, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.51% (0.2596 => 0.2765, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.37% (0.2761 => 0.2937, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.29% (0.3022 => 0.3212, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.25% (0.2782 => 0.2956, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.22% (0.2765 => 0.2937, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hello: 6.21% (0.2607 => 0.2769, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2760 => 0.2931, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 6.16% (0.2726 => 0.2894, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.10% (0.2966 => 0.3147, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.08% (0.3489 => 0.3701, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.06% (0.2690 => 0.2853, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1819 => 0.1929, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (0.3149 => 0.3338, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.99% (1.9828 => 2.1015, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.98% (0.3580 => 0.3794, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.2937 => 0.3112, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 5.89% (0.2988 => 0.3164, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.82% (0.6959 => 0.7364, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.80% (0.3899 => 0.4125, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.80% (0.3485 => 0.3687, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.75% (0.2696 => 0.2851, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.63% (0.4016 => 0.4242, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 5.59% (0.3453 => 0.3646, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 5.46% (0.3534 => 0.3727, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.44% (0.4379 => 0.4617, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.41% (13.8202 => 14.5681, std. dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.39% (1.2193 => 1.2850, std. dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 5.30% (16.6129 => 17.4934, std. dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/moments: 5.27% (0.3868 => 0.4072, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.24% (13.2842 => 13.9809, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.22% (0.3756 => 0.3952, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.20% (0.9199 => 0.9677, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.13% (0.5577 => 0.5863, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.82% (1.3813 => 1.4479, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 4.79% (0.2925 => 0.3065, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.79% (1.4563 => 1.5260, std. dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.2945 => 0.3083, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.66% (1.1364 => 1.1894, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.64% (7.2180 => 7.5526, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.3819 => 1.4457, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.57% (0.7506 => 0.7849, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.56% (1.0594 => 1.1077, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.56% (0.5637 => 0.5894, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3246 => 0.3392, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.49% (1.1061 => 1.1558, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 4.48% (0.8310 => 0.8682, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.2914 => 0.3043, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 4.36% (3.8646 => 4.0332, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 4.36% (1.9270 => 2.0110, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.32% (1.3245 => 1.3817, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.2292 => 1.2817, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.17% (0.7460 => 0.7771, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.15% (4.3801 => 4.5618, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.07% (0.3755 => 0.3908, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.07% (3.6692 => 3.8185, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.99% (0.4791 => 0.4982, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (4.4433 => 4.6175, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.80% (4.9865 => 5.1760, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.74% (2.1791 => 2.2606, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 3.73% (0.3220 => 0.3340, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.53% (0.6283 => 0.6505, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.50% (0.8698 => 0.9002, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.47% (0.2995 => 0.3099, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.28% (3.1889 => 3.2934, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.26% (1.1333 => 1.1702, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.16% (6.5754 => 6.7834, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 2.97% (14.8535 => 15.2948, std. dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.87% (0.6135 => 0.6311, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 2.78% (14.5298 => 14.9344, std. dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 2.74% (16.2614 => 16.7070, std. dev.: 0.0089) MultiSource/Benchmarks/McCat/05-eks/eks: 2.60% (0.4113 => 0.4220, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.58% (2.1007 => 2.1548, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (3.2742 => 3.3510, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.25% (1.5188 => 1.5529, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 1.92% (4.6629 => 4.7525, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 1.87% (0.6250 => 0.6367, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.72% (0.6744 => 0.6860, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.60% (0.9108 => 0.9254, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.53% (1.0313 => 1.0471, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.18% (3.7467 => 3.7908, std. dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.03% (6.2785 => 6.3430, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.08% (0.1824 => 0.3230, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 56.43% (0.1322 => 0.2068, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 27.02% (1.8175 => 2.3086, std. dev.: 0.0389) SingleSource/Benchmarks/Misc/mandel-2: 7.72% (1.2998 => 1.4002, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.98% (1.5824 => 1.6770, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.99% (0.9996 => 1.0495, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: 4.43% (7.4271 => 7.7564, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7317, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.28% (12.4560 => 12.8642, std. dev.: 0.0228) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4755, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.41% (2.8606 => 2.9295, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.39% (1.7688 => 1.8110, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.18% (2.0200 => 2.0640, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5624, std. dev.: 0.0185) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.10% (4.1080 => 4.1943, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 2.09% (0.6159 => 0.6288, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5089 => 1.5361, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 1.27% (2.4679 => 2.4992, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0219) MultiSource/Applications/SPASS/SPASS: 1.01% (10.7476 => 10.8557, std. dev.: 0.0346) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.81% (22.5627 => 21.2526, std. dev.: 0.3943) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.44% (0.0997 => 0.0853, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.79% (1.2308 => 1.1103, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.81% (2.6470 => 2.5198, std. dev.: 0.0081) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9821, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.42% (1.9762 => 1.9086, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.28% (20.3410 => 19.6736, std. dev.: 0.1446) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9472, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.01% (6.6320 => 6.4988, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/lists: -1.92% (6.3560 => 6.2338, std. dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.88% (0.6589 => 0.6465, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.61% (9.9194 => 9.7598, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9963, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2177, std. dev.: 0.0348) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2617, std. dev.: 0.0023) MultiSource/Applications/lua/lua: -1.01% (26.5159 => 26.2473, std. dev.: 0.0234) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 01:05:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 03:05:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120723080509.844DB2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2291?compare_to=2288&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2291, Order: 160618, Start Time: 2012-07-23 06:43:29, End Time: 2012-07-23 08:05:28 To: 2288, Order: 160615, Start Time: 2012-07-23 04:56:50, End Time: 2012-07-23 06:15:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (51 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (794 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.79% (55.6629 => 56.6577, std. dev.: 0.0606) SingleSource/Benchmarks/Misc/lowercase: 1.27% (7.9418 => 8.0425, std. dev.: 0.0097) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.39% (10.3673 => 13.8287, std. dev.: 0.0890) SingleSource/UnitTests/ObjC/block-byref-aggr: 31.96% (0.3817 => 0.5037, std. dev.: 0.0377) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3543 => 0.3981, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.09% (0.3473 => 0.3893, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3497 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.89% (0.3516 => 0.3934, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 11.80% (0.3543 => 0.3961, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.76% (1.1194 => 1.2510, std. dev.: 0.0125) SingleSource/UnitTests/ObjC/synchronized: 11.71% (0.3561 => 0.3978, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.48% (0.3694 => 0.4118, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.94% (0.3886 => 0.4311, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.70% (0.3927 => 0.4347, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.49% (2.2022 => 2.4111, std. dev.: 0.0426) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.89% (1.7609 => 1.9175, std. dev.: 0.0302) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (0.1622 => 0.1733, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.82% (0.1584 => 0.1692, std. dev.: 0.0041) SingleSource/UnitTests/ObjC++/Hello: 6.72% (0.5925 => 0.6323, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.68% (0.6030 => 0.6433, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.43% (0.7326 => 0.7797, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 6.27% (10.4361 => 11.0905, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.63% (7.0540 => 7.4514, std. dev.: 0.1402) SingleSource/Benchmarks/Misc/oourafft: 5.55% (0.3282 => 0.3464, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.86% (9.4845 => 9.8506, std. dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 3.75% (0.7433 => 0.7712, std. dev.: 0.0031) MultiSource/Applications/spiff/spiff: 3.65% (0.7835 => 0.8121, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.32% (0.3826 => 0.3953, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 2.87% (5.7591 => 5.9242, std. dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.78% (0.4636 => 0.4765, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 2.75% (1.5603 => 1.6032, std. dev.: 0.0096) MultiSource/Applications/d/make_dparser: 2.73% (3.3354 => 3.4266, std. dev.: 0.0069) MultiSource/Applications/Burg/burg: 2.59% (1.1642 => 1.1943, std. dev.: 0.0072) MultiSource/Applications/treecc/treecc: 2.32% (2.0273 => 2.0743, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.5105 => 0.5218, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 1.95% (0.6456 => 0.6582, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.94% (3.8723 => 3.9476, std. dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.80% (0.6675 => 0.6795, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.74% (17.1811 => 17.4793, std. dev.: 0.0157) MultiSource/Applications/hexxagon/hexxagon: 1.71% (1.2842 => 1.3062, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.53% (1.5859 => 1.6101, std. dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9756, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.53% (5.3999 => 5.7524, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7528, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0561, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8417, std. dev.: 0.0326) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.48% (3.1578 => 3.2044, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.44% (2.6546 => 2.6928, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.05% (3.2416 => 3.2756, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 1.02% (9.1159 => 9.2088, std. dev.: 0.0213) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.15% (5.2763 => 3.1578, std. dev.: 0.0601) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.14% (5.3855 => 3.7085, std. dev.: 0.0542) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.31% (5.3526 => 3.7304, std. dev.: 0.0548) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.03% (2.9384 => 2.5555, std. dev.: 0.0343) MultiSource/Applications/ClamAV/clamscan: -10.05% (22.1758 => 19.9475, std. dev.: 0.0307) SingleSource/UnitTests/Vector/constpool: -4.96% (54.1659 => 51.4815, std. dev.: 0.0752) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.25% (3.8922 => 3.8437, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.59% (1.1492 => 0.7632, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.33% (0.0998 => 0.0855, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.53% (1.2373 => 1.1070, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: -8.65% (1.5373 => 1.4043, std. dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.45% (2.7294 => 2.5533, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5957, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4732, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.17% (8.6802 => 8.4054, std. dev.: 0.0751) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.10% (8.1563 => 7.9034, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.28% (1.7254 => 1.6861, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.16% (10.2830 => 10.0614, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.61% (2.0866 => 2.0530, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3743, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.53% (1.3677 => 1.3468, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.47% (2.5528 => 2.5153, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: -1.43% (12.5348 => 12.3551, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.40% (4.2280 => 4.1687, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 02:53:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 04:53:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120723095305.A2AF72A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2292?compare_to=2290&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2292, Order: 160619, Start Time: 2012-07-23 08:39:06, End Time: 2012-07-23 09:53:23 To: 2290, Order: 160618, Start Time: 2012-07-23 06:38:24, End Time: 2012-07-23 07:55:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (149 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: 1.29% (19.6736 => 19.9267, std. dev.: 0.0462) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.04% (26.1163 => 25.8450, std. dev.: 0.0282) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.89% (2.0176 => 2.3381, std. dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference-object: 10.14% (0.5818 => 0.6408, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 9.93% (0.5748 => 0.6319, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 9.02% (0.7061 => 0.7698, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: 8.61% (0.3578 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3601 => 0.3904, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3130 => 0.3392, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.27% (0.3650 => 0.3952, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.24% (0.3663 => 0.3965, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 8.23% (0.3646 => 0.3946, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 8.13% (0.3789 => 0.4097, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.08% (1.3693 => 1.4800, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: 8.07% (0.4003 => 0.4326, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.05% (0.3940 => 0.4257, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.02% (0.3914 => 0.4228, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.33% (0.7038 => 0.7554, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (0.4328 => 0.4637, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.02% (0.2721 => 0.2912, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.94% (0.7710 => 0.8245, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.92% (3.9660 => 4.2403, std. dev.: 0.0045) MultiSource/Applications/viterbi/viterbi: 6.83% (0.1478 => 0.1579, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.69% (0.2781 => 0.2967, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.52% (0.4062 => 0.4327, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.51% (0.2596 => 0.2765, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.46% (0.5265 => 0.5605, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.35% (0.3022 => 0.3214, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.35% (0.2726 => 0.2899, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2782 => 0.2958, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.22% (0.2765 => 0.2937, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2690 => 0.2857, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2760 => 0.2931, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.18% (0.2655 => 0.2819, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hello: 6.18% (0.2607 => 0.2768, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.15% (1.9828 => 2.1047, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.10% (0.3489 => 0.3702, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.09% (0.3580 => 0.3798, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2628 => 0.2788, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.04% (0.2966 => 0.3145, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2761 => 0.2927, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.92% (0.3899 => 0.4130, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.91% (0.3485 => 0.3691, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.90% (0.2696 => 0.2855, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 5.84% (0.3149 => 0.3333, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.83% (0.3107 => 0.3288, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.82% (0.6959 => 0.7364, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 5.76% (0.2988 => 0.3160, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 5.61% (0.3192 => 0.3371, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.59% (0.4379 => 0.4624, std. dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 5.53% (13.8202 => 14.5841, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/sieve: 5.50% (0.3453 => 0.3643, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.42% (0.4390 => 0.4628, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.42% (1.2193 => 1.2854, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 5.40% (16.6129 => 17.5103, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.38% (0.4016 => 0.4232, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.33% (0.9199 => 0.9689, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.30% (0.3868 => 0.4073, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (0.3756 => 0.3954, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.26% (0.3534 => 0.3720, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.20% (0.5577 => 0.5867, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 5.19% (0.3293 => 0.3464, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.13% (13.2842 => 13.9659, std. dev.: 0.0202) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (1.3813 => 1.4504, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.94% (1.4563 => 1.5283, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.85% (1.1061 => 1.1597, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.84% (1.1364 => 1.1914, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.80% (1.3819 => 1.4482, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 4.72% (0.2945 => 0.3084, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.70% (0.2914 => 0.3051, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.63% (3.8646 => 4.0435, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 4.63% (1.0594 => 1.1084, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3246 => 0.3396, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.5637 => 0.5895, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.57% (7.2180 => 7.5481, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/football/football: 4.52% (0.8310 => 0.8686, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 4.50% (0.7506 => 0.7844, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.50% (1.3245 => 1.3841, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 4.41% (1.2292 => 1.2834, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.37% (1.9270 => 2.0113, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.25% (3.6692 => 3.8250, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.17% (0.7460 => 0.7771, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.13% (0.4791 => 0.4989, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.07% (4.3801 => 4.5584, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.05% (4.9865 => 5.1886, std. dev.: 0.0153) MultiSource/Applications/siod/siod: 4.04% (2.1791 => 2.2671, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 3.94% (0.3220 => 0.3347, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.94% (0.3755 => 0.3903, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.90% (4.4433 => 4.6165, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.68% (0.6283 => 0.6514, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.58% (0.3131 => 0.3243, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.54% (0.2995 => 0.3101, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 3.41% (3.1889 => 3.2978, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.31% (1.1333 => 1.1708, std. dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 3.23% (6.5754 => 6.7877, std. dev.: 0.0147) MultiSource/Applications/JM/lencod/lencod: 3.09% (14.8535 => 15.3128, std. dev.: 0.0166) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.06% (0.6135 => 0.6323, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 2.90% (8.4961 => 8.7424, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 2.88% (16.2614 => 16.7290, std. dev.: 0.0132) MultiSource/Applications/ClamAV/clamscan: 2.85% (14.5298 => 14.9439, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.61% (2.1007 => 2.1555, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (3.2742 => 3.3501, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (1.5188 => 1.5531, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 2.07% (4.6629 => 4.7596, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 2.02% (0.6250 => 0.6376, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.88% (0.6744 => 0.6871, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.73% (1.0313 => 1.0491, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.66% (0.9108 => 0.9259, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.36% (3.7467 => 3.7975, std. dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 1.22% (33.2944 => 33.7008, std. dev.: 0.0294) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 76.97% (0.1824 => 0.3228, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 56.43% (0.1322 => 0.2068, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 27.30% (1.8175 => 2.3137, std. dev.: 0.0217) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.99% (1.2998 => 1.3777, std. dev.: 0.0181) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.95% (1.5824 => 1.6766, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.08% (0.9996 => 1.0504, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: 4.27% (7.4271 => 7.7444, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.2619 => 11.7304, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (12.4560 => 12.8580, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4742, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.43% (1.7688 => 1.8117, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.41% (2.8606 => 2.9295, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.14% (2.0200 => 2.0633, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5624, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.10% (4.1080 => 4.1944, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 2.08% (0.6159 => 0.6287, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.68% (0.8273 => 0.8412, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.56% (1.4298 => 1.4521, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5089 => 1.5324, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash2: 1.34% (3.1736 => 3.2160, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 1.27% (2.4679 => 2.4992, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.07% (10.7476 => 10.8621, std. dev.: 0.0293) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.70% (22.5627 => 21.2757, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.44% (1.2308 => 1.1023, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3067, std. dev.: 0.0030) SingleSource/UnitTests/Vector/multiplies: -4.85% (2.6470 => 2.5185, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9821, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.43% (1.9762 => 1.9085, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9477, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.04% (20.3410 => 19.9267, std. dev.: 0.0462) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2352, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5080, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.81% (28.2225 => 27.7128, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7607, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9963, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8615, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.31% (2.5254 => 2.4923, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1706, std. dev.: 0.0386) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2515, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2232, std. dev.: 0.0130) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 02:59:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 04:59:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120723095918.7DC172A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2293?compare_to=2291&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2293, Order: 160619, Start Time: 2012-07-23 08:39:16, End Time: 2012-07-23 09:58:14 To: 2291, Order: 160618, Start Time: 2012-07-23 06:43:29, End Time: 2012-07-23 08:05:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (77 on baseline) Performance Improvements: 1 (28 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (768 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.58% (13.8287 => 14.1852, std. dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.37% (79.6076 => 80.7016, std. dev.: 0.3804) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.60% (0.8639 => 0.8501, std. dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.83% (10.3673 => 14.1852, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.90% (1.1194 => 1.2526, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 11.52% (0.3473 => 0.3873, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.41% (0.3497 => 0.3896, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3543 => 0.3945, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 11.29% (0.3543 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.26% (0.3516 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3694 => 0.4104, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.55% (0.3828 => 0.4232, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3927 => 0.4335, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.96% (2.2022 => 2.3996, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.47% (1.7609 => 1.9101, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.03% (0.6030 => 0.6454, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.89% (0.5925 => 0.6333, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.28% (0.7326 => 0.7786, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.55% (10.4361 => 11.0158, std. dev.: 0.0295) SingleSource/Benchmarks/Misc/oourafft: 5.24% (0.3282 => 0.3454, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.22% (0.4615 => 0.4856, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.12% (0.4879 => 0.5129, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.01% (7.0540 => 7.4072, std. dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 4.21% (0.7433 => 0.7746, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.03% (0.8172 => 0.8501, std. dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.94% (0.3121 => 0.3244, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.71% (5.0018 => 5.1875, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.70% (4.9449 => 5.1278, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.67% (0.5860 => 0.6075, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 3.53% (9.4845 => 9.8196, std. dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.29% (0.5569 => 0.5752, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.25% (4.2646 => 4.4030, std. dev.: 0.0112) MultiSource/Applications/spiff/spiff: 3.20% (0.7835 => 0.8086, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.20% (0.8067 => 0.8325, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.05% (8.1363 => 8.3847, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 2.93% (1.1642 => 1.1983, std. dev.: 0.0053) MultiSource/Applications/hbd/hbd: 2.92% (1.5603 => 1.6058, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.88% (14.3668 => 14.7808, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.67% (0.3826 => 0.3928, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.63% (1.5415 => 1.5820, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.58% (5.7591 => 5.9076, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.55% (1.1861 => 1.2163, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.53% (1.3050 => 1.3380, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.47% (2.0273 => 2.0773, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash: 2.45% (0.4289 => 0.4394, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.44% (0.4103 => 0.4203, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.43% (3.3354 => 3.4166, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.36% (2.0665 => 2.1153, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 2.17% (3.8723 => 3.9563, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.12% (0.5105 => 0.5213, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.10% (0.9765 => 0.9970, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.84% (0.6450 => 0.6569, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 1.84% (0.6456 => 0.6575, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6675 => 0.6792, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.74% (1.2842 => 1.3066, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.73% (1.4186 => 1.4431, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 1.67% (0.7115 => 0.7234, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (2.2024 => 2.2388, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 1.65% (0.8921 => 0.9068, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.56% (17.1811 => 17.4490, std. dev.: 0.0121) MultiSource/Applications/siod/siod: 1.51% (2.2969 => 2.3315, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 1.30% (1.1840 => 1.1994, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.13% (2.6778 => 2.9759, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.62% (5.3999 => 5.7573, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.34% (3.6395 => 3.7611, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.70% (3.1578 => 3.2116, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8412, std. dev.: 0.0130) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5086 => 1.5338, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/whetstone: 1.65% (1.0554 => 1.0728, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.57% (1.3045 => 1.3250, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.44% (2.6546 => 2.6929, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.15% (9.1159 => 9.2203, std. dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.04% (3.2416 => 3.2752, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1286, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.19% (5.2763 => 3.1555, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.11% (5.3855 => 3.7103, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.51% (5.3526 => 3.7193, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.04% (2.9384 => 2.5551, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -10.31% (22.1758 => 19.8886, std. dev.: 0.0367) SingleSource/UnitTests/Vector/constpool: -5.17% (54.1659 => 51.3658, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.31% (3.8922 => 3.8411, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2373 => 1.1100, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel-2: -8.42% (1.5373 => 1.4079, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.46% (2.7294 => 2.5532, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5956, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.23% (8.1563 => 7.8927, std. dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4784, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (8.6802 => 8.4148, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.30% (1.7254 => 1.6857, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.12% (10.2830 => 10.0650, std. dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.65% (1.3677 => 1.3452, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.58% (2.0866 => 2.0536, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -1.54% (2.4116 => 2.3744, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.47% (2.5528 => 2.5153, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: -1.39% (12.5348 => 12.3602, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.32% (4.2280 => 4.1721, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 03:54:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 05:54:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120723105456.717B02A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2294?compare_to=2289&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2294, Order: 160618, Start Time: 2012-07-23 08:10:46, End Time: 2012-07-23 10:55:15 To: 2289, Order: 160615, Start Time: 2012-07-23 04:56:58, End Time: 2012-07-23 07:42:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (103 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (783 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.93% (0.3465 => 0.3913, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 12.91% (0.3446 => 0.3891, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.90% (0.3442 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.89% (0.3460 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.84% (0.3488 => 0.3936, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 12.79% (0.3496 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.71% (0.3469 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.36% (0.3650 => 0.4101, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.33% (0.3643 => 0.4092, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/parameter-passing: 12.03% (0.3724 => 0.4172, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.45% (0.5826 => 0.6260, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.17% (0.5889 => 0.6311, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.1620 => 0.1728, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.72% (0.7171 => 0.7581, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.23% (3.5627 => 3.7491, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.21% (1.6211 => 1.7056, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.95% (0.4361 => 0.4577, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.55% (1.3152 => 1.3751, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.53% (0.5900 => 0.6167, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 4.52% (0.4029 => 0.4211, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.48% (0.3930 => 0.4106, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.31% (0.4994 => 0.5209, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 4.27% (1.5932 => 1.6613, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.22% (0.5026 => 0.5238, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.20% (2.7292 => 2.8438, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.13% (0.2736 => 0.2849, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.12% (0.5000 => 0.5206, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.2866 => 0.2983, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.07% (0.2875 => 0.2992, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 4.06% (1.0781 => 1.1219, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.05% (4.2109 => 4.3816, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hello: 4.05% (0.2714 => 0.2824, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 4.04% (0.2725 => 0.2835, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.02% (0.2738 => 0.2848, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.96% (0.2729 => 0.2837, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.85% (0.2803 => 0.2911, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2792 => 0.2898, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.71% (1.9694 => 2.0424, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.69% (0.9909 => 1.0275, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/objinst: 3.68% (0.2823 => 0.2927, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.68% (0.3096 => 0.3210, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2750 => 0.2851, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.66% (2.0673 => 2.1430, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: 3.66% (0.2813 => 0.2916, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (1.9966 => 2.0682, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.57% (0.3195 => 0.3309, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.54% (0.2911 => 0.3014, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.53% (0.3004 => 0.3110, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.52% (0.3267 => 0.3382, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.46% (0.3348 => 0.3464, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.46% (0.3124 => 0.3232, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.44% (0.3317 => 0.3431, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.42% (0.3362 => 0.3477, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.41% (0.3258 => 0.3369, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.37% (5.5417 => 5.7286, std. dev.: 0.0035) MultiSource/Applications/hbd/hbd: 3.32% (0.9697 => 1.0019, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 3.30% (2.1013 => 2.1707, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.30% (0.3060 => 0.3161, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.26% (0.3890 => 0.4017, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.23% (0.3282 => 0.3388, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (0.4658 => 0.4808, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 3.15% (2.1653 => 2.2336, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.3625 => 0.3738, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3726 => 0.3842, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.11% (0.3477 => 0.3585, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.07% (4.4195 => 4.5550, std. dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 2.99% (4.6177 => 4.7560, std. dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/moments: 2.99% (0.3678 => 0.3788, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.95% (0.3690 => 0.3799, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.87% (0.4146 => 0.4265, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.3903 => 0.4013, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.73% (0.4251 => 0.4367, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.69% (0.7875 => 0.8087, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (1.8794 => 1.9298, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.64% (0.3981 => 0.4086, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.60% (0.3845 => 0.3945, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 2.54% (23.5202 => 24.1170, std. dev.: 0.0065) MultiSource/Applications/lua/lua: 2.52% (1.4269 => 1.4629, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.42% (0.4139 => 0.4239, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 2.38% (0.5546 => 0.5678, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.28% (0.6634 => 0.6785, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.6435 => 0.6577, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.11% (0.5012 => 0.5118, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.20% (2.0346 => 2.0591, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.40% (5.2852 => 11.7541, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.18% (0.2162 => 0.3355, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.92% (10.7630 => 13.6601, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.00% (0.5589 => 0.6707, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/objinst: 19.25% (9.4436 => 11.2614, std. dev.: 0.0484) SingleSource/Benchmarks/Shootout/lists: 13.44% (32.9687 => 37.3996, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: 7.02% (15.4430 => 16.5273, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.79% (3.3903 => 3.6206, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: 5.41% (19.6305 => 20.6930, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/whetstone: 5.30% (2.8036 => 2.9523, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.08% (2.2962 => 2.3899, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.40% (3.1722 => 3.2483, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (3.1728 => 3.2463, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 1.95% (15.8721 => 16.1818, std. dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: 1.32% (17.2379 => 17.4658, std. dev.: 0.0665) MultiSource/Applications/sgefa/sgefa: 1.27% (1.5554 => 1.5751, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.96% (2.4764 => 2.4031, std. dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: -1.65% (11.9555 => 11.7578, std. dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.82% (6.2401 => 4.1296, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -6.62% (0.2402 => 0.2243, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: -4.40% (14.0481 => 13.4305, std. dev.: 0.0335) SingleSource/Benchmarks/Misc/salsa20: -3.83% (35.5013 => 34.1409, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/objinst: -3.22% (12.0509 => 11.6625, std. dev.: 0.0370) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5754, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 04:35:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 06:35:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120723113536.2141D2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2295?compare_to=2292&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2295, Order: 160626, Start Time: 2012-07-23 10:21:38, End Time: 2012-07-23 11:35:54 To: 2292, Order: 160619, Start Time: 2012-07-23 08:39:06, End Time: 2012-07-23 09:53:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (154 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (705 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.68% (1.3777 => 1.4146, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.98% (55.3720 => 56.4667, std. dev.: 0.0579) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.86% (2.0176 => 2.3375, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 10.18% (0.5818 => 0.6410, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.99% (0.5748 => 0.6322, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 9.53% (0.7061 => 0.7734, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 8.55% (0.3578 => 0.3884, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3623 => 0.3926, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.36% (0.3601 => 0.3902, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.34% (0.3130 => 0.3391, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3789 => 0.4104, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 8.31% (0.3646 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.25% (0.3650 => 0.3951, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.24% (0.3663 => 0.3965, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.4003 => 0.4328, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.05% (0.3940 => 0.4257, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.97% (0.3914 => 0.4226, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.96% (1.3693 => 1.4783, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.40% (0.1986 => 0.2133, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 7.25% (0.7038 => 0.7548, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (0.4328 => 0.4635, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.98% (0.2721 => 0.2911, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (3.9660 => 4.2401, std. dev.: 0.0093) SingleSource/Regression/C++/ofstream_ctor: 6.83% (0.2781 => 0.2971, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.81% (0.7710 => 0.8235, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.55% (0.4062 => 0.4328, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.53% (0.5265 => 0.5609, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.32% (0.3022 => 0.3213, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.29% (0.2607 => 0.2771, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.25% (0.2782 => 0.2956, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.25% (0.2655 => 0.2821, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.22% (0.2765 => 0.2937, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2690 => 0.2857, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2760 => 0.2931, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.2937 => 0.3117, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2628 => 0.2789, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.13% (0.2726 => 0.2893, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.09% (1.9828 => 2.1036, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.07% (0.2966 => 0.3146, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2761 => 0.2928, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.05% (0.3489 => 0.3700, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.03% (0.3580 => 0.3796, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.98% (0.3899 => 0.4132, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 5.91% (0.3149 => 0.3335, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.3107 => 0.3290, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.86% (0.6959 => 0.7367, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.86% (0.2696 => 0.2854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.83% (0.3192 => 0.3378, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.80% (0.3485 => 0.3687, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.76% (0.4390 => 0.4643, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 5.76% (0.2988 => 0.3160, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.61% (13.8202 => 14.5961, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.58% (0.5577 => 0.5888, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.55% (16.6129 => 17.5348, std. dev.: 0.0146) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4379 => 0.4622, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 5.47% (0.3453 => 0.3642, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (1.2193 => 1.2859, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.35% (0.4016 => 0.4231, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.26% (0.9199 => 0.9683, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 5.25% (0.3293 => 0.3466, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (0.3756 => 0.3953, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.23% (0.3534 => 0.3719, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.22% (0.3868 => 0.4070, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.17% (13.2842 => 13.9708, std. dev.: 0.0206) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.2925 => 0.3076, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.10% (1.3813 => 1.4517, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.10% (1.4563 => 1.5305, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (1.3819 => 1.4519, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.99% (0.2243 => 0.2355, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.90% (1.0594 => 1.1113, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.81% (0.3246 => 0.3402, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.75% (1.1364 => 1.1904, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 4.72% (0.7506 => 0.7860, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.68% (3.8646 => 4.0455, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 4.65% (0.2945 => 0.3082, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.62% (1.9270 => 2.0161, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.62% (7.2180 => 7.5516, std. dev.: 0.0069) MultiSource/Applications/Burg/burg: 4.62% (1.1061 => 1.1572, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 4.60% (0.8310 => 0.8692, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.53% (0.2914 => 0.3046, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.52% (0.5637 => 0.5892, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.49% (1.3245 => 1.3840, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.30% (1.2292 => 1.2820, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.22% (0.7460 => 0.7775, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.13% (4.3801 => 4.5610, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (3.6692 => 3.8195, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.05% (0.3755 => 0.3907, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.03% (2.1791 => 2.2670, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.03% (0.4791 => 0.4984, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (4.4433 => 4.6170, std. dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.85% (4.9865 => 5.1786, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.72% (0.6283 => 0.6517, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.71% (0.2859 => 0.2965, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.59% (0.8698 => 0.9010, std. dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 3.57% (0.2995 => 0.3102, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 3.55% (0.3131 => 0.3242, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.53% (1.1333 => 1.1733, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.39% (3.1889 => 3.2970, std. dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: 3.20% (6.5754 => 6.7860, std. dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.18% (0.6135 => 0.6330, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 3.12% (14.8535 => 15.3163, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 3.00% (16.2614 => 16.7492, std. dev.: 0.0185) MultiSource/Benchmarks/mafft/pairlocalalign: 2.91% (8.4961 => 8.7437, std. dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: 2.83% (14.5298 => 14.9417, std. dev.: 0.0097) MultiSource/Benchmarks/McCat/05-eks/eks: 2.65% (0.4113 => 0.4222, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.58% (2.1007 => 2.1549, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (1.5188 => 1.5545, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (3.2742 => 3.3488, std. dev.: 0.0195) MultiSource/Applications/oggenc/oggenc: 2.11% (4.6629 => 4.7613, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 2.03% (0.6250 => 0.6377, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.72% (0.9108 => 0.9265, std. dev.: 0.0049) MultiSource/Applications/lemon/lemon: 1.66% (1.0313 => 1.0484, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 1.63% (0.6744 => 0.6854, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 1.39% (33.2944 => 33.7576, std. dev.: 0.0104) MultiSource/Applications/lua/lua: 1.34% (3.7467 => 3.7968, std. dev.: 0.0140) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (6.2785 => 6.3418, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.08% (0.1824 => 0.3230, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 56.58% (0.1322 => 0.2070, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.78% (1.8175 => 2.2861, std. dev.: 0.0429) SingleSource/Benchmarks/Misc/mandel-2: 8.83% (1.2998 => 1.4146, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.95% (1.5824 => 1.6766, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.90% (0.9996 => 1.0486, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.83% (0.2093 => 0.2194, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 4.28% (7.4271 => 7.7449, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.2619 => 11.7302, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9869, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (12.4560 => 12.8571, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4758, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.00% (1.9199 => 1.9775, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.44% (1.7688 => 1.8119, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.41% (2.8606 => 2.9295, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.17% (2.0200 => 2.0639, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: 2.14% (2.5089 => 2.5625, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.12% (4.1080 => 4.1949, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 2.08% (0.6159 => 0.6287, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5342, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 1.26% (2.4679 => 2.4991, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.16% (3.1736 => 3.2103, std. dev.: 0.0066) MultiSource/Applications/SPASS/SPASS: 1.04% (10.7476 => 10.8591, std. dev.: 0.0424) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.69% (22.5627 => 21.2781, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.54% (0.0997 => 0.0852, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.42% (1.2308 => 1.1025, std. dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3108, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -4.82% (2.6470 => 2.5193, std. dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9823, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.34% (1.9762 => 1.9101, std. dev.: 0.0093) MultiSource/Applications/spiff/spiff: -2.65% (3.0263 => 2.9462, std. dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2227, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.92% (20.3410 => 19.9511, std. dev.: 0.0359) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5105, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7142, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7605, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9962, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0136) MultiSource/Applications/minisat/minisat: -1.37% (9.3358 => 9.2080, std. dev.: 0.0106) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2577, std. dev.: 0.0052) MultiSource/Applications/lua/lua: -1.02% (26.5159 => 26.2454, std. dev.: 0.0196) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 04:47:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 06:47:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120723114713.38CAD2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2296?compare_to=2293&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2296, Order: 160626, Start Time: 2012-07-23 10:28:33, End Time: 2012-07-23 11:47:32 To: 2293, Order: 160619, Start Time: 2012-07-23 08:39:16, End Time: 2012-07-23 09:58:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (73 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (772 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.89% (10.3673 => 14.1923, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.13% (1.1194 => 1.2552, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/trivial-interface: 11.58% (0.3473 => 0.3875, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.38% (0.3497 => 0.3895, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.38% (0.3516 => 0.3916, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/exceptions-4: 11.26% (0.3543 => 0.3942, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.26% (0.3543 => 0.3942, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.26% (0.3561 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.88% (0.3694 => 0.4096, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: 10.71% (0.3828 => 0.4238, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.36% (0.3927 => 0.4334, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.95% (2.2022 => 2.3993, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.58% (1.7609 => 1.9119, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.00% (0.6030 => 0.6452, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.97% (0.5925 => 0.6338, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.32% (0.7326 => 0.7789, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 5.59% (10.4361 => 11.0199, std. dev.: 0.0097) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.45% (0.3177 => 0.3350, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 5.24% (0.3282 => 0.3454, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.81% (7.0540 => 7.3930, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.72% (0.4615 => 0.4833, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.71% (0.4879 => 0.5109, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 4.13% (0.7433 => 0.7740, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.61% (5.0018 => 5.1825, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (4.9449 => 5.1207, std. dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 3.52% (9.4845 => 9.8181, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.39% (0.5569 => 0.5758, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.39% (0.8172 => 0.8449, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.29% (0.3162 => 0.3266, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 3.20% (0.7835 => 0.8086, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.02% (4.2646 => 4.3935, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.02% (0.5860 => 0.6037, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.98% (8.1363 => 8.3786, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.85% (0.4103 => 0.4220, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.85% (14.3668 => 14.7758, std. dev.: 0.0120) MultiSource/Applications/hbd/hbd: 2.78% (1.5603 => 1.6037, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.77% (1.1861 => 1.2189, std. dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.4636 => 0.4764, std. dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 2.64% (5.7591 => 5.9110, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.60% (1.5415 => 1.5816, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.54% (1.3050 => 1.3381, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash: 2.49% (0.4289 => 0.4396, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.49% (2.0273 => 2.0777, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.47% (2.0665 => 2.1175, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.47% (1.1642 => 1.1929, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.43% (3.3354 => 3.4165, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.32% (0.8067 => 0.8254, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.01% (0.9765 => 0.9961, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.00% (0.5105 => 0.5207, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 1.97% (0.6456 => 0.6583, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.76% (2.2024 => 2.2412, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.75% (3.8723 => 3.9400, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.73% (1.4186 => 1.4432, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.66% (0.6675 => 0.6786, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.59% (1.2842 => 1.3046, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.58% (17.1811 => 17.4524, std. dev.: 0.0424) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.55% (1.5859 => 1.6105, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.55% (0.6450 => 0.6550, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 1.30% (0.8921 => 0.9037, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9756, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.59% (5.3999 => 5.7556, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.39% (3.6395 => 3.7628, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.74% (11.6436 => 11.8467, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.50% (3.1578 => 3.2051, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6884, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2241, std. dev.: 0.0348) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.03% (3.2416 => 3.2750, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1285, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.16% (5.2763 => 3.1572, std. dev.: 0.0114) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.20% (5.3855 => 3.7054, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.49% (5.3526 => 3.7207, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.12% (2.9384 => 2.5529, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.37% (22.1758 => 19.8767, std. dev.: 0.0435) SingleSource/UnitTests/Vector/constpool: -5.13% (54.1659 => 51.3861, std. dev.: 0.0266) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.56% (3.8922 => 3.8313, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.63% (0.0998 => 0.0842, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -10.21% (1.2373 => 1.1110, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -7.14% (1.5373 => 1.4276, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.45% (2.7294 => 2.5533, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5956, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4832, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.12% (8.1563 => 7.9015, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.6802 => 8.4301, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.28% (1.7254 => 1.6861, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.14% (10.2830 => 10.0628, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.05% (1.3677 => 1.3397, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.60% (2.0866 => 2.0533, std. dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3743, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.50% (2.5528 => 2.5145, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.47% (12.5348 => 12.3500, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.34% (4.2280 => 4.1713, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 07:07:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 09:07:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120723140703.3CCAF2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2297?compare_to=2294&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2297, Order: 160626, Start Time: 2012-07-23 11:23:11, End Time: 2012-07-23 14:07:23 To: 2294, Order: 160618, Start Time: 2012-07-23 08:10:46, End Time: 2012-07-23 10:55:15 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (104 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (782 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 13.03% (0.3460 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.03% (0.3446 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.99% (0.3465 => 0.3915, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 12.93% (0.3442 => 0.3887, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.90% (0.3488 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.87% (0.3496 => 0.3946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.83% (0.3469 => 0.3914, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.38% (0.3643 => 0.4094, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/property: 12.36% (0.3650 => 0.4101, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.14% (0.3724 => 0.4176, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.57% (0.5826 => 0.6267, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 7.23% (0.5889 => 0.6315, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 5.76% (0.7171 => 0.7584, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.12% (1.6211 => 1.7041, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.07% (3.5627 => 3.7432, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.82% (0.4361 => 0.4571, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 4.54% (0.4029 => 0.4212, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.41% (0.5900 => 0.6160, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.38% (0.3930 => 0.4102, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.37% (1.3152 => 1.3727, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hello: 4.27% (0.2714 => 0.2830, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.27% (0.2738 => 0.2855, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.22% (0.2725 => 0.2840, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.21% (0.2875 => 0.2996, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.18% (0.2729 => 0.2843, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 4.16% (1.5932 => 1.6595, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.14% (0.2803 => 0.2919, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.14% (2.7292 => 2.8421, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.08% (0.4994 => 0.5198, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.02% (0.5026 => 0.5228, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: 4.01% (0.3096 => 0.3220, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.98% (0.2792 => 0.2903, std. dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.96% (4.2109 => 4.3776, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.94% (0.5000 => 0.5197, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 3.93% (0.2823 => 0.2934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.93% (0.3792 => 0.3941, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 3.93% (0.2750 => 0.2858, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2780 => 0.2888, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 3.87% (0.2813 => 0.2922, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.85% (2.0673 => 2.1469, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.81% (0.9909 => 1.0287, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.79% (1.0781 => 1.1190, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/except: 3.77% (0.2811 => 0.2917, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.76% (0.3267 => 0.3390, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.72% (0.3195 => 0.3314, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.70% (0.2866 => 0.2972, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.68% (0.2911 => 0.3018, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.66% (0.3362 => 0.3485, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.63% (0.3004 => 0.3113, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.60% (1.9694 => 2.0403, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 3.59% (0.3258 => 0.3375, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.55% (0.3124 => 0.3235, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.53% (0.3060 => 0.3168, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.48% (1.9966 => 2.0660, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary2: 3.47% (0.3317 => 0.3432, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.43% (5.5417 => 5.7317, std. dev.: 0.0054) MultiSource/Applications/hbd/hbd: 3.35% (0.9697 => 1.0022, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.30% (0.3726 => 0.3849, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.29% (0.3282 => 0.3390, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.29% (0.3348 => 0.3458, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.26% (0.3678 => 0.3798, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.24% (0.3890 => 0.4016, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 3.22% (0.3477 => 0.3589, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (0.3625 => 0.3741, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.18% (0.4658 => 0.4806, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.17% (0.3690 => 0.3807, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 3.13% (2.1013 => 2.1670, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash: 3.09% (0.4146 => 0.4274, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 3.01% (2.1653 => 2.2304, std. dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 2.96% (4.6177 => 4.7542, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.92% (4.4195 => 4.5484, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.87% (0.3903 => 0.4015, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.82% (0.4251 => 0.4371, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.79% (1.8794 => 1.9318, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.3845 => 0.3951, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.74% (0.3981 => 0.4090, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.65% (0.7875 => 0.8084, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.61% (23.5202 => 24.1333, std. dev.: 0.0107) MultiSource/Applications/lua/lua: 2.45% (1.4269 => 1.4619, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.42% (0.4139 => 0.4239, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.35% (0.6435 => 0.6586, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.33% (0.5546 => 0.5675, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.20% (0.6634 => 0.6780, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 2.17% (0.5012 => 0.5121, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.13% (2.0346 => 2.0575, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.40% (5.2852 => 11.7544, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 55.37% (0.2162 => 0.3359, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.93% (10.7630 => 13.6620, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.47% (0.5589 => 0.6677, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/objinst: 19.23% (9.4436 => 11.2592, std. dev.: 0.0349) SingleSource/Benchmarks/Shootout/lists: 13.48% (32.9687 => 37.4120, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 7.02% (15.4430 => 16.5277, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.75% (3.3903 => 3.6193, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 5.42% (19.6305 => 20.6939, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/whetstone: 5.16% (2.8036 => 2.9484, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8936, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.07% (2.2962 => 2.3897, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (3.1728 => 3.2464, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.30% (3.1722 => 3.2451, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 1.89% (15.8721 => 16.1719, std. dev.: 0.0079) MultiSource/Applications/sgefa/sgefa: 1.42% (1.5554 => 1.5775, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.82% (2.4764 => 2.3818, std. dev.: 0.0334) MultiSource/Applications/kimwitu++/kc: -1.62% (11.9555 => 11.7614, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.82% (6.2401 => 4.1300, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -9.41% (0.2402 => 0.2176, std. dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/dry: -4.39% (14.0481 => 13.4316, std. dev.: 0.0370) SingleSource/Benchmarks/Misc/salsa20: -3.82% (35.5013 => 34.1447, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/objinst: -2.97% (12.0509 => 11.6935, std. dev.: 0.0326) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5756, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 10:27:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 12:27:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120723172737.6B6092A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2298?compare_to=2297&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2298, Order: 160629, Start Time: 2012-07-23 14:35:07, End Time: 2012-07-23 17:19:25 To: 2297, Order: 160626, Start Time: 2012-07-23 11:23:11, End Time: 2012-07-23 14:07:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (102 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (784 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.09% (0.3446 => 0.3897, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.04% (0.3465 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.99% (0.3442 => 0.3889, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.96% (0.3488 => 0.3940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.93% (0.3496 => 0.3948, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 12.91% (0.3469 => 0.3917, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.86% (0.3460 => 0.3905, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.38% (0.3650 => 0.4102, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.33% (0.3643 => 0.4092, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.00% (0.3724 => 0.4171, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.48% (0.5826 => 0.6262, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.25% (0.5889 => 0.6316, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.48% (0.1620 => 0.1725, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.75% (0.7171 => 0.7583, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.16% (1.6211 => 1.7048, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.16% (3.5627 => 3.7465, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.77% (0.4361 => 0.4569, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.40% (0.3930 => 0.4103, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.39% (0.5900 => 0.6159, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (0.4994 => 0.5211, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.34% (0.4029 => 0.4204, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/fibo: 4.33% (0.2725 => 0.2843, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.27% (0.2738 => 0.2855, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.24% (1.3152 => 1.3710, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.22% (1.5932 => 1.6605, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.21% (0.2875 => 0.2996, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.20% (0.2714 => 0.2828, std. dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.14% (2.7292 => 2.8423, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.10% (0.5026 => 0.5232, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.07% (0.2729 => 0.2840, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.07% (0.2803 => 0.2917, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 4.04% (0.2750 => 0.2861, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.01% (0.3096 => 0.3220, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.93% (0.3362 => 0.3494, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 3.91% (0.2813 => 0.2923, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.91% (4.2109 => 4.3755, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2780 => 0.2888, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.88% (0.5000 => 0.5194, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.88% (1.0781 => 1.1199, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.87% (0.2792 => 0.2900, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 3.86% (0.2823 => 0.2932, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.86% (0.9909 => 1.0291, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.81% (2.0673 => 2.1461, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.74% (0.2911 => 0.3020, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/except: 3.74% (0.2811 => 0.2916, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.73% (0.3267 => 0.3389, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.70% (0.2866 => 0.2972, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.69% (0.3060 => 0.3173, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.66% (0.3195 => 0.3312, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.66% (0.3004 => 0.3114, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.65% (0.2736 => 0.2836, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.65% (0.3258 => 0.3377, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.63% (1.9966 => 2.0691, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.60% (1.9694 => 2.0402, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.59% (0.3124 => 0.3236, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.56% (0.3317 => 0.3435, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.52% (0.3726 => 0.3857, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.37% (0.3890 => 0.4021, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.37% (5.5417 => 5.7283, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/moments: 3.29% (0.3678 => 0.3799, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3282 => 0.3389, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.25% (0.3477 => 0.3590, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (0.4658 => 0.4808, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.20% (0.9697 => 1.0007, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.17% (0.3690 => 0.3807, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (2.1013 => 2.1667, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 2.97% (2.1653 => 2.2297, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 2.94% (0.4146 => 0.4268, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.92% (4.6177 => 4.7527, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.90% (4.4195 => 4.5475, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash2: 2.89% (0.4251 => 0.4374, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.77% (0.3903 => 0.4011, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.77% (1.8794 => 1.9314, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.3981 => 0.4089, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.3845 => 0.3949, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 2.66% (23.5202 => 24.1448, std. dev.: 0.0053) MultiSource/Applications/treecc/treecc: 2.65% (0.7875 => 0.8084, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.58% (0.6634 => 0.6805, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.43% (1.4269 => 1.4616, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.5012 => 0.5130, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.34% (0.5546 => 0.5676, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.33% (0.6435 => 0.6585, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.16% (2.0346 => 2.0583, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.40% (5.2852 => 11.7541, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 54.81% (0.2162 => 0.3347, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.93% (10.7630 => 13.6616, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.97% (0.5589 => 0.6705, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/objinst: 19.64% (9.4436 => 11.2986, std. dev.: 0.0324) SingleSource/Benchmarks/Shootout/lists: 13.42% (32.9687 => 37.3938, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops: 7.00% (15.4430 => 16.5246, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.81% (3.3903 => 3.6212, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 5.41% (2.8036 => 2.9553, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout/matrix: 5.41% (19.6305 => 20.6925, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-2: 4.90% (1.8057 => 1.8941, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.07% (2.2962 => 2.3897, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.44% (3.1722 => 3.2497, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.17% (3.1728 => 3.2418, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 1.97% (15.8721 => 16.1848, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.73% (17.2379 => 17.5368, std. dev.: 0.0884) MultiSource/Applications/sgefa/sgefa: 1.36% (1.5554 => 1.5766, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.47% (2.4764 => 2.3904, std. dev.: 0.0225) MultiSource/Applications/kimwitu++/kc: -1.56% (11.9555 => 11.7690, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.83% (6.2401 => 4.1293, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -5.75% (0.2402 => 0.2264, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: -4.23% (14.0481 => 13.4535, std. dev.: 0.0341) SingleSource/Benchmarks/Misc/salsa20: -3.81% (35.5013 => 34.1477, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/objinst: -2.69% (12.0509 => 11.7262, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5754, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 11:30:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 13:30:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120723183053.693B22A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2299?compare_to=2296&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2299, Order: 160631, Start Time: 2012-07-23 17:12:24, End Time: 2012-07-23 18:31:13 To: 2296, Order: 160626, Start Time: 2012-07-23 10:28:33, End Time: 2012-07-23 11:47:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (77 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (767 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.35% (0.8449 => 0.8563, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.39% (54.6630 => 56.5176, std. dev.: 0.1084) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.87% (10.3673 => 14.1894, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/block-byref-aggr: 17.40% (0.3817 => 0.4481, std. dev.: 0.0190) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.98% (1.1194 => 1.2535, std. dev.: 0.0128) SingleSource/UnitTests/ObjC/trivial-interface: 11.63% (0.3473 => 0.3877, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 11.44% (0.3497 => 0.3897, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.41% (0.3516 => 0.3917, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 11.37% (0.3543 => 0.3946, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.23% (0.3561 => 0.3961, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.82% (0.3828 => 0.4242, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.99% (2.2022 => 2.4002, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.35% (1.7609 => 1.9080, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 7.10% (0.6030 => 0.6458, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.09% (0.5925 => 0.6345, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.42% (0.7326 => 0.7796, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 5.91% (0.3282 => 0.3476, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.71% (10.4361 => 11.0318, std. dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.08% (7.0540 => 7.4124, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.88% (0.4879 => 0.5117, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.81% (0.4615 => 0.4837, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.78% (0.8172 => 0.8563, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 4.16% (0.7433 => 0.7742, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.74% (4.9449 => 5.1300, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.0018 => 5.1816, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (9.4845 => 9.8162, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: 3.45% (0.7835 => 0.8105, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.43% (0.5569 => 0.5760, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.24% (0.4636 => 0.4786, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.20% (4.2646 => 4.4009, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.19% (0.4103 => 0.4234, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.11% (0.5860 => 0.6042, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.07% (0.3423 => 0.3528, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.8067 => 0.8314, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.04% (8.1363 => 8.3836, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (14.3668 => 14.7903, std. dev.: 0.0141) MultiSource/Applications/hbd/hbd: 2.68% (1.5603 => 1.6021, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.60% (1.5415 => 1.5816, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 2.60% (5.7591 => 5.9088, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 2.50% (1.1642 => 1.1933, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.1861 => 1.2157, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.48% (1.3050 => 1.3374, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 2.46% (3.3354 => 3.4173, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.27% (2.0665 => 2.1135, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.25% (0.5105 => 0.5220, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.19% (2.0273 => 2.0717, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.07% (1.4186 => 1.4479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.06% (0.6456 => 0.6589, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.92% (0.9765 => 0.9952, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.90% (2.2024 => 2.2442, std. dev.: 0.0142) MultiSource/Applications/lua/lua: 1.89% (3.8723 => 3.9456, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.77% (0.6675 => 0.6793, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.63% (0.6450 => 0.6555, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 1.63% (0.8921 => 0.9066, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.62% (1.2842 => 1.3050, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.54% (17.1811 => 17.4462, std. dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.53% (1.5859 => 1.6101, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.17% (1.1840 => 1.1979, std. dev.: 0.0051) MultiSource/Applications/siod/siod: 1.15% (2.2969 => 2.3234, std. dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9755, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.52% (5.3999 => 5.7520, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.27% (3.6395 => 3.7586, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0561, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (1.5086 => 1.5382, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8422, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.59% (3.1578 => 3.2081, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6890, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2251, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 1.04% (6.6465 => 6.7153, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.03% (3.2416 => 3.2749, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.18% (5.2763 => 3.1561, std. dev.: 0.0103) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.16% (5.3855 => 3.7073, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.46% (5.3526 => 3.7222, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.04% (2.9384 => 2.5553, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.31% (22.1758 => 19.8903, std. dev.: 0.0324) SingleSource/UnitTests/Vector/constpool: -5.12% (54.1659 => 51.3916, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.49% (3.8922 => 3.8343, std. dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.72% (1.2373 => 1.1047, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel-2: -8.03% (1.5373 => 1.4138, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.46% (2.7294 => 2.5532, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5957, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4733, std. dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.15% (8.1563 => 7.8994, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4245, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.31% (1.7254 => 1.6856, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.12% (10.2830 => 10.0645, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.63% (1.3677 => 1.3454, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.58% (2.0866 => 2.0536, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3741, std. dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -1.44% (2.5528 => 2.5160, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.41% (12.5348 => 12.3576, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.37% (4.2280 => 4.1701, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8139, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 13:17:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 15:17:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120723201744.097952A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2300?compare_to=2299&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2300, Order: 160634, Start Time: 2012-07-23 18:59:16, End Time: 2012-07-23 20:17:59 To: 2299, Order: 160631, Start Time: 2012-07-23 17:12:24, End Time: 2012-07-23 18:31:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (64 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (780 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.56% (14.1894 => 13.6840, std. dev.: 0.0115) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.99% (10.3673 => 13.6840, std. dev.: 0.0115) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3473 => 0.3900, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3516 => 0.3944, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.12% (0.3497 => 0.3921, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.02% (0.3543 => 0.3969, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.96% (0.3561 => 0.3987, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.61% (0.3694 => 0.4123, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.39% (1.1194 => 1.2469, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.29% (0.3828 => 0.4260, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.17% (0.3886 => 0.4320, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.13% (0.3927 => 0.4364, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.95% (2.2022 => 2.3773, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.85% (1.7609 => 1.8992, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.47% (0.6030 => 0.6420, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.46% (0.5925 => 0.6308, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.96% (0.2065 => 0.2188, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 5.83% (0.7326 => 0.7753, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.07% (0.3177 => 0.3338, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4615 => 0.4848, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 4.69% (10.4361 => 10.9253, std. dev.: 0.0164) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.37% (0.8172 => 0.8529, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 4.33% (0.3282 => 0.3424, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (7.0540 => 7.3545, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.18% (0.4879 => 0.5083, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 3.70% (0.7433 => 0.7708, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.40% (5.0018 => 5.1721, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.34% (4.9449 => 5.1100, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5569 => 0.5749, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (9.4845 => 9.7834, std. dev.: 0.0092) MultiSource/Applications/spiff/spiff: 3.04% (0.7835 => 0.8073, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.82% (0.5860 => 0.6025, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (4.2646 => 4.3807, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.71% (8.1363 => 8.3566, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.70% (1.3050 => 1.3402, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.53% (14.3668 => 14.7307, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 2.49% (1.5603 => 1.5991, std. dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.35% (0.4636 => 0.4745, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.28% (1.5415 => 1.5766, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.28% (1.1861 => 1.2131, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 2.24% (5.7591 => 5.8881, std. dev.: 0.0140) MultiSource/Applications/d/make_dparser: 2.19% (3.3354 => 3.4086, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.07% (2.0273 => 2.0693, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.73% (2.0665 => 2.1023, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.70% (0.9765 => 0.9931, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.55% (0.6450 => 0.6550, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 1.53% (3.8723 => 3.9314, std. dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.49% (2.2024 => 2.2352, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.42% (1.4186 => 1.4387, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (1.5859 => 1.6054, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 1.21% (0.8921 => 0.9029, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.18% (17.1811 => 17.3830, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.13% (2.6778 => 2.9758, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.55% (5.3999 => 5.7538, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7529, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.21% (1.0313 => 1.0541, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5086 => 1.5361, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.69% (11.6436 => 11.8409, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/whetstone: 1.66% (1.0554 => 1.0729, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.62% (3.1578 => 3.2091, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6898, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.05% (3.2416 => 3.2756, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 1.02% (6.6465 => 6.7142, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.34% (5.2763 => 3.1480, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.79% (5.3855 => 3.6736, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.01% (5.3526 => 3.6927, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.37% (2.9384 => 2.5454, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.52% (22.1758 => 19.8419, std. dev.: 0.0309) SingleSource/UnitTests/Vector/constpool: -5.26% (54.1659 => 51.3194, std. dev.: 0.0372) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.67% (3.8922 => 3.8273, std. dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2373 => 1.1057, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -7.51% (1.5373 => 1.4218, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.45% (2.7294 => 2.5534, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.18% (8.1563 => 7.8969, std. dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4844, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (8.6802 => 8.4149, std. dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.29% (1.7254 => 1.6859, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.11% (10.2830 => 10.0656, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.58% (2.0866 => 2.0536, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.58% (1.3677 => 1.3461, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3741, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.46% (12.5348 => 12.3514, std. dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -1.44% (2.5528 => 2.5161, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.41% (4.2280 => 4.1685, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 13:25:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 15:25:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120723202552.9C8252A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2301?compare_to=2295&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2301, Order: 160634, Start Time: 2012-07-23 19:11:55, End Time: 2012-07-23 20:26:12 To: 2295, Order: 160626, Start Time: 2012-07-23 10:21:38, End Time: 2012-07-23 11:35:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (139 on baseline) Performance Improvements: 3 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.27% (2.1036 => 2.0768, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: -1.05% (1.4783 => 1.4628, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.14% (3.7271 => 3.6845, std. dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.12% (2.0176 => 2.3226, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5818 => 0.6360, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.28% (0.7061 => 0.7716, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.17% (0.5748 => 0.6275, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.17% (0.3578 => 0.3906, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.89% (0.3601 => 0.3921, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.88% (0.3650 => 0.3974, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 8.83% (0.3646 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.71% (0.3663 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.67% (0.3623 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.60% (0.3789 => 0.4115, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.56% (0.3914 => 0.4249, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.42% (0.4003 => 0.4340, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.32% (0.3940 => 0.4268, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.83% (1.3693 => 1.4628, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.71% (0.7710 => 0.8227, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 6.54% (0.7038 => 0.7498, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.53% (3.9660 => 4.2250, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.38% (0.5265 => 0.5601, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2596 => 0.2757, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (0.4328 => 0.4591, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.06% (0.4062 => 0.4308, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.61% (0.1819 => 0.1921, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.57% (0.2781 => 0.2936, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.53% (0.6959 => 0.7344, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.4379 => 0.4616, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.35% (0.4390 => 0.4625, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.28% (0.2782 => 0.2929, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.23% (13.8202 => 14.5436, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.19% (0.3489 => 0.3670, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.10% (1.2193 => 1.2815, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.08% (0.3899 => 0.4097, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.07% (0.2760 => 0.2900, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.06% (0.2765 => 0.2905, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.99% (0.9199 => 0.9658, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.97% (0.2655 => 0.2787, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 4.95% (0.2607 => 0.2736, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.92% (0.2726 => 0.2860, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.89% (16.6129 => 17.4257, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.89% (0.3580 => 0.3755, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.86% (0.3107 => 0.3258, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 4.85% (0.2761 => 0.2895, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/random: 4.83% (0.2690 => 0.2820, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.82% (13.2842 => 13.9240, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.81% (1.4563 => 1.5263, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/fibo: 4.79% (0.2628 => 0.2754, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.79% (0.2966 => 0.3108, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.79% (0.5577 => 0.5844, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.79% (0.2925 => 0.3065, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 4.76% (0.3149 => 0.3299, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.74% (1.9828 => 2.0768, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 4.70% (0.2937 => 0.3075, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.65% (0.2988 => 0.3127, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.65% (0.3485 => 0.3647, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.57% (1.3813 => 1.4444, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 4.54% (0.7506 => 0.7847, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.53% (1.3819 => 1.4445, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.53% (0.2696 => 0.2818, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.52% (1.1061 => 1.1561, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.51% (0.4016 => 0.4197, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.44% (0.3246 => 0.3390, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.44% (1.1364 => 1.1868, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 4.35% (0.3192 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.31% (0.5637 => 0.5880, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.30% (7.2180 => 7.5282, std. dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.29% (0.2914 => 0.3039, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.28% (0.3293 => 0.3434, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.26% (0.8310 => 0.8664, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 4.26% (3.8646 => 4.0292, std. dev.: 0.0045) MultiSource/Applications/treecc/treecc: 4.21% (1.9270 => 2.0081, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.17% (1.0594 => 1.1036, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/moments: 4.16% (0.3868 => 0.4029, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.16% (0.3534 => 0.3681, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.3245 => 1.3795, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.83% (0.7460 => 0.7746, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.82% (3.6692 => 3.8092, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.80% (4.3801 => 4.5466, std. dev.: 0.0118) MultiSource/Applications/siod/siod: 3.76% (2.1791 => 2.2611, std. dev.: 0.0072) MultiSource/Benchmarks/McCat/18-imp/imp: 3.63% (0.3220 => 0.3337, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.55% (4.4433 => 4.6010, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.55% (0.4791 => 0.4961, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.47% (0.2995 => 0.3099, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.43% (0.2945 => 0.3046, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.38% (1.2292 => 1.2707, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (4.9865 => 5.1505, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.07% (1.1333 => 1.1681, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 3.04% (3.1889 => 3.2860, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.01% (0.6283 => 0.6472, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.96% (0.3755 => 0.3866, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.82% (0.6135 => 0.6308, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.81% (0.8698 => 0.8942, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (6.5754 => 6.7591, std. dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 2.66% (14.8535 => 15.2481, std. dev.: 0.0222) MultiSource/Benchmarks/mafft/pairlocalalign: 2.62% (8.4961 => 8.7191, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 2.58% (16.2614 => 16.6802, std. dev.: 0.0208) MultiSource/Applications/ClamAV/clamscan: 2.57% (14.5298 => 14.9026, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.33% (2.1007 => 2.1496, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.04% (1.5188 => 1.5498, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.02% (3.2742 => 3.3402, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 1.78% (4.6629 => 4.7458, std. dev.: 0.0042) MultiSource/Applications/lemon/lemon: 1.29% (1.0313 => 1.0446, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.22% (0.9108 => 0.9219, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.04% (3.7467 => 3.7856, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 76.97% (0.1824 => 0.3228, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 56.28% (0.1322 => 0.2066, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 25.94% (1.8175 => 2.2890, std. dev.: 0.0465) SingleSource/Benchmarks/Misc/mandel-2: 7.38% (1.2998 => 1.3957, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.97% (1.5824 => 1.6769, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.99% (0.9996 => 1.0495, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/salsa20: 4.29% (7.4271 => 7.7454, std. dev.: 0.0178) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7318, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (12.4560 => 12.8586, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4751, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.41% (2.8606 => 2.9294, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.39% (1.7688 => 1.8110, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.23% (2.0200 => 2.0650, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (2.5089 => 2.5623, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 2.09% (0.6159 => 0.6288, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.08% (4.1080 => 4.1935, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.59% (1.5089 => 1.5329, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 1.33% (3.1736 => 3.2159, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1969, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 1.26% (2.4679 => 2.4991, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.26% (22.5627 => 21.1499, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.18% (1.2308 => 1.1055, std. dev.: 0.0072) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.85% (2.6470 => 2.5186, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.84% (1.3780 => 1.3113, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9822, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.42% (1.9762 => 1.9087, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9450, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.57% (0.4867 => 0.4742, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.33% (0.8342 => 0.8148, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.21% (6.3560 => 6.2158, std. dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.01% (20.3410 => 19.9314, std. dev.: 0.0212) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5044, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7134, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7611, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9963, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8565, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.36% (2.5254 => 2.4910, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2250, std. dev.: 0.0100) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2598, std. dev.: 0.0025) MultiSource/Applications/lua/lua: -1.06% (26.5159 => 26.2357, std. dev.: 0.0254) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8480, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 13:39:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 15:39:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120723203938.A5C232A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2302?compare_to=2298&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2302, Order: 160633, Start Time: 2012-07-23 17:55:48, End Time: 2012-07-23 20:39:58 To: 2298, Order: 160629, Start Time: 2012-07-23 14:35:07, End Time: 2012-07-23 17:19:25 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (92 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (794 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 13.79% (0.3496 => 0.3978, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.76% (0.3446 => 0.3920, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.74% (0.3442 => 0.3915, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.73% (0.3460 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.71% (0.3465 => 0.3940, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.61% (0.3469 => 0.3941, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.59% (0.3488 => 0.3962, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.21% (0.3650 => 0.4132, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.01% (0.3643 => 0.4117, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 12.70% (0.3724 => 0.4197, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.71% (0.5826 => 0.6275, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.54% (0.5889 => 0.6333, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.42% (0.1620 => 0.1724, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.90% (0.7171 => 0.7594, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.04% (3.5627 => 3.7424, std. dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.82% (1.6211 => 1.6993, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.54% (0.4361 => 0.4559, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 4.47% (1.5932 => 1.6644, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (0.4994 => 0.5210, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.25% (0.5900 => 0.6151, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.22% (1.3152 => 1.3707, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.17% (0.3930 => 0.4094, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.17% (0.4029 => 0.4197, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.02% (0.5000 => 0.5201, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 4.01% (1.0781 => 1.1213, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.93% (2.7292 => 2.8364, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.92% (0.5026 => 0.5223, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.88% (0.2729 => 0.2835, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.86% (4.2109 => 4.3736, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.80% (0.2738 => 0.2842, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.79% (0.2875 => 0.2984, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.76% (0.2714 => 0.2816, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 3.74% (0.2725 => 0.2827, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2750 => 0.2852, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.65% (0.2792 => 0.2894, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (1.9694 => 2.0400, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.49% (5.5417 => 5.7351, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.48% (2.0673 => 2.1392, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.47% (0.2911 => 0.3012, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.46% (0.3124 => 0.3232, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (1.9966 => 2.0654, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.42% (0.3096 => 0.3202, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.36% (0.3004 => 0.3105, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.33% (0.3362 => 0.3474, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.33% (0.9909 => 1.0239, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.31% (0.3267 => 0.3375, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.29% (0.3195 => 0.3300, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3317 => 0.3423, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3258 => 0.3361, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3726 => 0.3842, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.11% (0.3890 => 0.4011, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (0.3625 => 0.3737, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3477 => 0.3580, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.95% (2.1013 => 2.1633, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.92% (0.4658 => 0.4794, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.90% (4.6177 => 4.7516, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/moments: 2.88% (0.3678 => 0.3784, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.84% (2.1653 => 2.2268, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 2.83% (23.5202 => 24.1866, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (4.4195 => 4.5433, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.4146 => 0.4259, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.71% (0.3690 => 0.3790, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.61% (0.3903 => 0.4005, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (1.8794 => 1.9282, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 2.56% (0.4251 => 0.4360, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.51% (0.3981 => 0.4081, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.50% (0.7875 => 0.8072, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 2.39% (0.9697 => 0.9929, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.26% (1.4269 => 1.4591, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.22% (0.5546 => 0.5669, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.18% (0.6435 => 0.6575, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.93% (0.6634 => 0.6762, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.01% (2.0346 => 2.0551, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.39% (5.2852 => 11.7540, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 56.15% (0.2162 => 0.3376, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.92% (10.7630 => 13.6603, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/objinst: 19.88% (9.4436 => 11.3211, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.43% (0.5589 => 0.6675, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: 13.31% (32.9687 => 37.3572, std. dev.: 0.0226) SingleSource/Benchmarks/Misc/flops: 7.00% (15.4430 => 16.5240, std. dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.82% (3.3903 => 3.6214, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 5.42% (19.6305 => 20.6942, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 5.31% (2.8036 => 2.9524, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-2: 5.31% (1.8057 => 1.9015, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.08% (2.2962 => 2.3899, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.35% (3.1722 => 3.2467, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (3.1728 => 3.2464, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1899, std. dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/fldry: 1.71% (17.2379 => 17.5330, std. dev.: 0.0877) MultiSource/Applications/sgefa/sgefa: 1.43% (1.5554 => 1.5776, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.94% (2.4764 => 2.3789, std. dev.: 0.0369) MultiSource/Applications/kimwitu++/kc: -1.56% (11.9555 => 11.7689, std. dev.: 0.0135) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.81% (6.2401 => 4.1303, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: -5.50% (0.2402 => 0.2270, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: -4.42% (14.0481 => 13.4269, std. dev.: 0.0371) SingleSource/Benchmarks/Misc/salsa20: -3.83% (35.5013 => 34.1403, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/objinst: -2.82% (12.0509 => 11.7114, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5754, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 15:04:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 17:04:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120723220419.D5DF12A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2303?compare_to=2300&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2303, Order: 160638, Start Time: 2012-07-23 20:46:06, End Time: 2012-07-23 22:04:39 To: 2300, Order: 160634, Start Time: 2012-07-23 18:59:16, End Time: 2012-07-23 20:17:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (73 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (770 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.01% (13.6840 => 14.0957, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.09% (55.5108 => 56.6719, std. dev.: 0.0841) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.96% (10.3673 => 14.0957, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 12.47% (0.3473 => 0.3906, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.27% (0.3497 => 0.3926, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.16% (0.3543 => 0.3974, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.05% (0.3543 => 0.3970, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 12.03% (0.3516 => 0.3939, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.93% (0.3561 => 0.3986, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/for-in: 11.78% (0.3694 => 0.4129, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.64% (1.1194 => 1.2497, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.18% (0.3828 => 0.4256, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.04% (0.3886 => 0.4315, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.92% (0.3927 => 0.4356, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.44% (2.2022 => 2.3880, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.09% (1.7609 => 1.9033, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.23% (0.6030 => 0.6466, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.22% (0.5925 => 0.6353, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.44% (0.7326 => 0.7798, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.81% (7.0540 => 7.3935, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/oourafft: 4.54% (0.3282 => 0.3431, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.50% (10.4361 => 10.9055, std. dev.: 0.0120) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.39% (0.4879 => 0.5093, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.18% (0.4615 => 0.4808, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 4.09% (0.7433 => 0.7737, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.79% (0.8172 => 0.8482, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.55% (4.9449 => 5.1205, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 3.46% (0.3180 => 0.3290, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.43% (5.0018 => 5.1734, std. dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (9.4845 => 9.8045, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.32% (0.4636 => 0.4790, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.29% (0.5569 => 0.5752, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.11% (8.1363 => 8.3890, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (4.2646 => 4.3914, std. dev.: 0.0081) MultiSource/Applications/hbd/hbd: 2.95% (1.5603 => 1.6064, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 2.92% (0.7835 => 0.8064, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.92% (0.5860 => 0.6031, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.89% (0.4289 => 0.4413, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.72% (14.3668 => 14.7582, std. dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.71% (2.0665 => 2.1224, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.59% (0.3865 => 0.3965, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.48% (1.3050 => 1.3374, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.46% (1.1861 => 1.2153, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.34% (1.5415 => 1.5775, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 2.31% (5.7591 => 5.8922, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 2.29% (3.3354 => 3.4118, std. dev.: 0.0056) MultiSource/Applications/treecc/treecc: 2.21% (2.0273 => 2.0722, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 2.10% (1.1642 => 1.1886, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.06% (0.6456 => 0.6589, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.01% (0.8067 => 0.8229, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.96% (0.5105 => 0.5205, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.81% (0.9765 => 0.9942, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.78% (1.2842 => 1.3071, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (0.6675 => 0.6791, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.72% (0.6450 => 0.6561, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.66% (3.8723 => 3.9365, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.58% (2.2024 => 2.2373, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.41% (17.1811 => 17.4231, std. dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.40% (1.4186 => 1.4384, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 1.28% (0.8921 => 0.9035, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.06% (1.1840 => 1.1966, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.12% (2.6778 => 2.9755, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.63% (5.3999 => 5.7577, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.33% (3.6395 => 3.7606, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.38% (1.0313 => 1.0558, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.5086 => 1.5366, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 1.71% (3.1578 => 3.2119, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8415, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 1.65% (1.0554 => 1.0728, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6890, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.04% (3.2416 => 3.2753, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1261, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.21% (5.2763 => 3.1545, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.55% (5.3855 => 3.6866, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.78% (5.3526 => 3.7051, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.20% (2.9384 => 2.5506, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -10.29% (22.1758 => 19.8937, std. dev.: 0.0130) SingleSource/UnitTests/Vector/constpool: -5.27% (54.1659 => 51.3088, std. dev.: 0.0321) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.54% (3.8922 => 3.8324, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.59% (1.1492 => 0.7632, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.58% (1.2373 => 1.1064, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: -6.83% (1.5373 => 1.4323, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.46% (2.7294 => 2.5532, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.21% (8.1563 => 7.8942, std. dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4807, std. dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4268, std. dev.: 0.0082) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.50% (0.4808 => 0.4688, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.34% (1.7254 => 1.6851, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -2.12% (10.2830 => 10.0647, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.62% (2.0866 => 2.0527, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -1.55% (2.4116 => 2.3742, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.52% (1.3677 => 1.3469, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.45% (2.5528 => 2.5159, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: -1.40% (12.5348 => 12.3596, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.33% (4.2280 => 4.1718, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2304, std. dev.: 0.0199) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 15:08:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 17:08:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120723220834.B3D862A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/2304?compare_to=2301&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2304, Order: 160640, Start Time: 2012-07-23 20:54:41, End Time: 2012-07-23 22:08:54 To: 2301, Order: 160634, Start Time: 2012-07-23 19:11:55, End Time: 2012-07-23 20:26:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (135 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (722 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.30% (2.0768 => 2.1037, std. dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.10% (2.0176 => 2.3021, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 10.14% (0.5818 => 0.6408, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.01% (0.7061 => 0.7768, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.90% (0.5748 => 0.6317, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.89% (0.3578 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3601 => 0.3909, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.48% (0.3646 => 0.3955, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.47% (0.3650 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.46% (0.3663 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3789 => 0.4107, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3623 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3914 => 0.4236, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.4003 => 0.4328, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.05% (0.3940 => 0.4257, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 7.39% (0.4062 => 0.4362, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 7.27% (1.3693 => 1.4688, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1986 => 0.2127, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2655 => 0.2839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.89% (0.4328 => 0.4626, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.65% (0.2781 => 0.2966, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.56% (0.7710 => 0.8216, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/random: 6.43% (0.2690 => 0.2863, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.36% (0.2721 => 0.2894, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 6.29% (0.2607 => 0.2771, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.29% (0.2782 => 0.2957, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.28% (0.7038 => 0.7480, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 6.27% (0.2726 => 0.2897, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2760 => 0.2933, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 6.24% (0.3107 => 0.3301, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.22% (0.3022 => 0.3210, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.22% (3.9660 => 4.2126, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.17% (0.4390 => 0.4661, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: 6.16% (0.2628 => 0.2790, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.15% (0.5265 => 0.5589, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2761 => 0.2930, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.10% (0.3489 => 0.3702, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.10% (0.2966 => 0.3147, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.10% (1.9828 => 2.1037, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wc: 6.09% (0.2937 => 0.3116, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2596 => 0.2754, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.08% (0.2696 => 0.2860, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.07% (0.3149 => 0.3340, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.84% (0.3580 => 0.3789, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.79% (0.2988 => 0.3161, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.74% (0.3485 => 0.3685, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.64% (0.3192 => 0.3372, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.59% (0.3453 => 0.3646, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (0.3756 => 0.3957, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.33% (0.6959 => 0.7330, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.30% (0.4016 => 0.4229, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.28% (0.3293 => 0.3467, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.25% (0.4379 => 0.4609, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.21% (0.3534 => 0.3718, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.17% (0.3868 => 0.4068, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.87% (1.2193 => 1.2787, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.84% (0.9199 => 0.9644, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 4.82% (16.6129 => 17.4135, std. dev.: 0.0128) MultiSource/Applications/SPASS/SPASS: 4.78% (13.8202 => 14.4814, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.63% (0.5577 => 0.5835, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.40% (1.4563 => 1.5204, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.32% (13.2842 => 13.8575, std. dev.: 0.0094) MultiSource/Benchmarks/McCat/09-vor/vor: 4.27% (0.2925 => 0.3050, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 4.21% (1.2292 => 1.2810, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.19% (0.3246 => 0.3382, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.17% (0.5637 => 0.5872, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.16% (1.1364 => 1.1837, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.13% (7.2180 => 7.5160, std. dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.05% (0.2914 => 0.3032, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.04% (1.3819 => 1.4377, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.99% (1.3813 => 1.4364, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: 3.98% (0.7506 => 0.7805, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.97% (1.0594 => 1.1015, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 3.97% (1.1061 => 1.1500, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.94% (0.3755 => 0.3903, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 3.89% (0.8310 => 0.8633, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (3.8646 => 4.0121, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.78% (0.7460 => 0.7742, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.78% (1.9270 => 1.9998, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (1.3245 => 1.3741, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.61% (4.3801 => 4.5384, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.46% (3.6692 => 3.7963, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.38% (0.4791 => 0.4953, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.31% (4.9865 => 5.1517, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.29% (0.3220 => 0.3326, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 3.27% (2.1791 => 2.2503, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.23% (4.4433 => 4.5869, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.14% (0.6283 => 0.6480, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.84% (0.6135 => 0.6309, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.81% (1.1333 => 1.1652, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.65% (3.1889 => 3.2733, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 2.43% (0.4113 => 0.4213, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.38% (6.5754 => 6.7319, std. dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.32% (2.1007 => 2.1495, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.32% (14.8535 => 15.1974, std. dev.: 0.0093) MultiSource/Applications/ClamAV/clamscan: 2.25% (14.5298 => 14.8570, std. dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: 2.22% (8.4961 => 8.6850, std. dev.: 0.0156) MultiSource/Applications/sqlite3/sqlite3: 2.16% (16.2614 => 16.6127, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.96% (3.2742 => 3.3384, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.93% (1.5188 => 1.5481, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 1.87% (0.6250 => 0.6367, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 1.33% (4.6629 => 4.7250, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 77.14% (0.1824 => 0.3231, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 56.66% (0.1322 => 0.2071, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 27.37% (1.8175 => 2.3149, std. dev.: 0.0314) SingleSource/Benchmarks/Misc/mandel-2: 7.02% (1.2998 => 1.3910, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.96% (1.5824 => 1.6767, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.98% (0.9996 => 1.0494, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 4.28% (7.4271 => 7.7447, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7328, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (12.4560 => 12.8579, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4748, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.41% (2.8606 => 2.9295, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.34% (1.7688 => 1.8102, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.15% (2.0200 => 2.0635, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: 2.14% (2.5089 => 2.5625, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.10% (4.1080 => 4.1943, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 2.05% (0.6159 => 0.6285, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5333, std. dev.: 0.0083) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 1.26% (2.4679 => 2.4991, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.26% (1.9290 => 1.9533, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 1.24% (3.1736 => 3.2130, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.37% (22.5627 => 21.1244, std. dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.66% (0.6576 => 0.6467, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.85% (0.0997 => 0.0829, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.66% (1.2308 => 1.0996, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2653, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std. dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -4.84% (2.6470 => 2.5188, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9824, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.45% (1.9762 => 1.9081, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: -2.67% (3.0263 => 2.9455, std. dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4867 => 0.4748, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2185, std. dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.02% (20.3410 => 19.9296, std. dev.: 0.0410) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5082, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7136, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (9.9194 => 9.7606, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9962, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.37% (2.5254 => 2.4907, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2225, std. dev.: 0.0184) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 16:50:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 18:50:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120723235047.91C832A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2305?compare_to=2304&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2305, Order: 160646, Start Time: 2012-07-23 22:36:55, End Time: 2012-07-23 23:51:06 To: 2304, Order: 160640, Start Time: 2012-07-23 20:54:41, End Time: 2012-07-23 22:08:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 6 (145 on baseline) Performance Improvements: 7 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 941 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 30.46% (5.7585 => 7.5123, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.93% (0.9540 => 0.9915, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7093 => 1.7757, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 1.33% (1.1532 => 1.1685, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.28% (79.6230 => 80.6410, std. dev.: 0.1056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.24% (2.9295 => 2.9659, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -43.55% (0.3231 => 0.1824, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: -33.56% (0.2071 => 0.1376, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -7.34% (2.5625 => 2.3743, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -3.20% (12.8579 => 12.4459, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: -2.34% (0.6285 => 0.6138, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.88% (4.1943 => 4.1155, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -1.80% (3.2130 => 3.1551, std. dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.69% (2.0176 => 2.3139, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference-object: 9.76% (0.5818 => 0.6386, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: 9.53% (0.5748 => 0.6296, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 9.25% (0.7061 => 0.7714, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 8.17% (1.3693 => 1.4812, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.99% (0.3130 => 0.3380, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 7.94% (0.3578 => 0.3862, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.78% (0.3663 => 0.3948, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.78% (0.3601 => 0.3881, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3623 => 0.3904, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3646 => 0.3927, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.62% (0.3650 => 0.3928, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 7.61% (0.3914 => 0.4212, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.60% (0.3789 => 0.4077, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 7.59% (0.3940 => 0.4239, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.54% (0.4003 => 0.4305, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.53% (0.4328 => 0.4654, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.89% (0.7038 => 0.7523, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 6.87% (0.4062 => 0.4341, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 6.83% (0.2781 => 0.2971, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.76% (0.2782 => 0.2970, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.74% (0.2760 => 0.2946, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.72% (0.3022 => 0.3225, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (3.9660 => 4.2324, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2607 => 0.2781, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.65% (0.2690 => 0.2869, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.63% (0.5265 => 0.5614, std. dev.: 0.0089) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.63% (0.7710 => 0.8221, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.57% (1.9828 => 2.1130, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.55% (0.2655 => 0.2829, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2765 => 0.2945, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.50% (0.2937 => 0.3128, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 6.49% (0.2726 => 0.2903, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.47% (0.2966 => 0.3158, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.43% (0.2628 => 0.2797, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.39% (0.2596 => 0.2762, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.39% (0.3899 => 0.4148, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 6.37% (0.2761 => 0.2937, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.36% (0.3489 => 0.3711, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.35% (0.3149 => 0.3349, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3107 => 0.3303, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.2988 => 0.3175, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.26% (0.3580 => 0.3804, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.20% (0.4390 => 0.4662, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2696 => 0.2862, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.05% (0.3485 => 0.3696, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.05% (0.3192 => 0.3385, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.94% (0.3453 => 0.3658, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.72% (0.6959 => 0.7357, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.70% (0.4016 => 0.4245, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists1: 5.69% (0.3534 => 0.3735, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.59% (0.3293 => 0.3477, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.57% (0.4379 => 0.4623, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (0.3756 => 0.3962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.48% (0.3868 => 0.4080, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.44% (16.6129 => 17.5160, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.42% (0.5577 => 0.5879, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.38% (1.2193 => 1.2849, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.11% (13.8202 => 14.5260, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2945 => 0.3093, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.00% (0.9199 => 0.9659, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.64% (0.7506 => 0.7854, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.62% (1.4563 => 1.5236, std. dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.56% (0.2914 => 0.3047, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.54% (13.2842 => 13.8871, std. dev.: 0.0057) MultiSource/Applications/Burg/burg: 4.50% (1.1061 => 1.1559, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.49% (1.2292 => 1.2844, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.45% (1.3819 => 1.4434, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.38% (1.1364 => 1.1862, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.38% (1.0594 => 1.1058, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.3245 => 1.3825, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.37% (0.3246 => 0.3388, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.34% (1.3813 => 1.4413, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 4.32% (0.8310 => 0.8669, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.31% (0.5637 => 0.5880, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.29% (1.9270 => 2.0097, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.27% (3.8646 => 4.0298, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.20% (7.2180 => 7.5208, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.18% (0.3755 => 0.3912, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.94% (0.7460 => 0.7754, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.85% (3.6692 => 3.8104, std. dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 3.84% (0.2995 => 0.3110, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.83% (4.9865 => 5.1775, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.74% (0.4791 => 0.4970, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.70% (2.1791 => 2.2598, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.69% (4.3801 => 4.5417, std. dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 3.63% (0.3220 => 0.3337, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.62% (0.8698 => 0.9013, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.62% (4.4433 => 4.6042, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.45% (0.6283 => 0.6500, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.23% (1.1333 => 1.1699, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: 3.09% (0.4113 => 0.4240, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.06% (0.6135 => 0.6323, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.84% (3.1889 => 3.2796, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (3.2742 => 3.3621, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.64% (2.1007 => 2.1562, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 2.63% (8.4961 => 8.7199, std. dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 2.62% (6.5754 => 6.7479, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 2.58% (14.8535 => 15.2369, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.53% (1.5188 => 1.5572, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.49% (14.5298 => 14.8915, std. dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.6250 => 0.6398, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.34% (4.6629 => 4.7720, std. dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 2.31% (16.2614 => 16.6373, std. dev.: 0.0138) MultiSource/Benchmarks/Bullet/bullet: 1.62% (33.2944 => 33.8347, std. dev.: 0.0210) MultiSource/Applications/minisat/minisat: 1.51% (0.6744 => 0.6846, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.47% (0.9108 => 0.9242, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.36% (1.0313 => 1.0453, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5123, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/fbench: 24.59% (1.8175 => 2.2645, std. dev.: 0.0502) SingleSource/Benchmarks/Misc/mandel-2: 6.99% (1.2998 => 1.3907, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.20% (0.9996 => 1.0516, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: 4.40% (7.4271 => 7.7539, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7312, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4744, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8154, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5333, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5944, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0494, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.22% (10.7476 => 10.8792, std. dev.: 0.0488) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 1.08% (1.1560 => 1.1685, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1397, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.91% (22.5627 => 21.2282, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.66% (0.0997 => 0.0811, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.69% (1.2308 => 1.0992, std. dev.: 0.0058) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3092, std. dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.93% (1.9762 => 1.9183, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.67% (0.8342 => 0.8119, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9478, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.55% (0.4867 => 0.4743, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2322, std. dev.: 0.0086) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5048, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7075, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.67% (20.3410 => 20.0014, std. dev.: 0.0493) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.56% (0.6589 => 0.6486, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0055, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.3167 => 5.2463, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std. dev.: 0.0156) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2220, std. dev.: 0.0167) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.13% (9.9194 => 9.8077, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 16:51:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 18:51:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120723235111.2BC9F2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2306?compare_to=2303&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2306, Order: 160646, Start Time: 2012-07-23 22:32:40, End Time: 2012-07-23 23:51:30 To: 2303, Order: 160638, Start Time: 2012-07-23 20:46:06, End Time: 2012-07-23 22:04:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 8 (78 on baseline) Performance Improvements: 4 (25 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 922 (770 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 131.20% (5.7577 => 13.3116, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (4.1718 => 4.3751, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 2.07% (2.3742 => 2.4234, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.6851 => 1.7158, std. dev.: 0.0004) MultiSource/Applications/aha/aha: 1.45% (3.1583 => 3.2040, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.32% (1.6750 => 1.6971, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.14% (26.2841 => 26.5835, std. dev.: 0.0190) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.00% (2.8907 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.05% (14.0957 => 13.6656, std. dev.: 0.0068) SingleSource/UnitTests/ObjC++/property-reference: -1.46% (0.7798 => 0.7684, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -4.92% (1.9604 => 1.8640, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: -1.61% (1.0728 => 1.0555, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.81% (10.3673 => 13.6656, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.62% (1.1194 => 1.2495, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 11.17% (0.3473 => 0.3861, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.95% (0.3497 => 0.3880, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.89% (0.3543 => 0.3929, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 10.89% (0.3516 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.76% (0.3561 => 0.3944, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.53% (0.3694 => 0.4083, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.22% (0.3886 => 0.4283, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.98% (0.3927 => 0.4319, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.82% (2.2022 => 2.3965, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.22% (1.7609 => 1.9057, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (0.1622 => 0.1731, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5925 => 0.6290, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.07% (0.6030 => 0.6396, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2065 => 0.2180, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.29% (0.3177 => 0.3345, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 5.16% (10.4361 => 10.9746, std. dev.: 0.0074) SingleSource/UnitTests/ObjC++/property-reference: 4.89% (0.7326 => 0.7684, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 4.88% (0.3282 => 0.3442, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.80% (7.0540 => 7.3924, std. dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.66% (0.4615 => 0.4830, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.4879 => 0.5094, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.04% (0.8172 => 0.8502, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 4.00% (9.4845 => 9.8642, std. dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 3.98% (0.7433 => 0.7729, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.71% (4.9449 => 5.1282, std. dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.54% (5.0018 => 5.1791, std. dev.: 0.0077) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3423 => 0.3542, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.40% (0.5860 => 0.6059, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.5569 => 0.5755, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 3.29% (1.5603 => 1.6117, std. dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 3.22% (0.3109 => 0.3209, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 3.08% (0.7835 => 0.8076, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.07% (4.2646 => 4.3954, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.4636 => 0.4777, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.93% (8.1363 => 8.3748, std. dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 2.76% (5.7591 => 5.9183, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.74% (1.1861 => 1.2186, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (14.3668 => 14.7545, std. dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.63% (0.4103 => 0.4211, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.62% (1.3050 => 1.3392, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 2.59% (0.4289 => 0.4400, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.51% (3.3354 => 3.4191, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.38% (1.5415 => 1.5782, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.37% (0.5105 => 0.5226, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.27% (2.0665 => 2.1134, std. dev.: 0.0106) MultiSource/Applications/treecc/treecc: 2.18% (2.0273 => 2.0714, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 2.14% (1.1642 => 1.1891, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.11% (0.8067 => 0.8237, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.98% (0.6456 => 0.6584, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.96% (0.6675 => 0.6806, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.90% (3.8723 => 3.9459, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.89% (2.2024 => 2.2440, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.78% (0.9765 => 0.9939, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.68% (1.4186 => 1.4425, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.62% (17.1811 => 17.4602, std. dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.61% (0.6450 => 0.6554, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.50% (1.2842 => 1.3035, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 1.39% (0.8921 => 0.9045, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.21% (1.1840 => 1.1983, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (2.6778 => 2.9762, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.48% (4.2280 => 4.3751, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7462, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.30% (1.0313 => 1.0550, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.88% (26.0924 => 26.5835, std. dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/hash2: 1.65% (3.1578 => 3.2099, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5086 => 1.5332, std. dev.: 0.0031) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2040, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.37% (11.6436 => 11.8036, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.36% (2.6546 => 2.6906, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2392, std. dev.: 0.0477) SingleSource/Benchmarks/Misc/oourafft: 1.03% (6.6465 => 6.7149, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.27% (5.2763 => 3.1516, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.36% (5.3855 => 3.6967, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.77% (5.3526 => 3.7058, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.03% (2.9384 => 2.5554, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.35% (22.1758 => 19.8812, std. dev.: 0.0254) SingleSource/UnitTests/Vector/constpool: -5.21% (54.1659 => 51.3446, std. dev.: 0.0677) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.04% (3.8922 => 3.8517, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.44% (1.2373 => 1.1081, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -6.86% (1.5373 => 1.4318, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -4.79% (1.9577 => 1.8640, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4810, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.11% (8.1563 => 7.9024, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4136, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0031, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: -1.75% (12.5348 => 12.3154, std. dev.: 0.0084) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.34% (1.8329 => 1.8084, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 16:52:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 18:52:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120723235240.B3C862A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2307?compare_to=2302&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2307, Order: 160643, Start Time: 2012-07-23 21:08:36, End Time: 2012-07-23 23:53:00 To: 2302, Order: 160633, Start Time: 2012-07-23 17:55:48, End Time: 2012-07-23 20:39:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (101 on baseline) Performance Improvements: 0 (8 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (785 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.16% (123.9245 => 129.0787, std. dev.: 0.4055) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 12.31% (0.3460 => 0.3886, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.29% (0.3465 => 0.3891, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.28% (0.3446 => 0.3869, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.21% (0.3496 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.17% (0.3442 => 0.3861, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3469 => 0.3891, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.13% (0.3488 => 0.3911, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 11.70% (0.3650 => 0.4077, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.58% (0.3643 => 0.4065, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3724 => 0.4145, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1620 => 0.1749, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 7.62% (0.5826 => 0.6270, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.56% (0.5889 => 0.6334, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 5.86% (0.7171 => 0.7591, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.18% (1.6211 => 1.7051, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 5.11% (1.5932 => 1.6746, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.98% (3.5627 => 3.7400, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.65% (0.4361 => 0.4564, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.56% (1.3152 => 1.3752, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.37% (0.4994 => 0.5212, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.30% (0.3930 => 0.4099, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.29% (0.5900 => 0.6153, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 4.24% (0.4029 => 0.4200, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.10% (0.5000 => 0.5205, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 3.97% (4.2109 => 4.3780, std. dev.: 0.0046) MultiSource/Applications/d/make_dparser: 3.94% (1.0781 => 1.1206, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 3.91% (0.2714 => 0.2820, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.89% (0.2725 => 0.2831, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.87% (0.2738 => 0.2844, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.86% (0.2875 => 0.2986, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.86% (0.5026 => 0.5220, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 3.78% (0.2803 => 0.2909, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.72% (0.2792 => 0.2896, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.71% (0.2780 => 0.2883, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 3.70% (0.2811 => 0.2915, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.66% (0.2866 => 0.2971, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.65% (0.9909 => 1.0271, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.2911 => 0.3017, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.63% (2.7292 => 2.8283, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: 3.63% (0.2813 => 0.2915, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 3.61% (23.5202 => 24.3697, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wc: 3.59% (0.3096 => 0.3207, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.58% (2.0673 => 2.1413, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.54% (0.2823 => 0.2923, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.50% (0.3004 => 0.3109, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.49% (0.3124 => 0.3233, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.48% (0.3362 => 0.3479, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.47% (0.3317 => 0.3432, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.44% (0.3195 => 0.3305, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.44% (1.9694 => 2.0372, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: 3.43% (0.3267 => 0.3379, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.40% (0.3060 => 0.3164, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.38% (0.3258 => 0.3368, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.28% (1.9966 => 2.0620, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3282 => 0.3389, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.26% (0.3348 => 0.3457, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.26% (0.3625 => 0.3743, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.19% (0.3890 => 0.4014, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.17% (5.5417 => 5.7173, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/sieve: 3.17% (0.3726 => 0.3844, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.15% (0.3678 => 0.3794, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.13% (0.9697 => 1.0001, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.13% (0.3477 => 0.3586, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.05% (0.4658 => 0.4800, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.05% (2.1013 => 2.1653, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 2.99% (0.4146 => 0.4270, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (4.4195 => 4.5516, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.93% (0.3690 => 0.3798, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 2.89% (0.4251 => 0.4374, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.84% (2.1653 => 2.2267, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.3845 => 0.3951, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.74% (0.3903 => 0.4010, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.74% (4.6177 => 4.7440, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.3981 => 0.4088, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (1.8794 => 1.9297, std. dev.: 0.0064) MultiSource/Applications/treecc/treecc: 2.55% (0.7875 => 0.8076, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.54% (1.4269 => 1.4632, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.39% (0.6435 => 0.6589, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.38% (0.6634 => 0.6792, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.27% (0.5012 => 0.5126, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.20% (0.5546 => 0.5668, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.36% (2.0346 => 2.0622, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 122.39% (5.2852 => 11.7539, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 57.12% (0.2162 => 0.3397, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.93% (10.7630 => 13.6614, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.70% (0.5589 => 0.6746, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/objinst: 19.86% (9.4436 => 11.3191, std. dev.: 0.0222) SingleSource/Benchmarks/Shootout/lists: 13.45% (32.9687 => 37.4037, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 6.96% (15.4430 => 16.5184, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.83% (3.3903 => 3.6220, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 5.40% (19.6305 => 20.6913, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: 5.32% (2.8036 => 2.9528, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-2: 5.13% (1.8057 => 1.8983, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.07% (2.2962 => 2.3896, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.44% (3.1722 => 3.2495, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (3.1728 => 3.2466, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 1.89% (15.8721 => 16.1726, std. dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/fldry: 1.86% (17.2379 => 17.5590, std. dev.: 0.0846) MultiSource/Applications/sgefa/sgefa: 1.43% (1.5554 => 1.5776, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.96% (2.4764 => 2.4030, std. dev.: 0.0214) MultiSource/Applications/kimwitu++/kc: -1.21% (11.9555 => 11.8111, std. dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-1: -33.85% (6.2401 => 4.1279, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.87% (0.2402 => 0.2261, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -4.29% (14.0481 => 13.4452, std. dev.: 0.0389) SingleSource/Benchmarks/Misc/salsa20: -3.80% (35.5013 => 34.1536, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/objinst: -3.14% (12.0509 => 11.6730, std. dev.: 0.0266) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (3.6262 => 3.5754, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 18:33:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 20:33:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120724013312.71FBE2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2308?compare_to=2305&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2308, Order: 160649, Start Time: 2012-07-24 00:19:04, End Time: 2012-07-24 01:33:31 To: 2305, Order: 160646, Start Time: 2012-07-23 22:36:55, End Time: 2012-07-23 23:51:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (142 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.73% (1.3907 => 1.4148, std. dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.49% (2.0176 => 2.3099, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 9.83% (0.5818 => 0.6390, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.48% (0.5748 => 0.6293, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.47% (0.7061 => 0.7730, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 8.05% (0.3578 => 0.3866, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.04% (1.3693 => 1.4794, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.80% (0.3601 => 0.3882, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.79% (0.3646 => 0.3930, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.70% (0.3623 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.70% (0.3663 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.68% (0.3789 => 0.4080, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.67% (0.4003 => 0.4310, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.62% (0.3650 => 0.3928, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.54% (0.3914 => 0.4209, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.51% (0.3940 => 0.4236, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.46% (0.4328 => 0.4651, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.11% (0.4062 => 0.4351, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.98% (0.2781 => 0.2975, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.87% (0.2765 => 0.2955, std. dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 6.83% (0.7038 => 0.7519, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.81% (0.2760 => 0.2948, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.72% (0.2782 => 0.2969, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.68% (0.3022 => 0.3224, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2607 => 0.2781, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.67% (0.2655 => 0.2832, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.63% (3.9660 => 4.2291, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.61% (1.9828 => 2.1139, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: 6.58% (0.2690 => 0.2867, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.57% (0.2937 => 0.3130, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.2966 => 0.3160, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.53% (0.2726 => 0.2904, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.51% (0.2628 => 0.2799, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.50% (0.7710 => 0.8211, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.45% (0.2761 => 0.2939, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.39% (0.3489 => 0.3712, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.37% (0.3107 => 0.3305, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.36% (0.5265 => 0.5600, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.36% (0.3899 => 0.4147, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.2988 => 0.3178, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 6.35% (0.3149 => 0.3349, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.32% (0.2596 => 0.2760, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.26% (0.3580 => 0.3804, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.24% (0.4390 => 0.4664, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2696 => 0.2864, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary2: 6.17% (0.3192 => 0.3389, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.08% (0.3485 => 0.3697, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3453 => 0.3661, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.73% (0.6959 => 0.7358, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 5.72% (0.3534 => 0.3736, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.65% (0.3293 => 0.3479, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.53% (0.4016 => 0.4238, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.51% (0.3756 => 0.3963, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.4379 => 0.4618, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.38% (0.3868 => 0.4076, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.33% (1.2193 => 1.2843, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 5.23% (16.6129 => 17.4818, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.08% (0.9199 => 0.9666, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.04% (0.5577 => 0.5858, std. dev.: 0.0071) MultiSource/Applications/SPASS/SPASS: 5.03% (13.8202 => 14.5147, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.60% (0.2914 => 0.3048, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 4.55% (0.2925 => 0.3058, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.52% (13.2842 => 13.8851, std. dev.: 0.0254) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.4563 => 1.5216, std. dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 4.48% (1.2292 => 1.2843, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.44% (1.1364 => 1.1868, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.37% (0.3246 => 0.3388, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.37% (1.3813 => 1.4417, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.35% (0.5637 => 0.5882, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.33% (3.8646 => 4.0319, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.30% (1.3819 => 1.4413, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1049, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.28% (0.8310 => 0.8666, std. dev.: 0.0096) MultiSource/Applications/spiff/spiff: 4.26% (0.7506 => 0.7826, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.23% (0.3755 => 0.3914, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.21% (1.9270 => 2.0082, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.15% (7.2180 => 7.5176, std. dev.: 0.0090) MultiSource/Applications/Burg/burg: 4.15% (1.1061 => 1.1520, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.09% (1.3245 => 1.3787, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.82% (4.9865 => 5.1771, std. dev.: 0.0290) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.81% (0.7460 => 0.7744, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.4791 => 0.4972, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.77% (0.2995 => 0.3108, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.77% (3.6692 => 3.8075, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.77% (4.3801 => 4.5451, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 3.69% (2.1791 => 2.2594, std. dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.68% (0.8698 => 0.9018, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.63% (4.4433 => 4.6044, std. dev.: 0.0070) MultiSource/Benchmarks/McCat/18-imp/imp: 3.60% (0.3220 => 0.3336, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.36% (0.6283 => 0.6494, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.23% (1.1333 => 1.1699, std. dev.: 0.0098) MultiSource/Benchmarks/McCat/05-eks/eks: 3.01% (0.4113 => 0.4237, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.00% (0.6135 => 0.6319, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.85% (3.1889 => 3.2798, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.1007 => 2.1569, std. dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 2.56% (8.4961 => 8.7140, std. dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (6.5754 => 6.7432, std. dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 2.54% (14.8535 => 15.2303, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.53% (3.2742 => 3.3571, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.47% (1.5188 => 1.5563, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.37% (14.5298 => 14.8743, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 2.29% (4.6629 => 4.7696, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 2.25% (16.2614 => 16.6277, std. dev.: 0.0167) SingleSource/Benchmarks/Misc-C++/bigfib: 2.22% (0.6250 => 0.6389, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.67% (33.2944 => 33.8512, std. dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.43% (0.9108 => 0.9238, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5197, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.98% (1.8175 => 2.2716, std. dev.: 0.0438) SingleSource/Benchmarks/Misc/mandel-2: 8.85% (1.2998 => 1.4148, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.30% (0.9996 => 1.0526, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 4.44% (7.4271 => 7.7571, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.2619 => 11.7307, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4745, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0310 => 1.0556, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.51% (1.5089 => 1.5317, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5941, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.14% (1.9290 => 1.9509, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.91% (22.5627 => 21.2294, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.85% (0.3511 => 0.3411, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.05% (0.0997 => 0.0837, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.11% (1.2308 => 1.1064, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.84% (1.3780 => 1.3113, std. dev.: 0.0086) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.67% (0.8342 => 0.8119, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9476, std. dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.09% (6.6320 => 6.4937, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2293, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9429, std. dev.: 0.0555) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7048, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0057, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2493, std. dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8081, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 18:38:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 20:38:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120724013803.675712A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2309?compare_to=2306&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2309, Order: 160649, Start Time: 2012-07-24 00:19:29, End Time: 2012-07-24 01:38:23 To: 2306, Order: 160646, Start Time: 2012-07-23 22:32:40, End Time: 2012-07-23 23:51:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (75 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (773 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.93% (10.3673 => 13.6775, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.81% (1.1194 => 1.2516, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.20% (0.3473 => 0.3862, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.95% (0.3543 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.92% (0.3497 => 0.3879, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.92% (0.3543 => 0.3930, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 10.86% (0.3516 => 0.3898, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.84% (0.3561 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.53% (0.3694 => 0.4083, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.11% (0.3886 => 0.4279, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.01% (0.3927 => 0.4320, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.84% (2.2022 => 2.3969, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.10% (1.7609 => 1.9036, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (0.1622 => 0.1731, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.06% (0.5925 => 0.6284, std. dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference-object: 5.95% (0.6030 => 0.6389, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2065 => 0.2180, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.38% (0.3177 => 0.3348, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 5.11% (10.4361 => 10.9694, std. dev.: 0.0147) SingleSource/UnitTests/ObjC++/property-reference: 4.90% (0.7326 => 0.7685, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.85% (7.0540 => 7.3959, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/oourafft: 4.84% (0.3282 => 0.3441, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.53% (0.4879 => 0.5100, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.51% (0.4615 => 0.4823, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 4.09% (0.7433 => 0.7737, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (9.4845 => 9.8661, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (4.9449 => 5.1338, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.68% (0.5569 => 0.5774, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.60% (0.8172 => 0.8466, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.57% (5.0018 => 5.1806, std. dev.: 0.0069) MultiSource/Applications/hbd/hbd: 3.44% (1.5603 => 1.6140, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.20% (4.2646 => 4.4012, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.11% (0.5860 => 0.6042, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.08% (0.4636 => 0.4779, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.92% (8.1363 => 8.3738, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.87% (1.3050 => 1.3425, std. dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 2.78% (5.7591 => 5.9192, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (14.3668 => 14.7607, std. dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.72% (1.1861 => 1.2184, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.68% (0.7835 => 0.8045, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.48% (1.5415 => 1.5798, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.43% (3.3354 => 3.4165, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.27% (0.5105 => 0.5221, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.24% (0.8067 => 0.8248, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.20% (1.1642 => 1.1898, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.15% (2.0665 => 2.1110, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 2.11% (2.0273 => 2.0701, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 2.06% (0.6456 => 0.6589, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.04% (0.9765 => 0.9964, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.01% (0.6675 => 0.6809, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.97% (3.8723 => 3.9486, std. dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.92% (2.2024 => 2.2446, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.91% (1.5859 => 1.6162, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.77% (1.4186 => 1.4437, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.66% (0.6450 => 0.6557, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.63% (17.1811 => 17.4619, std. dev.: 0.0265) MultiSource/Applications/hexxagon/hexxagon: 1.47% (1.2842 => 1.3031, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 1.46% (0.8921 => 0.9051, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.43% (1.1840 => 1.2009, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (2.6778 => 2.9761, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.47% (4.2280 => 4.3747, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.35% (3.6395 => 3.7613, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.89% (26.0924 => 26.5857, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash2: 1.66% (3.1578 => 3.2103, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5086 => 1.5331, std. dev.: 0.0010) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2041, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.40% (2.6546 => 2.6917, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8041, std. dev.: 0.0142) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2308, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/oourafft: 1.07% (6.6465 => 6.7179, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.03% (5.2763 => 3.1641, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.26% (5.3855 => 3.7019, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.86% (5.3526 => 3.7010, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.10% (2.9384 => 2.5536, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.38% (22.1758 => 19.8744, std. dev.: 0.0235) SingleSource/UnitTests/Vector/constpool: -5.21% (54.1659 => 51.3462, std. dev.: 0.0317) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.01% (3.8922 => 3.8530, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.10% (1.2373 => 1.1000, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel-2: -6.99% (1.5373 => 1.4298, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.72% (1.9577 => 1.8653, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4917, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4131, std. dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9136, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0015, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/lists: -1.68% (12.5348 => 12.3246, std. dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5129, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.8329 => 1.8079, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 20:05:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 22:05:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120724030514.8AB6E2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2310?compare_to=2307&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2310, Order: 160651, Start Time: 2012-07-24 00:22:29, End Time: 2012-07-24 03:05:33 To: 2307, Order: 160643, Start Time: 2012-07-23 21:08:36, End Time: 2012-07-23 23:53:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 6 (74 on baseline) Performance Improvements: 17 (10 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 931 (810 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops-1: 85.39% (4.1279 => 7.6528, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 11.78% (2.5921 => 2.8974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 8.60% (11.6730 => 12.6765, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.80% (0.3397 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.10% (54.2032 => 54.7992, std. dev.: 0.0861) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.09% (3.1150 => 3.1490, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: -55.02% (11.7539 => 5.2869, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -35.30% (25.5643 => 16.5389, std. dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -22.61% (13.6614 => 10.5723, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -17.46% (0.6746 => 0.5568, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/objinst: -16.49% (11.3191 => 9.4525, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout/lists: -11.75% (37.4037 => 33.0075, std. dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -10.84% (17.5590 => 15.6562, std. dev.: 0.1428) SingleSource/Benchmarks/Misc/whetstone: -5.58% (2.9528 => 2.7880, std. dev.: 0.0139) SingleSource/Benchmarks/Shootout/matrix: -5.05% (20.6913 => 19.6463, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.51% (3.6220 => 3.4585, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -3.98% (34.1536 => 32.7959, std. dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.81% (2.3896 => 2.2985, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.15% (0.6153 => 0.6021, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -2.14% (16.5184 => 16.1644, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.96% (3.2466 => 3.1829, std. dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: -1.71% (1.5776 => 1.5506, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -1.58% (3.5754 => 3.5189, std. dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 11.71% (0.3442 => 0.3845, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.69% (0.3446 => 0.3849, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.69% (0.3465 => 0.3870, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.62% (0.3460 => 0.3862, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.58% (0.3496 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.55% (0.3488 => 0.3891, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.53% (0.3469 => 0.3869, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.25% (0.3643 => 0.4053, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/property: 11.07% (0.3650 => 0.4054, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.88% (0.3724 => 0.4129, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.76% (0.5826 => 0.6220, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.64% (0.5889 => 0.6280, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.28% (1.5932 => 1.6773, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 5.06% (0.7171 => 0.7534, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.85% (1.6211 => 1.6998, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.69% (3.5627 => 3.7297, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.62% (1.3152 => 1.3759, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.38% (0.4361 => 0.4552, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.31% (0.4994 => 0.5209, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (0.3930 => 0.4089, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.00% (0.5026 => 0.5227, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.95% (0.4029 => 0.4188, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.90% (0.5000 => 0.5195, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.88% (0.5900 => 0.6129, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 3.81% (4.2109 => 4.3714, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 3.77% (1.0781 => 1.1187, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.65% (0.2792 => 0.2894, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.55% (0.2875 => 0.2977, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.44% (0.3195 => 0.3305, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.34% (0.3267 => 0.3376, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.31% (2.0673 => 2.1358, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.29% (0.3096 => 0.3198, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.29% (0.9697 => 1.0016, std. dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 3.28% (0.9909 => 1.0234, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3258 => 0.3363, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.14% (1.9694 => 2.0313, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3317 => 0.3421, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 3.08% (0.3348 => 0.3451, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.06% (0.3890 => 0.4009, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sieve: 3.01% (0.3726 => 0.3838, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.01% (0.4658 => 0.4798, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.97% (1.9966 => 2.0558, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/moments: 2.96% (0.3678 => 0.3787, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.96% (5.5417 => 5.7058, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.95% (0.3625 => 0.3732, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 2.92% (23.5202 => 24.2081, std. dev.: 0.0154) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.92% (0.4139 => 0.4260, std. dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.89% (2.7292 => 2.8080, std. dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 2.81% (2.1013 => 2.1604, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (4.4195 => 4.5365, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.61% (0.3903 => 0.4005, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.54% (2.1653 => 2.2204, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 2.54% (0.4251 => 0.4359, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.54% (1.8794 => 1.9271, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 2.48% (0.4146 => 0.4249, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.41% (4.6177 => 4.7290, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.36% (0.7875 => 0.8061, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 2.06% (1.4269 => 1.4563, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.04% (0.6435 => 0.6566, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.02% (0.6634 => 0.6768, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.97% (0.5546 => 0.5655, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.20% (2.0346 => 2.0591, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 12.44% (2.5769 => 2.8974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6765, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-2: 5.03% (1.8057 => 1.8965, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1644, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1973, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std. dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.03% (3.1169 => 3.1490, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.66% (11.9555 => 11.7576, std. dev.: 0.0185) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.94% (25.4195 => 16.5389, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary2: -10.57% (0.2402 => 0.2148, std. dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/fldry: -9.18% (17.2379 => 15.6562, std. dev.: 0.1428) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7959, std. dev.: 0.0118) SingleSource/Benchmarks/Dhrystone/dry: -3.55% (14.0481 => 13.5493, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.94% (0.6140 => 0.6021, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5723, std. dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.16% (3.3991 => 3.3598, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 20:15:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 22:15:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120724031512.00ECC2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2311?compare_to=2308&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2311, Order: 160653, Start Time: 2012-07-24 02:01:29, End Time: 2012-07-24 03:15:31 To: 2308, Order: 160649, Start Time: 2012-07-24 00:19:04, End Time: 2012-07-24 01:33:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (141 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.37% (2.0176 => 2.3076, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 9.04% (0.7061 => 0.7699, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.90% (0.5818 => 0.6336, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 8.86% (0.5748 => 0.6257, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.65% (1.3693 => 1.4878, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 7.71% (0.3578 => 0.3854, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.44% (0.3601 => 0.3869, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.39% (0.4328 => 0.4648, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 7.38% (0.3646 => 0.3915, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.37% (0.3650 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.31% (0.3623 => 0.3888, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.31% (0.3789 => 0.4066, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.29% (0.3663 => 0.3930, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.23% (0.3914 => 0.4197, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 7.16% (0.2781 => 0.2980, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.07% (0.4003 => 0.4286, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.98% (0.3940 => 0.4215, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.90% (0.1986 => 0.2123, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.84% (0.4062 => 0.4340, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.72% (0.3022 => 0.3225, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.69% (0.2782 => 0.2968, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.68% (0.7038 => 0.7508, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2607 => 0.2781, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.67% (0.2655 => 0.2832, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.64% (0.2937 => 0.3132, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.63% (0.2760 => 0.2943, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.62% (0.2628 => 0.2802, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/random: 6.58% (0.2690 => 0.2867, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.53% (1.9828 => 2.1123, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 6.53% (0.2726 => 0.2904, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2765 => 0.2945, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.51% (0.2966 => 0.3159, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.49% (0.4390 => 0.4675, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.47% (0.3107 => 0.3308, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/methcall: 6.41% (0.2761 => 0.2938, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.38% (0.2696 => 0.2868, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.35% (0.3149 => 0.3349, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.31% (0.3489 => 0.3709, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.26% (3.9660 => 4.2143, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.23% (0.7710 => 0.8190, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary2: 6.14% (0.3192 => 0.3388, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.12% (0.2988 => 0.3171, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.12% (0.3580 => 0.3799, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.08% (0.3485 => 0.3697, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.03% (0.3899 => 0.4134, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.02% (0.5265 => 0.5582, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.97% (0.2596 => 0.2751, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.91% (0.3453 => 0.3657, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.88% (0.1819 => 0.1926, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.57% (0.3534 => 0.3731, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.56% (0.3293 => 0.3476, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.50% (0.4016 => 0.4237, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.40% (0.3756 => 0.3959, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.40% (0.3868 => 0.4077, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.30% (0.4379 => 0.4611, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.16% (0.6959 => 0.7318, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.14% (1.2193 => 1.2820, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.96% (0.2945 => 0.3091, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.78% (0.9199 => 0.9639, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 4.71% (16.6129 => 17.3946, std. dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.5577 => 0.5838, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 4.68% (13.8202 => 14.4666, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.55% (13.2842 => 13.8884, std. dev.: 0.0138) MultiSource/Applications/hexxagon/hexxagon: 4.47% (1.2292 => 1.2841, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.22% (1.4563 => 1.5178, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.18% (0.3755 => 0.3912, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.17% (1.1364 => 1.1838, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 4.15% (0.8310 => 0.8655, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.14% (0.2925 => 0.3046, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.13% (0.3246 => 0.3380, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.12% (1.3813 => 1.4382, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.10% (0.5637 => 0.5868, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.10% (1.0594 => 1.1028, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.08% (0.2914 => 0.3033, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.06% (1.3819 => 1.4380, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.01% (0.7506 => 0.7807, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.98% (7.2180 => 7.5054, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.86% (1.3245 => 1.3756, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 3.81% (3.8646 => 4.0118, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 3.79% (1.9270 => 2.0001, std. dev.: 0.0115) MultiSource/Applications/Burg/burg: 3.74% (1.1061 => 1.1475, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.67% (0.7460 => 0.7734, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.63% (4.9865 => 5.1674, std. dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 3.57% (0.2995 => 0.3102, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.53% (0.4791 => 0.4960, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.50% (0.8698 => 0.9002, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.43% (3.6692 => 3.7949, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.38% (4.3801 => 4.5281, std. dev.: 0.0099) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.35% (4.4433 => 4.5921, std. dev.: 0.0088) MultiSource/Benchmarks/McCat/18-imp/imp: 3.29% (0.3220 => 0.3326, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.19% (2.1791 => 2.2486, std. dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.15% (0.6283 => 0.6481, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.03% (1.1333 => 1.1676, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 2.80% (0.4113 => 0.4228, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 2.68% (3.1889 => 3.2743, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.64% (0.6135 => 0.6297, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.60% (8.4961 => 8.7167, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.47% (3.2742 => 3.3551, std. dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 2.38% (6.5754 => 6.7316, std. dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 2.34% (14.8535 => 15.2005, std. dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: 2.32% (16.2614 => 16.6382, std. dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.30% (2.1007 => 2.1491, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 2.26% (14.5298 => 14.8579, std. dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/bigfib: 2.24% (0.6250 => 0.6390, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.18% (4.6629 => 4.7645, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.13% (1.5188 => 1.5512, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.28% (0.9108 => 0.9225, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.10% (33.2944 => 33.6596, std. dev.: 0.0085) MultiSource/Applications/lemon/lemon: 1.01% (1.0313 => 1.0417, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5132, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 26.00% (1.8175 => 2.2900, std. dev.: 0.0352) SingleSource/Benchmarks/Misc/mandel-2: 7.89% (1.2998 => 1.4023, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6760, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.36% (0.9996 => 1.0532, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/salsa20: 4.51% (7.4271 => 7.7624, std. dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7317, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4737, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5089 => 1.5357, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (1.9290 => 1.9566, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.14% (22.5627 => 21.1770, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -19.06% (0.0997 => 0.0807, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.98% (1.2308 => 1.0956, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.42% (1.3780 => 1.3033, std. dev.: 0.0107) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.93% (1.9762 => 1.9183, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.70% (0.8342 => 0.8117, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.65% (3.0263 => 2.9460, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.19% (6.3560 => 6.2169, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5080, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7073, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.65% (20.3410 => 20.0045, std. dev.: 0.0346) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: -1.35% (5.3167 => 5.2448, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4932, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.11% (9.9194 => 9.8090, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8494, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 20:25:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 22:25:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120724032527.0C51A2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2312?compare_to=2309&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2312, Order: 160657, Start Time: 2012-07-24 02:06:54, End Time: 2012-07-24 03:25:45 To: 2309, Order: 160649, Start Time: 2012-07-24 00:19:29, End Time: 2012-07-24 01:38:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (73 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (776 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.73% (3.7971 => 3.8628, std. dev.: 0.0136) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.22% (10.3673 => 13.6038, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.72% (1.1194 => 1.2506, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.49% (0.3473 => 0.3872, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3543 => 0.3940, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-2: 11.15% (0.3497 => 0.3887, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.04% (0.3516 => 0.3904, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3561 => 0.3953, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.01% (0.3543 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.77% (0.3694 => 0.4092, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.37% (0.3828 => 0.4225, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.32% (0.3886 => 0.4287, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.21% (0.3927 => 0.4328, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.45% (2.2022 => 2.3883, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.39% (1.7609 => 1.9087, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.04% (0.5925 => 0.6283, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.92% (0.6030 => 0.6387, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2065 => 0.2181, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.45% (0.3177 => 0.3350, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 4.86% (0.7326 => 0.7682, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.66% (10.4361 => 10.9228, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.59% (7.0540 => 7.3777, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.49% (0.4879 => 0.5098, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.46% (0.4615 => 0.4821, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.93% (9.4845 => 9.8571, std. dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: 3.78% (0.7433 => 0.7714, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.62% (4.9449 => 5.1237, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.48% (5.0018 => 5.1758, std. dev.: 0.0100) MultiSource/Applications/hbd/hbd: 3.45% (1.5603 => 1.6141, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5569 => 0.5750, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.18% (0.8172 => 0.8432, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.16% (0.5860 => 0.6045, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.13% (0.4636 => 0.4781, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.03% (4.2646 => 4.3938, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.85% (8.1363 => 8.3679, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.72% (1.3050 => 1.3405, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.67% (5.7591 => 5.9130, std. dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.62% (14.3668 => 14.7435, std. dev.: 0.0131) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.55% (1.1861 => 1.2163, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.45% (0.5105 => 0.5230, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 2.45% (0.4289 => 0.4394, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 2.32% (3.3354 => 3.4128, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.29% (2.0665 => 2.1139, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 2.25% (1.1642 => 1.1904, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.21% (1.5415 => 1.5756, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.12% (0.9765 => 0.9972, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.08% (0.6456 => 0.6590, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.04% (0.6675 => 0.6811, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.04% (2.0273 => 2.0686, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.96% (0.8067 => 0.8225, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 1.89% (3.8723 => 3.9453, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.86% (1.5859 => 1.6154, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (2.2024 => 2.2433, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.74% (0.6450 => 0.6562, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 1.60% (1.2842 => 1.3048, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.55% (17.1811 => 17.4470, std. dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.47% (1.4186 => 1.4395, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 1.45% (0.8921 => 0.9050, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.35% (1.1840 => 1.2000, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.16% (2.6778 => 2.9766, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.43% (4.2280 => 4.3732, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7590, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 2.24% (3.7781 => 3.8628, std. dev.: 0.0136) MultiSource/Applications/lua/lua: 1.78% (26.0924 => 26.5577, std. dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/hash2: 1.67% (3.1578 => 3.2105, std. dev.: 0.0023) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2034, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.39% (2.6546 => 2.6914, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.37% (11.6436 => 11.8028, std. dev.: 0.0156) SingleSource/Benchmarks/Misc/oourafft: 1.06% (6.6465 => 6.7170, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.12% (5.2763 => 3.1597, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.25% (5.3855 => 3.7024, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.65% (5.3526 => 3.7121, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.09% (2.9384 => 2.5538, std. dev.: 0.0173) MultiSource/Applications/ClamAV/clamscan: -10.24% (22.1758 => 19.9058, std. dev.: 0.0089) SingleSource/UnitTests/Vector/constpool: -5.15% (54.1659 => 51.3746, std. dev.: 0.0229) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.67% (1.2373 => 1.1053, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -6.35% (1.5373 => 1.4397, std. dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/fldry: -4.82% (1.9577 => 1.8633, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4819, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.15% (8.6802 => 8.4072, std. dev.: 0.0163) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (8.1563 => 7.9003, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0012, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists: -1.73% (12.5348 => 12.3176, std. dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8092, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 21:57:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 23 Jul 2012 23:57:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120724045722.3BADC2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2313?compare_to=2311&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2313, Order: 160660, Start Time: 2012-07-24 03:43:32, End Time: 2012-07-24 04:57:40 To: 2311, Order: 160653, Start Time: 2012-07-24 02:01:29, End Time: 2012-07-24 03:15:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (140 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.58% (79.2919 => 80.5472, std. dev.: 0.4183) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.64% (2.0176 => 2.3129, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 10.19% (0.5818 => 0.6411, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.15% (0.7061 => 0.7778, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.06% (0.5748 => 0.6326, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: 8.97% (0.3578 => 0.3899, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 8.78% (0.3601 => 0.3917, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.55% (0.3650 => 0.3962, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 8.53% (0.3646 => 0.3957, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.52% (0.3663 => 0.3975, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.47% (0.3789 => 0.4110, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.45% (0.3623 => 0.3929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.22% (0.4003 => 0.4332, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.20% (0.3914 => 0.4235, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.11% (1.3693 => 1.4803, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/property: 8.10% (0.3940 => 0.4259, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.70% (0.3130 => 0.3371, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (0.4328 => 0.4658, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.30% (0.2781 => 0.2984, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.02% (0.2607 => 0.2790, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.92% (0.4062 => 0.4343, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.88% (0.2760 => 0.2950, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.87% (0.2782 => 0.2973, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.82% (0.3022 => 0.3228, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.77% (0.2628 => 0.2806, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 6.77% (0.2690 => 0.2872, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3149 => 0.3362, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.76% (0.2765 => 0.2952, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.73% (1.9828 => 2.1162, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.68% (0.7038 => 0.7508, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2937 => 0.3133, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.64% (0.2966 => 0.3163, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.64% (0.2726 => 0.2907, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.3107 => 0.3312, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.59% (0.2761 => 0.2943, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.56% (0.4390 => 0.4678, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.54% (3.9660 => 4.2253, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.53% (0.3489 => 0.3717, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.42% (0.2696 => 0.2869, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.40% (0.3485 => 0.3708, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.32% (0.2596 => 0.2760, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.31% (0.3580 => 0.3806, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.26% (0.3899 => 0.4143, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.21% (0.7710 => 0.8189, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 6.16% (0.2988 => 0.3172, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.13% (0.5265 => 0.5588, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sieve: 5.99% (0.3453 => 0.3660, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.94% (0.1819 => 0.1927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.80% (0.3293 => 0.3484, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.74% (0.3868 => 0.4090, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.69% (0.3534 => 0.3735, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.63% (0.4016 => 0.4242, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (0.3756 => 0.3965, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.53% (0.6959 => 0.7344, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.44% (0.4379 => 0.4617, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.23% (1.2193 => 1.2831, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (0.2945 => 0.3097, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.05% (16.6129 => 17.4513, std. dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.99% (0.9199 => 0.9658, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.94% (13.8202 => 14.5033, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.86% (0.5577 => 0.5848, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.64% (13.2842 => 13.9003, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.2292 => 1.2859, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.48% (0.2925 => 0.3056, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.39% (0.2914 => 0.3042, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.37% (1.4563 => 1.5200, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.34% (0.3246 => 0.3387, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.31% (0.3755 => 0.3917, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.30% (1.1364 => 1.1853, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.25% (7.2180 => 7.5249, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 4.25% (0.7506 => 0.7825, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.22% (1.0594 => 1.1041, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 4.21% (3.8646 => 4.0272, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.18% (1.3245 => 1.3799, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.16% (1.3813 => 1.4388, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 4.15% (0.8310 => 0.8655, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.13% (0.5637 => 0.5870, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.09% (1.9270 => 2.0058, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.07% (1.1061 => 1.1511, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.91% (1.3819 => 1.4360, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.89% (0.7460 => 0.7750, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (4.4433 => 4.6119, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.76% (0.4791 => 0.4971, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.64% (0.8698 => 0.9015, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.62% (4.3801 => 4.5385, std. dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 3.61% (0.2995 => 0.3103, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.56% (3.6692 => 3.7998, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3220 => 0.3333, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.47% (4.9865 => 5.1597, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.26% (2.1791 => 2.2502, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.17% (0.6283 => 0.6482, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.11% (1.1333 => 1.1686, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.83% (3.1889 => 3.2792, std. dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.82% (0.6135 => 0.6308, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 2.72% (0.4113 => 0.4225, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.66% (8.4961 => 8.7217, std. dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (6.5754 => 6.7494, std. dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 2.41% (14.8535 => 15.2114, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.38% (3.2742 => 3.3521, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.38% (16.2614 => 16.6479, std. dev.: 0.0140) MultiSource/Applications/ClamAV/clamscan: 2.33% (14.5298 => 14.8682, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.24% (1.5188 => 1.5528, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.11% (0.6250 => 0.6382, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 1.73% (4.6629 => 4.7438, std. dev.: 0.0132) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (0.9108 => 0.9235, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.19% (1.0313 => 1.0436, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.04% (33.2944 => 33.6421, std. dev.: 0.0161) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5175, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.94% (1.8175 => 2.2707, std. dev.: 0.0453) SingleSource/Benchmarks/Misc/mandel-2: 7.42% (1.2998 => 1.3962, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.19% (0.9996 => 1.0515, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: 4.34% (7.4271 => 7.7498, std. dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7322, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4744, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.58% (1.7688 => 1.8144, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (0.9692 => 0.9910, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5089 => 1.5357, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0047) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4513, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5953, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5115, std. dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (1.9290 => 1.9561, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1965, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1394, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.16% (22.5627 => 21.1719, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.95% (0.0997 => 0.0828, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.97% (1.2308 => 1.0958, std. dev.: 0.0094) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2638, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3071, std. dev.: 0.0074) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.70% (0.8342 => 0.8117, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9451, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -2.67% (1.9762 => 1.9235, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.19% (20.3410 => 19.8950, std. dev.: 0.0708) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2299, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5008, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7073, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0054, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2492, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2237, std. dev.: 0.0260) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.13% (9.9194 => 9.8078, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 22:12:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 00:12:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120724051224.0E3D62A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2314?compare_to=2312&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2314, Order: 160660, Start Time: 2012-07-24 03:53:44, End Time: 2012-07-24 05:12:43 To: 2312, Order: 160657, Start Time: 2012-07-24 02:06:54, End Time: 2012-07-24 03:25:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (87 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (762 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.23% (13.6038 => 13.9066, std. dev.: 0.0111) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.19% (0.8432 => 0.8532, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.15% (1.3044 => 1.3194, std. dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.14% (10.3673 => 13.9066, std. dev.: 0.0111) SingleSource/UnitTests/ObjC/trivial-interface: 12.01% (0.3473 => 0.3890, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.87% (0.3497 => 0.3912, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.80% (1.1194 => 1.2515, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.77% (0.3561 => 0.3980, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.75% (0.3516 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.74% (0.3543 => 0.3959, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 11.53% (0.3694 => 0.4120, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.94% (0.3886 => 0.4311, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.85% (0.3927 => 0.4353, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.13% (2.2022 => 2.4032, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.72% (1.7609 => 1.9145, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 7.15% (0.1622 => 0.1738, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.94% (0.5925 => 0.6336, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.88% (0.6030 => 0.6445, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.96% (0.2065 => 0.2188, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.76% (0.3177 => 0.3360, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.51% (0.7326 => 0.7730, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.46% (10.4361 => 11.0058, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.05% (7.0540 => 7.4100, std. dev.: 0.0277) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3282 => 0.3446, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.82% (0.4879 => 0.5114, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.70% (0.4615 => 0.4832, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.41% (0.8172 => 0.8532, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 4.21% (0.7433 => 0.7746, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 4.05% (9.4845 => 9.8688, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.9449 => 5.1406, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (5.0018 => 5.1979, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.49% (4.2646 => 4.4135, std. dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.41% (0.5569 => 0.5759, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.38% (0.5860 => 0.6058, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.32% (0.4636 => 0.4790, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.28% (8.1363 => 8.4030, std. dev.: 0.0047) MultiSource/Applications/hbd/hbd: 3.24% (1.5603 => 1.6108, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.21% (0.3826 => 0.3949, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.11% (14.3668 => 14.8132, std. dev.: 0.0125) MultiSource/Benchmarks/sim/sim: 3.07% (0.3387 => 0.3491, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.06% (5.7591 => 5.9355, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.99% (1.1861 => 1.2216, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.99% (0.3650 => 0.3759, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.92% (0.4103 => 0.4223, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 2.92% (0.7835 => 0.8064, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.78% (1.3050 => 1.3413, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 2.77% (0.4289 => 0.4408, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 2.75% (3.3354 => 3.4272, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.74% (2.0665 => 2.1231, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3865 => 0.3969, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.62% (0.5105 => 0.5239, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.58% (1.1642 => 1.1942, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.52% (0.4203 => 0.4309, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.49% (0.4620 => 0.4735, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.47% (1.5415 => 1.5795, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.34% (2.0273 => 2.0748, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6456 => 0.6607, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.28% (0.8067 => 0.8251, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.18% (1.5859 => 1.6205, std. dev.: 0.0070) MultiSource/Applications/lua/lua: 2.18% (3.8723 => 3.9567, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (0.6675 => 0.6819, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.08% (2.2024 => 2.2482, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.03% (0.9765 => 0.9963, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 1.92% (1.2842 => 1.3089, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.88% (0.6450 => 0.6571, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.77% (17.1811 => 17.4847, std. dev.: 0.0406) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.76% (1.4186 => 1.4436, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/football/football: 1.57% (0.8921 => 0.9061, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.38% (1.1840 => 1.2003, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 1.22% (2.2969 => 2.3249, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (2.6778 => 2.9762, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.42% (4.2280 => 4.3728, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7494, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.53% (1.0313 => 1.0574, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.83% (3.1578 => 3.2157, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.81% (26.0924 => 26.5647, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5086 => 1.5339, std. dev.: 0.0016) MultiSource/Applications/aha/aha: 1.45% (3.1595 => 3.2053, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8039, std. dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.35% (2.6546 => 2.6904, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.14% (1.3045 => 1.3194, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/oourafft: 1.06% (6.6465 => 6.7167, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1287, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.35% (5.2763 => 3.1473, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.94% (5.3855 => 3.7194, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.36% (5.3526 => 3.7274, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.42% (2.9384 => 2.5442, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -9.93% (22.1758 => 19.9739, std. dev.: 0.0126) SingleSource/UnitTests/Vector/constpool: -5.31% (54.1659 => 51.2915, std. dev.: 0.0345) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1165, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel-2: -7.32% (1.5373 => 1.4248, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -4.75% (1.9577 => 1.8648, std. dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4826, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (8.1563 => 7.9004, std. dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4285, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0002, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists: -1.80% (12.5348 => 12.3092, std. dev.: 0.0079) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8092, std. dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 23:16:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 01:16:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120724061610.D61EB2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2315?compare_to=2310&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2315, Order: 160660, Start Time: 2012-07-24 03:33:28, End Time: 2012-07-24 06:16:31 To: 2310, Order: 160651, Start Time: 2012-07-24 00:22:29, End Time: 2012-07-24 03:05:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (84 on baseline) Performance Improvements: 0 (10 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (800 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.82% (0.2148 => 0.2273, std. dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.77% (0.3446 => 0.3886, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3465 => 0.3904, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.63% (0.3460 => 0.3897, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3442 => 0.3876, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.56% (0.3496 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.53% (0.3488 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.48% (0.3469 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.08% (0.3643 => 0.4083, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.03% (0.3650 => 0.4089, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3724 => 0.4164, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.66% (0.5826 => 0.6272, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.47% (0.5889 => 0.6329, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.1620 => 0.1728, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.87% (0.7171 => 0.7592, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 5.31% (1.5932 => 1.6778, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.26% (1.6211 => 1.7063, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.11% (3.5627 => 3.7448, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.77% (1.3152 => 1.3780, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.73% (0.5900 => 0.6179, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.63% (0.4361 => 0.4563, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.63% (0.4994 => 0.5225, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.45% (0.3930 => 0.4105, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.40% (0.5000 => 0.5220, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.34% (0.4029 => 0.4204, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (0.5026 => 0.5240, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 4.07% (1.0781 => 1.1220, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.05% (4.2109 => 4.3815, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.93% (0.2875 => 0.2988, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.80% (0.2866 => 0.2975, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.79% (2.7292 => 2.8327, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 3.72% (0.2714 => 0.2815, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 3.71% (0.2725 => 0.2826, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.65% (0.2792 => 0.2894, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.65% (0.2738 => 0.2838, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.64% (1.9694 => 2.0410, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.53% (1.9966 => 2.0671, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.44% (0.3195 => 0.3305, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.41% (0.3317 => 0.3430, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.34% (0.9909 => 1.0240, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.33% (2.0673 => 2.1362, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 3.31% (0.3267 => 0.3375, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.29% (0.3096 => 0.3198, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.29% (0.3890 => 0.4018, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.27% (0.3060 => 0.3160, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.25% (0.3258 => 0.3364, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.25% (0.3726 => 0.3847, std. dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 3.24% (5.5417 => 5.7210, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 3.20% (2.1013 => 2.1686, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.20% (0.3124 => 0.3224, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.20% (0.4658 => 0.4807, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.18% (0.3362 => 0.3469, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (0.3625 => 0.3740, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.17% (0.3348 => 0.3454, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 3.06% (23.5202 => 24.2405, std. dev.: 0.0167) MultiSource/Applications/JM/ldecod/ldecod: 2.97% (2.1653 => 2.2296, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 2.96% (0.3678 => 0.3787, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3477 => 0.3580, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.90% (4.6177 => 4.7517, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.88% (0.4139 => 0.4258, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.87% (4.4195 => 4.5462, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.84% (0.3903 => 0.4014, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.72% (0.9697 => 0.9961, std. dev.: 0.0054) MultiSource/Applications/treecc/treecc: 2.69% (0.7875 => 0.8087, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 2.63% (0.4146 => 0.4255, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.61% (0.3981 => 0.4085, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.61% (1.8794 => 1.9284, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 2.52% (0.4251 => 0.4358, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.42% (1.4269 => 1.4614, std. dev.: 0.0084) MultiSource/Applications/Burg/burg: 2.29% (0.5546 => 0.5673, std. dev.: 0.0044) MultiSource/Applications/siod/siod: 2.23% (0.6634 => 0.6782, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.02% (0.6435 => 0.6565, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.22% (2.0346 => 2.0595, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 12.44% (2.5769 => 2.8975, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6795, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8945, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1703, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2036, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4584, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2223, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.06% (3.1169 => 3.1498, std. dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.34% (11.9555 => 11.7958, std. dev.: 0.0142) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.06% (25.4195 => 16.5074, std. dev.: 0.0305) SingleSource/Benchmarks/Misc/salsa20: -7.57% (35.5013 => 32.8146, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -7.47% (17.2379 => 15.9499, std. dev.: 0.1990) SingleSource/Benchmarks/Shootout-C++/ary2: -5.37% (0.2402 => 0.2273, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -3.62% (14.0481 => 13.5394, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.87% (0.6140 => 0.6025, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5759, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.16% (3.3991 => 3.3597, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 23:39:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 01:39:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120724063923.9E6712A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2316?compare_to=2313&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2316, Order: 160661, Start Time: 2012-07-24 05:25:38, End Time: 2012-07-24 06:39:43 To: 2313, Order: 160660, Start Time: 2012-07-24 03:43:32, End Time: 2012-07-24 04:57:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (141 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.25% (1.0958 => 1.1095, std. dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.56% (2.0176 => 2.3113, std. dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference-object: 10.21% (0.5818 => 0.6412, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.19% (0.5748 => 0.6334, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.06% (0.7061 => 0.7771, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.99% (0.3650 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3578 => 0.3889, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.45% (0.3623 => 0.3929, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-4: 8.42% (0.3646 => 0.3953, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3601 => 0.3904, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.30% (0.3663 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.26% (0.3789 => 0.4102, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3914 => 0.4236, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.14% (1.3693 => 1.4807, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 8.07% (0.3940 => 0.4258, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.02% (0.4003 => 0.4324, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.39% (0.4328 => 0.4648, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 7.23% (0.2781 => 0.2982, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.12% (0.2655 => 0.2844, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.07% (0.4062 => 0.4349, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2690 => 0.2879, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.02% (0.2765 => 0.2959, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.98% (0.3022 => 0.3233, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 6.94% (0.2607 => 0.2788, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.93% (0.2628 => 0.2810, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.90% (0.2782 => 0.2974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.90% (0.2696 => 0.2882, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.88% (0.7038 => 0.7522, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.79% (1.9828 => 2.1175, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.74% (0.2937 => 0.3135, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.74% (0.2760 => 0.2946, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.71% (0.2966 => 0.3165, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3107 => 0.3314, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.64% (0.2726 => 0.2907, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.63% (3.9660 => 4.2289, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/methcall: 6.52% (0.2761 => 0.2941, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.45% (0.3149 => 0.3352, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.39% (0.3489 => 0.3712, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.38% (0.7710 => 0.8202, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.36% (0.5265 => 0.5600, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.36% (0.2596 => 0.2761, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.28% (0.3580 => 0.3805, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.2988 => 0.3175, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.21% (0.3899 => 0.4141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.20% (0.3485 => 0.3701, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.17% (0.3192 => 0.3389, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.94% (0.3453 => 0.3658, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.88% (0.1819 => 0.1926, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.73% (0.4016 => 0.4246, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.71% (0.3293 => 0.3481, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.67% (0.4390 => 0.4639, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.66% (0.3534 => 0.3734, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.62% (0.4379 => 0.4625, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.49% (0.5577 => 0.5883, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.48% (0.3868 => 0.4080, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.43% (0.3756 => 0.3960, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.37% (0.6959 => 0.7333, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.36% (1.2193 => 1.2846, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (0.2945 => 0.3099, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.19% (0.9199 => 0.9676, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.96% (13.8202 => 14.5060, std. dev.: 0.0135) MultiSource/Applications/kimwitu++/kc: 4.88% (16.6129 => 17.4237, std. dev.: 0.0217) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.79% (1.4563 => 1.5260, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.65% (1.2292 => 1.2864, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.54% (13.2842 => 13.8872, std. dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.53% (0.2914 => 0.3046, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.51% (1.1364 => 1.1877, std. dev.: 0.0070) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.49% (0.7506 => 0.7843, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.5637 => 0.5884, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.33% (1.0594 => 1.1053, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.33% (7.2180 => 7.5303, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.27% (1.3245 => 1.3811, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 4.27% (0.8310 => 0.8665, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.25% (0.3246 => 0.3384, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.22% (1.1061 => 1.1528, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.21% (0.3755 => 0.3913, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.14% (1.9270 => 2.0067, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 4.07% (3.8646 => 4.0217, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.05% (1.3813 => 1.4372, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.03% (0.7460 => 0.7761, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.94% (1.3819 => 1.4364, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.3801 => 4.5515, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.84% (0.2995 => 0.3110, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.73% (4.4433 => 4.6089, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (0.4791 => 0.4966, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.64% (3.6692 => 3.8028, std. dev.: 0.0099) MultiSource/Benchmarks/McCat/18-imp/imp: 3.63% (0.3220 => 0.3337, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.53% (0.8698 => 0.9005, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.44% (4.9865 => 5.1582, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 3.29% (3.1889 => 3.2939, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.21% (1.1333 => 1.1697, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.21% (2.1791 => 2.2490, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4113 => 0.4230, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.84% (0.6135 => 0.6309, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 2.79% (8.4961 => 8.7334, std. dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (6.5754 => 6.7496, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.64% (16.2614 => 16.6907, std. dev.: 0.0190) MultiSource/Applications/ClamAV/clamscan: 2.62% (14.5298 => 14.9104, std. dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 2.58% (14.8535 => 15.2360, std. dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.57% (3.2742 => 3.3584, std. dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.41% (2.1007 => 2.1513, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.29% (0.6250 => 0.6393, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.21% (1.5188 => 1.5523, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 1.80% (4.6629 => 4.7470, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.41% (0.9108 => 0.9236, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.25% (1.0313 => 1.0442, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.08% (33.2944 => 33.6532, std. dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5169, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.52% (1.8175 => 2.2631, std. dev.: 0.0436) SingleSource/Benchmarks/Misc/mandel-2: 8.43% (1.2998 => 1.4094, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.05% (0.9996 => 1.0601, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 4.36% (7.4271 => 7.7507, std. dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7319, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.77% (1.9144 => 1.9866, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4744, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.62% (1.7688 => 1.8151, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.06% (1.0310 => 1.0522, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (1.9290 => 1.9560, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6870, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1405, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.29% (22.5627 => 21.1444, std. dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.65% (0.0997 => 0.0841, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.86% (1.2308 => 1.1095, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.37% (1.3780 => 1.3040, std. dev.: 0.0186) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.80% (1.9762 => 1.9209, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.70% (0.8342 => 0.8117, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9474, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5042, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.92% (20.3410 => 19.9497, std. dev.: 0.0381) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7088, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2431, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.3167 => 5.2462, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4935, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2184, std. dev.: 0.0235) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8084, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 23 23:59:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 01:59:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120724065918.1F5982A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2317?compare_to=2314&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2317, Order: 160661, Start Time: 2012-07-24 05:40:45, End Time: 2012-07-24 06:59:38 To: 2314, Order: 160660, Start Time: 2012-07-24 03:53:44, End Time: 2012-07-24 05:12:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (88 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (761 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.98% (10.3673 => 13.8899, std. dev.: 0.0091) SingleSource/UnitTests/ObjC/trivial-interface: 12.24% (0.3473 => 0.3898, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.09% (1.1194 => 1.2547, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 12.07% (0.3497 => 0.3919, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3561 => 0.3988, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.92% (0.3516 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.88% (0.3543 => 0.3964, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-4: 11.80% (0.3543 => 0.3961, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.78% (0.3694 => 0.4129, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.13% (0.3828 => 0.4254, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.12% (0.3886 => 0.4318, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.05% (0.3927 => 0.4361, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.85% (2.2022 => 2.3972, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.76% (1.7609 => 1.9151, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.98% (0.6030 => 0.6451, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.95% (0.5925 => 0.6337, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.76% (0.3177 => 0.3360, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 5.69% (0.7326 => 0.7743, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.35% (10.4361 => 10.9948, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/oourafft: 5.12% (0.3282 => 0.3450, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.90% (7.0540 => 7.3999, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.68% (0.4615 => 0.4831, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.57% (0.7433 => 0.7773, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.41% (0.8172 => 0.8532, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.13% (4.9449 => 5.1489, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (9.4845 => 9.8724, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.90% (5.0018 => 5.1968, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.56% (0.5569 => 0.5767, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.45% (4.2646 => 4.4119, std. dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.40% (0.5860 => 0.6059, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (0.4636 => 0.4793, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 3.27% (0.3180 => 0.3284, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.24% (8.1363 => 8.4001, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 3.17% (1.5603 => 1.6097, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.13% (0.3423 => 0.3530, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.12% (0.3650 => 0.3764, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.12% (1.1861 => 1.2231, std. dev.: 0.0103) MultiSource/Applications/spiff/spiff: 3.10% (0.7835 => 0.8078, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.09% (14.3668 => 14.8102, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.95% (0.4103 => 0.4224, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.90% (5.7591 => 5.9263, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.84% (2.0665 => 2.1251, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.81% (1.3050 => 1.3417, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 2.77% (0.4289 => 0.4408, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3865 => 0.3969, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.68% (3.3354 => 3.4249, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.66% (1.5415 => 1.5825, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 2.61% (1.1642 => 1.1946, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.55% (0.5105 => 0.5235, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.52% (0.4203 => 0.4309, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.51% (0.4064 => 0.4166, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.50% (2.0273 => 2.0779, std. dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/bigfib: 2.48% (0.6456 => 0.6616, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.33% (1.5859 => 1.6228, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 2.29% (3.8723 => 3.9609, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.28% (0.8067 => 0.8251, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.27% (2.2024 => 2.2524, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (0.4620 => 0.4724, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (0.6675 => 0.6820, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.05% (0.9765 => 0.9965, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.2842 => 1.3098, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.91% (0.5981 => 0.6095, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.80% (0.6450 => 0.6566, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 1.75% (0.8921 => 0.9077, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.59% (17.1811 => 17.4549, std. dev.: 0.0400) MultiSource/Applications/minisat/minisat: 1.57% (0.7115 => 0.7227, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.09% (1.0722 => 1.0839, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (2.6778 => 2.9760, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.50% (4.2280 => 4.3760, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.26% (3.6395 => 3.7582, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.84% (26.0924 => 26.5732, std. dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/hash2: 1.67% (3.1578 => 3.2105, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5086 => 1.5336, std. dev.: 0.0021) MultiSource/Applications/aha/aha: 1.44% (3.1595 => 3.2049, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8045, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6896, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2215, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/oourafft: 1.04% (6.6465 => 6.7156, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.01% (1.6805 => 1.6975, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.22% (5.2763 => 3.1542, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.08% (5.3855 => 3.7118, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.54% (5.3526 => 3.7180, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.16% (2.9384 => 2.5517, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -10.18% (22.1758 => 19.9180, std. dev.: 0.0165) SingleSource/UnitTests/Vector/constpool: -5.19% (54.1659 => 51.3551, std. dev.: 0.0225) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.67% (1.2373 => 1.1053, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel-2: -7.20% (1.5373 => 1.4266, std. dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.55% (1.9577 => 1.8687, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4780, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.15% (8.6802 => 8.4066, std. dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.02% (8.1563 => 7.9101, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0015, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.70% (12.5348 => 12.3216, std. dev.: 0.0047) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.24% (1.8329 => 1.8101, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 01:25:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 03:25:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120724082549.72D8A2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2318?compare_to=2316&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2318, Order: 160663, Start Time: 2012-07-24 07:11:55, End Time: 2012-07-24 08:26:09 To: 2316, Order: 160661, Start Time: 2012-07-24 05:25:38, End Time: 2012-07-24 06:39:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (142 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.79% (55.3773 => 56.3689, std. dev.: 0.0818) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.52% (2.0176 => 2.3105, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.16% (0.5748 => 0.6332, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.14% (0.5818 => 0.6408, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.04% (0.7061 => 0.7699, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/trivial-interface: 8.78% (0.3578 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.44% (0.3650 => 0.3958, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 8.42% (0.3646 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.39% (0.3601 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.30% (0.3663 => 0.3967, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.23% (0.3623 => 0.3921, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 8.16% (1.3693 => 1.4810, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: 8.02% (0.4003 => 0.4324, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.00% (0.3914 => 0.4227, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.92% (0.3940 => 0.4252, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.83% (0.3130 => 0.3375, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.32% (0.4328 => 0.4645, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.25% (0.1986 => 0.2130, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.19% (0.2781 => 0.2981, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.01% (0.2782 => 0.2977, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.94% (0.2607 => 0.2788, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.94% (0.4062 => 0.4344, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 6.89% (0.7038 => 0.7523, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.7710 => 0.8238, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.78% (0.3022 => 0.3227, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.78% (1.9828 => 2.1173, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (3.9660 => 4.2348, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 6.78% (0.2760 => 0.2947, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.74% (0.2655 => 0.2834, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.74% (0.2628 => 0.2805, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.69% (0.2690 => 0.2870, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.68% (0.2966 => 0.3164, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2937 => 0.3133, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.65% (0.2765 => 0.2949, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.64% (0.2726 => 0.2907, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.63% (0.2761 => 0.2944, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.3107 => 0.3312, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.57% (0.3149 => 0.3356, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.57% (0.5265 => 0.5611, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.51% (0.3489 => 0.3716, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.2721 => 0.2898, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.43% (0.2596 => 0.2763, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.42% (0.2696 => 0.2869, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3192 => 0.3393, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.28% (0.3580 => 0.3805, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.26% (0.3899 => 0.4143, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.22% (0.2988 => 0.3174, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.20% (0.3485 => 0.3701, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 6.08% (0.3453 => 0.3663, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.99% (0.1819 => 0.1928, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.79% (0.4390 => 0.4644, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 5.69% (0.3534 => 0.3735, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.68% (0.3293 => 0.3480, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.68% (0.4016 => 0.4244, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.51% (0.3868 => 0.4081, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.4379 => 0.4618, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.45% (0.6959 => 0.7338, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.36% (1.2193 => 1.2846, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.26% (0.2945 => 0.3100, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.16% (0.9199 => 0.9674, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.04% (0.5577 => 0.5858, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 5.02% (13.8202 => 14.5146, std. dev.: 0.0135) MultiSource/Applications/kimwitu++/kc: 5.02% (16.6129 => 17.4473, std. dev.: 0.0164) MultiSource/Applications/hexxagon/hexxagon: 4.70% (1.2292 => 1.2870, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (1.4563 => 1.5238, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/09-vor/vor: 4.58% (0.2925 => 0.3059, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.56% (13.2842 => 13.8901, std. dev.: 0.0115) MultiSource/Applications/spiff/spiff: 4.48% (0.7506 => 0.7842, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.46% (1.1364 => 1.1871, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.2914 => 0.3043, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.41% (0.3246 => 0.3389, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.40% (0.5637 => 0.5885, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (0.8310 => 0.8672, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.30% (7.2180 => 7.5285, std. dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1049, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (3.8646 => 4.0281, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.21% (0.3755 => 0.3913, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.18% (1.9270 => 2.0075, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.16% (1.3245 => 1.3796, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 4.15% (1.1061 => 1.1520, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.03% (1.3813 => 1.4369, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.99% (0.7460 => 0.7758, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.95% (3.6692 => 3.8142, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.85% (1.3819 => 1.4351, std. dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 3.77% (0.2995 => 0.3108, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.76% (4.3801 => 4.5449, std. dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (4.4433 => 4.6087, std. dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.69% (1.1333 => 1.1751, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 3.66% (0.3220 => 0.3338, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (0.4791 => 0.4966, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.58% (0.8698 => 0.9009, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.51% (4.9865 => 5.1614, std. dev.: 0.0049) MultiSource/Applications/siod/siod: 3.33% (2.1791 => 2.2517, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.6283 => 0.6491, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 3.04% (0.4113 => 0.4238, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 3.04% (3.1889 => 3.2857, std. dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: 2.84% (8.4961 => 8.7371, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.69% (16.2614 => 16.6981, std. dev.: 0.0107) MultiSource/Applications/ClamAV/clamscan: 2.65% (14.5298 => 14.9152, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (6.5754 => 6.7496, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 2.58% (14.8535 => 15.2365, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.57% (3.2742 => 3.3582, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.38% (2.1007 => 2.1508, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 2.29% (0.6250 => 0.6393, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5188 => 1.5527, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 1.82% (4.6629 => 4.7477, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.41% (0.9108 => 0.9236, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.29% (1.0313 => 1.0446, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 1.13% (33.2944 => 33.6721, std. dev.: 0.0230) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5139, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2635, std. dev.: 0.0401) SingleSource/Benchmarks/Misc/mandel-2: 7.72% (1.2998 => 1.4002, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.28% (0.9996 => 1.0524, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 4.35% (7.4271 => 7.7503, std. dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.2619 => 11.7309, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4760, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.64% (1.7688 => 1.8155, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5089 => 1.5335, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9591, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0031) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 1.35% (10.7476 => 10.8929, std. dev.: 0.0277) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2144, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.26% (22.5627 => 21.1507, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.25% (0.0997 => 0.0815, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.95% (1.2308 => 1.1083, std. dev.: 0.0222) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0075) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.70% (0.8342 => 0.8117, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9477, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.55% (0.4867 => 0.4743, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9339, std. dev.: 0.0605) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2318, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5092, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7076, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8633, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2479, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8086, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2361, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8497, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 01:51:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 03:51:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120724085100.F31152A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2319?compare_to=2317&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2319, Order: 160663, Start Time: 2012-07-24 07:31:50, End Time: 2012-07-24 08:51:21 To: 2317, Order: 160661, Start Time: 2012-07-24 05:40:45, End Time: 2012-07-24 06:59:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (90 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.07% (10.3673 => 13.8996, std. dev.: 0.0109) SingleSource/UnitTests/ObjC/exceptions-2: 12.18% (0.3497 => 0.3923, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 12.15% (0.3473 => 0.3895, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.12% (1.1194 => 1.2551, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.11% (0.3543 => 0.3972, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 11.97% (0.3543 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.86% (0.3516 => 0.3933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.77% (0.3561 => 0.3980, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.67% (0.3694 => 0.4125, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.09% (0.3886 => 0.4317, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.08% (0.3828 => 0.4252, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.05% (0.3927 => 0.4361, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.92% (2.2022 => 2.3987, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.76% (1.7609 => 1.9151, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (0.1622 => 0.1737, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.00% (0.5925 => 0.6340, std. dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 6.88% (0.6030 => 0.6445, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.52% (0.3177 => 0.3384, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 5.62% (0.7326 => 0.7738, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 5.44% (10.4361 => 11.0039, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/oourafft: 5.09% (0.3282 => 0.3449, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (7.0540 => 7.4039, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.77% (0.4615 => 0.4835, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 4.71% (0.7433 => 0.7783, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.48% (0.8172 => 0.8538, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (9.4845 => 9.8721, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (4.9449 => 5.1454, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.01% (5.0018 => 5.2023, std. dev.: 0.0105) MultiSource/Applications/spiff/spiff: 3.88% (0.7835 => 0.8139, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.74% (0.5860 => 0.6079, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.63% (0.2756 => 0.2856, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (4.2646 => 4.4183, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.5569 => 0.5769, std. dev.: 0.0048) MultiSource/Applications/hbd/hbd: 3.42% (1.5603 => 1.6137, std. dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.36% (0.4636 => 0.4792, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 3.33% (0.3180 => 0.3286, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.33% (0.3092 => 0.3195, std. dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 3.31% (0.3109 => 0.3212, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.26% (8.1363 => 8.4015, std. dev.: 0.0131) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.16% (14.3668 => 14.8208, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.06% (0.3826 => 0.3943, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.02% (1.1861 => 1.2219, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.01% (0.3650 => 0.3760, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.00% (5.7591 => 5.9317, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: 2.98% (0.4289 => 0.4417, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.97% (0.4103 => 0.4225, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3865 => 0.3974, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.82% (1.3050 => 1.3418, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.80% (2.0665 => 2.1243, std. dev.: 0.0061) MultiSource/Applications/d/make_dparser: 2.71% (3.3354 => 3.4258, std. dev.: 0.0148) MultiSource/Applications/Burg/burg: 2.70% (1.1642 => 1.1956, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.69% (1.5415 => 1.5829, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 2.65% (2.0273 => 2.0810, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.62% (0.5105 => 0.5239, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 2.60% (0.4620 => 0.4740, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.52% (0.4203 => 0.4309, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.52% (3.8723 => 3.9698, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.5859 => 1.6239, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6675 => 0.6829, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.24% (2.2024 => 2.2518, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.14% (0.9765 => 0.9974, std. dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 2.13% (1.2842 => 1.3116, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.06% (1.4186 => 1.4478, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6450 => 0.6574, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 1.74% (0.8921 => 0.9076, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.59% (17.1811 => 17.4551, std. dev.: 0.0290) MultiSource/Applications/siod/siod: 1.57% (2.2969 => 2.3329, std. dev.: 0.0038) MultiSource/Applications/minisat/minisat: 1.55% (0.7115 => 0.7225, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 1.47% (1.1840 => 1.2014, std. dev.: 0.0051) MultiSource/Applications/lemon/lemon: 1.21% (1.0722 => 1.0852, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (2.6778 => 2.9762, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.42% (4.2280 => 4.3726, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7501, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.90% (26.0924 => 26.5891, std. dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2136, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (1.5086 => 1.5341, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.55% (11.6436 => 11.8246, std. dev.: 0.0057) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2044, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.36% (2.6546 => 2.6907, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.14% (9.1159 => 9.2196, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/oourafft: 1.04% (6.6465 => 6.7155, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.02% (1.6805 => 1.6977, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.17% (5.2763 => 3.1568, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.00% (5.3855 => 3.7159, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.44% (5.3526 => 3.7231, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.14% (2.9384 => 2.5523, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: -10.05% (22.1758 => 19.9468, std. dev.: 0.0346) SingleSource/UnitTests/Vector/constpool: -5.10% (54.1659 => 51.4020, std. dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.83% (1.2373 => 1.1157, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -7.94% (1.5373 => 1.4152, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5538, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -4.63% (1.9577 => 1.8671, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5961, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4798, std. dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9045, std. dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4210, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0030, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: -1.70% (12.5348 => 12.3218, std. dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.30% (1.8329 => 1.8091, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 02:28:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 04:28:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120724092809.689EB2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2320?compare_to=2315&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2320, Order: 160661, Start Time: 2012-07-24 06:44:22, End Time: 2012-07-24 09:28:28 To: 2315, Order: 160660, Start Time: 2012-07-24 03:33:28, End Time: 2012-07-24 06:16:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (84 on baseline) Performance Improvements: 1 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (799 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.41% (0.2146 => 0.2262, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.62% (0.6283 => 0.6385, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.79% (15.9499 => 15.6645, std. dev.: 0.0180) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 12.92% (0.3460 => 0.3907, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.80% (0.3446 => 0.3887, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.78% (0.3465 => 0.3908, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.67% (0.3496 => 0.3939, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3442 => 0.3878, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.65% (0.3469 => 0.3908, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.61% (0.3488 => 0.3928, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 12.35% (0.3643 => 0.4093, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.27% (0.3650 => 0.4098, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.95% (0.3724 => 0.4169, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.84% (0.5826 => 0.6283, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.66% (0.5889 => 0.6340, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.56% (0.2103 => 0.2262, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.1620 => 0.1733, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 6.11% (0.7171 => 0.7609, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.48% (1.6211 => 1.7099, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.42% (1.5932 => 1.6796, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.21% (3.5627 => 3.7483, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.03% (0.5900 => 0.6197, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.01% (0.3930 => 0.4127, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.84% (0.4361 => 0.4572, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.80% (0.5000 => 0.5240, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.79% (0.4994 => 0.5233, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.74% (1.3152 => 1.3776, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.59% (0.4029 => 0.4214, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.36% (0.5026 => 0.5245, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: 4.33% (4.2109 => 4.3934, std. dev.: 0.0060) MultiSource/Applications/d/make_dparser: 4.14% (1.0781 => 1.1227, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.02% (0.2736 => 0.2846, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.01% (2.7292 => 2.8386, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.87% (0.2866 => 0.2977, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.76% (0.2792 => 0.2897, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.76% (0.2875 => 0.2983, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.73% (0.9909 => 1.0279, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hello: 3.72% (0.2714 => 0.2815, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 3.71% (0.2725 => 0.2826, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.65% (0.2738 => 0.2838, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.61% (1.9966 => 2.0687, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (1.9694 => 2.0400, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/objinst: 3.54% (0.2823 => 0.2923, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (2.1013 => 2.1757, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (0.3195 => 0.3308, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.48% (0.3362 => 0.3479, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.47% (2.0673 => 2.1391, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.47% (0.3890 => 0.4025, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 3.39% (0.3096 => 0.3201, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.36% (5.5417 => 5.7280, std. dev.: 0.0122) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.29% (0.4139 => 0.4275, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (0.4658 => 0.4811, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 3.27% (0.3726 => 0.3848, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.25% (4.6177 => 4.7679, std. dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 3.22% (23.5202 => 24.2773, std. dev.: 0.0174) MultiSource/Benchmarks/MallocBench/gs/gs: 3.15% (1.8794 => 1.9386, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.14% (0.3625 => 0.3739, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.02% (2.1653 => 2.2308, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: 3.02% (0.3678 => 0.3789, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.02% (0.3348 => 0.3449, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.01% (0.7875 => 0.8112, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3477 => 0.3580, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.91% (4.4195 => 4.5483, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (0.3903 => 0.4016, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.88% (0.9697 => 0.9976, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3690 => 0.3795, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 2.82% (0.4251 => 0.4371, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.77% (0.4146 => 0.4261, std. dev.: 0.0041) MultiSource/Applications/siod/siod: 2.73% (0.6634 => 0.6815, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.3845 => 0.3949, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.66% (1.4269 => 1.4648, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.59% (0.3981 => 0.4084, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.52% (0.5546 => 0.5686, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.24% (0.6435 => 0.6579, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 2.09% (0.5012 => 0.5117, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.27% (2.0346 => 2.0605, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 12.44% (2.5769 => 2.8975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6677, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8946, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1662, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2034, std. dev.: 0.0395) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2226, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.43% (1.0142 => 1.0287, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.41% (1.0927 => 1.1081, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.32% (2.4764 => 2.3941, std. dev.: 0.0098) MultiSource/Applications/kimwitu++/kc: -1.20% (11.9555 => 11.8117, std. dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.99% (25.4195 => 16.5246, std. dev.: 0.0136) SingleSource/Benchmarks/Dhrystone/fldry: -9.13% (17.2379 => 15.6645, std. dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/ary2: -7.87% (0.2402 => 0.2213, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7891, std. dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: -3.68% (14.0481 => 13.5307, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.94% (0.6140 => 0.6021, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5791, std. dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.15% (3.3991 => 3.3599, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 03:08:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 05:08:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120724100812.2594C2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2321?compare_to=2318&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2321, Order: 160664, Start Time: 2012-07-24 08:54:15, End Time: 2012-07-24 10:08:30 To: 2318, Order: 160663, Start Time: 2012-07-24 07:11:55, End Time: 2012-07-24 08:26:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (141 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.39% (2.0176 => 2.3079, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 10.50% (0.5818 => 0.6429, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.34% (0.7061 => 0.7791, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.33% (0.5748 => 0.6342, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 8.75% (0.3578 => 0.3891, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.56% (0.3623 => 0.3933, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 8.48% (0.3646 => 0.3955, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3601 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.44% (0.3663 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.42% (0.3789 => 0.4108, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.41% (0.3650 => 0.3957, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3914 => 0.4236, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.14% (0.4003 => 0.4329, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.07% (0.3940 => 0.4258, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.96% (1.3693 => 1.4783, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.20% (0.1986 => 0.2129, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.02% (0.4328 => 0.4632, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.72% (0.2781 => 0.2968, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.69% (0.7038 => 0.7509, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.50% (0.4062 => 0.4326, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.44% (3.9660 => 4.2214, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.36% (0.5265 => 0.5600, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.36% (0.2782 => 0.2959, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 6.34% (0.2760 => 0.2935, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.32% (0.2596 => 0.2760, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 6.30% (0.2937 => 0.3122, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.29% (0.2607 => 0.2771, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.29% (0.3022 => 0.3212, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.22% (0.2765 => 0.2937, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.21% (0.7710 => 0.8189, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.21% (1.9828 => 2.1059, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2690 => 0.2857, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.20% (0.2966 => 0.3150, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.18% (0.2655 => 0.2819, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.16% (0.2726 => 0.2894, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2628 => 0.2789, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.03% (0.3899 => 0.4134, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (0.3149 => 0.3338, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.99% (0.1819 => 0.1928, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.99% (0.3489 => 0.3698, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2761 => 0.2926, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.95% (0.4390 => 0.4651, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.93% (0.2696 => 0.2856, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.92% (0.3107 => 0.3291, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.87% (0.3580 => 0.3790, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.82% (0.2988 => 0.3162, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.76% (0.3192 => 0.3376, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.74% (0.3485 => 0.3685, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.59% (0.6959 => 0.7348, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.44% (0.3453 => 0.3641, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.4379 => 0.4616, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 5.38% (0.3293 => 0.3470, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.29% (0.3534 => 0.3721, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.21% (1.2193 => 1.2828, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.20% (0.4016 => 0.4225, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.18% (0.5577 => 0.5866, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.11% (0.3756 => 0.3948, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.09% (0.3868 => 0.4065, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.04% (16.6129 => 17.4503, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.97% (0.9199 => 0.9656, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.86% (13.8202 => 14.4913, std. dev.: 0.0160) MultiSource/Benchmarks/McCat/09-vor/vor: 4.68% (0.2925 => 0.3062, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.65% (0.2945 => 0.3082, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (13.2842 => 13.8994, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.60% (1.4563 => 1.5233, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.50% (1.3813 => 1.4435, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 4.50% (0.2243 => 0.2344, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.47% (0.5637 => 0.5889, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.2914 => 0.3043, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.39% (1.3819 => 1.4425, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.36% (1.1364 => 1.1859, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.34% (0.3246 => 0.3387, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.28% (3.8646 => 4.0299, std. dev.: 0.0110) MultiSource/Applications/spiff/spiff: 4.28% (0.7506 => 0.7827, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.24% (1.0594 => 1.1043, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 4.21% (1.2292 => 1.2810, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.21% (0.8310 => 0.8660, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.15% (7.2180 => 7.5174, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.04% (1.3245 => 1.3780, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.02% (1.1061 => 1.1506, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.99% (0.7460 => 0.7758, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.95% (1.9270 => 2.0031, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.94% (0.3755 => 0.3903, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.70% (4.3801 => 4.5422, std. dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 3.67% (0.2995 => 0.3105, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (4.4433 => 4.6060, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.57% (3.6692 => 3.8001, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.55% (0.4791 => 0.4961, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.54% (4.9865 => 5.1629, std. dev.: 0.0109) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3220 => 0.3329, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.32% (2.1791 => 2.2514, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.31% (0.8698 => 0.8986, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.16% (0.6135 => 0.6329, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.16% (1.1333 => 1.1691, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.07% (0.6283 => 0.6476, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.88% (3.1889 => 3.2808, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4113 => 0.4227, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.64% (8.4961 => 8.7207, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 2.56% (6.5754 => 6.7439, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 2.43% (14.8535 => 15.2139, std. dev.: 0.0132) MultiSource/Applications/sqlite3/sqlite3: 2.38% (16.2614 => 16.6491, std. dev.: 0.0184) MultiSource/Applications/ClamAV/clamscan: 2.38% (14.5298 => 14.8752, std. dev.: 0.0198) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (3.2742 => 3.3498, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.09% (1.5188 => 1.5506, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 1.98% (4.6629 => 4.7552, std. dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/bigfib: 1.89% (0.6250 => 0.6368, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.37% (0.9108 => 0.9233, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.33% (33.2944 => 33.7357, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5115, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 25.15% (1.8175 => 2.2746, std. dev.: 0.0443) SingleSource/Benchmarks/Misc/mandel-2: 8.09% (1.2998 => 1.4050, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.20% (0.9996 => 1.0516, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: 4.48% (7.4271 => 7.7602, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7328, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4745, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9771, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.7688 => 1.8141, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0310 => 1.0556, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5336, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (1.9290 => 1.9554, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1394, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.22% (22.5627 => 21.1586, std. dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.75% (0.0997 => 0.0840, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.81% (1.2308 => 1.0978, std. dev.: 0.0072) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9185, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.72% (3.0263 => 2.9439, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.67% (0.8342 => 0.8119, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.42% (0.4867 => 0.4749, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5066, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7083, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2445, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.54% (20.3410 => 20.0273, std. dev.: 0.0647) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0058, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2470, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4927, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std. dev.: 0.0060) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2195, std. dev.: 0.0435) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8086, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 03:38:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 05:38:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120724103832.7F6212A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2322?compare_to=2319&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2322, Order: 160664, Start Time: 2012-07-24 09:19:34, End Time: 2012-07-24 10:38:51 To: 2319, Order: 160663, Start Time: 2012-07-24 07:31:50, End Time: 2012-07-24 08:51:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (96 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (753 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.5574 => 56.4924, std. dev.: 0.0807) SingleSource/Benchmarks/Shootout/ary3: 1.34% (3.7102 => 3.7600, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.02% (1.3021 => 1.3154, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -5.38% (13.8996 => 13.1512, std. dev.: 0.0093) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.85% (10.3673 => 13.1512, std. dev.: 0.0093) SingleSource/UnitTests/ObjC/trivial-interface: 12.32% (0.3473 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3543 => 0.3974, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 12.15% (0.3497 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.09% (0.3516 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.85% (0.3561 => 0.3983, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.59% (0.3694 => 0.4122, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.49% (1.1194 => 1.2480, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 11.21% (0.3828 => 0.4257, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.09% (0.3886 => 0.4317, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.80% (1.7609 => 1.9159, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.42% (2.2022 => 2.3876, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.36% (0.5925 => 0.6361, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 7.15% (0.6030 => 0.6461, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.14% (0.7326 => 0.7776, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.00% (0.2065 => 0.2189, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.85% (0.3177 => 0.3363, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.74% (10.4361 => 10.9310, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.68% (7.0540 => 7.3841, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.66% (0.4615 => 0.4830, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.61% (0.4879 => 0.5104, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 4.24% (0.3282 => 0.3421, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.23% (0.8172 => 0.8518, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 3.95% (9.4845 => 9.8594, std. dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: 3.83% (0.7433 => 0.7718, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (4.9449 => 5.1323, std. dev.: 0.0081) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.2905 => 0.3015, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.75% (0.4636 => 0.4810, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.69% (5.0018 => 5.1863, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hello: 3.68% (0.2714 => 0.2814, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.67% (0.3136 => 0.3251, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.56% (0.5569 => 0.5767, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.55% (0.2872 => 0.2974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.51% (0.3052 => 0.3159, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 3.42% (0.3098 => 0.3204, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.36% (0.5860 => 0.6057, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.33% (4.2646 => 4.4068, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sieve: 3.28% (0.3603 => 0.3721, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3232 => 0.3336, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.19% (0.4203 => 0.4337, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 3.17% (0.3283 => 0.3387, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.16% (2.0665 => 2.1318, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 3.14% (1.5603 => 1.6093, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists: 3.13% (0.3422 => 0.3529, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.12% (0.3650 => 0.3764, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.12% (0.4103 => 0.4231, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.10% (0.3865 => 0.3985, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.09% (8.1363 => 8.3878, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.08% (0.4064 => 0.4189, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.01% (0.3423 => 0.3526, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 2.88% (0.7835 => 0.8061, std. dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 2.84% (5.7591 => 5.9228, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.83% (14.3668 => 14.7731, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.82% (0.3826 => 0.3934, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 2.77% (0.3684 => 0.3786, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (0.3935 => 0.4043, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.74% (1.1861 => 1.2186, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: 2.67% (0.4048 => 0.4156, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.61% (1.3050 => 1.3391, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6456 => 0.6621, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.53% (3.3354 => 3.4197, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.51% (0.5105 => 0.5233, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.50% (1.5415 => 1.5801, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 2.45% (0.4620 => 0.4733, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.38% (1.1642 => 1.1919, std. dev.: 0.0075) MultiSource/Applications/treecc/treecc: 2.24% (2.0273 => 2.0727, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.19% (1.2842 => 1.3123, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.07% (0.8067 => 0.8234, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.05% (0.6675 => 0.6812, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.2024 => 2.2461, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.98% (0.9765 => 0.9958, std. dev.: 0.0040) MultiSource/Applications/lua/lua: 1.97% (3.8723 => 3.9484, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.89% (0.6450 => 0.6572, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.72% (0.5981 => 0.6084, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.57% (1.4186 => 1.4409, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.53% (17.1811 => 17.4438, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 1.30% (0.8921 => 0.9037, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.16% (2.6778 => 2.9767, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.45% (4.2280 => 4.3739, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.34% (3.6395 => 3.7609, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.84% (26.0924 => 26.5721, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/hash2: 1.80% (3.1578 => 3.2146, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5086 => 1.5355, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 1.64% (3.6994 => 3.7600, std. dev.: 0.0042) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2043, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.41% (9.1159 => 9.2441, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8041, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6895, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.05% (6.6465 => 6.7163, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.29% (5.2763 => 3.1503, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.25% (5.3855 => 3.7026, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.63% (5.3526 => 3.7130, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.40% (2.9384 => 2.5447, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.18% (22.1758 => 19.9177, std. dev.: 0.0320) SingleSource/UnitTests/Vector/constpool: -5.16% (54.1659 => 51.3691, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (3.8922 => 3.8487, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.33% (0.0998 => 0.0835, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2373 => 1.1062, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel-2: -7.27% (1.5373 => 1.4256, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.84% (1.9577 => 1.8629, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5957, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4908, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9046, std. dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4262, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0011, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/lists: -1.66% (12.5348 => 12.3267, std. dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 04:50:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 06:50:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120724115034.B1C272A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2323?compare_to=2321&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2323, Order: 160667, Start Time: 2012-07-24 10:36:29, End Time: 2012-07-24 11:50:54 To: 2321, Order: 160664, Start Time: 2012-07-24 08:54:15, End Time: 2012-07-24 10:08:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (145 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.25% (79.9696 => 80.9675, std. dev.: 0.3829) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.05% (2.0176 => 2.3010, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 10.83% (0.5818 => 0.6448, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.66% (0.5748 => 0.6361, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.57% (0.7061 => 0.7807, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.42% (0.3578 => 0.3915, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: 9.16% (0.3601 => 0.3931, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.13% (0.3646 => 0.3979, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.10% (0.3650 => 0.3982, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 9.06% (0.3663 => 0.3995, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.03% (0.3789 => 0.4131, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.00% (0.3623 => 0.3949, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.87% (0.3914 => 0.4261, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.84% (0.4003 => 0.4357, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 8.73% (1.3693 => 1.4889, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.60% (0.3940 => 0.4279, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.95% (0.4062 => 0.4385, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.79% (0.4328 => 0.4665, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.62% (0.2781 => 0.2993, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.45% (0.3022 => 0.3247, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.40% (0.4390 => 0.4715, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wc: 7.29% (0.2937 => 0.3151, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.29% (0.2690 => 0.2886, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2655 => 0.2848, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.23% (0.2726 => 0.2923, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2760 => 0.2959, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2782 => 0.2982, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.08% (1.9828 => 2.1232, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2628 => 0.2814, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.05% (0.2765 => 0.2960, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.02% (0.3149 => 0.3370, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.98% (0.3107 => 0.3324, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.98% (0.2966 => 0.3173, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.94% (0.2696 => 0.2883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2761 => 0.2952, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.88% (0.7038 => 0.7522, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.87% (0.7710 => 0.8240, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.82% (0.3489 => 0.3727, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.66% (0.2988 => 0.3187, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.66% (3.9660 => 4.2301, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.62% (0.3580 => 0.3817, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.61% (0.3192 => 0.3403, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.54% (0.3485 => 0.3713, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.54% (0.3899 => 0.4154, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.51% (0.2596 => 0.2765, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.50% (0.5265 => 0.5607, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 6.34% (0.3453 => 0.3672, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3534 => 0.3750, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.07% (0.3293 => 0.3493, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.98% (0.4016 => 0.4256, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: 5.92% (0.3868 => 0.4097, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (0.3756 => 0.3976, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.69% (0.4379 => 0.4628, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.59% (0.6959 => 0.7348, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.45% (1.2193 => 1.2857, std. dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: 5.29% (16.6129 => 17.4919, std. dev.: 0.0267) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.21% (0.9199 => 0.9678, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 5.20% (13.8202 => 14.5388, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.15% (0.5577 => 0.5864, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (0.2925 => 0.3074, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 5.01% (1.2292 => 1.2908, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.73% (0.7506 => 0.7861, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.69% (13.2842 => 13.9078, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.69% (0.3755 => 0.3931, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.59% (1.4563 => 1.5232, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3246 => 0.3395, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.5637 => 0.5895, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.54% (1.1364 => 1.1880, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.51% (1.3813 => 1.4436, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.49% (7.2180 => 7.5424, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.43% (1.3819 => 1.4431, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.42% (0.7460 => 0.7790, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.34% (3.8646 => 4.0322, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.33% (1.9270 => 2.0105, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.33% (1.1061 => 1.1540, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 4.32% (0.8310 => 0.8669, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1049, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.24% (1.3245 => 1.3807, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.07% (4.3801 => 4.5583, std. dev.: 0.0097) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (4.4433 => 4.6177, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.83% (3.6692 => 3.8096, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 3.81% (0.2995 => 0.3109, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.76% (0.8698 => 0.9025, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3220 => 0.3341, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (0.4791 => 0.4967, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.63% (4.9865 => 5.1675, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 3.50% (2.1791 => 2.2553, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.47% (0.6283 => 0.6501, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (1.1333 => 1.1716, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 3.22% (3.1889 => 3.2917, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4113 => 0.4243, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.08% (0.6135 => 0.6324, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 2.91% (8.4961 => 8.7430, std. dev.: 0.0070) MultiSource/Applications/JM/ldecod/ldecod: 2.71% (6.5754 => 6.7536, std. dev.: 0.0160) MultiSource/Applications/ClamAV/clamscan: 2.66% (14.5298 => 14.9168, std. dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: 2.62% (14.8535 => 15.2420, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 2.57% (16.2614 => 16.6795, std. dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.53% (2.1007 => 2.1538, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 2.51% (0.6250 => 0.6407, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.47% (3.2742 => 3.3552, std. dev.: 0.0190) MultiSource/Applications/oggenc/oggenc: 2.45% (4.6629 => 4.7772, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.5188 => 1.5556, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.66% (0.6744 => 0.6856, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (0.9108 => 0.9235, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.37% (33.2944 => 33.7521, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.18% (1.0313 => 1.0435, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.01% (3.7467 => 3.7845, std. dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.62% (0.4846 => 0.6960, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 25.69% (1.8175 => 2.2844, std. dev.: 0.0358) SingleSource/Benchmarks/Misc/mandel-2: 8.45% (1.2998 => 1.4096, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.22% (0.9996 => 1.0518, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.36% (7.4271 => 7.7511, std. dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7335, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9885, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4744, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8149, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.45% (2.0200 => 2.0493, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.26% (1.9290 => 1.9533, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 1.18% (10.7476 => 10.8739, std. dev.: 0.0419) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1398, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1803, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.15% (0.0997 => 0.0816, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2308 => 1.1046, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.71% (0.8342 => 0.8116, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9479, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.18% (20.3410 => 19.8968, std. dev.: 0.0720) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2254, std. dev.: 0.0098) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7093, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8577, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.3167 => 5.2461, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2239, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8079, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 05:25:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 07:25:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120724122536.B3B432A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2324?compare_to=2322&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2324, Order: 160667, Start Time: 2012-07-24 11:07:01, End Time: 2012-07-24 12:25:57 To: 2322, Order: 160664, Start Time: 2012-07-24 09:19:34, End Time: 2012-07-24 10:38:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (101 on baseline) Performance Improvements: 1 (25 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (747 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.32% (7.9393 => 8.0443, std. dev.: 0.0208) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.97% (3.7600 => 3.6861, std. dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.66% (10.3673 => 13.0277, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 12.78% (0.3473 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.61% (0.3497 => 0.3938, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.48% (0.3543 => 0.3985, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.40% (0.3516 => 0.3952, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.36% (0.3543 => 0.3981, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.33% (0.3561 => 0.4000, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.05% (0.3694 => 0.4139, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.62% (0.3828 => 0.4273, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.59% (0.3927 => 0.4382, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.55% (1.1194 => 1.2487, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.87% (1.7609 => 1.9171, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.65% (2.2022 => 2.3927, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5925 => 0.6357, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.23% (0.6030 => 0.6466, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.2065 => 0.2203, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.52% (0.3177 => 0.3384, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.14% (0.7326 => 0.7776, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.97% (0.1892 => 0.2005, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.77% (0.4615 => 0.4835, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.73% (0.4879 => 0.5110, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.73% (10.4361 => 10.9296, std. dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.66% (7.0540 => 7.3826, std. dev.: 0.0106) MultiSource/Applications/lambda-0_1_3/lambda: 4.48% (0.7433 => 0.7766, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.18% (0.5569 => 0.5802, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.99% (0.8172 => 0.8498, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 3.86% (9.4845 => 9.8507, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.9449 => 5.1357, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (5.0018 => 5.1936, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2831 => 0.2936, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.62% (0.2871 => 0.2975, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.60% (1.5603 => 1.6164, std. dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 3.58% (0.2905 => 0.3009, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.57% (0.3052 => 0.3161, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.51% (0.7835 => 0.8110, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: 3.49% (0.3098 => 0.3206, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.41% (0.5860 => 0.6060, std. dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.33% (0.3121 => 0.3225, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (4.2646 => 4.4055, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.29% (0.3865 => 0.3992, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.23% (0.3650 => 0.3768, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.23% (8.1363 => 8.3987, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.19% (0.3136 => 0.3236, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3423 => 0.3532, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.16% (0.3162 => 0.3262, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3232 => 0.3334, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.14% (0.4103 => 0.4232, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.13% (0.3422 => 0.3529, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.10% (2.0665 => 2.1306, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 3.08% (0.3603 => 0.3714, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.08% (5.7591 => 5.9365, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 3.08% (0.3283 => 0.3384, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.08% (0.4064 => 0.4189, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.4636 => 0.4777, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 3.03% (0.4289 => 0.4419, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 3.01% (0.3684 => 0.3795, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.98% (1.1861 => 1.2214, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.95% (0.3826 => 0.3939, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.83% (0.4203 => 0.4322, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.83% (1.3050 => 1.3419, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.79% (3.3354 => 3.4284, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (14.3668 => 14.7624, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 2.68% (2.0273 => 2.0816, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 2.62% (0.6456 => 0.6625, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.59% (0.3935 => 0.4037, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.57% (1.1642 => 1.1941, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 2.47% (0.4048 => 0.4148, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.43% (0.5105 => 0.5229, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.43% (1.5415 => 1.5789, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/hash2: 2.42% (0.4620 => 0.4732, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.33% (0.8067 => 0.8255, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 2.33% (1.2842 => 1.3141, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.25% (3.8723 => 3.9596, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.24% (0.9765 => 0.9984, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (0.6675 => 0.6819, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.15% (1.4186 => 1.4491, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.14% (0.6450 => 0.6588, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.08% (2.2024 => 2.2482, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.96% (1.5859 => 1.6170, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5981 => 0.6096, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.61% (17.1811 => 17.4578, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 1.43% (0.8921 => 0.9049, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.18% (1.1840 => 1.1980, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.15% (2.6778 => 2.9764, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.44% (4.2280 => 4.3734, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7538, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.08% (1.0313 => 1.0527, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 1.81% (26.0924 => 26.5651, std. dev.: 0.0148) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5086 => 1.5329, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 1.44% (2.2771 => 2.3099, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.42% (2.6546 => 2.6923, std. dev.: 0.0015) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8038, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/oourafft: 1.04% (6.6465 => 6.7159, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.01% (1.6805 => 1.6975, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9195, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.18% (5.2763 => 3.1564, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.24% (5.3855 => 3.7032, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.64% (5.3526 => 3.7128, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.51% (2.9384 => 2.5415, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -10.08% (22.1758 => 19.9405, std. dev.: 0.0258) SingleSource/UnitTests/Vector/constpool: -5.22% (54.1659 => 51.3405, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.01% (3.8922 => 3.8527, std. dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.83% (0.0998 => 0.0840, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.54% (1.2373 => 1.1069, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -6.88% (1.5373 => 1.4316, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5961, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -4.47% (1.9577 => 1.8702, std. dev.: 0.0264) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4787, std. dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (8.1563 => 7.9108, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.6802 => 8.4374, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9994, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/lists: -1.73% (12.5348 => 12.3179, std. dev.: 0.0053) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8086, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 05:40:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 07:40:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120724124002.11C6C2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2325?compare_to=2320&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2325, Order: 160664, Start Time: 2012-07-24 09:57:04, End Time: 2012-07-24 12:40:23 To: 2320, Order: 160661, Start Time: 2012-07-24 06:44:22, End Time: 2012-07-24 09:28:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (97 on baseline) Performance Improvements: 2 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (786 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 17.20% (101.0611 => 118.4474, std. dev.: 0.0715) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.70% (0.2262 => 0.2133, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.63% (0.6385 => 0.6281, std. dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.87% (0.3465 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.81% (0.3442 => 0.3883, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.74% (0.3446 => 0.3885, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 12.69% (0.3460 => 0.3899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.65% (0.3469 => 0.3908, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/for-in: 12.61% (0.3496 => 0.3937, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.56% (0.3488 => 0.3926, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.08% (0.3643 => 0.4083, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 12.03% (0.3650 => 0.4089, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.71% (0.3724 => 0.4160, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.90% (0.5826 => 0.6286, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.79% (0.5889 => 0.6348, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 6.00% (0.7171 => 0.7601, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.32% (1.6211 => 1.7074, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.32% (3.5627 => 3.7522, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.27% (0.5026 => 0.5291, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.02% (0.5900 => 0.6196, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 4.86% (0.4029 => 0.4225, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/fibo: 4.66% (0.2725 => 0.2852, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.65% (0.4361 => 0.4564, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 4.61% (0.2714 => 0.2839, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.60% (0.2738 => 0.2864, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.59% (1.3152 => 1.3756, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.59% (0.2875 => 0.3007, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.58% (0.2729 => 0.2854, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.51% (0.4994 => 0.5219, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 4.50% (0.2803 => 0.2929, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.39% (1.5932 => 1.6631, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.38% (0.5000 => 0.5219, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.37% (0.2792 => 0.2914, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 4.36% (0.3096 => 0.3231, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.33% (0.3930 => 0.4100, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.2866 => 0.2989, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.22% (4.2109 => 4.3886, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2750 => 0.2865, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.16% (0.2811 => 0.2928, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.14% (2.0673 => 2.1528, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 4.12% (0.2813 => 0.2929, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 4.10% (1.0781 => 1.1223, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 4.09% (0.3004 => 0.3127, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2823 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.06% (0.2780 => 0.2893, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.3258 => 0.3390, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.02% (0.2911 => 0.3028, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.01% (0.9909 => 1.0306, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.96% (0.3362 => 0.3495, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.91% (2.7292 => 2.8358, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.89% (0.3060 => 0.3179, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.89% (0.3267 => 0.3394, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.80% (0.3317 => 0.3443, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.78% (0.3124 => 0.3242, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.76% (0.2736 => 0.2839, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.72% (0.3195 => 0.3314, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.72% (1.9694 => 2.0426, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 3.67% (0.9697 => 1.0053, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.63% (0.3282 => 0.3401, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.57% (0.3726 => 0.3859, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.56% (0.3678 => 0.3809, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.56% (0.3625 => 0.3754, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.52% (0.3348 => 0.3466, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.50% (0.4658 => 0.4821, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (1.9966 => 2.0663, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists1: 3.34% (0.3477 => 0.3593, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.31% (4.4195 => 4.5657, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.31% (0.3690 => 0.3812, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.31% (0.3903 => 0.4032, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.19% (0.3890 => 0.4014, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.12% (2.1013 => 2.1668, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 3.11% (23.5202 => 24.2526, std. dev.: 0.0152) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.3845 => 0.3962, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 3.01% (0.4146 => 0.4271, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.95% (0.4139 => 0.4261, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 2.94% (2.1653 => 2.2290, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 2.92% (4.6177 => 4.7524, std. dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/hash2: 2.92% (0.4251 => 0.4375, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.91% (0.3981 => 0.4097, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.88% (5.5417 => 5.7013, std. dev.: 0.0131) MultiSource/Benchmarks/MallocBench/gs/gs: 2.86% (1.8794 => 1.9332, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 2.69% (0.5546 => 0.5695, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 2.50% (0.7875 => 0.8072, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 2.33% (0.5012 => 0.5129, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.21% (1.4269 => 1.4584, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.16% (0.6435 => 0.6574, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.11% (0.6634 => 0.6774, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 12.42% (2.5769 => 2.8970, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.2122 => 0.2238, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/objinst: 5.25% (12.0509 => 12.6832, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8919, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1705, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2071, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4584, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2218, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.48% (2.4764 => 2.3903, std. dev.: 0.0072) MultiSource/Applications/kimwitu++/kc: -1.47% (11.9555 => 11.7792, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5222, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: -10.16% (0.2402 => 0.2158, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -9.43% (17.2379 => 15.6125, std. dev.: 0.2987) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8087, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -3.64% (14.0481 => 13.5365, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.92% (0.6140 => 0.6022, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5764, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.15% (3.3991 => 3.3599, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 06:33:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 08:33:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120724133300.4C6AD2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2326?compare_to=2323&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2326, Order: 160668, Start Time: 2012-07-24 12:19:01, End Time: 2012-07-24 13:33:21 To: 2323, Order: 160667, Start Time: 2012-07-24 10:36:29, End Time: 2012-07-24 11:50:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (144 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.65% (54.5608 => 56.5537, std. dev.: 0.0886) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.10% (2.0176 => 2.3021, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.86% (0.5818 => 0.6450, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.66% (0.5748 => 0.6361, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.64% (0.7061 => 0.7812, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 9.42% (0.3578 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.25% (0.3601 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.15% (0.3650 => 0.3984, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 9.13% (0.3646 => 0.3979, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.11% (0.3623 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.09% (0.3663 => 0.3996, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.05% (0.3789 => 0.4132, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.94% (0.3914 => 0.4264, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.84% (1.3693 => 1.4903, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/parameter-passing: 8.69% (0.4003 => 0.4351, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.68% (0.3940 => 0.4282, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.83% (0.3130 => 0.3375, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.76% (0.4328 => 0.4664, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.70% (0.2781 => 0.2995, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 7.43% (0.2690 => 0.2890, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.36% (0.2607 => 0.2799, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.35% (0.2937 => 0.3153, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2655 => 0.2850, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 7.34% (0.4062 => 0.4360, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2782 => 0.2986, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2628 => 0.2819, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.25% (0.2760 => 0.2960, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.3107 => 0.3331, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 7.19% (0.2726 => 0.2922, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3022 => 0.3239, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.17% (1.9828 => 2.1249, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.05% (0.2696 => 0.2886, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.2966 => 0.3175, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.04% (0.7710 => 0.8253, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 7.02% (0.3149 => 0.3370, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2761 => 0.2953, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.91% (0.7038 => 0.7524, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.85% (0.3489 => 0.3728, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.84% (0.2721 => 0.2907, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.73% (0.3580 => 0.3821, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3192 => 0.3405, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.63% (0.2988 => 0.3186, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.59% (0.3899 => 0.4156, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (3.9660 => 4.2269, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.55% (0.5265 => 0.5610, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.51% (0.3485 => 0.3712, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.49% (0.3453 => 0.3677, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.15% (0.4390 => 0.4660, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 6.13% (0.3293 => 0.3495, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3534 => 0.3750, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.98% (0.4016 => 0.4256, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (0.3756 => 0.3977, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.87% (0.3868 => 0.4095, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.73% (0.4379 => 0.4630, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.6959 => 0.7352, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2945 => 0.3110, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.45% (1.2193 => 1.2858, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.33% (0.5577 => 0.5874, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 5.27% (16.6129 => 17.4881, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.22% (0.9199 => 0.9679, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.21% (13.8202 => 14.5402, std. dev.: 0.0096) MultiSource/Applications/hexxagon/hexxagon: 4.99% (1.2292 => 1.2905, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.84% (13.2842 => 13.9268, std. dev.: 0.0114) MultiSource/Applications/spiff/spiff: 4.84% (0.7506 => 0.7869, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.69% (0.3755 => 0.3931, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.67% (0.5637 => 0.5900, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (1.4563 => 1.5239, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3246 => 0.3396, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.56% (0.2914 => 0.3047, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.51% (1.1364 => 1.1876, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 4.49% (3.8646 => 4.0382, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.46% (7.2180 => 7.5402, std. dev.: 0.0120) MultiSource/Applications/Burg/burg: 4.44% (1.1061 => 1.1552, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 4.37% (1.9270 => 2.0112, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (0.8310 => 0.8672, std. dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.35% (1.3813 => 1.4414, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.31% (1.3819 => 1.4414, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.24% (1.3245 => 1.3806, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.23% (1.0594 => 1.1042, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.10% (0.7460 => 0.7766, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.95% (4.3801 => 4.5531, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.90% (4.4433 => 4.6168, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (3.6692 => 3.8101, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.84% (0.8698 => 0.9032, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 3.84% (0.2995 => 0.3110, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.76% (0.4791 => 0.4971, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.70% (0.3220 => 0.3339, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.64% (4.9865 => 5.1682, std. dev.: 0.0190) MultiSource/Applications/siod/siod: 3.57% (2.1791 => 2.2569, std. dev.: 0.0163) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.36% (1.1333 => 1.1714, std. dev.: 0.0090) MultiSource/Applications/d/make_dparser: 3.17% (3.1889 => 3.2900, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.05% (0.6135 => 0.6322, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 3.04% (0.4113 => 0.4238, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 2.94% (8.4961 => 8.7463, std. dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 2.66% (6.5754 => 6.7500, std. dev.: 0.0066) MultiSource/Applications/ClamAV/clamscan: 2.64% (14.5298 => 14.9137, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (2.1007 => 2.1558, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.61% (14.8535 => 15.2419, std. dev.: 0.0099) MultiSource/Applications/sqlite3/sqlite3: 2.55% (16.2614 => 16.6768, std. dev.: 0.0246) MultiSource/Applications/oggenc/oggenc: 2.48% (4.6629 => 4.7787, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.48% (3.2742 => 3.3553, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 2.45% (0.6250 => 0.6403, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.38% (1.5188 => 1.5549, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.52% (0.9108 => 0.9246, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 1.33% (33.2944 => 33.7379, std. dev.: 0.0156) MultiSource/Applications/lemon/lemon: 1.21% (1.0313 => 1.0438, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.02% (3.7467 => 3.7851, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5204, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 25.52% (1.8175 => 2.2814, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/mandel-2: 8.22% (1.2998 => 1.4066, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.19% (0.9996 => 1.0515, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7552, std. dev.: 0.0089) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7319, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4747, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.69% (1.7688 => 1.8163, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5089 => 1.5328, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: 1.33% (1.9290 => 1.9547, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.28% (9.0760 => 9.1923, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.01% (3.1071 => 3.1386, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.06% (22.5627 => 21.1960, std. dev.: 0.0169) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.05% (0.0997 => 0.0837, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2308 => 1.1107, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.70% (0.8342 => 0.8117, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.66% (3.0263 => 2.9458, std. dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2245, std. dev.: 0.0155) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9387, std. dev.: 0.0379) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5023, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7073, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.3167 => 5.2462, std. dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.13% (9.9194 => 9.8078, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2322, std. dev.: 0.0128) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 07:12:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 09:12:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120724141234.715222A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2327?compare_to=2324&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2327, Order: 160668, Start Time: 2012-07-24 12:54:03, End Time: 2012-07-24 14:12:54 To: 2324, Order: 160667, Start Time: 2012-07-24 11:07:01, End Time: 2012-07-24 12:25:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (101 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (748 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.42% (1.1069 => 1.1226, std. dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.63% (10.3673 => 13.0243, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/trivial-interface: 12.76% (0.3473 => 0.3916, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.56% (0.3543 => 0.3988, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.50% (0.3497 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.41% (0.3561 => 0.4003, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.40% (0.3516 => 0.3952, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.28% (0.3543 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.21% (0.3694 => 0.4145, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.55% (1.1194 => 1.2487, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: 11.55% (0.3828 => 0.4270, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.53% (0.3886 => 0.4334, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.43% (0.3927 => 0.4376, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.94% (1.7609 => 1.9184, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.66% (2.2022 => 2.3929, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.27% (0.5925 => 0.6356, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.23% (0.6030 => 0.6466, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 6.05% (0.7326 => 0.7769, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.97% (0.1892 => 0.2005, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.82% (0.3177 => 0.3362, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.77% (7.0540 => 7.3902, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.76% (0.4879 => 0.5111, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.73% (10.4361 => 10.9297, std. dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.70% (0.4615 => 0.4832, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 4.54% (0.3282 => 0.3431, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.45% (0.7433 => 0.7764, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.30% (0.8172 => 0.8523, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.09% (0.5569 => 0.5797, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 4.03% (0.3423 => 0.3561, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (9.4845 => 9.8603, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.9449 => 5.1359, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.4103 => 0.4261, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.80% (5.0018 => 5.1918, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.70% (0.3136 => 0.3252, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (0.4636 => 0.4806, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.56% (0.2891 => 0.2994, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.56% (1.5603 => 1.6158, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.55% (0.2872 => 0.2974, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.54% (0.7835 => 0.8112, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: 3.52% (0.2871 => 0.2972, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.49% (0.3121 => 0.3230, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.46% (0.5860 => 0.6063, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 3.45% (0.3098 => 0.3205, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.41% (4.2646 => 4.4102, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3180 => 0.3288, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.37% (0.3052 => 0.3155, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.34% (0.3232 => 0.3340, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.30% (8.1363 => 8.4045, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sieve: 3.28% (0.3603 => 0.3721, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.27% (0.3422 => 0.3534, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.24% (2.0665 => 2.1335, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.23% (0.3650 => 0.3768, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.21% (0.3865 => 0.3989, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.16% (0.3162 => 0.3262, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 3.15% (5.7591 => 5.9404, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary3: 3.11% (0.3283 => 0.3385, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.10% (0.4289 => 0.4422, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.03% (0.3826 => 0.3942, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.98% (0.4064 => 0.4185, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.97% (0.4203 => 0.4328, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.97% (1.1861 => 1.2213, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.84% (1.3050 => 1.3421, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 2.80% (0.3684 => 0.3787, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (14.3668 => 14.7609, std. dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.72% (0.3935 => 0.4042, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 2.71% (0.4620 => 0.4745, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.65% (1.1642 => 1.1951, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 2.62% (3.3354 => 3.4229, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 2.62% (0.4048 => 0.4154, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.60% (0.6456 => 0.6624, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.57% (2.0273 => 2.0794, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.47% (1.5415 => 1.5795, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.43% (0.8067 => 0.8263, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 2.31% (1.2842 => 1.3139, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 2.23% (3.8723 => 3.9585, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.18% (0.9765 => 0.9978, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (0.6675 => 0.6820, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.06% (0.6450 => 0.6583, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.06% (1.5859 => 1.6186, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.02% (2.2024 => 2.2468, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.96% (0.5981 => 0.6098, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.73% (1.4186 => 1.4431, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 1.53% (17.1811 => 17.4445, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/football/football: 1.47% (0.8921 => 0.9052, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.46% (0.7115 => 0.7219, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.28% (1.1840 => 1.1991, std. dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (2.6778 => 2.9761, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.41% (4.2280 => 4.3723, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7481, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.93% (26.0924 => 26.5947, std. dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/hash2: 1.78% (3.1578 => 3.2140, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5086 => 1.5342, std. dev.: 0.0022) MultiSource/Applications/aha/aha: 1.43% (3.1595 => 3.2046, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (2.6546 => 2.6921, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8043, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/oourafft: 1.05% (6.6465 => 6.7163, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.01% (1.6805 => 1.6974, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.24% (5.2763 => 3.1531, std. dev.: 0.0102) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.22% (5.3855 => 3.7043, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.52% (5.3526 => 3.7191, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.47% (2.9384 => 2.5426, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -10.09% (22.1758 => 19.9386, std. dev.: 0.0224) SingleSource/UnitTests/Vector/constpool: -5.33% (54.1659 => 51.2766, std. dev.: 0.0601) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.27% (1.2373 => 1.1226, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -7.77% (1.5373 => 1.4178, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.79% (1.9577 => 1.8639, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4847, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.13% (8.1563 => 7.9014, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4198, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 9.9999, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3226, std. dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.30% (1.8329 => 1.8090, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 08:24:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 10:24:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120724152445.E27C32A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2328?compare_to=2326&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2328, Order: 160673, Start Time: 2012-07-24 14:10:51, End Time: 2012-07-24 15:25:06 To: 2326, Order: 160668, Start Time: 2012-07-24 12:19:01, End Time: 2012-07-24 13:33:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.09% (2.0176 => 2.3018, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 10.88% (0.5818 => 0.6451, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.74% (0.7061 => 0.7819, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 10.70% (0.5748 => 0.6363, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.39% (0.3578 => 0.3914, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.32% (0.3650 => 0.3990, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 9.22% (0.3601 => 0.3933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.19% (0.3623 => 0.3956, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.15% (0.3663 => 0.3998, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.13% (0.3646 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.00% (0.3789 => 0.4130, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.92% (0.3914 => 0.4263, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.76% (0.3940 => 0.4285, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.72% (0.4003 => 0.4352, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.69% (1.3693 => 1.4883, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.98% (0.2655 => 0.2867, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.72% (0.4328 => 0.4662, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.55% (0.2781 => 0.2991, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.41% (0.4062 => 0.4363, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2782 => 0.2988, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.39% (0.2937 => 0.3154, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.36% (0.2607 => 0.2799, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.29% (0.2690 => 0.2886, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.26% (0.2726 => 0.2924, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2628 => 0.2817, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.17% (0.2760 => 0.2958, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.15% (0.3022 => 0.3238, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.15% (1.9828 => 2.1245, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2765 => 0.2961, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.05% (0.3149 => 0.3371, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary: 7.05% (0.3107 => 0.3326, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.01% (0.2966 => 0.3174, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.97% (0.5265 => 0.5632, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2761 => 0.2953, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.88% (0.3489 => 0.3729, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.88% (0.7038 => 0.7522, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2988 => 0.3190, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.72% (0.3899 => 0.4161, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.71% (0.7710 => 0.8227, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.68% (0.3580 => 0.3819, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3192 => 0.3405, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.66% (0.3485 => 0.3717, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.63% (3.9660 => 4.2288, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 6.37% (0.3453 => 0.3673, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.23% (0.3534 => 0.3754, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.20% (0.4390 => 0.4662, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 6.10% (0.3293 => 0.3494, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.10% (0.3756 => 0.3985, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.00% (0.4016 => 0.4257, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.89% (0.3868 => 0.4096, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.64% (0.2945 => 0.3111, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.45% (0.6959 => 0.7338, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.43% (1.2193 => 1.2855, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.21% (0.9199 => 0.9678, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.20% (13.8202 => 14.5386, std. dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 5.20% (16.6129 => 17.4764, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.09% (0.5577 => 0.5861, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.97% (1.4563 => 1.5287, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.2292 => 1.2901, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.78% (0.7506 => 0.7865, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.75% (13.2842 => 13.9158, std. dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.75% (0.2127 => 0.2228, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.2140 => 0.2241, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.71% (0.3755 => 0.3932, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3246 => 0.3395, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.5637 => 0.5895, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.56% (7.2180 => 7.5475, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.56% (0.2914 => 0.3047, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.56% (1.1364 => 1.1882, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/18-imp/imp: 4.53% (0.3220 => 0.3366, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.52% (0.7460 => 0.7797, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.50% (1.3813 => 1.4435, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.39% (1.3245 => 1.3827, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 4.38% (0.8310 => 0.8674, std. dev.: 0.0101) MultiSource/Benchmarks/nbench/nbench: 4.31% (1.0594 => 1.1051, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 4.28% (1.9270 => 2.0095, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 4.27% (3.8646 => 4.0298, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 4.25% (1.1061 => 1.1531, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.18% (1.3819 => 1.4396, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.09% (4.3801 => 4.5593, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.94% (4.4433 => 4.6184, std. dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: 3.84% (0.2995 => 0.3110, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.82% (3.6692 => 3.8093, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.72% (0.8698 => 0.9022, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.64% (4.9865 => 5.1680, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.59% (0.4791 => 0.4963, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 3.50% (0.2859 => 0.2959, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.44% (0.6135 => 0.6346, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.42% (1.1333 => 1.1721, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.36% (0.6283 => 0.6494, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.35% (2.1791 => 2.2520, std. dev.: 0.0039) MultiSource/Applications/d/make_dparser: 3.16% (3.1889 => 3.2896, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4113 => 0.4239, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 2.95% (8.4961 => 8.7469, std. dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: 2.69% (6.5754 => 6.7522, std. dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: 2.69% (14.5298 => 14.9204, std. dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: 2.61% (14.8535 => 15.2407, std. dev.: 0.0162) MultiSource/Applications/sqlite3/sqlite3: 2.58% (16.2614 => 16.6813, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.51% (2.1007 => 2.1535, std. dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: 2.50% (4.6629 => 4.7794, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 2.43% (0.6250 => 0.6402, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.42% (3.2742 => 3.3533, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (1.5188 => 1.5532, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.85% (0.6744 => 0.6869, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 1.32% (33.2944 => 33.7352, std. dev.: 0.0124) MultiSource/Applications/lemon/lemon: 1.21% (1.0313 => 1.0438, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 1.14% (3.7467 => 3.7894, std. dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.46% (5.7573 => 7.5107, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 25.62% (1.8175 => 2.2832, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/mandel-2: 7.95% (1.2998 => 1.4031, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.15% (0.9996 => 1.0511, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: 4.48% (7.4271 => 7.7595, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7343, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4757, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8161, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5355, std. dev.: 0.0029) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4522, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5950, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1964, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1682, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1393, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 1.01% (10.7476 => 10.8561, std. dev.: 0.0415) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.08% (22.5627 => 21.1920, std. dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.75% (0.0997 => 0.0830, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -10.88% (1.2308 => 1.0969, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3068, std. dev.: 0.0030) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.69% (0.8342 => 0.8118, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9473, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.15% (20.3410 => 19.9038, std. dev.: 0.0662) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2250, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5058, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7074, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8572, std. dev.: 0.0167) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2469, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2230, std. dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8079, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 08:51:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 10:51:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120724155131.DD4122A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2329?compare_to=2325&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2329, Order: 160668, Start Time: 2012-07-24 13:08:30, End Time: 2012-07-24 15:51:53 To: 2325, Order: 160664, Start Time: 2012-07-24 09:57:04, End Time: 2012-07-24 12:40:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (100 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (783 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.65% (1.6631 => 1.6906, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.94% (0.3446 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.87% (0.3465 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.80% (0.3460 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.78% (0.3442 => 0.3882, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.76% (0.3496 => 0.3942, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.74% (0.3469 => 0.3911, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.64% (0.3488 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.27% (0.3643 => 0.4090, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.22% (0.3650 => 0.4096, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.95% (0.3724 => 0.4169, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.60% (0.1063 => 0.1165, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.39% (0.5826 => 0.6315, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.30% (0.5889 => 0.6378, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1620 => 0.1735, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 6.41% (0.7171 => 0.7631, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 6.11% (1.5932 => 1.6906, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.35% (1.6211 => 1.7078, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.29% (0.5026 => 0.5292, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.27% (3.5627 => 3.7506, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (1.3152 => 1.3799, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.89% (0.4994 => 0.5238, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.82% (0.4361 => 0.4571, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.78% (0.5900 => 0.6182, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (0.5000 => 0.5237, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 4.72% (0.4029 => 0.4219, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 4.66% (0.9697 => 1.0149, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 4.62% (0.9909 => 1.0367, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.61% (0.3930 => 0.4111, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.57% (0.2866 => 0.2997, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 4.49% (1.0781 => 1.1265, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 4.44% (0.2725 => 0.2846, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.42% (0.2714 => 0.2834, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.35% (0.2875 => 0.3000, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.31% (4.2109 => 4.3924, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.27% (0.2738 => 0.2855, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.25% (0.2729 => 0.2845, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.24% (0.3258 => 0.3396, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.22% (0.2750 => 0.2866, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.17% (0.2803 => 0.2920, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.17% (0.3096 => 0.3225, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.15% (0.2792 => 0.2908, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.10% (0.3362 => 0.3500, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 4.04% (0.3267 => 0.3399, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 4.00% (0.2823 => 0.2936, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (2.0673 => 2.1496, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.95% (2.7292 => 2.8370, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 3.95% (0.2813 => 0.2924, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.92% (0.3060 => 0.3180, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.92% (0.2780 => 0.2889, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.89% (0.3317 => 0.3446, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.80% (0.2736 => 0.2840, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.3004 => 0.3118, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.79% (0.3195 => 0.3316, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 3.77% (0.2811 => 0.2917, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.75% (0.3124 => 0.3241, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.72% (0.3845 => 0.3988, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.71% (0.2911 => 0.3019, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (1.9966 => 2.0696, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (1.9694 => 2.0408, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.60% (0.4139 => 0.4288, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.56% (0.3625 => 0.3754, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.52% (0.3726 => 0.3857, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.49% (0.3348 => 0.3465, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.48% (0.3678 => 0.3806, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.42% (0.3890 => 0.4023, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.41% (23.5202 => 24.3225, std. dev.: 0.0139) MultiSource/Applications/SPASS/SPASS: 3.40% (5.5417 => 5.7300, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 3.39% (0.3477 => 0.3595, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.38% (0.3282 => 0.3393, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (2.1013 => 2.1723, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.26% (0.4658 => 0.4810, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.20% (0.3690 => 0.3808, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.12% (4.4195 => 4.5574, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 3.10% (0.7875 => 0.8119, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.09% (0.4146 => 0.4274, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.06% (2.1653 => 2.2316, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 3.02% (4.6177 => 4.7571, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: 3.01% (0.4251 => 0.4379, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.97% (0.3903 => 0.4019, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 2.91% (1.8794 => 1.9340, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.86% (0.3981 => 0.4095, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.43% (1.4269 => 1.4616, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 2.39% (0.5012 => 0.5132, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.37% (0.6634 => 0.6791, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.33% (0.6435 => 0.6585, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.27% (0.5546 => 0.5672, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.32% (2.0346 => 2.0615, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 12.43% (2.5769 => 2.8971, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6741, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 5.09% (1.8057 => 1.8977, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1681, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2076, std. dev.: 0.0408) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4586, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2241, std. dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.44% (1.0142 => 1.0288, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1050, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.02% (3.1169 => 3.1488, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.93% (2.4764 => 2.3791, std. dev.: 0.0079) MultiSource/Applications/kimwitu++/kc: -1.19% (11.9555 => 11.8129, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.98% (25.4195 => 16.5281, std. dev.: 0.0152) SingleSource/Benchmarks/Dhrystone/fldry: -10.61% (17.2379 => 15.4092, std. dev.: 0.2987) SingleSource/Benchmarks/Shootout-C++/ary2: -9.49% (0.2402 => 0.2174, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7958, std. dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/dry: -3.53% (14.0481 => 13.5529, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.91% (0.6140 => 0.6023, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5760, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.16% (3.3991 => 3.3596, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 08:59:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 10:59:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120724155936.F3E5D2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2330?compare_to=2327&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2330, Order: 160673, Start Time: 2012-07-24 14:40:54, End Time: 2012-07-24 15:59:58 To: 2327, Order: 160668, Start Time: 2012-07-24 12:54:03, End Time: 2012-07-24 14:12:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (96 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (753 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.42% (39.9806 => 42.5457, std. dev.: 0.1535) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.12% (54.8747 => 56.5852, std. dev.: 0.1135) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.76% (1.1226 => 1.1028, std. dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.62% (10.3673 => 13.0231, std. dev.: 0.0105) SingleSource/UnitTests/ObjC/trivial-interface: 12.64% (0.3473 => 0.3912, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.41% (0.3497 => 0.3931, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 12.34% (0.3516 => 0.3950, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.33% (0.3543 => 0.3980, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.28% (0.3543 => 0.3978, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/synchronized: 12.27% (0.3561 => 0.3998, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.02% (0.3694 => 0.4138, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.63% (1.1194 => 1.2496, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 11.57% (0.3828 => 0.4271, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 11.38% (0.3927 => 0.4374, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.37% (0.3886 => 0.4328, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.84% (1.7609 => 1.9166, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.61% (2.2022 => 2.3919, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.26% (0.5925 => 0.6355, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.21% (0.6030 => 0.6465, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 6.01% (0.7326 => 0.7766, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.82% (0.3177 => 0.3362, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 4.83% (10.4361 => 10.9400, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.82% (0.4879 => 0.5114, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.79% (0.4615 => 0.4836, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.67% (7.0540 => 7.3836, std. dev.: 0.0161) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.40% (0.7433 => 0.7760, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.04% (0.8172 => 0.8502, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (4.9449 => 5.1428, std. dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 3.91% (9.4845 => 9.8551, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.80% (5.0018 => 5.1921, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.65% (0.4636 => 0.4805, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.65% (0.5569 => 0.5772, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.58% (0.3826 => 0.3963, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.50% (0.5860 => 0.6065, std. dev.: 0.0060) MultiSource/Applications/hbd/hbd: 3.49% (1.5603 => 1.6148, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.38% (4.2646 => 4.4086, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 3.37% (0.7835 => 0.8099, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 3.29% (0.3098 => 0.3200, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.27% (0.4103 => 0.4237, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.20% (0.3121 => 0.3221, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.19% (0.3162 => 0.3263, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.19% (0.3136 => 0.3236, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3423 => 0.3532, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.18% (8.1363 => 8.3952, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary: 3.12% (0.3232 => 0.3333, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3603 => 0.3715, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.11% (5.7591 => 5.9381, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/lists: 3.07% (0.3422 => 0.3527, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.05% (0.3865 => 0.3983, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1861 => 1.2222, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.03% (0.4289 => 0.4419, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.02% (2.0665 => 2.1290, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.01% (0.3650 => 0.3760, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.90% (0.4203 => 0.4325, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.88% (0.4064 => 0.4181, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.85% (1.3050 => 1.3422, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 2.80% (0.3684 => 0.3787, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (14.3668 => 14.7626, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.71% (1.1642 => 1.1958, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.62% (1.5415 => 1.5819, std. dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.59% (2.0273 => 2.0799, std. dev.: 0.0065) MultiSource/Applications/d/make_dparser: 2.58% (3.3354 => 3.4216, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.48% (0.8067 => 0.8267, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 2.45% (0.4620 => 0.4733, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.43% (0.6456 => 0.6613, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.27% (0.5105 => 0.5221, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.21% (0.9765 => 0.9981, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 2.20% (1.2842 => 1.3125, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 2.19% (3.8723 => 3.9570, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.2024 => 2.2473, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.00% (1.5859 => 1.6176, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.98% (0.6675 => 0.6807, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.96% (0.5981 => 0.6098, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.88% (0.6450 => 0.6571, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.81% (1.4186 => 1.4443, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 1.60% (0.8921 => 0.9064, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.58% (17.1811 => 17.4524, std. dev.: 0.0288) MultiSource/Applications/siod/siod: 1.26% (2.2969 => 2.3258, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (2.6778 => 2.9761, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.49% (4.2280 => 4.3754, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7480, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.13% (1.0313 => 1.0533, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 1.74% (3.1578 => 3.2128, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 1.74% (26.0924 => 26.5466, std. dev.: 0.0153) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5086 => 1.5340, std. dev.: 0.0007) MultiSource/Applications/aha/aha: 1.45% (3.1595 => 3.2054, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.39% (11.6436 => 11.8052, std. dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.38% (2.6546 => 2.6913, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2273, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/oourafft: 1.06% (6.6465 => 6.7170, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.02% (1.6805 => 1.6976, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.00% (2.8904 => 2.9194, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.19% (5.2763 => 3.1555, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.25% (5.3855 => 3.7025, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.69% (5.3526 => 3.7098, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.45% (2.9384 => 2.5431, std. dev.: 0.0161) MultiSource/Applications/ClamAV/clamscan: -10.09% (22.1758 => 19.9384, std. dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: -5.27% (54.1659 => 51.3123, std. dev.: 0.0174) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.87% (1.2373 => 1.1028, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/mandel-2: -6.99% (1.5373 => 1.4298, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.81% (1.9577 => 1.8636, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4810, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (8.1563 => 7.9086, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.6802 => 8.4374, std. dev.: 0.0166) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0010, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -1.75% (12.5348 => 12.3155, std. dev.: 0.0075) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8094, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 11:00:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 13:00:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120724180044.3EA322A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2331?compare_to=2328&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2331, Order: 160675, Start Time: 2012-07-24 16:46:53, End Time: 2012-07-24 18:01:04 To: 2328, Order: 160673, Start Time: 2012-07-24 14:10:51, End Time: 2012-07-24 15:25:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.73% (55.6080 => 56.5674, std. dev.: 0.0772) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.25% (2.0176 => 2.3051, std. dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference-object: 11.17% (0.5818 => 0.6468, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.08% (0.5748 => 0.6385, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.92% (0.7061 => 0.7832, std. dev.: 0.0093) SingleSource/UnitTests/ObjC/trivial-interface: 9.50% (0.3578 => 0.3918, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.22% (0.3601 => 0.3933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.21% (0.3650 => 0.3986, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: 9.15% (0.3663 => 0.3998, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.11% (0.3623 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.08% (0.3646 => 0.3977, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 9.03% (0.3789 => 0.4131, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.92% (0.3914 => 0.4263, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.83% (0.3940 => 0.4288, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.74% (0.4003 => 0.4353, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 8.49% (1.3693 => 1.4855, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 7.91% (0.2781 => 0.3001, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.76% (0.3130 => 0.3373, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.76% (0.4328 => 0.4664, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2607 => 0.2801, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2782 => 0.2989, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.43% (0.2690 => 0.2890, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.43% (0.2760 => 0.2965, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 7.39% (0.2937 => 0.3154, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash: 7.39% (0.4062 => 0.4362, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.38% (0.2655 => 0.2851, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.35% (0.3022 => 0.3244, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.31% (0.2765 => 0.2967, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.30% (0.2726 => 0.2925, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.29% (1.9828 => 2.1274, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.3107 => 0.3331, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/methcall: 7.17% (0.2761 => 0.2959, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.15% (0.3149 => 0.3374, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.94% (0.3489 => 0.3731, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.92% (0.7038 => 0.7525, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.2721 => 0.2909, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 6.89% (0.2988 => 0.3194, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.86% (0.3192 => 0.3411, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.84% (0.3580 => 0.3825, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.84% (3.9660 => 4.2374, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.80% (0.5265 => 0.5623, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.71% (0.7710 => 0.8227, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.67% (0.3899 => 0.4159, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.66% (0.3485 => 0.3717, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.49% (0.3453 => 0.3677, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.26% (0.4390 => 0.4665, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 6.17% (0.3534 => 0.3752, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.15% (0.4016 => 0.4263, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.13% (0.3293 => 0.3495, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: 6.00% (0.3868 => 0.4100, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.99% (0.3756 => 0.3981, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.60% (0.6959 => 0.7349, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.60% (1.2193 => 1.2876, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.33% (0.5577 => 0.5874, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.25% (16.6129 => 17.4858, std. dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.15% (0.9199 => 0.9673, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 5.10% (1.2292 => 1.2919, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 5.10% (13.8202 => 14.5244, std. dev.: 0.0098) MultiSource/Applications/spiff/spiff: 5.05% (0.7506 => 0.7885, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.83% (1.4563 => 1.5266, std. dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.80% (0.2914 => 0.3054, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.79% (0.3755 => 0.3935, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.65% (0.3246 => 0.3397, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.62% (13.2842 => 13.8981, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.62% (1.1364 => 1.1889, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.5637 => 0.5895, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.44% (7.2180 => 7.5386, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.42% (1.3813 => 1.4423, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.41% (1.3819 => 1.4428, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 4.34% (1.0594 => 1.1054, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 4.33% (0.8310 => 0.8670, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.33% (1.3245 => 1.3818, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 4.30% (3.8646 => 4.0306, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 4.24% (1.9270 => 2.0087, std. dev.: 0.0050) MultiSource/Applications/Burg/burg: 4.20% (1.1061 => 1.1526, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.14% (0.7460 => 0.7769, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.01% (3.6692 => 3.8163, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (4.3801 => 4.5526, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.90% (0.8698 => 0.9037, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.82% (4.4433 => 4.6131, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3220 => 0.3341, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (0.4791 => 0.4967, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.55% (4.9865 => 5.1637, std. dev.: 0.0204) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.44% (1.1333 => 1.1723, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 3.37% (2.1791 => 2.2525, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.26% (0.6283 => 0.6488, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.21% (0.4113 => 0.4245, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.98% (3.1889 => 3.2840, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.95% (8.4961 => 8.7464, std. dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.93% (0.6135 => 0.6315, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (6.5754 => 6.7497, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 2.64% (14.8535 => 15.2449, std. dev.: 0.0146) MultiSource/Applications/sqlite3/sqlite3: 2.62% (16.2614 => 16.6876, std. dev.: 0.0332) MultiSource/Applications/ClamAV/clamscan: 2.56% (14.5298 => 14.9014, std. dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.50% (3.2742 => 3.3560, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (2.1007 => 2.1531, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 2.40% (4.6629 => 4.7748, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.38% (0.6250 => 0.6399, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.34% (1.5188 => 1.5544, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.52% (0.9108 => 0.9246, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.50% (0.6744 => 0.6845, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.27% (1.0313 => 1.0444, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 1.11% (33.2944 => 33.6651, std. dev.: 0.0047) MultiSource/Applications/lua/lua: 1.00% (3.7467 => 3.7843, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.46% (5.7573 => 7.5110, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: 24.17% (1.8175 => 2.2567, std. dev.: 0.0495) SingleSource/Benchmarks/Misc/mandel-2: 7.42% (1.2998 => 1.3963, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.24% (0.9996 => 1.0520, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7557, std. dev.: 0.0130) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7316, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4750, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.37% (1.0310 => 1.0554, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.34% (0.9692 => 0.9919, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5343, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5945, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6862, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.01% (3.1071 => 3.1384, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.16% (22.5627 => 21.1737, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.85% (0.0997 => 0.0819, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.58% (1.0460 => 0.8621, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.16% (1.2308 => 1.1057, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std. dev.: 0.0064) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9447, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.69% (0.8342 => 0.8118, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.55% (0.4867 => 0.4743, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -2.21% (6.3560 => 6.2155, std. dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.97% (20.3410 => 19.9408, std. dev.: 0.0545) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5091, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7075, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0057, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0121) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4932, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2520, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2278, std. dev.: 0.0102) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8086, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 11:05:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 13:05:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120724180516.8E4292A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2332?compare_to=2330&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2332, Order: 160675, Start Time: 2012-07-24 16:46:42, End Time: 2012-07-24 18:05:37 To: 2330, Order: 160673, Start Time: 2012-07-24 14:40:54, End Time: 2012-07-24 15:59:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (93 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (756 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.31% (0.8502 => 0.8613, std. dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.95% (10.3673 => 12.9542, std. dev.: 0.0087) SingleSource/UnitTests/ObjC/trivial-interface: 12.58% (0.3473 => 0.3910, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.27% (0.3497 => 0.3926, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 12.19% (0.3543 => 0.3975, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3516 => 0.3944, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3543 => 0.3974, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.13% (0.3561 => 0.3993, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.91% (0.3694 => 0.4134, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2483, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions: 11.44% (0.3828 => 0.4266, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.30% (0.3886 => 0.4325, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: 11.23% (0.3927 => 0.4368, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.80% (1.7609 => 1.9159, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.46% (2.2022 => 2.3884, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 7.63% (0.5925 => 0.6377, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.56% (0.6030 => 0.6486, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.26% (0.1432 => 0.1536, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.03% (0.1892 => 0.2025, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: 6.37% (0.7326 => 0.7793, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.73% (0.3177 => 0.3359, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.40% (0.8172 => 0.8613, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.69% (7.0540 => 7.3851, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.68% (0.4615 => 0.4831, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.59% (10.4361 => 10.9151, std. dev.: 0.0164) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.53% (0.4879 => 0.5100, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.42% (0.3282 => 0.3427, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 4.16% (0.7433 => 0.7742, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (5.0018 => 5.2006, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.95% (0.5569 => 0.5789, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 3.91% (9.4845 => 9.8556, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (4.9449 => 5.1332, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.76% (0.3162 => 0.3281, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.56% (0.2891 => 0.2994, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.48% (0.5860 => 0.6064, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.47% (0.4636 => 0.4797, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.40% (0.7835 => 0.8101, std. dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.33% (0.3121 => 0.3225, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.31% (0.4103 => 0.4239, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (4.2646 => 4.4053, std. dev.: 0.0117) MultiSource/Applications/hbd/hbd: 3.29% (1.5603 => 1.6117, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.25% (0.3136 => 0.3238, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.23% (8.1363 => 8.3990, std. dev.: 0.0068) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3423 => 0.3532, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 2.95% (0.3422 => 0.3523, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.95% (1.1861 => 1.2211, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 2.94% (0.3603 => 0.3709, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.94% (2.0665 => 2.1272, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 2.91% (0.4289 => 0.4414, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.90% (0.3650 => 0.3756, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3865 => 0.3977, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.88% (5.7591 => 5.9250, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.85% (1.3050 => 1.3422, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.80% (0.3826 => 0.3933, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.79% (1.5415 => 1.5845, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (0.4064 => 0.4177, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (14.3668 => 14.7544, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.59% (3.3354 => 3.4217, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.57% (0.5105 => 0.5236, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.47% (1.1642 => 1.1930, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.42% (2.0273 => 2.0764, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.4620 => 0.4730, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 2.35% (0.4299 => 0.4400, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.26% (0.6456 => 0.6602, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.17% (0.9765 => 0.9977, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.17% (3.8723 => 3.9562, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (0.6675 => 0.6819, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.12% (0.6450 => 0.6587, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.09% (1.5859 => 1.6191, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.06% (1.2842 => 1.3106, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.01% (0.5981 => 0.6101, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.4186 => 1.4441, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.60% (17.1811 => 17.4558, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/football/football: 1.43% (0.8921 => 0.9049, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 1.24% (1.1840 => 1.1987, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.14% (2.2969 => 2.3230, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (2.6778 => 2.9761, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.47% (4.2280 => 4.3749, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7471, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.55% (1.0313 => 1.0576, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.81% (1.5086 => 1.5359, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.78% (26.0924 => 26.5558, std. dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/hash2: 1.76% (3.1578 => 3.2134, std. dev.: 0.0035) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2044, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8043, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.35% (2.6546 => 2.6905, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2218, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/oourafft: 1.08% (6.6465 => 6.7183, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 1.05% (2.2771 => 2.3010, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1288, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.31% (5.2763 => 3.1495, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.30% (5.3855 => 3.7000, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.76% (5.3526 => 3.7059, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.45% (2.9384 => 2.5431, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.16% (22.1758 => 19.9233, std. dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -5.26% (54.1659 => 51.3169, std. dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.00% (1.2373 => 1.1136, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -8.61% (1.5373 => 1.4049, std. dev.: 0.0238) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.74% (1.9577 => 1.8650, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4849, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9040, std. dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4127, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0003, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -1.73% (12.5348 => 12.3181, std. dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8088, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 12:02:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 14:02:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120724190251.0394E2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2333?compare_to=2329&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2333, Order: 160673, Start Time: 2012-07-24 16:19:52, End Time: 2012-07-24 19:03:12 To: 2329, Order: 160668, Start Time: 2012-07-24 13:08:30, End Time: 2012-07-24 15:51:53 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (99 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (784 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.90% (0.3496 => 0.3947, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 12.88% (0.3446 => 0.3890, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.87% (0.3465 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.75% (0.3442 => 0.3881, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 12.75% (0.3460 => 0.3901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.74% (0.3469 => 0.3911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.61% (0.3488 => 0.3928, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 12.19% (0.3643 => 0.4087, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.08% (0.3650 => 0.4091, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.76% (0.3724 => 0.4162, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 11.16% (0.3792 => 0.4215, std. dev.: 0.0120) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.60% (0.1063 => 0.1165, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.27% (0.5826 => 0.6308, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.25% (0.5889 => 0.6375, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 6.40% (0.7171 => 0.7630, std. dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 6.13% (1.5932 => 1.6909, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.85% (0.5026 => 0.5320, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.36% (3.5627 => 3.7538, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.35% (0.4994 => 0.5261, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.34% (1.6211 => 1.7077, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.11% (0.4029 => 0.4235, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.09% (1.3152 => 1.3821, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.77% (0.4361 => 0.4569, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 4.74% (0.9697 => 1.0157, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.66% (0.3930 => 0.4113, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.58% (0.5000 => 0.5229, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.49% (0.5900 => 0.6165, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 4.49% (1.0781 => 1.1265, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.40% (0.2866 => 0.2992, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.35% (0.2875 => 0.3000, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.32% (4.2109 => 4.3928, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/fibo: 4.29% (0.2725 => 0.2842, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.27% (0.2714 => 0.2830, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.27% (0.2738 => 0.2855, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2750 => 0.2865, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.18% (0.2729 => 0.2843, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.13% (0.3096 => 0.3224, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.07% (0.2803 => 0.2917, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.05% (0.2792 => 0.2905, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2823 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.01% (0.3267 => 0.3398, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.98% (0.9909 => 1.0303, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.96% (2.7292 => 2.8372, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3258 => 0.3386, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.92% (2.0673 => 2.1483, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2780 => 0.2888, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.87% (0.2813 => 0.2922, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.84% (0.2736 => 0.2841, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.81% (0.2811 => 0.2918, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.3004 => 0.3118, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.78% (0.3362 => 0.3489, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.74% (0.2911 => 0.3020, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.74% (0.3317 => 0.3441, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.72% (0.3195 => 0.3314, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.68% (0.3124 => 0.3239, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.67% (1.9694 => 2.0416, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.60% (0.3890 => 0.4030, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 3.54% (0.3726 => 0.3858, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.53% (1.9966 => 2.0671, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: 3.46% (0.3348 => 0.3464, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.43% (0.3678 => 0.3804, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.41% (0.3282 => 0.3394, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.37% (0.4658 => 0.4815, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.37% (0.3625 => 0.3747, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 3.34% (23.5202 => 24.3053, std. dev.: 0.0183) MultiSource/Applications/JM/ldecod/ldecod: 3.30% (2.1653 => 2.2368, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (2.1013 => 2.1705, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 3.28% (5.5417 => 5.7235, std. dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/lists1: 3.28% (0.3477 => 0.3591, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.26% (4.4195 => 4.5634, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3690 => 0.3806, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.13% (0.3903 => 0.4025, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 3.08% (4.6177 => 4.7600, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 3.06% (0.4146 => 0.4273, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.05% (0.7875 => 0.8115, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.92% (0.4139 => 0.4260, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 2.92% (0.4251 => 0.4375, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.91% (0.3845 => 0.3957, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 2.90% (0.5546 => 0.5707, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.84% (0.3981 => 0.4094, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.78% (1.8794 => 1.9317, std. dev.: 0.0065) MultiSource/Applications/lua/lua: 2.73% (1.4269 => 1.4658, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.49% (0.6435 => 0.6595, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.41% (0.6634 => 0.6794, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.5012 => 0.5130, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.26% (2.0346 => 2.0602, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 12.44% (2.5769 => 2.8974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6727, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1674, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-2: 4.68% (1.8057 => 1.8902, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1947, std. dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2252, std. dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.24% (1.0142 => 1.0268, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.07% (3.1169 => 3.1502, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.79% (2.4764 => 2.3826, std. dev.: 0.0108) MultiSource/Applications/kimwitu++/kc: -1.13% (11.9555 => 11.8201, std. dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.95% (25.4195 => 16.5346, std. dev.: 0.0108) SingleSource/Benchmarks/Dhrystone/fldry: -9.68% (17.2379 => 15.5685, std. dev.: 0.1512) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7886, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary2: -6.45% (0.2402 => 0.2247, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -3.49% (14.0481 => 13.5583, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.94% (0.6140 => 0.6021, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5763, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.14% (3.3991 => 3.3605, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 12:42:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 14:42:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120724194254.3A0212A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2334?compare_to=2331&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2334, Order: 160680, Start Time: 2012-07-24 18:28:57, End Time: 2012-07-24 19:43:13 To: 2331, Order: 160675, Start Time: 2012-07-24 16:46:53, End Time: 2012-07-24 18:01:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.16% (2.0176 => 2.3032, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 11.83% (0.5818 => 0.6506, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.57% (0.5748 => 0.6413, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 11.46% (0.7061 => 0.7870, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3578 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.27% (0.3601 => 0.3971, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.23% (0.3646 => 0.4019, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.16% (0.3663 => 0.4035, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.14% (0.3650 => 0.4020, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-3: 10.07% (0.3623 => 0.3988, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.92% (0.3789 => 0.4165, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.79% (0.3914 => 0.4297, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.54% (0.4003 => 0.4385, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.52% (0.3940 => 0.4315, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.22% (1.3693 => 1.4818, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.55% (0.2781 => 0.2991, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.46% (0.4328 => 0.4651, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.14% (0.4062 => 0.4352, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hello: 7.10% (0.2607 => 0.2792, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.08% (0.2655 => 0.2843, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.05% (0.2782 => 0.2978, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.03% (0.2760 => 0.2954, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 7.00% (0.2628 => 0.2812, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.95% (0.2690 => 0.2877, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.93% (0.2726 => 0.2915, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.92% (0.3022 => 0.3231, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.87% (0.2765 => 0.2955, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.84% (0.2966 => 0.3169, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.81% (1.9828 => 2.1179, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.80% (3.9660 => 4.2358, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary: 6.79% (0.3107 => 0.3318, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (0.7710 => 0.8233, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.65% (0.5265 => 0.5615, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.64% (0.2696 => 0.2875, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.64% (0.3149 => 0.3358, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.59% (0.7038 => 0.7502, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.59% (0.3489 => 0.3719, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.46% (0.2988 => 0.3181, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.42% (0.3192 => 0.3397, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.34% (0.3485 => 0.3706, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.28% (0.3580 => 0.3805, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.17% (0.4390 => 0.4661, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 6.14% (0.3453 => 0.3665, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.08% (0.3899 => 0.4136, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.97% (0.3534 => 0.3745, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.91% (0.3756 => 0.3978, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.86% (0.3293 => 0.3486, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.75% (0.4016 => 0.4247, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 5.66% (0.3868 => 0.4087, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.65% (0.1789 => 0.1890, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.57% (1.2193 => 1.2872, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.37% (0.9199 => 0.9693, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.34% (13.8202 => 14.5585, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.33% (0.6959 => 0.7330, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.2945 => 0.3101, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.20% (0.5577 => 0.5867, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.05% (1.4563 => 1.5298, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2127 => 0.2233, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.89% (0.7506 => 0.7873, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.86% (1.2292 => 1.2890, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.85% (16.6129 => 17.4181, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.76% (7.2180 => 7.5613, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.72% (13.2842 => 13.9114, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.72% (0.5637 => 0.5903, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (1.1364 => 1.1898, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.53% (0.2914 => 0.3046, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3246 => 0.3392, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.39% (1.0594 => 1.1059, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.39% (1.9270 => 2.0115, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.38% (1.1061 => 1.1546, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.37% (0.3755 => 0.3919, std. dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 4.34% (0.2995 => 0.3125, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.31% (1.3813 => 1.4409, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.28% (0.8310 => 0.8666, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.28% (1.3819 => 1.4410, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.24% (1.3245 => 1.3807, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 4.18% (3.8646 => 4.0262, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.17% (0.7460 => 0.7771, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.3801 => 4.5597, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.09% (4.4433 => 4.6251, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.90% (3.6692 => 3.8122, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (0.4791 => 0.4967, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.59% (0.8698 => 0.9010, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.41% (0.6283 => 0.6497, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (1.1333 => 1.1716, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 3.36% (0.4113 => 0.4251, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.29% (2.1791 => 2.2509, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.28% (4.9865 => 5.1503, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 3.26% (3.1889 => 3.2927, std. dev.: 0.0145) MultiSource/Benchmarks/sim/sim: 3.23% (0.3131 => 0.3232, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.08% (0.6135 => 0.6324, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (8.4961 => 8.7548, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 2.82% (16.2614 => 16.7204, std. dev.: 0.0177) MultiSource/Applications/ClamAV/clamscan: 2.81% (14.5298 => 14.9376, std. dev.: 0.0239) MultiSource/Applications/JM/ldecod/ldecod: 2.78% (6.5754 => 6.7582, std. dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 2.62% (14.8535 => 15.2420, std. dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.61% (3.2742 => 3.3596, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (2.1007 => 2.1526, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 2.29% (4.6629 => 4.7697, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 2.26% (0.6250 => 0.6391, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.21% (1.5188 => 1.5523, std. dev.: 0.0074) MultiSource/Applications/minisat/minisat: 1.66% (0.6744 => 0.6856, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.31% (0.9108 => 0.9227, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.27% (1.0313 => 1.0444, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.19% (6.2785 => 6.3534, std. dev.: 0.0064) MultiSource/Applications/lua/lua: 1.06% (3.7467 => 3.7865, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 24.80% (1.8175 => 2.2683, std. dev.: 0.0472) SingleSource/Benchmarks/Misc/mandel-2: 6.95% (1.2998 => 1.3901, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.19% (0.9996 => 1.0515, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 4.32% (7.4271 => 7.7482, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.2619 => 11.7308, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4752, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8156, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5089 => 1.5363, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5941, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1935, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6865, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.23% (22.5627 => 21.1568, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.85% (0.3511 => 0.3411, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -19.56% (0.0997 => 0.0802, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.58% (1.2308 => 1.1006, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.76% (1.3780 => 1.3124, std. dev.: 0.0087) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.79% (1.9762 => 1.9210, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9449, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.69% (0.8342 => 0.8118, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2226, std. dev.: 0.0118) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.10% (20.3410 => 19.9142, std. dev.: 0.0311) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5032, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7049, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0055, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.5254 => 2.4926, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2178, std. dev.: 0.0196) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2507, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8086, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 12:52:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 14:52:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120724195236.092E72A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2335?compare_to=2332&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2335, Order: 160680, Start Time: 2012-07-24 18:33:59, End Time: 2012-07-24 19:52:49 To: 2332, Order: 160675, Start Time: 2012-07-24 16:46:42, End Time: 2012-07-24 18:05:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (81 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (768 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.36% (12.9542 => 13.6490, std. dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.65% (10.3673 => 13.6490, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 13.62% (0.3473 => 0.3946, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.38% (0.3497 => 0.3965, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 13.32% (0.3543 => 0.4015, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.25% (0.3561 => 0.4033, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.24% (0.3543 => 0.4012, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.20% (0.3516 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.97% (0.3694 => 0.4173, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.36% (0.3828 => 0.4301, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.20% (0.3886 => 0.4360, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.17% (0.3927 => 0.4405, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.29% (1.1194 => 1.2458, std. dev.: 0.0151) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.16% (2.2022 => 2.3819, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.08% (0.6030 => 0.6517, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.02% (0.5925 => 0.6400, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.00% (1.7609 => 1.9017, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.65% (0.7326 => 0.7813, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.67% (0.3177 => 0.3357, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.18% (0.8172 => 0.8595, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.64% (0.4615 => 0.4829, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 4.51% (0.3282 => 0.3430, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.46% (10.4361 => 10.9018, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.4879 => 0.5096, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.34% (7.0540 => 7.3600, std. dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 4.04% (0.7433 => 0.7733, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.0018 => 5.1916, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.78% (4.9449 => 5.1318, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 3.76% (9.4845 => 9.8410, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.40% (0.5860 => 0.6059, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.37% (4.2646 => 4.4082, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.15% (0.4636 => 0.4782, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.14% (8.1363 => 8.3921, std. dev.: 0.0067) MultiSource/Applications/spiff/spiff: 3.09% (0.7835 => 0.8077, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.01% (1.5603 => 1.6073, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 2.95% (0.3423 => 0.3524, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.81% (1.3050 => 1.3417, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.72% (0.5105 => 0.5244, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.70% (1.1861 => 1.2181, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.66% (0.4103 => 0.4212, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.61% (0.3865 => 0.3966, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (14.3668 => 14.7361, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 2.54% (0.4289 => 0.4398, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.51% (2.0665 => 2.1183, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.46% (0.4064 => 0.4164, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.45% (3.3354 => 3.4171, std. dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 2.44% (5.7591 => 5.8996, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.43% (1.5415 => 1.5790, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 2.26% (0.6456 => 0.6602, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.20% (2.0273 => 2.0719, std. dev.: 0.0054) MultiSource/Applications/lua/lua: 1.99% (3.8723 => 3.9495, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.93% (0.9765 => 0.9953, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.89% (1.5859 => 1.6159, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.88% (0.6450 => 0.6571, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (0.6675 => 0.6800, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.79% (2.2024 => 2.2418, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.77% (1.2842 => 1.3069, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.72% (0.5981 => 0.6084, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.62% (1.4186 => 1.4416, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 1.29% (0.8921 => 0.9036, std. dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 1.27% (17.1811 => 17.3988, std. dev.: 0.0159) MultiSource/Benchmarks/nbench/nbench: 1.17% (1.1840 => 1.1979, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.15% (2.6778 => 2.9764, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.40% (4.2280 => 4.3717, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (3.6395 => 3.7598, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.54% (1.0313 => 1.0575, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.85% (26.0924 => 26.5764, std. dev.: 0.0074) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5086 => 1.5334, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 1.59% (3.1578 => 3.2081, std. dev.: 0.0035) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2045, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.6436 => 11.8072, std. dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6880, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2276, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/fbench: 1.08% (2.2771 => 2.3016, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/oourafft: 1.03% (6.6465 => 6.7150, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.03% (1.6805 => 1.6978, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.27% (5.2763 => 3.1517, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.42% (5.3855 => 3.6933, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.88% (5.3526 => 3.6999, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.58% (2.9384 => 2.5394, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.33% (22.1758 => 19.8861, std. dev.: 0.0189) SingleSource/UnitTests/Vector/constpool: -5.29% (54.1659 => 51.3002, std. dev.: 0.0491) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.80% (1.2373 => 1.1161, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -7.96% (1.5373 => 1.4149, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5961, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.50% (1.9577 => 1.8696, std. dev.: 0.0186) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4878, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.00% (8.1563 => 7.9118, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.6802 => 8.4215, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0039, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: -1.80% (12.5348 => 12.3093, std. dev.: 0.0095) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5115, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8089, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 14:25:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 16:25:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120724212501.4B0B52A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2336?compare_to=2334&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2336, Order: 160684, Start Time: 2012-07-24 20:11:11, End Time: 2012-07-24 21:25:19 To: 2334, Order: 160680, Start Time: 2012-07-24 18:28:57, End Time: 2012-07-24 19:43:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (143 on baseline) Performance Improvements: 3 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.75% (0.7870 => 0.7732, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: -1.64% (0.6506 => 0.6399, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -1.56% (0.6413 => 0.6313, std. dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.63% (2.0176 => 2.2926, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 9.99% (0.5818 => 0.6399, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 9.84% (0.3578 => 0.3930, std. dev.: 0.0056) SingleSource/UnitTests/ObjC++/Hello: 9.83% (0.5748 => 0.6313, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.55% (0.3601 => 0.3945, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 9.53% (0.3663 => 0.4012, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.52% (0.3623 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.52% (0.3646 => 0.3993, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.50% (0.7061 => 0.7732, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.45% (0.3650 => 0.3995, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.32% (0.3789 => 0.4142, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.22% (0.3914 => 0.4275, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.22% (0.4003 => 0.4372, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.01% (0.3940 => 0.4295, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.72% (1.3693 => 1.4750, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.42% (0.1819 => 0.1954, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (0.4328 => 0.4637, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.73% (0.7710 => 0.8229, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 6.72% (0.2781 => 0.2968, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2782 => 0.2966, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.55% (3.9660 => 4.2256, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 6.52% (0.4062 => 0.4327, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.51% (0.2596 => 0.2765, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3107 => 0.3309, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2607 => 0.2776, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.48% (0.5265 => 0.5606, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 6.46% (0.7038 => 0.7493, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2760 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2690 => 0.2862, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3022 => 0.3215, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.38% (0.2726 => 0.2900, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.30% (0.2937 => 0.3122, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2628 => 0.2793, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.27% (1.9828 => 2.1071, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.26% (0.2765 => 0.2938, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.20% (0.2966 => 0.3150, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.16% (0.3149 => 0.3343, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2696 => 0.2862, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.16% (0.2761 => 0.2931, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.13% (0.3489 => 0.3703, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.96% (0.2988 => 0.3166, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.92% (0.3580 => 0.3792, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.85% (0.3485 => 0.3689, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.83% (0.3192 => 0.3378, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.79% (0.3453 => 0.3653, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3899 => 0.4123, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.69% (0.4379 => 0.4628, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.50% (0.4016 => 0.4237, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.44% (0.4390 => 0.4629, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.40% (0.6959 => 0.7335, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.38% (1.2193 => 1.2849, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.38% (0.3868 => 0.4076, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.31% (0.3293 => 0.3468, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.29% (0.3534 => 0.3721, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (0.3756 => 0.3954, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.12% (0.9199 => 0.9670, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.11% (13.8202 => 14.5260, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.98% (0.5577 => 0.5855, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 4.81% (16.6129 => 17.4117, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.78% (1.4563 => 1.5259, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.75% (13.2842 => 13.9158, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.67% (7.2180 => 7.5552, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.56% (0.2914 => 0.3047, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.53% (0.7506 => 0.7846, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.48% (1.1364 => 1.1873, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.45% (0.5637 => 0.5888, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.43% (1.2292 => 1.2836, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (1.3819 => 1.4418, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.32% (1.3813 => 1.4410, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.31% (0.3246 => 0.3386, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.24% (3.8646 => 4.0285, std. dev.: 0.0107) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.24% (0.7460 => 0.7776, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 4.19% (1.9270 => 2.0078, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 4.18% (0.8310 => 0.8657, std. dev.: 0.0122) MultiSource/Applications/Burg/burg: 4.16% (1.1061 => 1.1521, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.13% (1.3245 => 1.3792, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.13% (4.4433 => 4.6266, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 4.11% (1.0594 => 1.1029, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.07% (4.3801 => 4.5584, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3755 => 0.3902, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.79% (3.6692 => 3.8081, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.70% (0.3220 => 0.3339, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.67% (0.2995 => 0.3105, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.42% (0.4791 => 0.4955, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.40% (0.8698 => 0.8994, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.31% (4.9865 => 5.1518, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.29% (2.1791 => 2.2509, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.26% (1.1333 => 1.1703, std. dev.: 0.0101) MultiSource/Benchmarks/McCat/05-eks/eks: 3.21% (0.4113 => 0.4245, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.20% (3.1889 => 3.2911, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.09% (0.6283 => 0.6477, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.00% (0.6135 => 0.6319, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.88% (8.4961 => 8.7407, std. dev.: 0.0131) MultiSource/Applications/oggenc/oggenc: 2.83% (4.6629 => 4.7948, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.76% (16.2614 => 16.7100, std. dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: 2.64% (6.5754 => 6.7491, std. dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: 2.60% (14.5298 => 14.9071, std. dev.: 0.0101) MultiSource/Applications/JM/lencod/lencod: 2.57% (14.8535 => 15.2356, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (3.2742 => 3.3511, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.10% (1.5188 => 1.5507, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 1.87% (0.6250 => 0.6367, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.25% (0.9108 => 0.9222, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.11% (1.0313 => 1.0427, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.10% (33.2944 => 33.6596, std. dev.: 0.0159) MultiSource/Applications/lua/lua: 1.07% (3.7467 => 3.7869, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5189, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2639, std. dev.: 0.0451) SingleSource/Benchmarks/Misc/mandel-2: 7.58% (1.2998 => 1.3983, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.10% (0.9996 => 1.0606, std. dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 4.52% (7.4271 => 7.7627, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7338, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4745, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.57% (1.7688 => 1.8143, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5089 => 1.5332, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1397, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.26% (22.5627 => 21.1496, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.85% (0.3511 => 0.3411, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.85% (0.0997 => 0.0819, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.73% (1.2308 => 1.1110, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std. dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.67% (0.8342 => 0.8119, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -2.58% (3.0263 => 2.9483, std. dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.06% (20.3410 => 19.9228, std. dev.: 0.0642) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2373, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5090, std. dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7065, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2485, std. dev.: 0.0069) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4935, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2190, std. dev.: 0.0338) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.11% (9.9194 => 9.8091, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.10% (3.8887 => 3.8458, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 14:41:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 16:41:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120724214125.4D6272A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2337?compare_to=2335&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2337, Order: 160685, Start Time: 2012-07-24 20:22:51, End Time: 2012-07-24 21:41:43 To: 2335, Order: 160680, Start Time: 2012-07-24 18:33:59, End Time: 2012-07-24 19:52:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (97 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (752 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.73% (3.7762 => 3.9170, std. dev.: 0.0282) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.80% (10.3673 => 13.6643, std. dev.: 0.0111) SingleSource/UnitTests/ObjC/trivial-interface: 13.88% (0.3473 => 0.3955, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 13.61% (0.3497 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.54% (0.3516 => 0.3992, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.46% (0.3543 => 0.4020, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.46% (0.3543 => 0.4020, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.34% (0.3561 => 0.4036, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.02% (0.3694 => 0.4175, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.59% (0.3828 => 0.4310, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.59% (0.0834 => 0.0939, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.56% (0.3886 => 0.4374, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.43% (0.3927 => 0.4415, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.25% (1.1194 => 1.2453, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.50% (2.2022 => 2.3893, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.91% (1.7609 => 1.9002, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 7.41% (0.5925 => 0.6364, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.28% (0.6030 => 0.6469, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.61% (0.1892 => 0.2017, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 6.06% (0.7326 => 0.7770, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.3177 => 0.3367, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.03% (0.8172 => 0.8583, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (0.4615 => 0.4843, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 4.94% (0.3282 => 0.3444, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.93% (0.3121 => 0.3275, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 4.63% (10.4361 => 10.9194, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.63% (7.0540 => 7.3806, std. dev.: 0.0140) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.55% (0.4879 => 0.5101, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 4.26% (0.7433 => 0.7750, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (4.9449 => 5.1488, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (5.0018 => 5.2034, std. dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 3.99% (9.4845 => 9.8626, std. dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.82% (0.5860 => 0.6084, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.69% (0.7835 => 0.8124, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.65% (4.2646 => 4.4204, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 3.65% (0.3098 => 0.3211, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.62% (0.4636 => 0.4804, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/18-imp/imp: 3.53% (0.3423 => 0.3544, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.42% (8.1363 => 8.4146, std. dev.: 0.0056) MultiSource/Applications/hbd/hbd: 3.38% (1.5603 => 1.6130, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 3.33% (0.3180 => 0.3286, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.23% (0.3162 => 0.3264, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.20% (1.1861 => 1.2241, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 3.16% (5.7591 => 5.9412, std. dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.4064 => 0.4191, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.11% (0.3826 => 0.3945, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (1.3050 => 1.3455, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.07% (1.1642 => 1.1999, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.05% (14.3668 => 14.8045, std. dev.: 0.0245) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.05% (0.4103 => 0.4228, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.03% (0.3865 => 0.3982, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3603 => 0.3712, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.98% (0.4289 => 0.4417, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 2.95% (0.3422 => 0.3523, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.93% (0.3650 => 0.3757, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.89% (3.3354 => 3.4319, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.88% (2.0665 => 2.1260, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.81% (0.4203 => 0.4321, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.77% (1.5415 => 1.5842, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 2.74% (0.3684 => 0.3785, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 2.63% (2.0273 => 2.0807, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.60% (0.8067 => 0.8277, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 2.59% (0.6456 => 0.6623, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.40% (0.4620 => 0.4731, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.33% (3.8723 => 3.9625, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.32% (0.9765 => 0.9992, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.25% (0.6675 => 0.6825, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.18% (2.2024 => 2.2504, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.16% (1.5859 => 1.6202, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.09% (1.2842 => 1.3111, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.06% (0.6450 => 0.6583, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.02% (0.5981 => 0.6102, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.87% (1.4186 => 1.4451, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 1.67% (0.8921 => 0.9070, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.58% (17.1811 => 17.4523, std. dev.: 0.0107) MultiSource/Applications/minisat/minisat: 1.53% (0.7115 => 0.7224, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.49% (1.1840 => 1.2016, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.35% (2.2969 => 2.3278, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.15% (2.6778 => 2.9763, std. dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 3.68% (3.7781 => 3.9170, std. dev.: 0.0282) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.41% (4.2280 => 4.3723, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7471, std. dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.79% (26.0924 => 26.5600, std. dev.: 0.0237) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5086 => 1.5338, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 1.66% (3.1578 => 3.2102, std. dev.: 0.0025) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2043, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.39% (11.6436 => 11.8052, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6902, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 1.06% (6.6465 => 6.7170, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1287, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.49% (0.8651 => 0.1688, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.50% (5.2763 => 3.1394, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.40% (5.3855 => 3.6944, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.75% (5.3526 => 3.7067, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.64% (2.9384 => 2.5377, std. dev.: 0.0125) MultiSource/Applications/ClamAV/clamscan: -10.12% (22.1758 => 19.9309, std. dev.: 0.0135) SingleSource/UnitTests/Vector/constpool: -5.33% (54.1659 => 51.2783, std. dev.: 0.0168) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.30% (1.2373 => 1.1099, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -8.39% (1.5373 => 1.4083, std. dev.: 0.0225) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5535, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (1.9577 => 1.8573, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5961, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4807, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4155, std. dev.: 0.0200) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9125, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0025, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -1.68% (12.5348 => 12.3243, std. dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.40% (1.8329 => 1.8073, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 15:14:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 17:14:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120724221421.0876B2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2338?compare_to=2333&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2338, Order: 160682, Start Time: 2012-07-24 19:31:19, End Time: 2012-07-24 22:14:38 To: 2333, Order: 160673, Start Time: 2012-07-24 16:19:52, End Time: 2012-07-24 19:03:12 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (82 on baseline) Performance Improvements: 1 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (801 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.83% (125.1952 => 131.2369, std. dev.: 0.2461) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.59% (2.0577 => 2.1316, std. dev.: 0.0136) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.84% (1.0157 => 0.9970, std. dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 15.98% (0.3792 => 0.4398, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/exceptions-2: 13.87% (0.3446 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.85% (0.3465 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.76% (0.3460 => 0.3936, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.74% (0.3442 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.72% (0.3469 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.70% (0.3496 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.62% (0.3488 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.20% (0.3643 => 0.4124, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.07% (0.3650 => 0.4127, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.67% (0.3724 => 0.4196, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.88% (0.1063 => 0.1168, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.98% (0.5826 => 0.6291, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.76% (0.5889 => 0.6346, std. dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 7.18% (1.5932 => 1.7076, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.21% (0.7171 => 0.7616, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.93% (0.5026 => 0.5324, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.53% (0.4994 => 0.5270, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.44% (3.5627 => 3.7564, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.28% (1.6211 => 1.7067, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.04% (1.3152 => 1.3815, std. dev.: 0.0097) MultiSource/Applications/spiff/spiff: 4.99% (0.4029 => 0.4230, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.95% (0.4361 => 0.4577, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 4.75% (1.0781 => 1.1293, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (0.5000 => 0.5237, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.64% (0.5900 => 0.6174, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.64% (0.2866 => 0.2999, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.58% (0.3930 => 0.4110, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.17% (4.2109 => 4.3866, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.00% (2.7292 => 2.8385, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.84% (0.2736 => 0.2841, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 3.74% (0.2725 => 0.2827, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.71% (1.9694 => 2.0425, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.69% (0.2738 => 0.2839, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.67% (5.5417 => 5.7453, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.62% (0.2875 => 0.2979, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (1.9966 => 2.0683, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.58% (0.2792 => 0.2892, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.39% (0.3890 => 0.4022, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 3.39% (23.5202 => 24.3166, std. dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 3.37% (0.9909 => 1.0243, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.35% (0.4658 => 0.4814, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.35% (2.0673 => 2.1365, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.33% (0.3362 => 0.3474, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.30% (0.3124 => 0.3227, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (2.1013 => 2.1700, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.19% (0.3195 => 0.3297, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.19% (0.3258 => 0.3362, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.18% (0.3267 => 0.3371, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.17% (4.6177 => 4.7643, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.17% (4.4195 => 4.5598, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.14% (0.3625 => 0.3739, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.02% (2.1653 => 2.2307, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/moments: 2.94% (0.3678 => 0.3786, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 2.87% (0.3726 => 0.3833, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.85% (0.5546 => 0.5704, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 2.82% (0.9697 => 0.9970, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.79% (0.3903 => 0.4012, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.78% (0.4139 => 0.4254, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.4146 => 0.4259, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.71% (0.3690 => 0.3790, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 2.69% (1.8794 => 1.9300, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 2.67% (0.7875 => 0.8085, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 2.61% (1.4269 => 1.4641, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 2.45% (0.4251 => 0.4355, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.35% (0.6634 => 0.6790, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.6435 => 0.6577, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.12% (2.0346 => 2.0574, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 12.44% (2.5769 => 2.8974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 8.81% (0.2122 => 0.2309, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6779, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-2: 4.74% (1.8057 => 1.8913, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1668, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.38% (2.0820 => 2.1316, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1952, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2231, std. dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.24% (1.0142 => 1.0268, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.68% (2.4764 => 2.3853, std. dev.: 0.0159) MultiSource/Applications/kimwitu++/kc: -1.37% (11.9555 => 11.7919, std. dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.06% (25.4195 => 16.5083, std. dev.: 0.0241) SingleSource/Benchmarks/Dhrystone/fldry: -8.35% (17.2379 => 15.7991, std. dev.: 0.2341) SingleSource/Benchmarks/Shootout-C++/ary2: -7.87% (0.2402 => 0.2213, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7995, std. dev.: 0.0119) SingleSource/Benchmarks/Dhrystone/dry: -3.58% (14.0481 => 13.5457, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5192, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.91% (0.6140 => 0.6023, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5690, std. dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.15% (3.3991 => 3.3599, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 16:07:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 18:07:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120724230700.5DB312A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2339?compare_to=2336&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2339, Order: 160692, Start Time: 2012-07-24 21:53:15, End Time: 2012-07-24 23:07:20 To: 2336, Order: 160684, Start Time: 2012-07-24 20:11:11, End Time: 2012-07-24 21:25:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (139 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.71% (54.4761 => 56.4998, std. dev.: 0.0702) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.43% (2.0176 => 2.2886, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 9.66% (0.5818 => 0.6380, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.60% (0.5748 => 0.6300, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.59% (0.3650 => 0.4000, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 9.59% (0.3578 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.55% (0.3601 => 0.3945, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.52% (0.7061 => 0.7733, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 9.27% (0.3646 => 0.3984, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.23% (0.3663 => 0.4001, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.19% (0.3623 => 0.3956, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.16% (0.3789 => 0.4136, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.02% (0.4003 => 0.4364, std. dev.: 0.0086) SingleSource/UnitTests/ObjC/exceptions: 8.97% (0.3914 => 0.4265, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.81% (0.3940 => 0.4287, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.57% (0.3130 => 0.3367, std. dev.: 0.0052) MultiSource/Applications/hbd/hbd: 7.07% (1.3693 => 1.4661, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.67% (0.7710 => 0.8224, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (3.9660 => 4.2232, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.43% (0.2596 => 0.2763, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 6.35% (0.4328 => 0.4603, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.31% (0.7038 => 0.7482, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.31% (0.5265 => 0.5597, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash: 5.83% (0.4062 => 0.4299, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.83% (0.2781 => 0.2943, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.54% (0.2782 => 0.2936, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.49% (0.3022 => 0.3188, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.4379 => 0.4616, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.41% (0.2607 => 0.2748, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.39% (0.6959 => 0.7334, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.36% (0.2726 => 0.2872, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2690 => 0.2834, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.35% (0.2765 => 0.2913, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.33% (0.2628 => 0.2768, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.31% (0.2937 => 0.3093, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.28% (1.9828 => 2.0875, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.25% (0.3580 => 0.3768, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.23% (0.3899 => 0.4103, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.3107 => 0.3268, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.18% (0.2761 => 0.2904, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.12% (1.2193 => 1.2817, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.06% (0.4390 => 0.4612, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.04% (0.2696 => 0.2832, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.02% (0.2988 => 0.3138, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 4.92% (0.3192 => 0.3349, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.87% (0.9199 => 0.9647, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 4.79% (13.8202 => 14.4828, std. dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.77% (0.5577 => 0.5843, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.75% (0.3453 => 0.3617, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3293 => 0.3446, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.62% (16.6129 => 17.3808, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.58% (0.4016 => 0.4200, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.48% (0.2925 => 0.3056, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.45% (0.7506 => 0.7840, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.43% (1.4563 => 1.5208, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.2914 => 0.3043, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.39% (0.3756 => 0.3921, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.33% (0.5637 => 0.5881, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.30% (13.2842 => 13.8548, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.22% (0.3246 => 0.3383, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.21% (7.2180 => 7.5219, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.18% (1.3813 => 1.4391, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.13% (1.3819 => 1.4390, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.13% (1.1364 => 1.1833, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.11% (1.1061 => 1.1516, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 4.08% (3.8646 => 4.0222, std. dev.: 0.0103) MultiSource/Applications/treecc/treecc: 4.06% (1.9270 => 2.0052, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.01% (0.7460 => 0.7759, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 3.97% (0.8310 => 0.8640, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 3.95% (1.0594 => 1.1012, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 3.94% (0.2945 => 0.3061, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.89% (1.3245 => 1.3760, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.63% (1.2292 => 1.2738, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.62% (4.3801 => 4.5387, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.62% (4.4433 => 4.6040, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (3.6692 => 3.7980, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3220 => 0.3332, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.41% (0.2995 => 0.3097, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.30% (0.3755 => 0.3879, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.28% (2.1791 => 2.2506, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.26% (0.4791 => 0.4947, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.07% (4.9865 => 5.1398, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1333 => 1.1678, std. dev.: 0.0046) MultiSource/Applications/d/make_dparser: 2.98% (3.1889 => 3.2840, std. dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.87% (0.8698 => 0.8948, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 2.87% (0.4113 => 0.4231, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.82% (0.6283 => 0.6460, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.77% (0.6135 => 0.6305, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 2.56% (8.4961 => 8.7133, std. dev.: 0.0121) MultiSource/Applications/ClamAV/clamscan: 2.36% (14.5298 => 14.8733, std. dev.: 0.0140) MultiSource/Applications/JM/ldecod/ldecod: 2.30% (6.5754 => 6.7269, std. dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 2.26% (16.2614 => 16.6287, std. dev.: 0.0169) MultiSource/Applications/oggenc/oggenc: 2.25% (4.6629 => 4.7680, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.21% (2.1007 => 2.1471, std. dev.: 0.0089) MultiSource/Applications/JM/lencod/lencod: 2.21% (14.8535 => 15.1812, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.17% (3.2742 => 3.3451, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.06% (1.5188 => 1.5501, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5186, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 25.14% (1.8175 => 2.2745, std. dev.: 0.0423) SingleSource/Benchmarks/Misc/mandel-2: 8.16% (1.2998 => 1.4059, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.09% (0.9996 => 1.0505, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 4.44% (7.4271 => 7.7566, std. dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7338, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4754, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.29% (1.0310 => 1.0546, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5089 => 1.5332, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9591, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5943, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2145, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6868, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 1.09% (10.7476 => 10.8645, std. dev.: 0.0320) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.51% (22.5627 => 21.0945, std. dev.: 0.0205) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.05% (0.0997 => 0.0827, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -10.55% (1.2308 => 1.1010, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.33% (2.5089 => 2.3753, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.10% (1.3780 => 1.3077, std. dev.: 0.0084) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5137, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.69% (0.8342 => 0.8118, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9453, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2183, std. dev.: 0.0155) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.89% (20.3410 => 19.9570, std. dev.: 0.0551) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7091, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4928, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2168, std. dev.: 0.0277) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8705, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2538, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8086, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 16:28:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 18:28:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120724232829.1B9292A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2340?compare_to=2337&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2340, Order: 160693, Start Time: 2012-07-24 22:09:53, End Time: 2012-07-24 23:28:49 To: 2337, Order: 160685, Start Time: 2012-07-24 20:22:51, End Time: 2012-07-24 21:41:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (91 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.35% (3.9170 => 3.7858, std. dev.: 0.0334) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.69% (10.3673 => 13.6531, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 13.82% (0.3473 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3497 => 0.3975, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.62% (0.3516 => 0.3995, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.60% (0.3543 => 0.4025, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.46% (0.3543 => 0.4020, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.42% (0.3561 => 0.4039, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: 13.16% (0.3694 => 0.4180, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.70% (0.3828 => 0.4314, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/property: 12.58% (0.3886 => 0.4375, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.58% (0.3927 => 0.4421, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.77% (1.1194 => 1.2512, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.09% (2.2022 => 2.4024, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.25% (1.7609 => 1.9061, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.43% (0.6030 => 0.6478, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.36% (0.5925 => 0.6361, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.07% (0.2065 => 0.2211, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.45% (0.1892 => 0.2014, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.39% (0.7326 => 0.7794, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.20% (0.4615 => 0.4855, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.19% (10.4361 => 10.9780, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (7.0540 => 7.4040, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 4.94% (0.3282 => 0.3444, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.86% (0.4879 => 0.5116, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 4.37% (0.7433 => 0.7758, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.37% (4.9449 => 5.1609, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.34% (0.8172 => 0.8527, std. dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 4.26% (9.4845 => 9.8881, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.24% (5.0018 => 5.2138, std. dev.: 0.0104) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.2554 => 0.2660, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.02% (0.5569 => 0.5793, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 3.80% (0.3423 => 0.3553, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.75% (0.3121 => 0.3238, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.74% (0.5860 => 0.6079, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (4.2646 => 4.4218, std. dev.: 0.0134) MultiSource/Applications/spiff/spiff: 3.64% (0.7835 => 0.8120, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.63% (8.1363 => 8.4313, std. dev.: 0.0070) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.3180 => 0.3295, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 3.49% (0.3092 => 0.3200, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.38% (1.5603 => 1.6131, std. dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 3.37% (5.7591 => 5.9534, std. dev.: 0.0063) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.25% (1.1861 => 1.2247, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 3.16% (3.3354 => 3.4407, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (1.3050 => 1.3455, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.09% (14.3668 => 14.8113, std. dev.: 0.0201) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.98% (0.4636 => 0.4774, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.86% (1.1642 => 1.1975, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.83% (2.0273 => 2.0847, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.81% (0.8067 => 0.8294, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.77% (1.5415 => 1.5842, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 2.71% (3.8723 => 3.9774, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.59% (0.5105 => 0.5237, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.51% (0.4103 => 0.4206, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.51% (0.4064 => 0.4166, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.49% (0.4289 => 0.4396, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.44% (0.9765 => 1.0003, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 2.37% (0.4299 => 0.4401, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.35% (2.0665 => 2.1150, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6675 => 0.6829, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.28% (0.6456 => 0.6603, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.2024 => 2.2522, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.24% (1.5859 => 1.6215, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.20% (0.6450 => 0.6592, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.19% (0.5981 => 0.6112, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.10% (1.4186 => 1.4484, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.94% (17.1811 => 17.5151, std. dev.: 0.0245) MultiSource/Applications/hexxagon/hexxagon: 1.85% (1.2842 => 1.3079, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 1.76% (0.8921 => 0.9078, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.63% (0.7115 => 0.7231, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.49% (1.1840 => 1.2016, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.46% (2.2969 => 2.3305, std. dev.: 0.0061) MultiSource/Applications/lemon/lemon: 1.12% (1.0722 => 1.0842, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (2.6778 => 2.9762, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.39% (4.2280 => 4.3714, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7467, std. dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.86% (26.0924 => 26.5785, std. dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2161, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5086 => 1.5344, std. dev.: 0.0017) MultiSource/Applications/aha/aha: 1.43% (3.1595 => 3.2046, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8046, std. dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.38% (2.6546 => 2.6913, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2365, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.02% (1.6805 => 1.6976, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.01% (6.6465 => 6.7138, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.46% (0.8651 => 0.1690, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1614, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.97% (5.3855 => 3.7174, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.28% (5.3526 => 3.7321, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.25% (2.9384 => 2.5492, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -9.98% (22.1758 => 19.9625, std. dev.: 0.0058) SingleSource/UnitTests/Vector/constpool: -5.18% (54.1659 => 51.3628, std. dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.95% (1.2373 => 1.1142, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -8.65% (1.5373 => 1.4043, std. dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.71% (1.9577 => 1.8654, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4827, std. dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9124, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.6802 => 8.4362, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0005, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: -1.71% (12.5348 => 12.3203, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.34% (1.8329 => 1.8083, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 17:49:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 19:49:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120725004905.32F4A2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2341?compare_to=2339&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2341, Order: 160701, Start Time: 2012-07-24 23:35:21, End Time: 2012-07-25 00:49:25 To: 2339, Order: 160692, Start Time: 2012-07-24 21:53:15, End Time: 2012-07-24 23:07:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (141 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 950 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.68% (2.0875 => 2.1225, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.31% (1.4661 => 1.4853, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.22% (1.2738 => 1.2894, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: 1.09% (3.7013 => 3.7416, std. dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.35% (2.0176 => 2.3071, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.88% (0.5818 => 0.6393, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.78% (0.5748 => 0.6310, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.22% (0.7061 => 0.7712, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 9.03% (0.3578 => 0.3901, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.83% (0.3601 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.75% (0.3646 => 0.3965, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.68% (0.3663 => 0.3981, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.66% (0.3650 => 0.3966, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 8.64% (0.3623 => 0.3936, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.60% (0.3789 => 0.4115, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.47% (1.3693 => 1.4853, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.44% (0.4003 => 0.4341, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.41% (0.3914 => 0.4243, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.35% (0.3940 => 0.4269, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.2781 => 0.3004, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.79% (0.4328 => 0.4665, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.48% (0.2782 => 0.2990, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.46% (0.2937 => 0.3156, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2607 => 0.2801, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.42% (0.1819 => 0.1954, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.42% (0.2655 => 0.2852, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.34% (0.4062 => 0.4360, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2690 => 0.2887, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2760 => 0.2959, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2765 => 0.2964, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.19% (0.2726 => 0.2922, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3022 => 0.3239, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.08% (0.3107 => 0.3327, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.05% (0.2696 => 0.2886, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.05% (1.9828 => 2.1225, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.01% (0.2966 => 0.3174, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2761 => 0.2954, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.99% (0.3149 => 0.3369, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.77% (0.3192 => 0.3408, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2988 => 0.3190, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.70% (0.3580 => 0.3820, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.69% (0.7038 => 0.7509, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.68% (0.3489 => 0.3722, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.51% (0.3899 => 0.4153, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.51% (0.3485 => 0.3712, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.48% (3.9660 => 4.2229, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.48% (0.5265 => 0.5606, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.43% (0.3453 => 0.3675, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.41% (0.7710 => 0.8204, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.39% (0.2596 => 0.2762, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.15% (0.4390 => 0.4660, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.13% (0.3293 => 0.3495, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3534 => 0.3750, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.98% (0.4016 => 0.4256, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (0.3756 => 0.3976, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 5.82% (0.3868 => 0.4093, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2945 => 0.3113, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.48% (0.4379 => 0.4619, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.33% (0.6959 => 0.7330, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.28% (1.2193 => 1.2837, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 5.05% (13.8202 => 14.5185, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.99% (0.9199 => 0.9658, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.98% (0.5577 => 0.5855, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.91% (16.6129 => 17.4281, std. dev.: 0.0100) MultiSource/Applications/hexxagon/hexxagon: 4.90% (1.2292 => 1.2894, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.69% (0.3755 => 0.3931, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.65% (13.2842 => 13.9019, std. dev.: 0.0064) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.44% (1.4563 => 1.5210, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.42% (0.5637 => 0.5886, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.39% (0.2914 => 0.3042, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.34% (0.3246 => 0.3387, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.33% (1.1364 => 1.1856, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.28% (7.2180 => 7.5270, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.28% (1.3813 => 1.4404, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.28% (1.3819 => 1.4410, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.22% (0.7460 => 0.7775, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.20% (0.7506 => 0.7821, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.17% (1.9270 => 2.0074, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.14% (0.8310 => 0.8654, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.13% (1.0594 => 1.1032, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 4.12% (3.8646 => 4.0237, std. dev.: 0.0065) MultiSource/Applications/Burg/burg: 4.06% (1.1061 => 1.1510, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.03% (1.3245 => 1.3779, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.75% (3.6692 => 3.8069, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.73% (4.3801 => 4.5435, std. dev.: 0.0090) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.64% (4.4433 => 4.6051, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.63% (0.8698 => 0.9014, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.54% (0.3220 => 0.3334, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.51% (0.4791 => 0.4959, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.47% (0.2995 => 0.3099, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.45% (4.9865 => 5.1585, std. dev.: 0.0098) MultiSource/Applications/siod/siod: 3.42% (2.1791 => 2.2536, std. dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.23% (1.1333 => 1.1699, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.17% (0.6283 => 0.6482, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.07% (3.1889 => 3.2869, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.79% (4.6629 => 4.7928, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 2.78% (8.4961 => 8.7323, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.77% (0.6135 => 0.6305, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 2.52% (14.5298 => 14.8954, std. dev.: 0.0135) MultiSource/Applications/JM/ldecod/ldecod: 2.50% (6.5754 => 6.7395, std. dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 2.49% (16.2614 => 16.6669, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.6250 => 0.6398, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.35% (2.1007 => 2.1500, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 2.33% (14.8535 => 15.1994, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.25% (3.2742 => 3.3479, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.14% (1.5188 => 1.5513, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.33% (33.2944 => 33.7362, std. dev.: 0.0097) MultiSource/Applications/lemon/lemon: 1.07% (1.0313 => 1.0423, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5145, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.14% (1.8175 => 2.2563, std. dev.: 0.0557) SingleSource/Benchmarks/Misc/mandel-2: 7.56% (1.2998 => 1.3981, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.62% (0.9996 => 1.0558, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 4.40% (7.4271 => 7.7536, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7325, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4741, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.60% (1.7688 => 1.8148, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5342, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5945, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1941, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: 1.03% (1.9290 => 1.9489, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.19% (22.5627 => 21.1664, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1100, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.16% (1.3780 => 1.3069, std. dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9198, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9452, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.67% (0.8342 => 0.8119, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2287, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5022, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.88% (20.3410 => 19.9594, std. dev.: 0.0503) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7080, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8591, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2505, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.11% (9.9194 => 9.8089, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8480, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 18:15:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 20:15:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120725011525.4A1BD2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2342?compare_to=2340&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2342, Order: 160701, Start Time: 2012-07-24 23:56:46, End Time: 2012-07-25 01:15:45 To: 2340, Order: 160693, Start Time: 2012-07-24 22:09:53, End Time: 2012-07-24 23:28:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (86 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (763 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.89% (1.4043 => 1.4309, std. dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.15% (13.6531 => 13.4957, std. dev.: 0.0151) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.18% (10.3673 => 13.4957, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.90% (1.1194 => 1.2526, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 11.69% (0.3473 => 0.3879, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.44% (0.3497 => 0.3897, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.40% (0.3543 => 0.3947, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 11.38% (0.3516 => 0.3916, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.35% (0.3543 => 0.3945, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.32% (0.3561 => 0.3964, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.04% (0.3694 => 0.4102, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.68% (0.3828 => 0.4237, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.65% (0.3886 => 0.4300, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.3927 => 0.4340, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.13% (2.2022 => 2.4033, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.48% (1.7609 => 1.9102, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.24% (0.1432 => 0.1550, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 7.52% (0.1622 => 0.1744, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.62% (0.5925 => 0.6317, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.52% (0.6030 => 0.6423, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.17% (0.3177 => 0.3373, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.97% (0.7326 => 0.7763, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.30% (10.4361 => 10.9888, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.22% (7.0540 => 7.4220, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.06% (0.4879 => 0.5126, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 4.94% (0.3282 => 0.3444, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.77% (0.4615 => 0.4835, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 4.32% (9.4845 => 9.8945, std. dev.: 0.0083) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.98% (0.7433 => 0.7729, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.9449 => 5.1405, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.0018 => 5.1949, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.83% (0.8172 => 0.8485, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.57% (0.5569 => 0.5768, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.50% (0.5860 => 0.6065, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.34% (4.2646 => 4.4069, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.33% (0.3121 => 0.3225, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.33% (5.7591 => 5.9510, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.29% (8.1363 => 8.4037, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.21% (0.4636 => 0.4785, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3423 => 0.3532, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.10% (0.7835 => 0.8078, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 2.99% (1.5603 => 1.6070, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.99% (1.1861 => 1.2216, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (14.3668 => 14.7947, std. dev.: 0.0121) MultiSource/Benchmarks/sim/sim: 2.95% (0.3387 => 0.3487, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.85% (3.3354 => 3.4305, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.82% (0.5105 => 0.5249, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.81% (1.3050 => 1.3417, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.63% (0.4103 => 0.4211, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.62% (0.8067 => 0.8278, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.56% (1.5415 => 1.5810, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.56% (1.1642 => 1.1940, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 2.49% (0.4289 => 0.4396, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.41% (2.0273 => 2.0762, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.40% (0.6675 => 0.6835, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.26% (0.9765 => 0.9986, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.25% (3.8723 => 3.9595, std. dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.6456 => 0.6601, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.20% (2.0665 => 2.1120, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.19% (1.5859 => 1.6206, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.08% (2.2024 => 2.2481, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6450 => 0.6574, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.4186 => 1.4458, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.84% (0.5981 => 0.6091, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.71% (17.1811 => 17.4752, std. dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/football/football: 1.59% (0.8921 => 0.9063, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.50% (0.7115 => 0.7222, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.41% (1.1840 => 1.2007, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.28% (2.2969 => 2.3264, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (2.6778 => 2.9761, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.48% (4.2280 => 4.3751, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7550, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.76% (26.0924 => 26.5523, std. dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/hash2: 1.74% (3.1578 => 3.2128, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5086 => 1.5327, std. dev.: 0.0012) MultiSource/Applications/aha/aha: 1.43% (3.1595 => 3.2048, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.42% (2.6546 => 2.6922, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8042, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2216, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/oourafft: 1.07% (6.6465 => 6.7177, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.02% (1.6805 => 1.6976, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.92% (5.2763 => 3.1702, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.88% (5.3855 => 3.7227, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.27% (5.3526 => 3.7326, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.04% (2.9384 => 2.5552, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -10.21% (22.1758 => 19.9126, std. dev.: 0.0165) SingleSource/UnitTests/Vector/constpool: -5.18% (54.1659 => 51.3576, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.94% (1.2373 => 1.1143, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -6.92% (1.5373 => 1.4309, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5539, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.57% (1.9577 => 1.8682, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.17% (8.1563 => 7.8976, std. dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4903, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4166, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0056, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists: -1.73% (12.5348 => 12.3175, std. dev.: 0.0056) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.32% (1.8329 => 1.8087, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 18:25:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 20:25:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120725012528.F403C2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2343?compare_to=2338&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2343, Order: 160700, Start Time: 2012-07-24 22:42:41, End Time: 2012-07-25 01:25:49 To: 2338, Order: 160682, Start Time: 2012-07-24 19:31:19, End Time: 2012-07-24 22:14:38 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 2 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (787 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.70% (131.2369 => 126.3774, std. dev.: 1.8757) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.07% (2.1316 => 2.0874, std. dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 12.69% (0.3460 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3465 => 0.3904, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.57% (0.3469 => 0.3905, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.57% (0.3446 => 0.3879, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.52% (0.3442 => 0.3873, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.50% (0.3496 => 0.3933, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.47% (0.3488 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.05% (0.3650 => 0.4090, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3643 => 0.4081, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.60% (0.3724 => 0.4156, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.45% (0.5826 => 0.6260, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 7.20% (0.5889 => 0.6313, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.1620 => 0.1728, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.50% (1.5932 => 1.6968, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.67% (0.5026 => 0.5311, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.58% (0.7171 => 0.7571, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.45% (0.4994 => 0.5266, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.15% (1.6211 => 1.7046, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.07% (3.5627 => 3.7433, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.04% (0.2738 => 0.2876, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.75% (0.5900 => 0.6180, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.68% (0.5000 => 0.5234, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.56% (0.4361 => 0.4560, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.56% (1.3152 => 1.3752, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 4.44% (0.2725 => 0.2846, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.37% (0.4029 => 0.4205, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 4.35% (0.2714 => 0.2832, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.33% (0.3930 => 0.4100, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.31% (0.2875 => 0.2999, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 4.22% (1.0781 => 1.1236, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.21% (0.2729 => 0.2844, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.15% (0.2792 => 0.2908, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.14% (0.2803 => 0.2919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.11% (0.3625 => 0.3774, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.11% (0.2750 => 0.2863, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 4.10% (0.2780 => 0.2894, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.09% (0.2911 => 0.3030, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.07% (2.0673 => 2.1515, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 4.07% (0.3096 => 0.3222, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2823 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.02% (0.2811 => 0.2924, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.02% (0.2813 => 0.2926, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.89% (0.3004 => 0.3121, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.89% (4.2109 => 4.3748, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary3: 3.89% (0.3267 => 0.3394, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.88% (0.9909 => 1.0293, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.84% (0.3362 => 0.3491, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.84% (0.3258 => 0.3383, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.79% (0.3195 => 0.3316, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.78% (0.3124 => 0.3242, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.69% (0.3060 => 0.3173, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.2866 => 0.2970, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 3.53% (0.3678 => 0.3808, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.53% (0.9697 => 1.0039, std. dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.51% (2.7292 => 2.8249, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.47% (0.3282 => 0.3396, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 3.44% (0.3726 => 0.3854, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 3.43% (0.3348 => 0.3463, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.39% (0.3477 => 0.3595, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.29% (0.4139 => 0.4275, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.21% (1.9694 => 2.0326, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.20% (0.3690 => 0.3808, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.13% (4.4195 => 4.5580, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.11% (1.9966 => 2.0587, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.10% (5.5417 => 5.7137, std. dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 3.09% (23.5202 => 24.2470, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/hash: 3.06% (0.4146 => 0.4273, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.06% (0.3890 => 0.4009, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.05% (0.4658 => 0.4800, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 2.96% (0.4251 => 0.4377, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.90% (2.1013 => 2.1623, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.77% (0.3903 => 0.4011, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.3981 => 0.4091, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.3845 => 0.3951, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (2.1653 => 2.2248, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 2.67% (4.6177 => 4.7411, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 2.61% (1.8794 => 1.9284, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.43% (0.7875 => 0.8066, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.35% (0.6435 => 0.6586, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 2.27% (0.5012 => 0.5126, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.10% (1.4269 => 1.4569, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 2.08% (0.6634 => 0.6772, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.06% (0.5546 => 0.5660, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 12.44% (2.5769 => 2.8974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.33% (0.2122 => 0.2235, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6700, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8953, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1706, std. dev.: 0.0490) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1919, std. dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4586, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2242, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.24% (1.0142 => 1.0268, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.06% (3.1169 => 3.1498, std. dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.42% (2.4764 => 2.3916, std. dev.: 0.0296) MultiSource/Applications/kimwitu++/kc: -1.57% (11.9555 => 11.7674, std. dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.99% (25.4195 => 16.5262, std. dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/fldry: -9.09% (17.2379 => 15.6708, std. dev.: 0.1914) SingleSource/Benchmarks/Shootout-C++/ary2: -7.66% (0.2402 => 0.2218, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8060, std. dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: -3.55% (14.0481 => 13.5495, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.82% (0.6140 => 0.6028, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5791, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.15% (3.3991 => 3.3601, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 19:31:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 21:31:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120725023118.AC7712A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2344?compare_to=2341&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2344, Order: 160702, Start Time: 2012-07-25 01:17:24, End Time: 2012-07-25 02:31:37 To: 2341, Order: 160701, Start Time: 2012-07-24 23:35:21, End Time: 2012-07-25 00:49:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (143 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.42% (2.0176 => 2.3086, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.85% (0.5818 => 0.6391, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.77% (0.7061 => 0.7751, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 9.64% (0.5748 => 0.6302, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.00% (0.3578 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.89% (0.3601 => 0.3921, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.78% (0.3646 => 0.3966, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.66% (0.3650 => 0.3966, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.66% (0.3789 => 0.4117, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.64% (0.3623 => 0.3936, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.63% (0.3663 => 0.3979, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.51% (1.3693 => 1.4858, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.46% (0.3914 => 0.4245, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.32% (0.4003 => 0.4336, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.31% (0.3130 => 0.3390, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.25% (0.3940 => 0.4265, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.98% (0.2781 => 0.3003, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.83% (0.4328 => 0.4667, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.64% (0.1819 => 0.1958, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.59% (0.2607 => 0.2805, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.48% (0.2782 => 0.2990, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.40% (0.2690 => 0.2889, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.39% (0.4062 => 0.4362, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.38% (0.2655 => 0.2851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.35% (0.2937 => 0.3153, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2628 => 0.2821, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.32% (0.2760 => 0.2962, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.26% (0.2726 => 0.2924, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.25% (0.3022 => 0.3241, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3107 => 0.3330, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.17% (0.2761 => 0.2959, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.13% (1.9828 => 2.1241, std. dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.12% (0.2765 => 0.2962, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 7.11% (0.3149 => 0.3373, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.97% (0.2696 => 0.2884, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.97% (0.4390 => 0.4696, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.79% (0.3489 => 0.3726, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.75% (0.7038 => 0.7513, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 6.74% (0.3192 => 0.3407, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/matrix: 6.63% (0.2988 => 0.3186, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.62% (0.3580 => 0.3817, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (3.9660 => 4.2269, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.54% (0.3899 => 0.4154, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.51% (0.7710 => 0.8212, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.51% (0.2596 => 0.2765, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.48% (0.3485 => 0.3711, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.48% (0.5265 => 0.5606, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 6.46% (0.3453 => 0.3676, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.16% (0.3293 => 0.3496, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.03% (0.3534 => 0.3747, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.00% (0.4016 => 0.4257, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.95% (0.3868 => 0.4098, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.94% (0.3756 => 0.3979, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.77% (0.2945 => 0.3115, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.64% (0.4379 => 0.4626, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.40% (0.6959 => 0.7335, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.32% (1.2193 => 1.2842, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.12% (0.9199 => 0.9670, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.12% (13.8202 => 14.5276, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.02% (0.5577 => 0.5857, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.00% (16.6129 => 17.4430, std. dev.: 0.0248) MultiSource/Applications/hexxagon/hexxagon: 4.92% (1.2292 => 1.2897, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/09-vor/vor: 4.68% (0.2925 => 0.3062, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 4.67% (1.1061 => 1.1577, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.66% (0.3755 => 0.3930, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.62% (13.2842 => 13.8984, std. dev.: 0.0141) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.60% (1.4563 => 1.5233, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.47% (0.3246 => 0.3391, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.46% (0.2914 => 0.3044, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.44% (7.2180 => 7.5384, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.44% (1.3813 => 1.4426, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.40% (0.5637 => 0.5885, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.37% (0.7460 => 0.7786, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.36% (1.1364 => 1.1860, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.29% (0.7506 => 0.7828, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.23% (1.3819 => 1.4403, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.22% (1.9270 => 2.0084, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 4.22% (3.8646 => 4.0277, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.19% (1.0594 => 1.1038, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.16% (0.8310 => 0.8656, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.10% (1.3245 => 1.3788, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (4.4433 => 4.6148, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.81% (0.8698 => 0.9029, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.77% (4.3801 => 4.5453, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.71% (3.6692 => 3.8054, std. dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 3.64% (0.2995 => 0.3104, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 3.63% (0.3220 => 0.3337, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.56% (4.9865 => 5.1641, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.53% (0.4791 => 0.4960, std. dev.: 0.0048) MultiSource/Applications/siod/siod: 3.40% (2.1791 => 2.2532, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.6283 => 0.6495, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.27% (1.1333 => 1.1704, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 3.20% (3.1889 => 3.2910, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 3.09% (0.4113 => 0.4240, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.90% (0.6135 => 0.6313, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.85% (4.6629 => 4.7957, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 2.79% (8.4961 => 8.7328, std. dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 2.69% (6.5754 => 6.7522, std. dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: 2.56% (16.2614 => 16.6778, std. dev.: 0.0099) MultiSource/Applications/ClamAV/clamscan: 2.50% (14.5298 => 14.8937, std. dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/bigfib: 2.48% (0.6250 => 0.6405, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.46% (14.8535 => 15.2184, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.41% (3.2742 => 3.3532, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.37% (2.1007 => 2.1504, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.25% (1.5188 => 1.5529, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.41% (33.2944 => 33.7653, std. dev.: 0.0100) MultiSource/Applications/lemon/lemon: 1.27% (1.0313 => 1.0444, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.20% (0.9108 => 0.9217, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5177, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fbench: 25.20% (1.8175 => 2.2755, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/mandel-2: 8.23% (1.2998 => 1.4068, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.34% (0.9996 => 1.0530, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 4.40% (7.4271 => 7.7541, std. dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7315, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4751, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.82% (1.9199 => 1.9741, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8149, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.24% (0.9692 => 0.9909, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5333, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5945, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (1.9290 => 1.9556, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1961, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1396, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.15% (22.5627 => 21.1755, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.35% (0.0997 => 0.0824, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -10.67% (1.2308 => 1.0995, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3070, std. dev.: 0.0076) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9447, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.69% (0.8342 => 0.8118, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.38% (0.4533 => 0.4425, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.23% (20.3410 => 19.8883, std. dev.: 0.0610) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2287, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5054, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7067, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0054, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2484, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2246, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8085, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 20:02:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 22:02:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120725030222.7AA802A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2345?compare_to=2342&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2345, Order: 160702, Start Time: 2012-07-25 01:43:48, End Time: 2012-07-25 03:02:43 To: 2342, Order: 160701, Start Time: 2012-07-24 23:56:46, End Time: 2012-07-25 01:15:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (85 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.17% (10.3673 => 13.4950, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.95% (1.1194 => 1.2532, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.60% (0.3473 => 0.3876, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.47% (0.3497 => 0.3898, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3543 => 0.3945, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 11.32% (0.3543 => 0.3944, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.29% (0.3516 => 0.3913, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 11.07% (0.3694 => 0.4103, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.66% (0.3828 => 0.4236, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.58% (0.3886 => 0.4297, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.54% (0.3927 => 0.4341, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.13% (2.2022 => 2.4032, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.47% (1.7609 => 1.9100, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.46% (0.1622 => 0.1743, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 6.60% (0.5925 => 0.6316, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.57% (0.6030 => 0.6426, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.92% (0.3177 => 0.3365, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 5.60% (0.7326 => 0.7736, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 5.34% (10.4361 => 10.9938, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.32% (7.0540 => 7.4290, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.16% (0.4879 => 0.5131, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 5.03% (0.3282 => 0.3447, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.83% (0.4615 => 0.4838, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 4.32% (9.4845 => 9.8943, std. dev.: 0.0157) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.00% (0.7433 => 0.7730, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.9449 => 5.1419, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (5.0018 => 5.2009, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.98% (0.8172 => 0.8497, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.52% (0.5569 => 0.5765, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.36% (0.5860 => 0.6057, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.31% (8.1363 => 8.4056, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.31% (4.2646 => 4.4057, std. dev.: 0.0074) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.29% (5.7591 => 5.9484, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.22% (0.3136 => 0.3237, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.04% (0.3387 => 0.3490, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.02% (0.7835 => 0.8072, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.02% (0.4636 => 0.4776, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (14.3668 => 14.7953, std. dev.: 0.0201) MultiSource/Applications/hbd/hbd: 2.97% (1.5603 => 1.6067, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.97% (1.1861 => 1.2213, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.87% (1.3050 => 1.3424, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.81% (3.3354 => 3.4290, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 2.66% (0.4289 => 0.4403, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.63% (0.8067 => 0.8279, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.55% (0.5105 => 0.5235, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.53% (1.1642 => 1.1936, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.50% (1.5415 => 1.5800, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.37% (2.0273 => 2.0753, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.35% (0.6675 => 0.6832, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.23% (0.9765 => 0.9983, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.23% (2.0665 => 2.1125, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 2.17% (3.8723 => 3.9564, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.16% (1.5859 => 1.6202, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.15% (0.6456 => 0.6595, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.2024 => 2.2492, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.02% (0.6450 => 0.6580, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.94% (0.5981 => 0.6097, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.4186 => 1.4452, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.76% (17.1811 => 17.4834, std. dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: 1.71% (1.2842 => 1.3061, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.59% (0.7115 => 0.7228, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.41% (1.1840 => 1.2007, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 1.08% (2.2969 => 2.3217, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.15% (2.6778 => 2.9763, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.42% (4.2280 => 4.3728, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.39% (3.6395 => 3.7630, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0008) MultiSource/Benchmarks/llubenchmark/llu: 2.15% (3.7781 => 3.8595, std. dev.: 0.0117) MultiSource/Applications/lua/lua: 1.84% (26.0924 => 26.5727, std. dev.: 0.0319) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5086 => 1.5343, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 1.67% (3.1578 => 3.2104, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: 1.48% (9.1159 => 9.2505, std. dev.: 0.0407) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.44% (2.6546 => 2.6929, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.40% (11.6436 => 11.8070, std. dev.: 0.0141) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2037, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 1.29% (2.2771 => 2.3065, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/oourafft: 1.03% (6.6465 => 6.7147, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.87% (5.2763 => 3.1725, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.87% (5.3855 => 3.7230, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.28% (5.3526 => 3.7319, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.92% (2.9384 => 2.5588, std. dev.: 0.0137) MultiSource/Applications/ClamAV/clamscan: -10.11% (22.1758 => 19.9335, std. dev.: 0.0175) SingleSource/UnitTests/Vector/constpool: -5.11% (54.1659 => 51.3990, std. dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.54% (1.2373 => 1.1069, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -8.11% (1.5373 => 1.4127, std. dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.78% (1.9577 => 1.8642, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4779, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9042, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4201, std. dev.: 0.0231) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0001, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3231, std. dev.: 0.0066) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8096, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 21:36:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 24 Jul 2012 23:36:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120725043628.F2E0A2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2346?compare_to=2343&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2346, Order: 160702, Start Time: 2012-07-25 01:53:46, End Time: 2012-07-25 04:36:49 To: 2343, Order: 160700, Start Time: 2012-07-24 22:42:41, End Time: 2012-07-25 01:25:49 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (95 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (788 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.64% (0.3465 => 0.3903, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.59% (0.3446 => 0.3880, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.58% (0.3442 => 0.3875, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.56% (0.3488 => 0.3926, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.54% (0.3460 => 0.3894, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.48% (0.3469 => 0.3902, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.47% (0.3496 => 0.3932, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.05% (0.3643 => 0.4082, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.95% (0.3650 => 0.4086, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: 11.63% (0.3724 => 0.4157, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5826 => 0.6251, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.10% (0.5889 => 0.6307, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.54% (1.5932 => 1.6974, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.48% (0.1620 => 0.1725, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.55% (0.7171 => 0.7569, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.09% (0.4994 => 0.5248, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.05% (0.5026 => 0.5280, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.02% (3.5627 => 3.7415, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.00% (1.6211 => 1.7022, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.80% (0.5900 => 0.6183, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.68% (0.5000 => 0.5234, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.65% (1.3152 => 1.3764, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.63% (0.4361 => 0.4563, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.42% (0.2738 => 0.2859, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 4.35% (0.2714 => 0.2832, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.33% (0.3930 => 0.4100, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2875 => 0.2998, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.21% (0.2729 => 0.2844, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 4.20% (1.0781 => 1.1234, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 4.19% (0.4029 => 0.4198, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.12% (0.2792 => 0.2907, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.10% (0.2803 => 0.2918, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.07% (0.3096 => 0.3222, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.06% (0.2780 => 0.2893, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.05% (0.2813 => 0.2927, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.04% (0.3267 => 0.3399, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.00% (0.2750 => 0.2860, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.00% (2.0673 => 2.1499, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.98% (0.2911 => 0.3027, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.97% (0.2823 => 0.2935, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 3.95% (0.2811 => 0.2922, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.90% (0.9909 => 1.0295, std. dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 3.86% (0.3004 => 0.3120, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 3.83% (4.2109 => 4.3722, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.81% (0.3124 => 0.3243, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.78% (0.3625 => 0.3762, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.78% (0.3362 => 0.3489, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.78% (0.3258 => 0.3381, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3195 => 0.3315, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 3.74% (0.3317 => 0.3441, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.65% (0.2736 => 0.2836, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 3.65% (0.3477 => 0.3604, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.52% (0.2866 => 0.2967, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 3.52% (0.3726 => 0.3857, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.48% (0.3678 => 0.3806, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.46% (0.3348 => 0.3464, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.44% (2.7292 => 2.8230, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.41% (0.3282 => 0.3394, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 3.35% (0.9697 => 1.0022, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (0.4658 => 0.4812, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (1.9694 => 2.0328, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.17% (0.3690 => 0.3807, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.14% (1.9966 => 2.0592, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 3.08% (0.4251 => 0.4382, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.08% (5.5417 => 5.7123, std. dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 3.07% (23.5202 => 24.2427, std. dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/hash: 3.06% (0.4146 => 0.4273, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.05% (4.4195 => 4.5545, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (0.3890 => 0.4005, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.91% (2.1013 => 2.1624, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.89% (0.3981 => 0.4096, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.86% (0.3845 => 0.3955, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.83% (0.4139 => 0.4256, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.74% (4.6177 => 4.7444, std. dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (2.1653 => 2.2238, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.61% (0.3903 => 0.4005, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.53% (1.8794 => 1.9269, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 2.43% (0.5012 => 0.5134, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.37% (0.7875 => 0.8062, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.36% (0.6435 => 0.6587, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.34% (0.6634 => 0.6789, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.11% (1.4269 => 1.4570, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 12.44% (2.5769 => 2.8975, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-2: 5.17% (1.8057 => 1.8991, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6739, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.2122 => 0.2230, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1673, std. dev.: 0.0797) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1945, std. dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4586, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2236, std. dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.24% (1.0142 => 1.0268, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.02% (3.1169 => 3.1486, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.44% (2.4764 => 2.3912, std. dev.: 0.0088) MultiSource/Applications/kimwitu++/kc: -1.56% (11.9555 => 11.7687, std. dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.96% (25.4195 => 16.5324, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary2: -8.62% (0.2402 => 0.2195, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -7.77% (17.2379 => 15.8985, std. dev.: 0.1478) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8079, std. dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -3.63% (14.0481 => 13.5386, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.97% (0.6140 => 0.6019, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5807, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.15% (3.3991 => 3.3601, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 22:06:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 00:06:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120725050627.84C172A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2347?compare_to=2344&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2347, Order: 160703, Start Time: 2012-07-25 03:52:42, End Time: 2012-07-25 05:06:48 To: 2344, Order: 160702, Start Time: 2012-07-25 01:17:24, End Time: 2012-07-25 02:31:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (145 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.82% (55.0341 => 56.5834, std. dev.: 0.0166) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.49% (41.8623 => 42.4848, std. dev.: 0.0486) SingleSource/Benchmarks/McGill/chomp: 1.01% (1.0995 => 1.1106, std. dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.86% (2.0176 => 2.3174, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.83% (0.5818 => 0.6390, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.66% (0.5748 => 0.6303, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.05% (0.7061 => 0.7700, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 8.55% (0.3578 => 0.3884, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.30% (0.3601 => 0.3900, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.28% (0.3646 => 0.3948, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.28% (1.3693 => 1.4827, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.27% (0.3130 => 0.3389, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.23% (0.3623 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.22% (0.3663 => 0.3964, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.19% (0.3650 => 0.3949, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.13% (0.2781 => 0.3007, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3914 => 0.4230, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.97% (0.4003 => 0.4322, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.90% (0.4328 => 0.4670, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.84% (0.3940 => 0.4249, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2782 => 0.2993, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.52% (0.2607 => 0.2803, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.42% (0.2655 => 0.2852, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.41% (0.4062 => 0.4363, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.40% (0.2690 => 0.2889, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.39% (0.2937 => 0.3154, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2628 => 0.2822, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.34% (0.2726 => 0.2926, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.32% (0.2760 => 0.2962, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.31% (0.3022 => 0.3243, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.27% (0.2765 => 0.2966, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.24% (0.2761 => 0.2961, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.21% (0.3149 => 0.3376, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.21% (1.9828 => 2.1257, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3107 => 0.3330, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.16% (0.2696 => 0.2889, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.11% (0.4390 => 0.4702, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.86% (0.3192 => 0.3411, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.85% (0.7038 => 0.7520, std. dev.: 0.0118) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.83% (3.9660 => 4.2367, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.82% (0.3489 => 0.3727, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.73% (0.2988 => 0.3189, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.70% (0.3580 => 0.3820, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.66% (0.3485 => 0.3717, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.59% (0.3899 => 0.4156, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.57% (0.3453 => 0.3680, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.57% (0.5265 => 0.5611, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.56% (0.7710 => 0.8216, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.2721 => 0.2898, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.26% (0.3293 => 0.3499, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.20% (0.3534 => 0.3753, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.10% (0.4016 => 0.4261, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.05% (0.3868 => 0.4102, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.96% (0.3756 => 0.3980, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.73% (0.4379 => 0.4630, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.70% (0.6959 => 0.7356, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (1.2193 => 1.2859, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.29% (0.5577 => 0.5872, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.28% (13.8202 => 14.5498, std. dev.: 0.0153) MultiSource/Applications/hexxagon/hexxagon: 5.23% (1.2292 => 1.2935, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.16% (0.9199 => 0.9674, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 5.13% (16.6129 => 17.4654, std. dev.: 0.0082) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.80% (13.2842 => 13.9214, std. dev.: 0.0168) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.77% (0.3755 => 0.3934, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.4563 => 1.5245, std. dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3246 => 0.3395, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.55% (1.1364 => 1.1881, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.52% (7.2180 => 7.5439, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.51% (0.5637 => 0.5891, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.39% (1.9270 => 2.0116, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.38% (0.7506 => 0.7835, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.38% (0.8310 => 0.8674, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3813 => 1.4415, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.36% (1.1061 => 1.1543, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1048, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.27% (3.8646 => 4.0295, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.27% (1.3245 => 1.3810, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.21% (1.3819 => 1.4401, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.17% (0.7460 => 0.7771, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.02% (2.1791 => 2.2668, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.99% (0.4791 => 0.4982, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (4.4433 => 4.6199, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.3801 => 4.5536, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.90% (0.8698 => 0.9037, std. dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (3.6692 => 3.8091, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.70% (4.9865 => 5.1710, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.6283 => 0.6495, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.35% (1.1333 => 1.1713, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.28% (3.1889 => 3.2936, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.19% (0.3131 => 0.3231, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.85% (0.6135 => 0.6310, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 2.84% (8.4961 => 8.7377, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4113 => 0.4227, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (6.5754 => 6.7532, std. dev.: 0.0139) MultiSource/Applications/oggenc/oggenc: 2.68% (4.6629 => 4.7879, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.67% (14.5298 => 14.9184, std. dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 2.66% (16.2614 => 16.6939, std. dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.65% (2.1007 => 2.1563, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 2.64% (14.8535 => 15.2461, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.57% (3.2742 => 3.3582, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 2.53% (0.6250 => 0.6408, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.51% (1.5188 => 1.5569, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.50% (0.6744 => 0.6845, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.41% (33.2944 => 33.7623, std. dev.: 0.0057) MultiSource/Applications/lemon/lemon: 1.39% (1.0313 => 1.0456, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.36% (0.9108 => 0.9232, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.08% (3.7467 => 3.7870, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5197, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2609, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/mandel-2: 7.89% (1.2998 => 1.4024, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.24% (0.9996 => 1.0520, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 4.37% (7.4271 => 7.7516, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.2619 => 11.7303, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4756, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.59% (1.7688 => 1.8147, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.45% (2.0200 => 2.0493, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.17% (1.9290 => 1.9516, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.09% (22.5627 => 21.1897, std. dev.: 0.0144) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.75% (0.0997 => 0.0830, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1106, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.84% (1.3780 => 1.3113, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.69% (0.8342 => 0.8118, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -2.58% (3.0263 => 2.9481, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.49% (0.4867 => 0.4746, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: -2.45% (0.4533 => 0.4422, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2242, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9419, std. dev.: 0.0313) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5043, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7086, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0056, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.35% (5.3167 => 5.2449, std. dev.: 0.0084) MultiSource/Applications/minisat/minisat: -1.35% (9.3358 => 9.2102, std. dev.: 0.0118) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8082, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8490, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 22:11:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 00:11:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120725051130.7F3862A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2348?compare_to=2345&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2348, Order: 160703, Start Time: 2012-07-25 03:52:52, End Time: 2012-07-25 05:11:51 To: 2345, Order: 160702, Start Time: 2012-07-25 01:43:48, End Time: 2012-07-25 03:02:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (111 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (738 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.48% (3.8595 => 3.8024, std. dev.: 0.0169) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.65% (10.3673 => 13.4417, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 12.58% (0.3473 => 0.3910, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.42% (0.3543 => 0.3983, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.41% (0.3497 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.26% (0.3516 => 0.3947, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.25% (0.3543 => 0.3977, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3561 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.91% (0.3694 => 0.4134, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.80% (1.1194 => 1.2515, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 11.47% (0.3828 => 0.4267, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3927 => 0.4375, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 11.40% (0.3886 => 0.4329, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.50% (1.7609 => 1.9105, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.40% (2.2022 => 2.3872, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.87% (0.5925 => 0.6332, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.85% (0.6030 => 0.6443, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 6.31% (0.7326 => 0.7788, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.85% (0.3177 => 0.3363, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 5.40% (10.4361 => 10.9994, std. dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.24% (0.4615 => 0.4857, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.73% (0.4879 => 0.5110, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.60% (0.3282 => 0.3433, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.49% (7.0540 => 7.3709, std. dev.: 0.0096) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.34% (0.8172 => 0.8527, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 4.33% (0.7433 => 0.7755, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.11% (4.9449 => 5.1482, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (9.4845 => 9.8707, std. dev.: 0.0075) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.95% (5.0018 => 5.1993, std. dev.: 0.0092) MultiSource/Benchmarks/McCat/08-main/main: 3.92% (0.2554 => 0.2654, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.84% (0.3098 => 0.3217, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.82% (0.4636 => 0.4813, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.80% (0.3162 => 0.3282, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.78% (1.5603 => 1.6193, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.76% (0.2871 => 0.2979, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.75% (0.2905 => 0.3014, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.73% (0.5569 => 0.5777, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 3.70% (0.3052 => 0.3165, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.66% (0.2756 => 0.2857, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2891 => 0.2996, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.62% (0.3232 => 0.3349, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.59% (0.2872 => 0.2975, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.57% (0.2831 => 0.2932, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.57% (0.5860 => 0.6069, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (4.2646 => 4.4153, std. dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3092 => 0.3201, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.52% (0.4289 => 0.4440, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 3.47% (0.3109 => 0.3217, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.44% (0.4064 => 0.4204, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.44% (0.4103 => 0.4244, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.38% (0.3283 => 0.3394, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.38% (0.3136 => 0.3242, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.33% (8.1363 => 8.4074, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/sieve: 3.33% (0.3603 => 0.3723, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.31% (0.3865 => 0.3993, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.27% (0.3422 => 0.3534, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.25% (2.0665 => 2.1336, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.23% (0.3650 => 0.3768, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.22% (0.7835 => 0.8087, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 3.12% (5.7591 => 5.9388, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.11% (0.3826 => 0.3945, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.09% (0.3684 => 0.3798, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.05% (1.1861 => 1.2223, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.04% (1.3050 => 1.3447, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.00% (14.3668 => 14.7984, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary2: 2.99% (0.3379 => 0.3480, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.95% (0.4203 => 0.4327, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 2.88% (1.1642 => 1.1977, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.87% (0.3935 => 0.4048, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.86% (3.3354 => 3.4309, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.86% (0.5105 => 0.5251, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.85% (0.6456 => 0.6640, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 2.69% (0.4048 => 0.4157, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.59% (1.5415 => 1.5815, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.47% (0.6675 => 0.6840, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.47% (0.8067 => 0.8266, std. dev.: 0.0065) MultiSource/Benchmarks/McCat/05-eks/eks: 2.47% (0.4299 => 0.4405, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.44% (2.0273 => 2.0768, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.44% (1.2842 => 1.3155, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.39% (0.6450 => 0.6604, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 2.32% (3.8723 => 3.9621, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.28% (0.9765 => 0.9988, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.5981 => 0.6100, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.96% (1.5859 => 1.6170, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.85% (1.4186 => 1.4448, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.79% (17.1811 => 17.4884, std. dev.: 0.0296) MultiSource/Benchmarks/Prolangs-C/football/football: 1.70% (0.8921 => 0.9073, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.52% (0.7115 => 0.7223, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.39% (1.1840 => 1.2004, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 1.21% (2.2969 => 2.3246, std. dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (2.6778 => 2.9760, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.43% (4.2280 => 4.3732, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7489, std. dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.84% (26.0924 => 26.5718, std. dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/hash2: 1.65% (3.1578 => 3.2099, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5086 => 1.5334, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.48% (2.6546 => 2.6939, std. dev.: 0.0007) MultiSource/Applications/aha/aha: 1.44% (3.1595 => 3.2049, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.37% (11.6436 => 11.8034, std. dev.: 0.0133) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2315, std. dev.: 0.0093) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.03% (1.6805 => 1.6978, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.03% (6.6465 => 6.7149, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9196, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.38% (0.8651 => 0.1697, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.19% (5.2763 => 3.1555, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.29% (5.3855 => 3.7003, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.66% (5.3526 => 3.7115, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.08% (2.9384 => 2.5542, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -10.06% (22.1758 => 19.9447, std. dev.: 0.0142) SingleSource/UnitTests/Vector/constpool: -5.19% (54.1659 => 51.3553, std. dev.: 0.0229) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2373 => 1.1159, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -7.33% (1.5373 => 1.4246, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.72% (1.9577 => 1.8652, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5963, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4760, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.00% (8.1563 => 7.9116, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4235, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0013, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists: -1.68% (12.5348 => 12.3237, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8094, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 23:48:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 01:48:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120725064838.A7FCF2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2349?compare_to=2347&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2349, Order: 160705, Start Time: 2012-07-25 05:34:46, End Time: 2012-07-25 06:48:57 To: 2347, Order: 160703, Start Time: 2012-07-25 03:52:42, End Time: 2012-07-25 05:06:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (142 on baseline) Performance Improvements: 1 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.53% (3.7646 => 3.8222, std. dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.12% (3.7228 => 3.6810, std. dev.: 0.0158) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.20% (2.0176 => 2.3042, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.95% (0.5818 => 0.6397, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.79% (0.7061 => 0.7752, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.69% (0.5748 => 0.6305, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.42% (0.3578 => 0.3915, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 9.17% (0.3663 => 0.3999, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.16% (0.3601 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.13% (0.3646 => 0.3979, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.08% (0.3623 => 0.3952, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.07% (0.3130 => 0.3414, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.07% (0.3650 => 0.3981, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 8.92% (0.3789 => 0.4127, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 8.76% (0.3914 => 0.4257, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.69% (0.4003 => 0.4351, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.60% (0.3940 => 0.4279, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 7.98% (1.3693 => 1.4786, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (0.4328 => 0.4633, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.99% (0.7710 => 0.8249, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 6.94% (0.4062 => 0.4344, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 6.87% (0.2781 => 0.2972, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.73% (0.7038 => 0.7512, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.69% (0.2782 => 0.2968, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.67% (3.9660 => 4.2306, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.67% (0.2655 => 0.2832, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.65% (0.2690 => 0.2869, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.55% (0.3022 => 0.3220, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2607 => 0.2777, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.51% (0.5265 => 0.5608, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.50% (0.2937 => 0.3128, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.43% (0.2628 => 0.2797, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.40% (0.2765 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.38% (0.2760 => 0.2936, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.36% (1.9828 => 2.1089, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.36% (0.2721 => 0.2894, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.34% (0.2761 => 0.2936, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.31% (0.2726 => 0.2898, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.30% (0.2966 => 0.3153, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.22% (0.3489 => 0.3706, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.20% (0.4390 => 0.4662, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 6.18% (0.3107 => 0.3299, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.16% (0.3149 => 0.3343, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2696 => 0.2862, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.09% (0.3580 => 0.3798, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 6.06% (0.2988 => 0.3169, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.02% (0.3192 => 0.3384, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.87% (0.3899 => 0.4128, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.80% (0.3485 => 0.3687, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.73% (0.3453 => 0.3651, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.62% (0.4379 => 0.4625, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.47% (0.6959 => 0.7340, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.43% (0.3534 => 0.3726, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.35% (0.4016 => 0.4231, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.31% (1.2193 => 1.2841, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.31% (0.3293 => 0.3468, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.27% (0.3868 => 0.4072, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (0.3756 => 0.3950, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.08% (0.9199 => 0.9666, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.05% (13.8202 => 14.5187, std. dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.00% (0.5577 => 0.5856, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.89% (16.6129 => 17.4260, std. dev.: 0.0140) MultiSource/Applications/spiff/spiff: 4.77% (0.7506 => 0.7864, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.68% (0.2925 => 0.3062, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.59% (1.4563 => 1.5232, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (13.2842 => 13.8940, std. dev.: 0.0161) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.58% (1.3819 => 1.4452, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.50% (7.2180 => 7.5429, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.50% (0.2914 => 0.3045, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.47% (0.5637 => 0.5889, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.38% (1.3813 => 1.4418, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.36% (1.1364 => 1.1860, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.34% (1.2292 => 1.2826, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.34% (0.3246 => 0.3387, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.27% (1.9270 => 2.0092, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 4.22% (1.1061 => 1.1528, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.19% (3.8646 => 4.0267, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.3245 => 1.3793, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.09% (1.0594 => 1.1027, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.07% (0.3755 => 0.3908, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 4.07% (0.8310 => 0.8648, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.05% (0.7460 => 0.7762, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (4.3801 => 4.5527, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.74% (4.4433 => 4.6095, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 3.70% (0.3220 => 0.3339, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.68% (3.6692 => 3.8044, std. dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 3.67% (0.2995 => 0.3105, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.38% (0.4791 => 0.4953, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.38% (4.9865 => 5.1551, std. dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.30% (0.8698 => 0.8985, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.29% (2.1791 => 2.2507, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.22% (1.1333 => 1.1698, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.07% (0.6283 => 0.6476, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.01% (3.1889 => 3.2848, std. dev.: 0.0055) MultiSource/Benchmarks/McCat/05-eks/eks: 2.97% (0.4113 => 0.4235, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.77% (8.4961 => 8.7311, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.66% (0.6135 => 0.6298, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.53% (4.6629 => 4.7808, std. dev.: 0.0142) MultiSource/Applications/ClamAV/clamscan: 2.53% (14.5298 => 14.8970, std. dev.: 0.0167) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (6.5754 => 6.7394, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 2.48% (16.2614 => 16.6643, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 2.42% (14.8535 => 15.2130, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (3.2742 => 3.3511, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (1.5188 => 1.5517, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 2.08% (0.6250 => 0.6380, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.10% (1.0313 => 1.0426, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5177, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2623, std. dev.: 0.0538) SingleSource/Benchmarks/Misc/mandel-2: 7.53% (1.2998 => 1.3977, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.10% (0.9996 => 1.0506, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 4.37% (7.4271 => 7.7515, std. dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7313, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4748, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.62% (1.7688 => 1.8151, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (0.9692 => 0.9910, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5089 => 1.5328, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1963, std. dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 1.30% (3.7731 => 3.8222, std. dev.: 0.0163) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2143, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.10% (10.7476 => 10.8657, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1406, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.31% (22.5627 => 21.1385, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -19.36% (0.0997 => 0.0804, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.95% (1.2308 => 1.1083, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.00% (1.3780 => 1.3091, std. dev.: 0.0264) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.93% (1.9762 => 1.9182, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.69% (0.8342 => 0.8118, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9452, std. dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.57% (0.4867 => 0.4742, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2208, std. dev.: 0.0051) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5014, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7092, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.61% (0.6589 => 0.6483, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.54% (20.3410 => 20.0284, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.5254 => 2.4925, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2500, std. dev.: 0.0064) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2239, std. dev.: 0.0355) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8081, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 24 23:58:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 01:58:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120725065820.9E0652A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2350?compare_to=2348&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2350, Order: 160705, Start Time: 2012-07-25 05:39:51, End Time: 2012-07-25 06:58:40 To: 2348, Order: 160703, Start Time: 2012-07-25 03:52:52, End Time: 2012-07-25 05:11:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (112 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (737 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.02% (13.4417 => 13.9822, std. dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.87% (10.3673 => 13.9822, std. dev.: 0.0096) SingleSource/UnitTests/ObjC/trivial-interface: 12.78% (0.3473 => 0.3917, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.73% (0.3497 => 0.3942, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3516 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.59% (0.3543 => 0.3989, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 12.56% (0.3543 => 0.3988, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.41% (0.3561 => 0.4003, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 12.18% (0.3694 => 0.4144, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.71% (0.3886 => 0.4341, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.70% (0.3828 => 0.4276, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.56% (0.3927 => 0.4381, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.43% (1.1194 => 1.2473, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.87% (2.2022 => 2.3975, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.55% (1.7609 => 1.9114, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.53% (0.5925 => 0.6371, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 7.38% (0.6030 => 0.6475, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 6.01% (0.7326 => 0.7766, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.73% (0.3177 => 0.3359, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 5.72% (10.4361 => 11.0332, std. dev.: 0.0162) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.92% (0.4615 => 0.4842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.76% (7.0540 => 7.3901, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.76% (0.4879 => 0.5111, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 4.63% (0.3282 => 0.3434, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.59% (0.7433 => 0.7774, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.19% (4.9449 => 5.1521, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (9.4845 => 9.8724, std. dev.: 0.0079) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.09% (5.0018 => 5.2062, std. dev.: 0.0084) MultiSource/Applications/hbd/hbd: 4.05% (1.5603 => 1.6235, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.03% (0.8172 => 0.8501, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.00% (0.5569 => 0.5792, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.94% (0.2891 => 0.3005, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.93% (0.2725 => 0.2832, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.91% (0.3098 => 0.3219, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.88% (0.4636 => 0.4816, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.86% (0.2872 => 0.2983, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 3.83% (0.2871 => 0.2981, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.81% (0.2831 => 0.2939, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.81% (0.2756 => 0.2861, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.80% (0.3052 => 0.3168, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.80% (0.2793 => 0.2899, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.78% (0.3121 => 0.3239, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.77% (0.3232 => 0.3354, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.75% (0.2905 => 0.3014, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.67% (0.3162 => 0.3278, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.3136 => 0.3250, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.62% (4.2646 => 4.4188, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash: 3.59% (0.4289 => 0.4443, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.58% (0.5860 => 0.6070, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 3.53% (0.3283 => 0.3399, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3180 => 0.3292, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.51% (8.1363 => 8.4216, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 3.50% (0.3603 => 0.3729, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.49% (2.0665 => 2.1387, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 3.48% (0.2877 => 0.2977, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.46% (0.3092 => 0.3199, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.4103 => 0.4242, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.37% (0.3650 => 0.3773, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.37% (0.7835 => 0.8099, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.35% (0.4064 => 0.4200, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.34% (0.3865 => 0.3994, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.32% (1.1861 => 1.2255, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.32% (0.3826 => 0.3953, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.27% (0.3422 => 0.3534, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.26% (0.4203 => 0.4340, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.17% (5.7591 => 5.9418, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: 3.07% (0.3684 => 0.3797, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (14.3668 => 14.8067, std. dev.: 0.0223) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.05% (0.3935 => 0.4055, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.05% (0.3379 => 0.3482, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.01% (0.4048 => 0.4170, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.3050 => 1.3437, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 2.86% (0.4620 => 0.4752, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.85% (3.3354 => 3.4306, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.84% (0.8067 => 0.8296, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.76% (1.5415 => 1.5841, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.76% (1.1642 => 1.1963, std. dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/bigfib: 2.68% (0.6456 => 0.6629, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.59% (1.2842 => 1.3174, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.56% (2.0273 => 2.0791, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.40% (0.6450 => 0.6605, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 2.37% (0.4299 => 0.4401, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.37% (0.9765 => 0.9996, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 2.34% (3.8723 => 3.9628, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.29% (0.6675 => 0.6828, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.12% (1.5859 => 1.6196, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.01% (2.2024 => 2.2467, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.4186 => 1.4459, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.82% (0.5981 => 0.6090, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.75% (17.1811 => 17.4816, std. dev.: 0.0156) MultiSource/Benchmarks/nbench/nbench: 1.39% (1.1840 => 1.2004, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.28% (2.2969 => 2.3264, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.01% (1.0722 => 1.0830, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.15% (2.6778 => 2.9764, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.46% (4.2280 => 4.3744, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.16% (3.6395 => 3.7546, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.54% (1.0313 => 1.0575, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.88% (26.0924 => 26.5818, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 1.70% (3.1578 => 3.2114, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5086 => 1.5327, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.53% (11.6436 => 11.8219, std. dev.: 0.0072) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2042, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6896, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: 1.14% (9.1159 => 9.2194, std. dev.: 0.0400) SingleSource/Benchmarks/Misc/oourafft: 1.03% (6.6465 => 6.7148, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.33% (5.2763 => 3.1482, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.13% (5.3855 => 3.7091, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.53% (5.3526 => 3.7184, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.43% (2.9384 => 2.5438, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -9.88% (22.1758 => 19.9842, std. dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: -5.23% (54.1659 => 51.3305, std. dev.: 0.0185) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.41% (1.2373 => 1.1085, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/mandel-2: -8.51% (1.5373 => 1.4065, std. dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5538, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.44% (1.9577 => 1.8707, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.20% (8.6802 => 8.4022, std. dev.: 0.0205) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4713, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9134, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0011, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists: -1.74% (12.5348 => 12.3161, std. dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.8329 => 1.8079, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 00:50:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 02:50:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120725075010.565442A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/2351?compare_to=2346&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2351, Order: 160705, Start Time: 2012-07-25 05:04:47, End Time: 2012-07-25 07:50:29 To: 2346, Order: 160702, Start Time: 2012-07-25 01:53:46, End Time: 2012-07-25 04:36:49 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (76 on baseline) Performance Improvements: 1 (10 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (808 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.59% (1.0022 => 1.0181, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.18% (54.2053 => 54.8463, std. dev.: 0.0782) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.17% (15.8985 => 15.7123, std. dev.: 0.0591) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 13.79% (0.3496 => 0.3978, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.78% (0.3446 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.75% (0.3469 => 0.3946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.65% (0.3465 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.63% (0.3442 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.61% (0.3460 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.50% (0.3488 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.07% (0.3643 => 0.4119, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.96% (0.3650 => 0.4123, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.57% (0.3724 => 0.4192, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.07% (0.5826 => 0.6296, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.90% (0.5889 => 0.6354, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 6.25% (1.5932 => 1.6928, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 6.22% (0.7171 => 0.7617, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.80% (0.5900 => 0.6242, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.75% (3.5627 => 3.7677, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.62% (1.6211 => 1.7122, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.55% (0.4994 => 0.5271, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.39% (0.5026 => 0.5297, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.26% (0.5000 => 0.5263, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.22% (1.3152 => 1.3839, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 5.14% (0.2725 => 0.2865, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.11% (0.2780 => 0.2922, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.09% (0.2792 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2738 => 0.2877, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.00% (0.4361 => 0.4579, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 4.99% (0.9697 => 1.0181, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.94% (0.4029 => 0.4228, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.93% (0.3267 => 0.3428, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.89% (0.3930 => 0.4122, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.87% (0.9909 => 1.0392, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/methcall: 4.83% (0.2813 => 0.2949, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.79% (2.0673 => 2.1663, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 4.76% (0.3004 => 0.3147, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3258 => 0.3413, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.64% (0.3317 => 0.3471, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.62% (0.2811 => 0.2941, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.60% (0.2911 => 0.3045, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.55% (0.3362 => 0.3515, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.2866 => 0.2995, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.39% (0.3124 => 0.3261, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.35% (2.7292 => 2.8480, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.34% (4.2109 => 4.3935, std. dev.: 0.0087) MultiSource/Applications/d/make_dparser: 4.30% (1.0781 => 1.1245, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.99% (0.3282 => 0.3413, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.97% (1.9694 => 2.0475, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.2736 => 0.2843, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (1.9966 => 2.0738, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 3.69% (0.4146 => 0.4299, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.63% (2.1013 => 2.1775, std. dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 3.53% (5.5417 => 5.7372, std. dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.3845 => 0.3979, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 3.48% (0.4251 => 0.4399, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.48% (0.4658 => 0.4820, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.34% (0.3890 => 0.4020, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.32% (4.6177 => 4.7712, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 3.27% (2.1653 => 2.2362, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 3.15% (23.5202 => 24.2615, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.14% (4.4195 => 4.5582, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.10% (0.3903 => 0.4024, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.90% (0.4139 => 0.4259, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.84% (1.8794 => 1.9328, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 2.74% (1.4269 => 1.4660, std. dev.: 0.0107) MultiSource/Applications/Burg/burg: 2.47% (0.5546 => 0.5683, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/richards_benchmark: 12.41% (2.5769 => 2.8968, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.88% (12.0509 => 12.6392, std. dev.: 0.0229) SingleSource/Benchmarks/Misc/flops-2: 4.39% (1.8057 => 1.8849, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1915, std. dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2228, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.06% (3.1169 => 3.1500, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.59% (11.9555 => 11.7652, std. dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.79% (25.4195 => 16.3223, std. dev.: 0.1023) SingleSource/Benchmarks/Dhrystone/fldry: -8.85% (17.2379 => 15.7123, std. dev.: 0.0591) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8024, std. dev.: 0.1165) SingleSource/Benchmarks/Shootout-C++/ary2: -6.99% (0.2402 => 0.2234, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -3.57% (14.0481 => 13.5470, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0134) MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.99% (0.6140 => 0.6018, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5762, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.16% (3.3991 => 3.3597, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 02:01:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 04:01:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120725090106.0CD652A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2352?compare_to=2349&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2352, Order: 160706, Start Time: 2012-07-25 07:47:09, End Time: 2012-07-25 09:01:24 To: 2349, Order: 160705, Start Time: 2012-07-25 05:34:46, End Time: 2012-07-25 06:48:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (143 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.24% (2.0176 => 2.3049, std. dev.: 0.0141) SingleSource/UnitTests/ObjC++/property-reference-object: 9.85% (0.5818 => 0.6391, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.73% (0.5748 => 0.6307, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.61% (0.3578 => 0.3922, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.38% (0.3646 => 0.3988, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 9.28% (0.3601 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.15% (0.3650 => 0.3984, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.08% (0.3623 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.06% (0.3663 => 0.3995, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 9.00% (0.3789 => 0.4130, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: 8.97% (0.3914 => 0.4265, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 8.75% (0.7061 => 0.7679, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/parameter-passing: 8.72% (0.4003 => 0.4352, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.65% (0.3940 => 0.4281, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.08% (1.3693 => 1.4799, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.99% (0.3130 => 0.3380, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (0.4328 => 0.4637, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.80% (0.2781 => 0.2970, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.79% (0.2607 => 0.2784, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.77% (0.7710 => 0.8232, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2937 => 0.3133, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.67% (0.4062 => 0.4333, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.67% (0.5265 => 0.5616, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/random: 6.65% (0.2690 => 0.2869, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.65% (0.2782 => 0.2967, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.63% (3.9660 => 4.2288, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.62% (0.7038 => 0.7504, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.55% (0.2655 => 0.2829, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2765 => 0.2946, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.53% (0.2726 => 0.2904, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.52% (0.3022 => 0.3219, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.51% (0.2966 => 0.3159, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.45% (0.2760 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.43% (0.2628 => 0.2797, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.41% (0.2761 => 0.2938, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.39% (1.9828 => 2.1096, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.39% (0.3489 => 0.3712, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.37% (0.3580 => 0.3808, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.34% (0.3107 => 0.3304, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.26% (0.3899 => 0.4143, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 6.26% (0.3149 => 0.3346, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2696 => 0.2864, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.09% (0.2988 => 0.3170, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.3192 => 0.3382, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.94% (0.3485 => 0.3692, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.73% (0.3453 => 0.3651, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.67% (0.4390 => 0.4639, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.59% (0.4379 => 0.4624, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 5.59% (0.3293 => 0.3477, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.53% (0.4016 => 0.4238, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.49% (0.3534 => 0.3728, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.47% (0.6959 => 0.7340, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.40% (1.2193 => 1.2851, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3756 => 0.3956, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.30% (0.3868 => 0.4073, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.25% (0.5577 => 0.5870, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.17% (13.8202 => 14.5346, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.11% (0.9199 => 0.9669, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.81% (16.6129 => 17.4124, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.70% (1.4563 => 1.5248, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.65% (7.2180 => 7.5539, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3246 => 0.3396, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.60% (0.2914 => 0.3048, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (13.2842 => 13.8936, std. dev.: 0.0062) MultiSource/Applications/spiff/spiff: 4.53% (0.7506 => 0.7846, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.50% (1.2292 => 1.2845, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (1.1364 => 1.1875, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.47% (0.5637 => 0.5889, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.46% (1.3813 => 1.4429, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.30% (0.7460 => 0.7781, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.29% (1.1061 => 1.1535, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.28% (1.3819 => 1.4410, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.20% (1.9270 => 2.0080, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.18% (0.3755 => 0.3912, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 4.16% (0.8310 => 0.8656, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.13% (3.8646 => 4.0243, std. dev.: 0.0110) MultiSource/Benchmarks/nbench/nbench: 4.12% (1.0594 => 1.1031, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.10% (1.3245 => 1.3788, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.97% (4.3801 => 4.5538, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (4.4433 => 4.6133, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.64% (3.6692 => 3.8028, std. dev.: 0.0114) MultiSource/Applications/sgefa/sgefa: 3.61% (0.2995 => 0.3103, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.53% (0.4791 => 0.4960, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.45% (2.1791 => 2.2542, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.40% (4.9865 => 5.1559, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.38% (0.8698 => 0.8992, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.21% (1.1333 => 1.1697, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.12% (0.6283 => 0.6479, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.07% (3.1889 => 3.2868, std. dev.: 0.0070) MultiSource/Benchmarks/McCat/05-eks/eks: 3.04% (0.4113 => 0.4238, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.81% (8.4961 => 8.7351, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.77% (0.6135 => 0.6305, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.57% (16.2614 => 16.6792, std. dev.: 0.0132) MultiSource/Applications/oggenc/oggenc: 2.56% (4.6629 => 4.7823, std. dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (6.5754 => 6.7431, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 2.51% (14.5298 => 14.8946, std. dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (2.1007 => 2.1531, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (3.2742 => 3.3549, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.45% (14.8535 => 15.2174, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.21% (1.5188 => 1.5524, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 1.97% (0.6250 => 0.6373, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.20% (1.0313 => 1.0437, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.19% (0.9108 => 0.9216, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5139, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 25.01% (1.8175 => 2.2721, std. dev.: 0.0482) SingleSource/Benchmarks/Misc/mandel-2: 7.33% (1.2998 => 1.3951, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.16% (0.9996 => 1.0512, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/salsa20: 4.35% (7.4271 => 7.7504, std. dev.: 0.0145) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7325, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9663, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4749, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.76% (1.7688 => 1.8177, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5089 => 1.5360, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5945, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5106, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.39% (1.9290 => 1.9558, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1403, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 1.00% (1.1560 => 1.1676, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1230, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.15% (0.0997 => 0.0836, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -10.78% (1.2308 => 1.0981, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std. dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.93% (1.9762 => 1.9183, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.71% (0.8342 => 0.8116, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.58% (3.0263 => 2.9482, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2174, std. dev.: 0.0120) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5039, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7084, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.60% (20.3410 => 20.0151, std. dev.: 0.0656) SingleSource/Benchmarks/Shootout/heapsort: -1.58% (3.9173 => 3.8556, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0056, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2485, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2274, std. dev.: 0.0216) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8081, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8474, std. dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 02:05:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 04:05:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120725090559.AE4772A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2353?compare_to=2350&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2353, Order: 160706, Start Time: 2012-07-25 07:47:07, End Time: 2012-07-25 09:06:20 To: 2350, Order: 160705, Start Time: 2012-07-25 05:39:51, End Time: 2012-07-25 06:58:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (111 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (738 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.83% (1.4065 => 1.4322, std. dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.25% (79.8294 => 80.8312, std. dev.: 0.1107) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.95% (10.3673 => 13.9905, std. dev.: 0.0110) SingleSource/UnitTests/ObjC/trivial-interface: 12.81% (0.3473 => 0.3918, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 12.70% (0.3497 => 0.3941, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3516 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.56% (0.3543 => 0.3988, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: 12.50% (0.3561 => 0.4006, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.48% (0.3543 => 0.3985, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/for-in: 12.15% (0.3694 => 0.4143, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.73% (0.3828 => 0.4277, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.66% (0.3886 => 0.4339, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.54% (0.3927 => 0.4380, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.46% (1.1194 => 1.2477, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.83% (2.2022 => 2.3966, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.54% (1.7609 => 1.9113, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.43% (0.5925 => 0.6365, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.35% (0.6030 => 0.6473, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 6.05% (0.7326 => 0.7769, std. dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 5.70% (10.4361 => 11.0307, std. dev.: 0.0321) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.3177 => 0.3358, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1892 => 0.1997, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.92% (0.4615 => 0.4842, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.78% (7.0540 => 7.3912, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.63% (0.7433 => 0.7777, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.4879 => 0.5103, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 4.06% (0.2831 => 0.2946, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (5.0018 => 5.2037, std. dev.: 0.0102) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (9.4845 => 9.8657, std. dev.: 0.0201) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (4.9449 => 5.1435, std. dev.: 0.0123) MultiSource/Applications/hbd/hbd: 4.01% (1.5603 => 1.6228, std. dev.: 0.0110) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 3.96% (0.3052 => 0.3173, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2725 => 0.2833, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.94% (0.8172 => 0.8494, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.90% (0.2872 => 0.2984, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.87% (0.3098 => 0.3218, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.84% (0.2891 => 0.3002, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.83% (0.2871 => 0.2981, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.81% (0.2756 => 0.2861, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.81% (0.5569 => 0.5781, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: 3.76% (0.2714 => 0.2816, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.72% (0.2905 => 0.3013, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.69% (0.2793 => 0.2896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.68% (0.3232 => 0.3351, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.67% (0.3136 => 0.3251, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.64% (0.3603 => 0.3734, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.62% (0.5860 => 0.6072, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.61% (0.3162 => 0.3276, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3865 => 0.4004, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.57% (0.2802 => 0.2902, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (4.2646 => 4.4147, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/methcall: 3.51% (0.2877 => 0.2978, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (2.0665 => 2.1390, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.48% (0.3650 => 0.3777, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.47% (8.1363 => 8.4186, std. dev.: 0.0098) MultiSource/Benchmarks/Olden/bh/bh: 3.46% (0.3092 => 0.3199, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 3.44% (0.3283 => 0.3396, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.40% (0.3826 => 0.3956, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 3.36% (0.3180 => 0.3287, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.31% (0.4289 => 0.4431, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: 3.30% (0.3422 => 0.3535, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.24% (0.4636 => 0.4786, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 3.23% (0.3684 => 0.3803, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.23% (0.3935 => 0.4062, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.22% (0.4064 => 0.4195, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.20% (0.7835 => 0.8086, std. dev.: 0.0081) MultiSource/Applications/oggenc/oggenc: 3.18% (5.7591 => 5.9422, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.16% (0.4203 => 0.4336, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.07% (14.3668 => 14.8076, std. dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.01% (1.1861 => 1.2218, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: 2.99% (0.4048 => 0.4169, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 2.99% (0.3379 => 0.3480, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.92% (3.3354 => 3.4328, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.3050 => 1.3429, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.88% (1.5859 => 1.6315, std. dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/bigfib: 2.82% (0.6456 => 0.6638, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.79% (0.4620 => 0.4749, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.67% (1.1642 => 1.1953, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.62% (0.5105 => 0.5239, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.62% (0.9765 => 1.0021, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.61% (1.2842 => 1.3177, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.49% (2.0273 => 2.0778, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.47% (1.5415 => 1.5795, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.38% (0.6675 => 0.6834, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.33% (3.8723 => 3.9625, std. dev.: 0.0151) MultiSource/Benchmarks/McCat/05-eks/eks: 2.33% (0.4299 => 0.4399, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.94% (2.2024 => 2.2452, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.87% (0.5981 => 0.6093, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.79% (1.4186 => 1.4440, std. dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 1.75% (17.1811 => 17.4815, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/football/football: 1.59% (0.8921 => 0.9063, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: 1.42% (0.7115 => 0.7216, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 1.40% (1.1840 => 1.2006, std. dev.: 0.0057) MultiSource/Applications/siod/siod: 1.22% (2.2969 => 2.3250, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (2.6778 => 2.9762, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.42% (4.2280 => 4.3725, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7463, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.92% (26.0924 => 26.5936, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/hash2: 1.75% (3.1578 => 3.2130, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.44% (2.6546 => 2.6929, std. dev.: 0.0020) MultiSource/Applications/aha/aha: 1.43% (3.1595 => 3.2046, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8043, std. dev.: 0.0147) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2257, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/oourafft: 1.05% (6.6465 => 6.7165, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.03% (1.6805 => 1.6978, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9196, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.32% (5.2763 => 3.1489, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.18% (5.3855 => 3.7062, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.54% (5.3526 => 3.7180, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.49% (2.9384 => 2.5420, std. dev.: 0.0098) MultiSource/Applications/ClamAV/clamscan: -10.07% (22.1758 => 19.9425, std. dev.: 0.0602) SingleSource/UnitTests/Vector/constpool: -5.27% (54.1659 => 51.3120, std. dev.: 0.0350) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.91% (1.2373 => 1.1147, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -6.84% (1.5373 => 1.4322, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.64% (1.9577 => 1.8668, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4888, std. dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.10% (8.1563 => 7.9031, std. dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4228, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0004, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/lists: -1.70% (12.5348 => 12.3212, std. dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.24% (1.8329 => 1.8101, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 03:43:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 05:43:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120725104306.BFF682A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2354?compare_to=2352&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2354, Order: 160709, Start Time: 2012-07-25 09:29:25, End Time: 2012-07-25 10:43:25 To: 2352, Order: 160706, Start Time: 2012-07-25 07:47:09, End Time: 2012-07-25 09:01:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (140 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.26% (2.0176 => 2.3054, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.90% (0.5818 => 0.6394, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.81% (0.5748 => 0.6312, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3578 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.19% (0.3601 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.13% (0.3646 => 0.3979, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.10% (0.3650 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.06% (0.3663 => 0.3995, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.05% (0.3623 => 0.3951, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.97% (0.3789 => 0.4129, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.94% (0.3914 => 0.4264, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.84% (0.4003 => 0.4357, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 8.70% (0.7061 => 0.7675, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 8.63% (0.3940 => 0.4280, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.07% (1.3693 => 1.4798, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (0.4328 => 0.4637, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.94% (0.2781 => 0.2974, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.72% (0.4062 => 0.4335, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.71% (0.7038 => 0.7510, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.69% (0.2782 => 0.2968, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.67% (0.7710 => 0.8224, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 6.64% (0.2607 => 0.2780, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.61% (0.2937 => 0.3131, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 6.58% (0.2690 => 0.2867, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.57% (0.3107 => 0.3311, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.53% (3.9660 => 4.2251, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.48% (0.2655 => 0.2827, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.47% (0.2628 => 0.2798, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.42% (0.5265 => 0.5603, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.42% (0.3022 => 0.3216, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2760 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.40% (0.2765 => 0.2942, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.37% (0.2761 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.35% (0.2726 => 0.2899, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.33% (1.9828 => 2.1084, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.26% (0.3149 => 0.3346, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.19% (0.3489 => 0.3705, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.17% (0.2966 => 0.3149, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2696 => 0.2862, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.01% (0.3580 => 0.3795, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.3192 => 0.3382, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.92% (0.2988 => 0.3165, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.91% (0.3485 => 0.3691, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.85% (0.3899 => 0.4127, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.82% (0.3453 => 0.3654, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.73% (0.4379 => 0.4630, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.63% (0.4390 => 0.4637, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 5.47% (0.3293 => 0.3473, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.46% (0.3534 => 0.3727, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.42% (0.6959 => 0.7336, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.38% (0.4016 => 0.4232, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.30% (0.3868 => 0.4073, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.30% (1.2193 => 1.2839, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (0.3756 => 0.3950, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.13% (0.5577 => 0.5863, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.05% (0.9199 => 0.9664, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 5.02% (13.8202 => 14.5139, std. dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2945 => 0.3089, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.76% (16.6129 => 17.4032, std. dev.: 0.0157) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.62% (0.2925 => 0.3060, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.61% (1.4563 => 1.5234, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (13.2842 => 13.8935, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.53% (7.2180 => 7.5448, std. dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.50% (0.2914 => 0.3045, std. dev.: 0.0041) MultiSource/Applications/spiff/spiff: 4.48% (0.7506 => 0.7842, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.44% (0.3246 => 0.3390, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.42% (1.3813 => 1.4424, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.42% (1.1364 => 1.1866, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.5637 => 0.5884, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.38% (1.2292 => 1.2830, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.27% (3.8646 => 4.0295, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.23% (1.3819 => 1.4403, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 4.21% (1.1061 => 1.1527, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.19% (1.9270 => 2.0078, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.16% (0.7460 => 0.7770, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.11% (1.3245 => 1.3790, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.10% (0.3755 => 0.3909, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.10% (1.0594 => 1.1028, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 4.09% (0.8310 => 0.8650, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.3801 => 4.5493, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.76% (4.4433 => 4.6105, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/18-imp/imp: 3.66% (0.3220 => 0.3338, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.66% (3.6692 => 3.8036, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.38% (0.4791 => 0.4953, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.38% (4.9865 => 5.1548, std. dev.: 0.0080) MultiSource/Applications/siod/siod: 3.33% (2.1791 => 2.2516, std. dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.32% (0.8698 => 0.8987, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.29% (1.1333 => 1.1706, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.11% (0.4113 => 0.4241, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.03% (3.1889 => 3.2854, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.77% (0.6135 => 0.6305, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.76% (8.4961 => 8.7303, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 2.55% (14.5298 => 14.8998, std. dev.: 0.0126) MultiSource/Applications/JM/ldecod/ldecod: 2.53% (6.5754 => 6.7417, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.48% (4.6629 => 4.7787, std. dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 2.41% (16.2614 => 16.6533, std. dev.: 0.0252) MultiSource/Applications/JM/lencod/lencod: 2.40% (14.8535 => 15.2100, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (3.2742 => 3.3503, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.32% (2.1007 => 2.1494, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.06% (1.5188 => 1.5501, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 1.94% (0.6250 => 0.6371, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.12% (0.9108 => 0.9210, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.10% (1.0313 => 1.0426, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.77% (0.4846 => 0.6967, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.39% (5.7573 => 7.5070, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2669, std. dev.: 0.0485) SingleSource/Benchmarks/Misc/mandel-2: 7.32% (1.2998 => 1.3950, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.20% (0.9996 => 1.0516, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: 4.33% (7.4271 => 7.7490, std. dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7324, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9658, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4753, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.34% (0.9692 => 0.9919, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5355, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1963, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1682, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1398, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.98% (0.4657 => 0.4006, std. dev.: 0.0084) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.33% (22.5627 => 21.1336, std. dev.: 0.0144) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.75% (0.0997 => 0.0840, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2308 => 1.1015, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.35% (1.3780 => 1.3043, std. dev.: 0.0093) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.71% (3.0263 => 2.9442, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.69% (0.8342 => 0.8118, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.55% (0.4867 => 0.4743, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5053, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2364, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7092, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0056, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.44% (20.3410 => 20.0476, std. dev.: 0.0529) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std. dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2493, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8084, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 03:52:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 05:52:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120725105253.CD50D2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2355?compare_to=2353&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2355, Order: 160709, Start Time: 2012-07-25 09:34:26, End Time: 2012-07-25 10:53:16 To: 2353, Order: 160706, Start Time: 2012-07-25 07:47:07, End Time: 2012-07-25 09:06:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (112 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (737 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.95% (10.3673 => 13.9903, std. dev.: 0.0107) SingleSource/UnitTests/ObjC/trivial-interface: 12.99% (0.3473 => 0.3924, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.70% (0.3497 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.62% (0.3543 => 0.3990, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3516 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.59% (0.3543 => 0.3989, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.47% (0.3561 => 0.4005, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.26% (0.3694 => 0.4147, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.81% (0.3828 => 0.4280, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.66% (0.3927 => 0.4385, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.61% (0.3886 => 0.4337, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2483, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.92% (2.2022 => 2.3987, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.50% (1.7609 => 1.9105, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.43% (0.5925 => 0.6365, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.41% (0.6030 => 0.6477, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 6.05% (0.7326 => 0.7769, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 5.80% (10.4361 => 11.0419, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.67% (0.3177 => 0.3357, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (0.4615 => 0.4843, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 4.84% (0.3282 => 0.3441, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.4879 => 0.5112, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.74% (7.0540 => 7.3885, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 4.45% (0.7433 => 0.7764, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.15% (4.9449 => 5.1503, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 4.12% (1.5603 => 1.6246, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.10% (5.0018 => 5.2070, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.03% (9.4845 => 9.8663, std. dev.: 0.0179) SingleSource/Regression/C++/ofstream_ctor: 3.99% (0.2905 => 0.3021, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.95% (0.8172 => 0.8495, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.94% (0.2891 => 0.3005, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.94% (0.3098 => 0.3220, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.93% (0.2872 => 0.2985, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.93% (0.3052 => 0.3172, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.92% (0.2831 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.92% (0.2756 => 0.2864, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.90% (0.2793 => 0.2902, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.89% (0.2725 => 0.2831, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.81% (0.5569 => 0.5781, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 3.80% (0.2871 => 0.2980, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.76% (0.3162 => 0.3281, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.74% (0.3232 => 0.3353, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.73% (0.3136 => 0.3253, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.65% (4.2646 => 4.4201, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/sieve: 3.64% (0.3603 => 0.3734, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/random: 3.60% (0.2802 => 0.2903, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.57% (0.5860 => 0.6069, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.56% (2.0665 => 2.1400, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/methcall: 3.55% (0.2877 => 0.2979, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.53% (8.1363 => 8.4233, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary3: 3.47% (0.3283 => 0.3397, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.45% (0.3650 => 0.3776, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.45% (0.3422 => 0.3540, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/09-vor/vor: 3.43% (0.3180 => 0.3289, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 3.43% (0.4289 => 0.4436, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.39% (0.3865 => 0.3996, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.4103 => 0.4242, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (0.4636 => 0.4793, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.37% (0.4064 => 0.4201, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.33% (0.3423 => 0.3537, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.29% (0.3826 => 0.3952, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.24% (0.7835 => 0.8089, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.24% (0.4203 => 0.4339, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.22% (0.3109 => 0.3209, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 3.20% (5.7591 => 5.9436, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/moments: 3.11% (0.4048 => 0.4174, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.10% (0.3935 => 0.4057, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.09% (0.3684 => 0.3798, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.08% (0.3379 => 0.3483, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (14.3668 => 14.8061, std. dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.05% (1.1861 => 1.2223, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.94% (3.3354 => 3.4334, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.93% (1.3050 => 1.3433, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.79% (0.4620 => 0.4749, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.76% (0.6456 => 0.6634, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.71% (1.1642 => 1.1957, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.8067 => 0.8285, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.58% (1.2842 => 1.3173, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.54% (2.0273 => 2.0788, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.53% (1.5415 => 1.5805, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.53% (0.5105 => 0.5234, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 2.42% (0.4299 => 0.4403, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.31% (3.8723 => 3.9618, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.26% (0.6675 => 0.6826, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.20% (0.9765 => 0.9980, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.11% (1.5859 => 1.6194, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6450 => 0.6585, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.4186 => 1.4458, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.90% (2.2024 => 2.2442, std. dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 1.73% (17.1811 => 17.4779, std. dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/football/football: 1.60% (0.8921 => 0.9064, std. dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 1.46% (1.1840 => 1.2013, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 1.29% (2.2969 => 2.3266, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.13% (2.6778 => 2.9758, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.47% (4.2280 => 4.3749, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (3.6395 => 3.7477, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.23% (1.0313 => 1.0543, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 1.91% (26.0924 => 26.5906, std. dev.: 0.0442) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2138, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5086 => 1.5346, std. dev.: 0.0011) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2037, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.40% (11.6436 => 11.8061, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.36% (2.6546 => 2.6907, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2321, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/oourafft: 1.04% (6.6465 => 6.7153, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.39% (5.2763 => 3.1454, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.14% (5.3855 => 3.7084, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.54% (5.3526 => 3.7179, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.43% (2.9384 => 2.5439, std. dev.: 0.0151) MultiSource/Applications/ClamAV/clamscan: -10.02% (22.1758 => 19.9537, std. dev.: 0.0218) SingleSource/UnitTests/Vector/constpool: -5.30% (54.1659 => 51.2960, std. dev.: 0.0184) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1166, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -8.60% (1.5373 => 1.4051, std. dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5538, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -4.35% (1.9577 => 1.8726, std. dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4894, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (8.1563 => 7.9081, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4264, std. dev.: 0.0161) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0007, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: -1.68% (12.5348 => 12.3244, std. dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8094, std. dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 04:01:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 06:01:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120725110148.28C752A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2356?compare_to=2351&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2356, Order: 160708, Start Time: 2012-07-25 08:18:53, End Time: 2012-07-25 11:02:10 To: 2351, Order: 160705, Start Time: 2012-07-25 05:04:47, End Time: 2012-07-25 07:50:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (97 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (786 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 10.65% (14.6088 => 16.1648, std. dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.27% (125.6518 => 129.7574, std. dev.: 0.8954) SingleSource/Benchmarks/Shootout-C++/methcall: 1.37% (16.3223 => 16.5463, std. dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3446 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.80% (0.3442 => 0.3917, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.70% (0.3488 => 0.3966, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 13.68% (0.3465 => 0.3939, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 13.64% (0.3460 => 0.3932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.58% (0.3469 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.50% (0.3496 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.12% (0.3643 => 0.4121, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.96% (0.3650 => 0.4123, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.57% (0.3724 => 0.4192, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.10% (0.5826 => 0.6298, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.90% (0.5889 => 0.6354, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.29% (0.7171 => 0.7622, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 6.25% (1.5932 => 1.6927, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.78% (3.5627 => 3.7687, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.61% (1.6211 => 1.7120, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 5.20% (0.2750 => 0.2893, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.17% (0.2725 => 0.2866, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.16% (0.2714 => 0.2854, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.11% (0.2738 => 0.2878, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.07% (0.4361 => 0.4582, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 5.06% (0.9697 => 1.0188, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.06% (0.2729 => 0.2867, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.05% (0.2792 => 0.2933, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.05% (0.4994 => 0.5246, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.04% (0.2875 => 0.3020, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.99% (0.2803 => 0.2943, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.95% (0.5900 => 0.6192, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 4.94% (0.2813 => 0.2952, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.91% (0.3930 => 0.4123, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 4.90% (0.3267 => 0.3427, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2823 => 0.2961, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.88% (0.3096 => 0.3247, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.87% (2.0673 => 2.1679, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 4.86% (0.2780 => 0.2915, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.85% (0.3317 => 0.3478, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.84% (0.2811 => 0.2947, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.80% (0.5000 => 0.5240, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.80% (1.3152 => 1.3783, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 4.79% (0.4029 => 0.4222, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.77% (0.2911 => 0.3050, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.73% (0.3004 => 0.3146, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.71% (0.3060 => 0.3204, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 4.68% (0.9909 => 1.0373, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.58% (0.3362 => 0.3516, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.45% (0.3124 => 0.3263, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.44% (0.3195 => 0.3337, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 4.42% (1.0781 => 1.1258, std. dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.34% (2.7292 => 2.8477, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 4.32% (0.3726 => 0.3887, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.30% (4.2109 => 4.3921, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists: 4.30% (0.3348 => 0.3492, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (0.5026 => 0.5241, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/moments: 4.19% (0.3678 => 0.3832, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.17% (0.3282 => 0.3419, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.08% (0.3625 => 0.3773, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.06% (0.3477 => 0.3618, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.95% (0.2736 => 0.2844, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.87% (0.2866 => 0.2977, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (1.9694 => 2.0448, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.79% (0.3690 => 0.3830, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.67% (1.9966 => 2.0698, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 3.67% (0.4146 => 0.4298, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 3.62% (0.4251 => 0.4405, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.54% (5.5417 => 5.7380, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 3.48% (2.1013 => 2.1745, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.47% (0.3890 => 0.4025, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (0.3845 => 0.3977, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.39% (0.4658 => 0.4816, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 3.19% (2.1653 => 2.2344, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (4.4195 => 4.5567, std. dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 3.09% (4.6177 => 4.7606, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.07% (0.3903 => 0.4023, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.00% (0.4139 => 0.4263, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 2.98% (23.5202 => 24.2212, std. dev.: 0.0233) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.5012 => 0.5153, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.81% (0.7875 => 0.8096, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 2.59% (1.8794 => 1.9280, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.56% (0.6435 => 0.6600, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.50% (1.4269 => 1.4626, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.40% (0.5546 => 0.5679, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.02% (0.6634 => 0.6768, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.04% (2.0346 => 2.0558, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.04% (0.2162 => 0.3525, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 12.44% (2.5769 => 2.8975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6669, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-2: 4.74% (1.8057 => 1.8913, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1648, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2100, std. dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2234, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.01% (3.1169 => 3.1484, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.36% (2.4764 => 2.3932, std. dev.: 0.0134) MultiSource/Applications/kimwitu++/kc: -1.63% (11.9555 => 11.7610, std. dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5463, std. dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/fldry: -9.44% (17.2379 => 15.6099, std. dev.: 0.2849) SingleSource/Benchmarks/Shootout-C++/ary2: -8.20% (0.2402 => 0.2205, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7900, std. dev.: 0.0135) SingleSource/Benchmarks/Dhrystone/dry: -3.56% (14.0481 => 13.5483, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.87% (0.6140 => 0.6025, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.67% (10.7630 => 10.5834, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.15% (3.3991 => 3.3600, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 05:25:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 07:25:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120725122501.27DAE2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2357?compare_to=2354&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2357, Order: 160716, Start Time: 2012-07-25 11:11:17, End Time: 2012-07-25 12:25:22 To: 2354, Order: 160709, Start Time: 2012-07-25 09:29:25, End Time: 2012-07-25 10:43:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (142 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.65% (28.5316 => 29.5744, std. dev.: 0.0430) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.76% (54.8108 => 56.3231, std. dev.: 0.0992) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.11% (1.5355 => 1.5526, std. dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.74% (2.0176 => 2.3150, std. dev.: 0.0151) SingleSource/UnitTests/ObjC++/property-reference-object: 9.69% (0.5818 => 0.6382, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.62% (0.5748 => 0.6301, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.28% (0.3578 => 0.3910, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.03% (0.3601 => 0.3926, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/synchronized: 8.93% (0.3663 => 0.3990, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.91% (0.3646 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.88% (0.3650 => 0.3974, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/for-in: 8.84% (0.3789 => 0.4124, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 8.83% (0.3623 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.76% (0.3914 => 0.4257, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.57% (0.7061 => 0.7666, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/parameter-passing: 8.54% (0.4003 => 0.4345, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.43% (0.3940 => 0.4272, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.03% (1.3693 => 1.4793, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.16% (0.4328 => 0.4638, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: 6.83% (0.2781 => 0.2971, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (0.7710 => 0.8233, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (3.9660 => 4.2348, std. dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 6.72% (0.7038 => 0.7511, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.67% (0.5265 => 0.5616, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 6.60% (0.4062 => 0.4330, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.51% (0.2782 => 0.2963, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.49% (0.3022 => 0.3218, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.45% (0.2760 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.44% (0.2607 => 0.2775, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2690 => 0.2862, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.38% (1.9828 => 2.1094, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 6.34% (0.2761 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.32% (0.2628 => 0.2794, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.30% (0.2937 => 0.3122, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.29% (0.2765 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.29% (0.2655 => 0.2822, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.27% (0.2966 => 0.3152, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.20% (0.2726 => 0.2895, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.18% (0.3107 => 0.3299, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.13% (0.3489 => 0.3703, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.13% (0.3149 => 0.3342, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.08% (0.2696 => 0.2860, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.05% (0.3899 => 0.4135, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.03% (0.3580 => 0.3796, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.89% (0.2988 => 0.3164, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.83% (0.3192 => 0.3378, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.82% (0.3485 => 0.3688, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.68% (0.3293 => 0.3480, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.67% (0.4390 => 0.4639, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.65% (0.3453 => 0.3648, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.64% (0.4379 => 0.4626, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.58% (0.6959 => 0.7347, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.57% (0.3534 => 0.3731, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.40% (1.2193 => 1.2852, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3756 => 0.3956, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.28% (0.4016 => 0.4228, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.23% (13.8202 => 14.5425, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.22% (0.5577 => 0.5868, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.20% (0.3868 => 0.4069, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.20% (0.9199 => 0.9677, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 4.97% (16.6129 => 17.4380, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: 4.79% (0.2925 => 0.3065, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.77% (1.4563 => 1.5257, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.65% (0.3246 => 0.3397, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.61% (13.2842 => 13.8971, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.59% (7.2180 => 7.5492, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.56% (0.5637 => 0.5894, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.56% (1.1364 => 1.1882, std. dev.: 0.0079) MultiSource/Applications/spiff/spiff: 4.50% (0.7506 => 0.7844, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.46% (0.2914 => 0.3044, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.43% (1.1061 => 1.1551, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.42% (1.2292 => 1.2835, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.36% (1.9270 => 2.0110, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.30% (1.3245 => 1.3814, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.23% (1.3813 => 1.4397, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 4.20% (3.8646 => 4.0269, std. dev.: 0.0105) MultiSource/Benchmarks/nbench/nbench: 4.19% (1.0594 => 1.1038, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.16% (1.3819 => 1.4394, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.15% (0.8310 => 0.8655, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.08% (0.7460 => 0.7764, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.04% (4.3801 => 4.5569, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (4.4433 => 4.6135, std. dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 3.77% (0.2995 => 0.3108, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3220 => 0.3341, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.66% (3.6692 => 3.8035, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (0.4791 => 0.4965, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.55% (2.1791 => 2.2564, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 3.53% (3.1889 => 3.3015, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.52% (4.9865 => 5.1620, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.35% (1.1333 => 1.1713, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.33% (0.8698 => 0.8988, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.25% (0.6283 => 0.6487, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 3.09% (0.4113 => 0.4240, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.87% (0.6135 => 0.6311, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.83% (8.4961 => 8.7365, std. dev.: 0.0099) MultiSource/Applications/oggenc/oggenc: 2.68% (4.6629 => 4.7880, std. dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: 2.60% (14.5298 => 14.9078, std. dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 2.60% (16.2614 => 16.6836, std. dev.: 0.0238) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.59% (2.1007 => 2.1552, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.58% (6.5754 => 6.7448, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 2.50% (14.8535 => 15.2254, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.47% (3.2742 => 3.3551, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.38% (1.5188 => 1.5549, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 1.90% (0.6250 => 0.6369, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.24% (1.0313 => 1.0441, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.20% (0.9108 => 0.9217, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5119, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 24.76% (1.8175 => 2.2675, std. dev.: 0.0458) SingleSource/Benchmarks/Misc/mandel-2: 7.44% (1.2998 => 1.3965, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.16% (0.9996 => 1.0512, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 4.44% (7.4271 => 7.7572, std. dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7318, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4746, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.90% (1.5089 => 1.5526, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.68% (1.7688 => 1.8162, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5941, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9550, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1943, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 1.17% (10.7476 => 10.8732, std. dev.: 0.0330) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (1.9433 => 1.9655, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1395, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.22% (0.4657 => 0.3995, std. dev.: 0.0111) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.34% (22.5627 => 21.1330, std. dev.: 0.0186) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.85% (0.0997 => 0.0829, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2308 => 1.1099, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3111, std. dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.95% (1.9762 => 1.9179, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.67% (0.8342 => 0.8119, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9472, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2266, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.02% (20.3410 => 19.9304, std. dev.: 0.0488) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5072, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7079, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4927, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2486, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2242, std. dev.: 0.0264) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8086, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 05:39:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 07:39:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120725123950.5D6052A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2358?compare_to=2355&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2358, Order: 160716, Start Time: 2012-07-25 11:21:15, End Time: 2012-07-25 12:40:11 To: 2355, Order: 160709, Start Time: 2012-07-25 09:34:26, End Time: 2012-07-25 10:53:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (117 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (732 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.00% (13.9903 => 14.2706, std. dev.: 0.0149) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.16% (54.7864 => 56.5188, std. dev.: 0.1124) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.65% (10.3673 => 14.2706, std. dev.: 0.0149) SingleSource/UnitTests/ObjC/trivial-interface: 13.01% (0.3473 => 0.3925, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 12.98% (0.3497 => 0.3951, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 12.79% (0.3543 => 0.3996, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.79% (0.3543 => 0.3996, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 12.66% (0.3516 => 0.3961, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 12.50% (0.3561 => 0.4006, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 12.24% (0.3694 => 0.4146, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.96% (0.3828 => 0.4286, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.84% (0.3886 => 0.4346, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.67% (1.1194 => 1.2500, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.64% (0.3927 => 0.4384, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.91% (2.2022 => 2.3984, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.70% (1.7609 => 1.9141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.14% (0.1622 => 0.1754, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.61% (0.5925 => 0.6376, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.40% (0.6030 => 0.6476, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.18% (10.4361 => 11.0809, std. dev.: 0.0120) SingleSource/UnitTests/ObjC++/property-reference: 6.05% (0.7326 => 0.7769, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.82% (0.3177 => 0.3362, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 5.15% (0.3282 => 0.3451, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.07% (0.4615 => 0.4849, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.90% (0.4879 => 0.5118, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.71% (7.0540 => 7.3859, std. dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 4.48% (0.7433 => 0.7766, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 4.24% (1.5603 => 1.6265, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.21% (4.9449 => 5.1532, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.13% (5.0018 => 5.2084, std. dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 4.10% (9.4845 => 9.8733, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.09% (0.8172 => 0.8506, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 4.00% (0.3098 => 0.3222, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.99% (0.2905 => 0.3021, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.97% (0.2872 => 0.2986, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.89% (0.2725 => 0.2831, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.88% (0.2756 => 0.2863, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 3.83% (0.2871 => 0.2981, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.77% (0.2891 => 0.3000, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.75% (4.2646 => 4.4246, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/strcat: 3.74% (0.2831 => 0.2937, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 3.74% (0.3052 => 0.3166, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.72% (0.2793 => 0.2897, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 3.69% (0.3603 => 0.3736, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.64% (0.3162 => 0.3277, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.5569 => 0.5771, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: 3.62% (0.7835 => 0.8119, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.62% (0.3121 => 0.3234, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.62% (0.3232 => 0.3349, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.59% (2.0665 => 2.1407, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.58% (8.1363 => 8.4274, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/random: 3.57% (0.2802 => 0.2902, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.56% (0.3283 => 0.3400, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3180 => 0.3292, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.51% (0.3650 => 0.3778, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.48% (0.2877 => 0.2977, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (0.4636 => 0.4795, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.42% (0.3826 => 0.3957, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3423 => 0.3540, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.41% (0.5860 => 0.6060, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.41% (0.3136 => 0.3243, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.39% (0.3422 => 0.3538, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.4103 => 0.4242, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.36% (0.4289 => 0.4433, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.29% (0.3865 => 0.3992, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.22% (0.4064 => 0.4195, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.21% (0.4203 => 0.4338, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.15% (0.3935 => 0.4059, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.15% (14.3668 => 14.8189, std. dev.: 0.0141) MultiSource/Applications/oggenc/oggenc: 3.14% (5.7591 => 5.9398, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3379 => 0.3485, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.13% (1.1861 => 1.2232, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 3.09% (0.4048 => 0.4173, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.02% (0.8067 => 0.8311, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3684 => 0.3793, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.96% (1.3050 => 1.3436, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 2.86% (0.4620 => 0.4752, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.79% (3.3354 => 3.4285, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.77% (0.6456 => 0.6635, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.74% (0.5105 => 0.5245, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.70% (1.1642 => 1.1956, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.53% (1.2842 => 1.3167, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.53% (2.0273 => 2.0786, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.52% (1.5415 => 1.5804, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 2.51% (0.4299 => 0.4407, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.25% (0.6675 => 0.6825, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.23% (3.8723 => 3.9586, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.14% (0.9765 => 0.9974, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6450 => 0.6585, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.2024 => 2.2473, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.01% (1.5859 => 1.6178, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.95% (1.4186 => 1.4463, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5981 => 0.6096, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 1.60% (0.8921 => 0.9064, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.44% (17.1811 => 17.4290, std. dev.: 0.0277) MultiSource/Applications/minisat/minisat: 1.43% (0.7115 => 0.7217, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.39% (1.1840 => 1.2004, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.38% (2.2969 => 2.3286, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.15% (2.6778 => 2.9763, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.51% (4.2280 => 4.3763, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.32% (3.6395 => 3.7604, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.87% (26.0924 => 26.5804, std. dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2161, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5086 => 1.5360, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.43% (2.6546 => 2.6925, std. dev.: 0.0008) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2036, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.39% (11.6436 => 11.8057, std. dev.: 0.0144) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2371, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/oourafft: 1.05% (6.6465 => 6.7164, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.01% (1.6805 => 1.6975, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.35% (5.2763 => 3.1471, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.05% (5.3855 => 3.7133, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.42% (5.3526 => 3.7244, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.39% (2.9384 => 2.5449, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -10.06% (22.1758 => 19.9454, std. dev.: 0.0226) SingleSource/UnitTests/Vector/constpool: -5.31% (54.1659 => 51.2872, std. dev.: 0.0581) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1072, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -8.07% (1.5373 => 1.4132, std. dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.67% (1.9577 => 1.8663, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.24% (8.6802 => 8.3987, std. dev.: 0.0189) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4787, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.97% (8.1563 => 7.9139, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0002, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: -1.66% (12.5348 => 12.3261, std. dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8086, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 07:07:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 09:07:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120725140704.312102A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2359?compare_to=2357&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2359, Order: 160720, Start Time: 2012-07-25 12:53:16, End Time: 2012-07-25 14:07:24 To: 2357, Order: 160716, Start Time: 2012-07-25 11:11:17, End Time: 2012-07-25 12:25:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (143 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.16% (1.5526 => 1.5346, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.85% (2.0176 => 2.3173, std. dev.: 0.0151) SingleSource/UnitTests/ObjC++/property-reference-object: 9.69% (0.5818 => 0.6382, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.57% (0.5748 => 0.6298, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.31% (0.3578 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.11% (0.3601 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.05% (0.3646 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3789 => 0.4128, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.94% (0.3623 => 0.3947, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.93% (0.3663 => 0.3990, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.90% (0.3650 => 0.3975, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 8.70% (0.7061 => 0.7675, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: 8.69% (0.4003 => 0.4351, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions: 8.69% (0.3914 => 0.4254, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.45% (0.3940 => 0.4273, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.08% (1.3693 => 1.4799, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (0.4328 => 0.4635, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.83% (0.7038 => 0.7519, std. dev.: 0.0118) SingleSource/Regression/C++/ofstream_ctor: 6.83% (0.2781 => 0.2971, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.82% (0.4062 => 0.4339, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.82% (0.2596 => 0.2773, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.74% (3.9660 => 4.2335, std. dev.: 0.0073) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.69% (0.7710 => 0.8226, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.5265 => 0.5612, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2607 => 0.2778, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.54% (0.2937 => 0.3129, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.51% (0.2782 => 0.2963, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.48% (1.9828 => 2.1112, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.43% (0.2690 => 0.2863, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.42% (0.3022 => 0.3216, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.38% (0.2760 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.37% (0.2765 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.34% (0.2761 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.33% (0.2655 => 0.2823, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.31% (0.2726 => 0.2898, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.24% (0.3107 => 0.3301, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.20% (0.2966 => 0.3150, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.16% (0.2628 => 0.2790, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.16% (0.3149 => 0.3343, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.15% (0.3580 => 0.3800, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.13% (0.3489 => 0.3703, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2696 => 0.2861, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.08% (0.3192 => 0.3386, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.03% (0.3899 => 0.4134, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.96% (0.2988 => 0.3166, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.82% (0.3485 => 0.3688, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.82% (0.6959 => 0.7364, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 5.73% (0.3453 => 0.3651, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.4379 => 0.4629, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.69% (0.4390 => 0.4640, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 5.53% (0.3293 => 0.3475, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.46% (0.3534 => 0.3727, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.45% (1.2193 => 1.2858, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (0.3756 => 0.3957, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.33% (0.4016 => 0.4230, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.30% (13.8202 => 14.5522, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.29% (0.5577 => 0.5872, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.9199 => 0.9680, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.22% (0.3868 => 0.4070, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2945 => 0.3093, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 4.91% (16.6129 => 17.4288, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 4.79% (0.2925 => 0.3065, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.78% (1.4563 => 1.5259, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.69% (13.2842 => 13.9077, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.68% (0.3246 => 0.3398, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.65% (7.2180 => 7.5537, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.64% (0.7506 => 0.7854, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.57% (1.1364 => 1.1883, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.54% (0.5637 => 0.5893, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.47% (1.2292 => 1.2841, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.46% (1.1061 => 1.1554, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 4.29% (3.8646 => 4.0303, std. dev.: 0.0064) MultiSource/Applications/treecc/treecc: 4.27% (1.9270 => 2.0093, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.25% (1.3813 => 1.4400, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.24% (1.3245 => 1.3807, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.22% (0.7460 => 0.7775, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 4.21% (0.8310 => 0.8660, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.20% (1.3819 => 1.4400, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.19% (1.0594 => 1.1038, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.18% (0.3755 => 0.3912, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.3801 => 4.5537, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (4.4433 => 4.6149, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.75% (3.6692 => 3.8069, std. dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: 3.74% (0.2995 => 0.3107, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 3.60% (2.1791 => 2.2575, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.59% (0.4791 => 0.4963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.45% (4.9865 => 5.1583, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.39% (0.8698 => 0.8993, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (1.1333 => 1.1716, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 3.19% (3.1889 => 3.2905, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.09% (0.6283 => 0.6477, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 3.01% (0.4113 => 0.4237, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 2.92% (8.4961 => 8.7444, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.90% (0.6135 => 0.6313, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (6.5754 => 6.7598, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 2.70% (4.6629 => 4.7890, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.60% (2.1007 => 2.1554, std. dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: 2.58% (14.5298 => 14.9046, std. dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: 2.53% (16.2614 => 16.6732, std. dev.: 0.0236) MultiSource/Applications/JM/lencod/lencod: 2.47% (14.8535 => 15.2207, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (3.2742 => 3.3549, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.39% (1.5188 => 1.5551, std. dev.: 0.0061) MultiSource/Applications/lemon/lemon: 1.24% (1.0313 => 1.0441, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.21% (0.9108 => 0.9218, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.10% (3.7467 => 3.7880, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 30.38% (5.7573 => 7.5066, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2618, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/mandel-2: 8.19% (1.2998 => 1.4062, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.11% (0.9996 => 1.0507, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: 4.37% (7.4271 => 7.7518, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.2619 => 11.7309, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4747, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.62% (1.7688 => 1.8152, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0310 => 1.0558, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5346, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.56% (1.4298 => 1.4521, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5952, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/fldry: 1.13% (1.9290 => 1.9508, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (3.1071 => 3.1387, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.14% (0.4657 => 0.4045, std. dev.: 0.0087) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.28% (22.5627 => 21.1454, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.35% (0.0997 => 0.0824, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -9.80% (1.2308 => 1.1102, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.16% (1.3780 => 1.3069, std. dev.: 0.0085) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9189, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.69% (0.8342 => 0.8118, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.66% (3.0263 => 2.9457, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2327, std. dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9607, std. dev.: 0.0348) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5105, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7078, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0054, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2521, std. dev.: 0.0051) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2297, std. dev.: 0.0190) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.11% (9.9194 => 9.8088, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 07:12:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 09:12:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120725141227.832342A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2360?compare_to=2356&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2360, Order: 160716, Start Time: 2012-07-25 11:29:57, End Time: 2012-07-25 14:12:48 To: 2356, Order: 160708, Start Time: 2012-07-25 08:18:53, End Time: 2012-07-25 11:02:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (98 on baseline) Performance Improvements: 1 (10 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (786 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.40% (2.0598 => 2.0886, std. dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.02% (1.3508 => 1.3646, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.28% (129.7574 => 125.4973, std. dev.: 0.5799) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3465 => 0.3942, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.76% (0.3446 => 0.3920, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.70% (0.3460 => 0.3934, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 13.68% (0.3442 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.68% (0.3488 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.64% (0.3496 => 0.3973, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.58% (0.3469 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.15% (0.3643 => 0.4122, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.96% (0.3650 => 0.4123, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.67% (0.3724 => 0.4196, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.19% (0.5826 => 0.6303, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.98% (0.5889 => 0.6359, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.55% (1.5932 => 1.6976, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 6.28% (0.7171 => 0.7621, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.81% (3.5627 => 3.7698, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.72% (1.6211 => 1.7139, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.29% (0.5900 => 0.6212, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.26% (0.9697 => 1.0207, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.23% (0.2714 => 0.2856, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.17% (0.2725 => 0.2866, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.2014 => 0.2118, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.15% (0.2738 => 0.2879, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.13% (0.2750 => 0.2891, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.13% (0.4994 => 0.5250, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.11% (0.2875 => 0.3022, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.05% (0.2792 => 0.2933, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.97% (1.3152 => 1.3805, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.95% (0.4361 => 0.4577, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 4.93% (0.3267 => 0.3428, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.92% (0.2803 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.91% (0.2813 => 0.2951, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2823 => 0.2961, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.89% (0.3930 => 0.4122, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.86% (0.4029 => 0.4225, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.84% (0.5000 => 0.5242, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.81% (2.0673 => 2.1668, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.78% (0.2780 => 0.2913, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.78% (0.3096 => 0.3244, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 4.77% (0.2811 => 0.2945, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 4.76% (0.3317 => 0.3475, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3258 => 0.3413, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.74% (0.2911 => 0.3049, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.72% (0.3792 => 0.3971, std. dev.: 0.0068) SingleSource/Regression/C++/ofstream_ctor: 4.66% (0.3004 => 0.3144, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.64% (0.9909 => 1.0369, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 4.61% (1.0781 => 1.1278, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (2.7292 => 2.8538, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.54% (0.5026 => 0.5254, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (0.3195 => 0.3339, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.50% (4.2109 => 4.4003, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3362 => 0.3513, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.44% (0.3060 => 0.3196, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.42% (0.3124 => 0.3262, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.39% (0.3348 => 0.3495, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.21% (0.3678 => 0.3833, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.19% (0.3726 => 0.3882, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.17% (0.3282 => 0.3419, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.14% (0.3625 => 0.3775, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.2866 => 0.2984, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 4.06% (0.3477 => 0.3618, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.97% (1.9694 => 2.0476, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.96% (0.3890 => 0.4044, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.84% (0.2736 => 0.2841, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.82% (0.3690 => 0.3831, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.80% (1.9966 => 2.0725, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 3.71% (0.4146 => 0.4300, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.60% (5.5417 => 5.7414, std. dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.59% (0.3845 => 0.3983, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 3.58% (0.4251 => 0.4403, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (2.1013 => 2.1763, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.47% (0.3981 => 0.4119, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.37% (0.4658 => 0.4815, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.32% (4.4195 => 4.5661, std. dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 3.31% (2.1653 => 2.2370, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 3.29% (4.6177 => 4.7696, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.13% (0.3903 => 0.4025, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 3.11% (23.5202 => 24.2513, std. dev.: 0.0162) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.97% (0.4139 => 0.4262, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.97% (0.7875 => 0.8109, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 2.86% (1.8794 => 1.9331, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 2.83% (0.5012 => 0.5154, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.67% (1.4269 => 1.4650, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.52% (0.5546 => 0.5686, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.32% (0.6634 => 0.6788, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.30% (2.0346 => 2.0610, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 12.43% (2.5769 => 2.8972, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6746, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-2: 5.05% (1.8057 => 1.8968, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2081, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4584, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2242, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.24% (1.0142 => 1.0268, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.02% (3.1169 => 3.1486, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.31% (2.4764 => 2.3944, std. dev.: 0.0200) MultiSource/Applications/kimwitu++/kc: -1.51% (11.9555 => 11.7752, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.11% (25.4195 => 16.4949, std. dev.: 0.0227) SingleSource/Benchmarks/Dhrystone/fldry: -9.67% (17.2379 => 15.5716, std. dev.: 0.2043) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8019, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: -3.55% (14.0481 => 13.5499, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.86% (0.6140 => 0.6026, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5752, std. dev.: 0.0060) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.16% (3.3991 => 3.3597, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 07:26:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 09:26:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120725142635.91E332A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2361?compare_to=2358&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2361, Order: 160720, Start Time: 2012-07-25 13:08:07, End Time: 2012-07-25 14:26:56 To: 2358, Order: 160716, Start Time: 2012-07-25 11:21:15, End Time: 2012-07-25 12:40:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (116 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (733 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.19% (1.4132 => 1.4300, std. dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.73% (10.3673 => 14.2785, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/trivial-interface: 13.07% (0.3473 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.87% (0.3497 => 0.3947, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.80% (0.3516 => 0.3966, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.79% (0.3543 => 0.3996, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.73% (0.3543 => 0.3994, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.61% (0.3561 => 0.4010, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.34% (0.3694 => 0.4150, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.94% (0.3886 => 0.4350, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.94% (0.3828 => 0.4285, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.81% (1.1194 => 1.2516, std. dev.: 0.0195) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3927 => 0.4390, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.95% (2.2022 => 2.3992, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.73% (1.7609 => 1.9146, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 8.20% (0.1622 => 0.1755, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.68% (0.5925 => 0.6380, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.56% (0.6030 => 0.6486, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.2065 => 0.2204, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 6.16% (10.4361 => 11.0791, std. dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference: 6.12% (0.7326 => 0.7774, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.3177 => 0.3364, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.4615 => 0.4853, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 4.98% (0.7433 => 0.7803, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.4879 => 0.5121, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/oourafft: 4.94% (0.3282 => 0.3444, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.81% (7.0540 => 7.3931, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.37% (4.9449 => 5.1609, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 4.31% (0.2554 => 0.2664, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.20% (9.4845 => 9.8833, std. dev.: 0.0060) MultiSource/Applications/hbd/hbd: 4.20% (1.5603 => 1.6258, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.16% (0.3098 => 0.3227, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.14% (0.8172 => 0.8510, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.11% (5.0018 => 5.2074, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 4.10% (0.2905 => 0.3024, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.07% (0.2725 => 0.2836, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 4.04% (0.2871 => 0.2987, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.03% (0.4636 => 0.4823, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.97% (0.2872 => 0.2986, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.92% (0.2756 => 0.2864, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 3.90% (0.3052 => 0.3171, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.85% (0.2831 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.84% (0.3232 => 0.3356, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.83% (0.3162 => 0.3283, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.80% (0.2793 => 0.2899, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 3.78% (0.2802 => 0.2908, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.77% (0.2891 => 0.3000, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.74% (4.2646 => 4.4241, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: 3.72% (0.2714 => 0.2815, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 3.72% (0.2877 => 0.2984, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.72% (0.5569 => 0.5776, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.68% (0.3121 => 0.3236, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.67% (2.0665 => 2.1423, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.3136 => 0.3250, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.63% (8.1363 => 8.4313, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 3.62% (0.3283 => 0.3402, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.58% (0.4103 => 0.4250, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3865 => 0.4003, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.56% (0.3650 => 0.3780, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.55% (0.5860 => 0.6068, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.54% (0.4064 => 0.4208, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3092 => 0.3201, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.51% (0.3935 => 0.4073, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.3180 => 0.3291, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 3.47% (0.3603 => 0.3728, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.43% (0.4289 => 0.4436, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 3.36% (0.3422 => 0.3537, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.32% (0.3826 => 0.3953, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.31% (0.3109 => 0.3212, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: 3.31% (0.7835 => 0.8094, std. dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 3.23% (5.7591 => 5.9449, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.20% (1.1861 => 1.2240, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 3.17% (0.3379 => 0.3486, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 3.15% (0.3684 => 0.3800, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.15% (14.3668 => 14.8187, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (1.3050 => 1.3458, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.12% (0.4203 => 0.4334, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.96% (0.4048 => 0.4168, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.93% (0.6456 => 0.6645, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.90% (0.4620 => 0.4754, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.89% (1.1642 => 1.1978, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.88% (0.5105 => 0.5252, std. dev.: 0.0048) MultiSource/Applications/d/make_dparser: 2.86% (3.3354 => 3.4308, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.74% (1.5415 => 1.5838, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.71% (0.8067 => 0.8286, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 2.66% (2.0273 => 2.0812, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 2.63% (0.4299 => 0.4412, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.56% (1.2842 => 1.3171, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 2.35% (3.8723 => 3.9634, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.32% (0.6675 => 0.6830, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.31% (0.9765 => 0.9991, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.14% (1.5859 => 1.6199, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6450 => 0.6585, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.95% (2.2024 => 2.2454, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.94% (0.5981 => 0.6097, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.4186 => 1.4458, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 1.65% (0.8921 => 0.9068, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.50% (0.7115 => 0.7222, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 1.50% (1.1840 => 1.2018, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.48% (17.1811 => 17.4350, std. dev.: 0.0087) MultiSource/Applications/siod/siod: 1.39% (2.2969 => 2.3289, std. dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.16% (2.6778 => 2.9766, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.43% (4.2280 => 4.3729, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7497, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.95% (26.0924 => 26.6007, std. dev.: 0.0225) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5357, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.65% (3.1578 => 3.2100, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.61% (9.1159 => 9.2628, std. dev.: 0.0233) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2044, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8037, std. dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6892, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 1.04% (6.6465 => 6.7154, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.01% (1.6805 => 1.6975, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.34% (5.2763 => 3.1481, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.03% (5.3855 => 3.7144, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.39% (5.3526 => 3.7262, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.29% (2.9384 => 2.5478, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -10.02% (22.1758 => 19.9546, std. dev.: 0.0178) SingleSource/UnitTests/Vector/constpool: -5.23% (54.1659 => 51.3312, std. dev.: 0.0406) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.66% (1.2373 => 1.1054, std. dev.: 0.0281) SingleSource/Benchmarks/Misc/mandel-2: -6.98% (1.5373 => 1.4300, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5538, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.79% (1.9577 => 1.8639, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4913, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.00% (8.1563 => 7.9116, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.6802 => 8.4298, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0022, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3231, std. dev.: 0.0026) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.37% (1.8329 => 1.8078, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 08:49:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 10:49:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120725154922.E53272A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2362?compare_to=2359&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2362, Order: 160726, Start Time: 2012-07-25 14:35:31, End Time: 2012-07-25 15:49:44 To: 2359, Order: 160720, Start Time: 2012-07-25 12:53:16, End Time: 2012-07-25 14:07:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (140 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.73% (2.0176 => 2.3147, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.80% (0.5818 => 0.6388, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.55% (0.5748 => 0.6297, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3578 => 0.3912, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 9.08% (0.3601 => 0.3928, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.07% (0.3650 => 0.3981, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.04% (0.3663 => 0.3994, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.02% (0.3646 => 0.3975, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.97% (0.3623 => 0.3948, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.92% (0.3789 => 0.4127, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.76% (0.3914 => 0.4257, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.69% (0.4003 => 0.4351, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.65% (0.7061 => 0.7672, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 8.58% (0.3940 => 0.4278, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.06% (1.3693 => 1.4797, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.99% (0.3130 => 0.3380, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.37% (0.1819 => 0.1953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (0.4328 => 0.4637, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.04% (0.4062 => 0.4348, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.86% (3.9660 => 4.2379, std. dev.: 0.0109) SingleSource/Regression/C++/ofstream_ctor: 6.83% (0.2781 => 0.2971, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.73% (0.7038 => 0.7512, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.72% (0.2782 => 0.2969, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.63% (0.5265 => 0.5614, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.61% (0.7710 => 0.8220, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wc: 6.54% (0.2937 => 0.3129, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2607 => 0.2777, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.52% (0.2655 => 0.2828, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2765 => 0.2945, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.2721 => 0.2898, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.49% (0.3022 => 0.3218, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.46% (1.9828 => 2.1109, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 6.43% (0.2690 => 0.2863, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.42% (0.2726 => 0.2901, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2760 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.41% (0.2761 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2628 => 0.2796, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.37% (0.3107 => 0.3305, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.31% (0.4390 => 0.4667, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.29% (0.3149 => 0.3347, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2696 => 0.2865, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.25% (0.3489 => 0.3707, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.23% (0.3899 => 0.4142, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.12% (0.2988 => 0.3171, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.05% (0.3485 => 0.3696, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.01% (0.3580 => 0.3795, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.92% (0.3192 => 0.3381, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.82% (0.3453 => 0.3654, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.66% (0.6959 => 0.7353, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 5.59% (0.3293 => 0.3477, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.43% (0.4016 => 0.4234, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.42% (1.2193 => 1.2854, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.39% (13.8202 => 14.5654, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3756 => 0.3958, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.33% (0.3868 => 0.4074, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.26% (0.9199 => 0.9683, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.22% (0.5577 => 0.5868, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 4.95% (0.2243 => 0.2354, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 4.92% (16.6129 => 17.4305, std. dev.: 0.0129) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.79% (1.4563 => 1.5260, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.75% (0.2127 => 0.2228, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.74% (13.2842 => 13.9140, std. dev.: 0.0120) MultiSource/Applications/spiff/spiff: 4.69% (0.7506 => 0.7858, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.66% (7.2180 => 7.5542, std. dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.63% (0.2914 => 0.3049, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3246 => 0.3395, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.56% (1.1364 => 1.1882, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.53% (1.2292 => 1.2849, std. dev.: 0.0057) MultiSource/Applications/Burg/burg: 4.48% (1.1061 => 1.1556, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.43% (0.5637 => 0.5887, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.42% (3.8646 => 4.0354, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 4.37% (1.9270 => 2.0112, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.29% (0.7460 => 0.7780, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.28% (1.3819 => 1.4410, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.26% (1.3245 => 1.3809, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.24% (1.3813 => 1.4399, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.21% (0.8310 => 0.8660, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.14% (1.0594 => 1.1033, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.07% (0.3755 => 0.3908, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.3801 => 4.5536, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.95% (4.4433 => 4.6190, std. dev.: 0.0064) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.71% (2.1791 => 2.2600, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.70% (3.6692 => 3.8051, std. dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: 3.67% (0.2995 => 0.3105, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (0.4791 => 0.4965, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.44% (4.9865 => 5.1579, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.40% (0.8698 => 0.8994, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.34% (1.1333 => 1.1712, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.27% (3.1889 => 3.2931, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 3.14% (0.4113 => 0.4242, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.09% (0.6283 => 0.6477, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.94% (8.4961 => 8.7461, std. dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.90% (0.6135 => 0.6313, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.67% (4.6629 => 4.7876, std. dev.: 0.0074) MultiSource/Applications/ClamAV/clamscan: 2.67% (14.5298 => 14.9172, std. dev.: 0.0157) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (6.5754 => 6.7484, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.58% (2.1007 => 2.1550, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 2.52% (16.2614 => 16.6709, std. dev.: 0.0178) MultiSource/Applications/JM/lencod/lencod: 2.51% (14.8535 => 15.2268, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.39% (3.2742 => 3.3523, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (1.5188 => 1.5545, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 1.97% (0.6250 => 0.6373, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.19% (0.9108 => 0.9216, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.18% (1.0313 => 1.0435, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.02% (6.2785 => 6.3426, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5129, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 25.54% (1.8175 => 2.2816, std. dev.: 0.0431) SingleSource/Benchmarks/Misc/mandel-2: 7.65% (1.2998 => 1.3992, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.34% (0.9996 => 1.0530, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: 4.31% (7.4271 => 7.7472, std. dev.: 0.0124) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7315, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4762, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8161, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5345, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (3.1071 => 3.1389, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.5627 => 21.1470, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.37% (1.2308 => 1.1032, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3063, std. dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.67% (0.8342 => 0.8119, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -2.67% (3.0263 => 2.9456, std. dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.09% (6.6320 => 6.4933, std. dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.92% (20.3410 => 19.9513, std. dev.: 0.0349) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2372, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7074, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.36% (5.3167 => 5.2446, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4932, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8081, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.02% (9.3358 => 9.2402, std. dev.: 0.0146) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 09:13:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 11:13:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120725161329.2564E2A6C06E@llvm.org> http://llvm.org/perf/db_default/v4/nts/2363?compare_to=2361&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2363, Order: 160726, Start Time: 2012-07-25 14:54:53, End Time: 2012-07-25 16:13:51 To: 2361, Order: 160720, Start Time: 2012-07-25 13:08:07, End Time: 2012-07-25 14:26:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (120 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (729 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.93% (10.3673 => 14.2993, std. dev.: 0.0141) SingleSource/UnitTests/ObjC/trivial-interface: 12.93% (0.3473 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.70% (0.3497 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3516 => 0.3959, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.56% (0.3543 => 0.3988, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.50% (0.3543 => 0.3986, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/synchronized: 12.44% (0.3561 => 0.4004, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: 12.21% (0.3694 => 0.4145, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3828 => 0.4288, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.88% (1.1194 => 1.2524, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.84% (0.3927 => 0.4392, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.76% (0.3886 => 0.4343, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.21% (2.2022 => 2.4050, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 8.94% (0.1622 => 0.1767, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.83% (1.7609 => 1.9163, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.24% (0.1432 => 0.1550, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.51% (0.6030 => 0.6483, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.46% (0.5925 => 0.6367, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.40% (0.1892 => 0.2013, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.34% (10.4361 => 11.0980, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.07% (0.7326 => 0.7771, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.37% (0.4879 => 0.5141, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4615 => 0.4852, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 5.06% (0.3282 => 0.3448, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.90% (7.0540 => 7.3997, std. dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 4.67% (0.7433 => 0.7780, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 4.42% (1.5603 => 1.6293, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.37% (4.9449 => 5.1608, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 4.25% (9.4845 => 9.8874, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.09% (5.0018 => 5.2063, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.06% (0.4636 => 0.4824, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 4.04% (0.2725 => 0.2835, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.03% (0.3052 => 0.3175, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.03% (0.2756 => 0.2867, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.00% (0.8172 => 0.8499, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 3.99% (0.2831 => 0.2944, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.98% (0.2891 => 0.3006, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3232 => 0.3360, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.92% (0.2905 => 0.3019, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.90% (0.5569 => 0.5786, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.87% (4.2646 => 4.4295, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/except: 3.87% (0.2871 => 0.2982, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.86% (0.2872 => 0.2983, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.3098 => 0.3216, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.80% (0.2793 => 0.2899, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 3.80% (0.2714 => 0.2817, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.78% (0.2700 => 0.2802, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.76% (2.0665 => 2.1441, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.70% (0.3162 => 0.3279, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.68% (0.2802 => 0.2905, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.67% (0.3136 => 0.3251, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.66% (8.1363 => 8.4341, std. dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/lists: 3.65% (0.3422 => 0.3547, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.3650 => 0.3783, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.64% (0.3603 => 0.3734, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.62% (0.3121 => 0.3234, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.61% (0.4103 => 0.4251, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3865 => 0.4004, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.58% (0.3180 => 0.3294, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 3.58% (0.2877 => 0.2980, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.55% (0.5860 => 0.6068, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.53% (0.3826 => 0.3961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.52% (0.4289 => 0.4440, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.47% (0.7835 => 0.8107, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 3.40% (5.7591 => 5.9550, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 3.40% (0.3092 => 0.3197, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (0.3935 => 0.4068, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.37% (0.3379 => 0.3493, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.35% (0.4064 => 0.4200, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.31% (0.3684 => 0.3806, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.26% (1.1861 => 1.2248, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.21% (0.4203 => 0.4338, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.16% (0.4048 => 0.4176, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.13% (14.3668 => 14.8167, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 3.12% (0.4620 => 0.4764, std. dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 3.07% (0.3387 => 0.3491, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.03% (1.3050 => 1.3445, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.00% (0.6456 => 0.6650, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.95% (1.1642 => 1.1985, std. dev.: 0.0075) MultiSource/Applications/d/make_dparser: 2.94% (3.3354 => 3.4333, std. dev.: 0.0101) MultiSource/Applications/hexxagon/hexxagon: 2.78% (1.2842 => 1.3199, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.75% (0.8067 => 0.8289, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.70% (0.5105 => 0.5243, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.63% (1.5415 => 1.5820, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.62% (2.0273 => 2.0804, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 2.42% (0.4299 => 0.4403, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.41% (1.5859 => 1.6241, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.38% (0.6675 => 0.6834, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.38% (3.8723 => 3.9645, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.35% (0.9765 => 0.9994, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.29% (2.2024 => 2.2529, std. dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.14% (0.6450 => 0.6588, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.09% (1.4186 => 1.4483, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.81% (0.5981 => 0.6089, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 1.65% (0.8921 => 0.9068, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.53% (17.1811 => 17.4447, std. dev.: 0.0147) MultiSource/Applications/minisat/minisat: 1.53% (0.7115 => 0.7224, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.45% (2.2969 => 2.3302, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 1.44% (1.1840 => 1.2011, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.10% (1.0722 => 1.0840, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.15% (2.6778 => 2.9764, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.44% (4.2280 => 4.3736, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7508, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 2.00% (3.7781 => 3.8535, std. dev.: 0.0276) MultiSource/Applications/lua/lua: 1.80% (26.0924 => 26.5625, std. dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/hash2: 1.70% (3.1578 => 3.2115, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.55% (1.5086 => 1.5320, std. dev.: 0.0014) MultiSource/Applications/aha/aha: 1.43% (3.1595 => 3.2047, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (2.6546 => 2.6920, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8043, std. dev.: 0.0143) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2328, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/oourafft: 1.07% (6.6465 => 6.7174, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.01% (1.6805 => 1.6975, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.12% (5.2763 => 3.1595, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.95% (5.3855 => 3.7189, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.30% (5.3526 => 3.7305, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.30% (2.9384 => 2.5477, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: -10.03% (22.1758 => 19.9512, std. dev.: 0.0112) SingleSource/UnitTests/Vector/constpool: -5.22% (54.1659 => 51.3360, std. dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2373 => 1.1109, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -7.83% (1.5373 => 1.4170, std. dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -4.42% (1.9577 => 1.8711, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.18% (8.1563 => 7.8969, std. dev.: 0.0100) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4867, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4269, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9994, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: -1.70% (12.5348 => 12.3213, std. dev.: 0.0065) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8086, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 10:23:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 12:23:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120725172324.0E6532A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/2364?compare_to=2360&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2364, Order: 160726, Start Time: 2012-07-25 14:40:39, End Time: 2012-07-25 17:23:46 To: 2360, Order: 160716, Start Time: 2012-07-25 11:29:57, End Time: 2012-07-25 14:12:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (100 on baseline) Performance Improvements: 0 (10 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (784 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.25% (125.4973 => 130.8313, std. dev.: 0.4901) SingleSource/Benchmarks/Dhrystone/fldry: 2.49% (15.5716 => 15.9598, std. dev.: 0.1149) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.88% (0.3465 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.87% (0.3446 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.79% (0.3460 => 0.3937, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.77% (0.3442 => 0.3916, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.73% (0.3488 => 0.3967, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 13.72% (0.3469 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.70% (0.3496 => 0.3975, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.34% (0.3643 => 0.4129, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 13.04% (0.3650 => 0.4126, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.70% (0.3724 => 0.4197, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.00% (0.5826 => 0.6292, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.83% (0.5889 => 0.6350, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.52% (1.5932 => 1.7130, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.11% (0.7171 => 0.7609, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.91% (3.5627 => 3.7734, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.72% (1.6211 => 1.7138, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.42% (0.5900 => 0.6220, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.37% (0.4994 => 0.5262, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.36% (0.2725 => 0.2871, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.34% (0.4361 => 0.4594, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.34% (0.2714 => 0.2859, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.30% (0.2738 => 0.2883, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.28% (0.5000 => 0.5264, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2875 => 0.3026, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.24% (0.2750 => 0.2894, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.23% (0.2792 => 0.2938, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.22% (1.3152 => 1.3838, std. dev.: 0.0049) MultiSource/Applications/hbd/hbd: 5.21% (0.9697 => 1.0202, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.17% (0.2729 => 0.2870, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.2014 => 0.2118, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.09% (0.3930 => 0.4130, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 5.07% (0.2780 => 0.2921, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.05% (0.2813 => 0.2955, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2823 => 0.2965, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.02% (0.2811 => 0.2952, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.99% (0.2803 => 0.2943, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.94% (0.3096 => 0.3249, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.91% (0.2911 => 0.3054, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.88% (0.9909 => 1.0393, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.88% (2.0673 => 2.1681, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.79% (0.4029 => 0.4222, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (2.7292 => 2.8592, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 4.75% (1.0781 => 1.1293, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.74% (0.3267 => 0.3422, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 4.69% (0.3004 => 0.3145, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3258 => 0.3410, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.64% (0.3317 => 0.3471, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.60% (0.3195 => 0.3342, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.58% (0.3124 => 0.3267, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.58% (0.5026 => 0.5256, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.54% (0.3060 => 0.3199, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.52% (0.3362 => 0.3514, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.48% (4.2109 => 4.3994, std. dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.36% (0.3625 => 0.3783, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.32% (0.3726 => 0.3887, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.24% (0.3282 => 0.3421, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.2866 => 0.2987, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 4.21% (0.3348 => 0.3489, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 4.16% (0.3678 => 0.3831, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.11% (0.3477 => 0.3620, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.06% (0.2736 => 0.2847, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (1.9694 => 2.0484, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (1.9966 => 2.0739, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.82% (0.3690 => 0.3831, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.78% (2.1013 => 2.1807, std. dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 3.67% (5.5417 => 5.7449, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.63% (0.4658 => 0.4827, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.62% (0.3890 => 0.4031, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 3.62% (0.4146 => 0.4296, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.59% (0.3845 => 0.3983, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 3.53% (0.4251 => 0.4401, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.52% (4.4195 => 4.5749, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.47% (0.3981 => 0.4119, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.46% (4.6177 => 4.7776, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 3.38% (2.1653 => 2.2385, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.28% (0.3903 => 0.4031, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.17% (0.4139 => 0.4270, std. dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 3.13% (23.5202 => 24.2569, std. dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/bigfib: 2.93% (0.5012 => 0.5159, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 2.92% (1.8794 => 1.9343, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 2.82% (0.7875 => 0.8097, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.67% (0.6435 => 0.6607, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.64% (1.4269 => 1.4645, std. dev.: 0.0073) MultiSource/Applications/Burg/burg: 2.54% (0.5546 => 0.5687, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.11% (0.6634 => 0.6774, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.33% (2.0346 => 2.0617, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 12.44% (2.5769 => 2.8975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.2122 => 0.2243, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6658, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8944, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1650, std. dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2092, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2245, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.24% (1.0142 => 1.0268, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.01% (3.1169 => 3.1484, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.56% (11.9555 => 11.7692, std. dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.09% (25.4195 => 16.5006, std. dev.: 0.0273) SingleSource/Benchmarks/Shootout-C++/ary2: -7.95% (0.2402 => 0.2211, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7986, std. dev.: 0.0116) SingleSource/Benchmarks/Dhrystone/fldry: -7.41% (17.2379 => 15.9598, std. dev.: 0.1149) SingleSource/Benchmarks/Dhrystone/dry: -3.50% (14.0481 => 13.5569, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.95% (0.6140 => 0.6020, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5793, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.15% (3.3991 => 3.3599, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 10:32:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 12:32:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120725173238.062E72A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/2365?compare_to=2362&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2365, Order: 160731, Start Time: 2012-07-25 16:18:49, End Time: 2012-07-25 17:32:59 To: 2362, Order: 160726, Start Time: 2012-07-25 14:35:31, End Time: 2012-07-25 15:49:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (144 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.70% (2.0176 => 2.3141, std. dev.: 0.0170) SingleSource/UnitTests/ObjC++/property-reference-object: 9.85% (0.5818 => 0.6391, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.62% (0.5748 => 0.6301, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.31% (0.3578 => 0.3911, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 9.08% (0.3601 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.08% (0.3646 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.01% (0.3663 => 0.3993, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.96% (0.3650 => 0.3977, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3789 => 0.4128, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.94% (0.3623 => 0.3947, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.79% (0.3914 => 0.4258, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.74% (0.7061 => 0.7678, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 8.64% (0.4003 => 0.4349, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.63% (0.3940 => 0.4280, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.12% (1.3693 => 1.4805, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (0.4328 => 0.4635, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2781 => 0.2973, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.84% (0.4062 => 0.4340, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.81% (0.7710 => 0.8235, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (3.9660 => 4.2327, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 6.69% (0.7038 => 0.7509, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.62% (0.3022 => 0.3222, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.54% (0.2782 => 0.2964, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.53% (0.5265 => 0.5609, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.49% (0.2760 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.47% (0.2765 => 0.2944, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.47% (0.2690 => 0.2864, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.44% (0.2607 => 0.2775, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.43% (1.9828 => 2.1103, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.41% (0.2761 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.37% (0.2937 => 0.3124, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.35% (0.2726 => 0.2899, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.33% (0.2655 => 0.2823, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.30% (0.2966 => 0.3153, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2628 => 0.2793, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.28% (0.3489 => 0.3708, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.28% (0.3107 => 0.3302, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.22% (0.3149 => 0.3345, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2696 => 0.2862, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.05% (0.3899 => 0.4135, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.01% (0.3580 => 0.3795, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.3192 => 0.3382, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.86% (0.2988 => 0.3163, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.85% (0.3485 => 0.3689, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.73% (0.4379 => 0.4630, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 5.68% (0.3453 => 0.3649, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.60% (0.4390 => 0.4636, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.53% (0.6959 => 0.7344, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 5.52% (0.3534 => 0.3729, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.50% (0.4016 => 0.4237, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.47% (0.3293 => 0.3473, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.38% (1.2193 => 1.2849, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.30% (0.3868 => 0.4073, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (0.3756 => 0.3954, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.25% (13.8202 => 14.5464, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.9199 => 0.9680, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (0.2945 => 0.3095, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.09% (0.5577 => 0.5861, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.95% (0.2243 => 0.2354, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.87% (0.3246 => 0.3404, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 4.86% (16.6129 => 17.4197, std. dev.: 0.0110) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.75% (0.2127 => 0.2228, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.72% (13.2842 => 13.9111, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/09-vor/vor: 4.72% (0.2925 => 0.3063, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.69% (1.4563 => 1.5246, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.65% (7.2180 => 7.5539, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.60% (0.2914 => 0.3048, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.58% (1.1364 => 1.1884, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.46% (0.7506 => 0.7841, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.45% (0.5637 => 0.5888, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.40% (1.2292 => 1.2833, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.28% (1.1061 => 1.1534, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.27% (1.3813 => 1.4403, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.22% (0.7460 => 0.7775, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.21% (1.9270 => 2.0082, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 4.19% (3.8646 => 4.0266, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/football/football: 4.19% (0.8310 => 0.8658, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.18% (1.3245 => 1.3799, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.16% (1.0594 => 1.1035, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.12% (1.3819 => 1.4388, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.01% (4.4433 => 4.6215, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.94% (0.3755 => 0.3903, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (4.3801 => 4.5521, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.74% (3.6692 => 3.8065, std. dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: 3.57% (0.2995 => 0.3102, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.53% (0.4791 => 0.4960, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.46% (2.1791 => 2.2544, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.44% (4.9865 => 5.1578, std. dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.30% (1.1333 => 1.1707, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.29% (0.8698 => 0.8984, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.22% (0.6283 => 0.6485, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.13% (3.1889 => 3.2887, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 3.01% (0.4113 => 0.4237, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.84% (8.4961 => 8.7375, std. dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.82% (0.6135 => 0.6308, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.71% (6.5754 => 6.7537, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 2.66% (4.6629 => 4.7867, std. dev.: 0.0138) MultiSource/Applications/ClamAV/clamscan: 2.55% (14.5298 => 14.9005, std. dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 2.51% (16.2614 => 16.6688, std. dev.: 0.0099) MultiSource/Applications/JM/lencod/lencod: 2.46% (14.8535 => 15.2188, std. dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.41% (2.1007 => 2.1514, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.34% (1.5188 => 1.5543, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (3.2742 => 3.3485, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 1.95% (0.6250 => 0.6372, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.19% (3.7467 => 3.7912, std. dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.16% (1.0313 => 1.0433, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.14% (0.9108 => 0.9212, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5180, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 25.27% (1.8175 => 2.2768, std. dev.: 0.0395) SingleSource/Benchmarks/Misc/mandel-2: 8.55% (1.2998 => 1.4109, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.19% (0.9996 => 1.0515, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 4.40% (7.4271 => 7.7539, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7317, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9664, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4745, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0186) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5089 => 1.5332, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5952, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1394, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.29% (22.5627 => 21.1436, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.85% (0.3511 => 0.3411, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.95% (0.0997 => 0.0818, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.79% (1.2308 => 1.1103, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.00% (1.3780 => 1.3091, std. dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9187, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.69% (0.8342 => 0.8118, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9451, std. dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2280, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5076, std. dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7071, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8592, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.47% (20.3410 => 20.0417, std. dev.: 0.0211) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0056, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2499, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2191, std. dev.: 0.0342) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.11% (9.9194 => 9.8089, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 11:00:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 13:00:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120725180038.1C7CE2A6C06F@llvm.org> http://llvm.org/perf/db_default/v4/nts/2366?compare_to=2363&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2366, Order: 160731, Start Time: 2012-07-25 16:41:47, End Time: 2012-07-25 18:00:57 To: 2363, Order: 160726, Start Time: 2012-07-25 14:54:53, End Time: 2012-07-25 16:13:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (116 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (733 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.88% (10.3673 => 14.2943, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 12.81% (0.3473 => 0.3918, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.58% (0.3497 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.54% (0.3516 => 0.3957, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.50% (0.3543 => 0.3986, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.50% (0.3543 => 0.3986, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.36% (0.3561 => 0.4001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.07% (0.3694 => 0.4140, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.92% (1.1194 => 1.2528, std. dev.: 0.0097) SingleSource/UnitTests/ObjC/exceptions: 11.78% (0.3828 => 0.4279, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.63% (0.3886 => 0.4338, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.54% (0.3927 => 0.4380, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.15% (2.2022 => 2.4036, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 9.00% (0.1622 => 0.1768, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.84% (1.7609 => 1.9166, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 8.24% (0.1432 => 0.1550, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.27% (0.5925 => 0.6356, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.25% (0.6030 => 0.6467, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 6.62% (0.7326 => 0.7811, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.18% (10.4361 => 11.0806, std. dev.: 0.0121) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.23% (0.4879 => 0.5134, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 5.09% (0.3282 => 0.3449, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.03% (0.4615 => 0.4847, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.87% (7.0540 => 7.3972, std. dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: 4.78% (0.7433 => 0.7788, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 4.49% (1.5603 => 1.6304, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 4.35% (0.2554 => 0.2665, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.24% (9.4845 => 9.8867, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.23% (4.9449 => 5.1542, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.23% (0.4636 => 0.4832, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.15% (5.0018 => 5.2092, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.03% (0.2756 => 0.2867, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.00% (0.8172 => 0.8499, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 4.00% (0.3052 => 0.3174, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2725 => 0.2833, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.2831 => 0.2943, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.93% (0.2872 => 0.2985, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.84% (0.2891 => 0.3002, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.83% (0.2793 => 0.2900, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.81% (0.5569 => 0.5781, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 3.78% (0.3283 => 0.3407, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.75% (4.2646 => 4.4247, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.73% (2.0665 => 2.1436, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/except: 3.73% (0.2871 => 0.2978, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 3.72% (0.2714 => 0.2815, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 3.71% (0.3098 => 0.3213, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.67% (0.3136 => 0.3251, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.66% (0.3603 => 0.3735, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.65% (8.1363 => 8.4335, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.3650 => 0.3783, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.64% (0.2802 => 0.2904, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.61% (0.4103 => 0.4251, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 3.58% (0.2877 => 0.2980, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3865 => 0.4002, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.54% (0.4064 => 0.4208, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.54% (0.3422 => 0.3543, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.53% (0.3826 => 0.3961, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.52% (0.4289 => 0.4440, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 3.52% (5.7591 => 5.9618, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.50% (0.5860 => 0.6065, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.3180 => 0.3291, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.43% (0.7835 => 0.8104, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3935 => 0.4069, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.40% (0.3092 => 0.3197, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 3.37% (0.3379 => 0.3493, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 3.26% (0.3684 => 0.3804, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.24% (14.3668 => 14.8328, std. dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.17% (1.1861 => 1.2237, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.16% (0.4203 => 0.4336, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.6456 => 0.6658, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 3.09% (0.4048 => 0.4173, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.04% (0.3387 => 0.3490, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.01% (0.4620 => 0.4759, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.3050 => 1.3438, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 2.96% (3.3354 => 3.4341, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 2.88% (1.1642 => 1.1977, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.85% (0.8067 => 0.8297, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.78% (0.5105 => 0.5247, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.74% (1.5415 => 1.5837, std. dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: 2.70% (1.2842 => 1.3189, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.56% (2.0273 => 2.0793, std. dev.: 0.0087) MultiSource/Applications/lua/lua: 2.49% (3.8723 => 3.9686, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 2.47% (0.4299 => 0.4405, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.40% (0.6675 => 0.6835, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.26% (0.9765 => 0.9986, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.20% (2.2024 => 2.2508, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.18% (1.5859 => 1.6205, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.11% (0.6450 => 0.6586, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.03% (1.4186 => 1.4474, std. dev.: 0.0064) MultiSource/Applications/minisat/minisat: 1.80% (0.7115 => 0.7243, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.72% (0.5981 => 0.6084, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.64% (17.1811 => 17.4631, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/football/football: 1.64% (0.8921 => 0.9067, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.55% (2.2969 => 2.3326, std. dev.: 0.0083) MultiSource/Benchmarks/nbench/nbench: 1.38% (1.1840 => 1.2003, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.06% (1.0722 => 1.0836, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (2.6778 => 2.9762, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.48% (4.2280 => 4.3752, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7508, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.79% (26.0924 => 26.5582, std. dev.: 0.0349) SingleSource/Benchmarks/Shootout-C++/hash2: 1.78% (3.1578 => 3.2140, std. dev.: 0.0029) MultiSource/Applications/aha/aha: 1.43% (3.1595 => 3.2046, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (2.6546 => 2.6919, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 1.39% (11.6436 => 11.8050, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/fbench: 1.34% (2.2771 => 2.3076, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2310, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/oourafft: 1.06% (6.6465 => 6.7168, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.01% (1.6805 => 1.6975, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.19% (5.2763 => 3.1557, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.91% (5.3855 => 3.7209, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.30% (5.3526 => 3.7310, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.22% (2.9384 => 2.5498, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -10.10% (22.1758 => 19.9351, std. dev.: 0.0154) SingleSource/UnitTests/Vector/constpool: -5.28% (54.1659 => 51.3074, std. dev.: 0.0406) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.48% (1.2373 => 1.1076, std. dev.: 0.0329) SingleSource/Benchmarks/Misc/mandel-2: -8.76% (1.5373 => 1.4026, std. dev.: 0.0232) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5538, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.77% (1.9577 => 1.8644, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4757, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (8.1563 => 7.9054, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4187, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0019, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -1.67% (12.5348 => 12.3251, std. dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8085, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 12:16:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 14:16:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120725191621.29CAD2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2367?compare_to=2365&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2367, Order: 160742, Start Time: 2012-07-25 18:02:33, End Time: 2012-07-25 19:16:40 To: 2365, Order: 160731, Start Time: 2012-07-25 16:18:49, End Time: 2012-07-25 17:32:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (147 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.65% (55.5158 => 56.4325, std. dev.: 0.1044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.52% (2.0176 => 2.3106, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 10.28% (0.5818 => 0.6416, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.11% (0.5748 => 0.6329, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.59% (0.3578 => 0.3921, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.33% (0.3601 => 0.3937, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.33% (0.3623 => 0.3961, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.31% (0.3663 => 0.4004, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.24% (0.3646 => 0.3983, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.24% (0.3789 => 0.4139, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.21% (0.3650 => 0.3986, std. dev.: 0.0073) SingleSource/UnitTests/ObjC++/property-reference: 9.09% (0.7061 => 0.7703, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.97% (0.3914 => 0.4265, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.91% (0.3940 => 0.4291, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.87% (0.4003 => 0.4358, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.11% (1.3693 => 1.4804, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (0.4328 => 0.4639, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.98% (0.2781 => 0.2975, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.82% (0.4062 => 0.4339, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.80% (0.7710 => 0.8234, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.77% (3.9660 => 4.2345, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.72% (0.7038 => 0.7511, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.60% (0.1819 => 0.1939, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.5265 => 0.5612, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.58% (0.2782 => 0.2965, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2607 => 0.2778, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2765 => 0.2946, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.54% (0.2937 => 0.3129, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.47% (0.2690 => 0.2864, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.45% (0.2760 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.43% (0.2628 => 0.2797, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.42% (0.3022 => 0.3216, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.2966 => 0.3156, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.38% (0.2726 => 0.2900, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.37% (0.2655 => 0.2824, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.33% (1.9828 => 2.1084, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.33% (0.3489 => 0.3710, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.30% (0.2761 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.21% (0.3107 => 0.3300, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.19% (0.3149 => 0.3344, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2696 => 0.2862, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.03% (0.3580 => 0.3796, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.98% (0.3899 => 0.4132, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.3192 => 0.3382, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.94% (0.3485 => 0.3692, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.89% (0.2988 => 0.3164, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.68% (0.3453 => 0.3649, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.4379 => 0.4627, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.58% (0.6959 => 0.7347, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.57% (0.3534 => 0.3731, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.47% (0.4390 => 0.4630, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.47% (0.3293 => 0.3473, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.38% (0.4016 => 0.4232, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.36% (1.2193 => 1.2846, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.30% (0.3868 => 0.4073, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (0.3756 => 0.3953, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.9199 => 0.9680, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 5.19% (13.8202 => 14.5381, std. dev.: 0.0175) MultiSource/Applications/kimwitu++/kc: 5.07% (16.6129 => 17.4547, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.06% (0.5577 => 0.5859, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.96% (0.2945 => 0.3091, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.81% (13.2842 => 13.9227, std. dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 4.79% (0.2925 => 0.3065, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.74% (7.2180 => 7.5599, std. dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.56% (0.2914 => 0.3047, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.55% (1.4563 => 1.5226, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.53% (0.7506 => 0.7846, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.52% (0.5637 => 0.5892, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.51% (1.1364 => 1.1877, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3246 => 0.3392, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.42% (1.1061 => 1.1550, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.42% (1.2292 => 1.2835, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 4.32% (1.0594 => 1.1052, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.32% (3.8646 => 4.0316, std. dev.: 0.0059) MultiSource/Applications/treecc/treecc: 4.24% (1.9270 => 2.0088, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.20% (0.8310 => 0.8659, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.16% (0.7460 => 0.7770, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.14% (1.3813 => 1.4385, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.13% (1.3819 => 1.4390, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.08% (1.3245 => 1.3786, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 4.08% (2.1791 => 2.2680, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.07% (0.3755 => 0.3908, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.3801 => 4.5546, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (4.4433 => 4.6203, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 3.81% (0.2995 => 0.3109, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.79% (3.6692 => 3.8081, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (0.4791 => 0.4965, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.56% (4.9865 => 5.1641, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.42% (1.1333 => 1.1721, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.39% (0.8698 => 0.8993, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.14% (0.6283 => 0.6480, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 3.11% (0.4113 => 0.4241, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.08% (3.1889 => 3.2871, std. dev.: 0.0164) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.97% (0.6135 => 0.6317, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.90% (8.4961 => 8.7425, std. dev.: 0.0159) MultiSource/Applications/JM/ldecod/ldecod: 2.77% (6.5754 => 6.7577, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.73% (14.8535 => 15.2594, std. dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 2.60% (16.2614 => 16.6843, std. dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: 2.56% (14.5298 => 14.9022, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.51% (3.2742 => 3.3564, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.45% (2.1007 => 2.1522, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 2.32% (4.6629 => 4.7709, std. dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5188 => 1.5527, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 1.98% (0.6250 => 0.6374, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.41% (0.9108 => 0.9236, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.19% (1.0313 => 1.0436, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.05% (3.7467 => 3.7859, std. dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: 1.01% (33.2944 => 33.6298, std. dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.00% (6.2785 => 6.3413, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5181, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 24.67% (1.8175 => 2.2658, std. dev.: 0.0462) SingleSource/Benchmarks/Misc/mandel-2: 8.01% (1.2998 => 1.4039, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.40% (0.9996 => 1.0536, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/salsa20: 4.37% (7.4271 => 7.7518, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7332, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4747, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8161, std. dev.: 0.0170) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0310 => 1.0567, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (0.9692 => 0.9910, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5331, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5951, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1940, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0407, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.05% (1.9290 => 1.9492, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.16% (22.5627 => 21.1728, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.05% (0.0997 => 0.0817, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.94% (1.2308 => 1.1085, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.66% (1.3780 => 1.3138, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.69% (0.8342 => 0.8118, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9475, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.55% (0.4867 => 0.4743, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2249, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.01% (6.6320 => 6.4985, std. dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7089, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.45% (20.3410 => 20.0455, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.31% (2.5254 => 2.4923, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.30% (5.3167 => 5.2475, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (9.9194 => 9.8079, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.12% (9.3358 => 9.2313, std. dev.: 0.0314) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 12:47:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 14:47:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120725194749.7DCA12A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2368?compare_to=2366&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2368, Order: 160743, Start Time: 2012-07-25 18:29:13, End Time: 2012-07-25 19:48:10 To: 2366, Order: 160731, Start Time: 2012-07-25 16:41:47, End Time: 2012-07-25 18:00:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (87 on baseline) Performance Improvements: 3 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (762 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.29% (79.0138 => 81.6120, std. dev.: 0.0815) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.93% (14.2943 => 13.8753, std. dev.: 0.0083) MultiSource/Applications/hbd/hbd: -1.27% (1.6304 => 1.6097, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.05% (2.1436 => 2.1210, std. dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.84% (10.3673 => 13.8753, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/trivial-interface: 12.78% (0.3473 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.47% (0.3497 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.39% (0.3543 => 0.3982, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 12.36% (0.3543 => 0.3981, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.34% (0.3516 => 0.3950, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/synchronized: 12.22% (0.3561 => 0.3996, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.02% (0.3694 => 0.4138, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.59% (1.1194 => 1.2491, std. dev.: 0.0124) SingleSource/UnitTests/ObjC/parameter-passing: 11.51% (0.3927 => 0.4379, std. dev.: 0.0082) SingleSource/UnitTests/ObjC/property: 11.45% (0.3886 => 0.4331, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.70% (2.2022 => 2.3938, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.55% (1.7609 => 1.9114, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.77% (0.5925 => 0.6326, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.68% (0.6030 => 0.6433, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.76% (0.1892 => 0.2001, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.76% (0.3177 => 0.3360, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.61% (10.4361 => 11.0219, std. dev.: 0.0219) SingleSource/UnitTests/ObjC++/property-reference: 5.51% (0.7326 => 0.7730, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/oourafft: 4.97% (0.3282 => 0.3445, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.73% (0.4879 => 0.5110, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.72% (0.4615 => 0.4833, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.69% (7.0540 => 7.3845, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 3.92% (0.2554 => 0.2654, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.87% (9.4845 => 9.8519, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (4.9449 => 5.1345, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.77% (5.0018 => 5.1905, std. dev.: 0.0085) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.77% (0.8172 => 0.8480, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.48% (0.5569 => 0.5763, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.34% (0.4636 => 0.4791, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.28% (0.5860 => 0.6052, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.27% (0.3121 => 0.3223, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.25% (4.2646 => 4.4031, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.23% (8.1363 => 8.3991, std. dev.: 0.0058) MultiSource/Applications/hbd/hbd: 3.17% (1.5603 => 1.6097, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary: 3.12% (0.3232 => 0.3333, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.11% (5.7591 => 5.9380, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 2.98% (0.3423 => 0.3525, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.90% (0.7835 => 0.8062, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.84% (1.1861 => 1.2198, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.79% (0.3650 => 0.3752, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3865 => 0.3971, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.4289 => 0.4406, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.71% (14.3668 => 14.7556, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.70% (1.3050 => 1.3402, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.64% (2.0665 => 2.1210, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.46% (0.4103 => 0.4204, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 2.46% (3.3354 => 3.4173, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.40% (0.4203 => 0.4304, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.39% (0.5105 => 0.5227, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.4620 => 0.4730, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 2.37% (0.4299 => 0.4401, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.36% (0.8067 => 0.8257, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.34% (0.6675 => 0.6831, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 2.32% (0.6456 => 0.6606, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.30% (1.5415 => 1.5770, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 2.20% (1.1642 => 1.1898, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 2.15% (2.0273 => 2.0708, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.00% (1.5859 => 1.6176, std. dev.: 0.0061) MultiSource/Applications/lua/lua: 1.99% (3.8723 => 3.9494, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.93% (0.9765 => 0.9953, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.93% (2.2024 => 2.2448, std. dev.: 0.0111) MultiSource/Applications/hexxagon/hexxagon: 1.84% (1.2842 => 1.3078, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.77% (0.6450 => 0.6564, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.68% (1.4186 => 1.4425, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.38% (17.1811 => 17.4188, std. dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/football/football: 1.35% (0.8921 => 0.9041, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 1.23% (1.1840 => 1.1986, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.15% (2.6778 => 2.9763, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.49% (4.2280 => 4.3756, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7499, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.80% (3.1578 => 3.2145, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.78% (26.0924 => 26.5567, std. dev.: 0.0271) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (1.5086 => 1.5318, std. dev.: 0.0013) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.37% (2.6546 => 2.6910, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.36% (11.6436 => 11.8022, std. dev.: 0.0046) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2312, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/oourafft: 1.04% (6.6465 => 6.7158, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.02% (1.6805 => 1.6976, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.33% (5.2763 => 3.1482, std. dev.: 0.0150) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.09% (5.3855 => 3.7112, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.54% (5.3526 => 3.7181, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.43% (2.9384 => 2.5439, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -10.35% (22.1758 => 19.8813, std. dev.: 0.0444) SingleSource/UnitTests/Vector/constpool: -5.00% (54.1659 => 51.4602, std. dev.: 0.0594) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.21% (1.2373 => 1.1110, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -9.70% (1.5373 => 1.3882, std. dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5538, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.55% (1.9577 => 1.8687, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4763, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.11% (8.6802 => 8.4099, std. dev.: 0.0135) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.97% (8.1563 => 7.9140, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0004, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: -1.75% (12.5348 => 12.3154, std. dev.: 0.0043) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8097, std. dev.: 0.0052) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 13:35:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 15:35:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120725203542.907F92A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2369?compare_to=2364&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2369, Order: 160741, Start Time: 2012-07-25 17:52:44, End Time: 2012-07-25 20:36:03 To: 2364, Order: 160726, Start Time: 2012-07-25 14:40:39, End Time: 2012-07-25 17:23:46 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 1 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (787 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.00% (1.7130 => 1.6958, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.68% (0.3465 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.55% (0.3469 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.53% (0.3496 => 0.3969, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.52% (0.3446 => 0.3912, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.48% (0.3442 => 0.3906, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.44% (0.3460 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.36% (0.3488 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.96% (0.3643 => 0.4115, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.88% (0.3650 => 0.4120, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.43% (0.3724 => 0.4187, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.60% (0.5826 => 0.6269, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.49% (0.5889 => 0.6330, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.44% (1.5932 => 1.6958, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.79% (0.7171 => 0.7586, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.63% (3.5627 => 3.7634, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.51% (1.6211 => 1.7105, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.44% (0.5000 => 0.5272, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.36% (0.5900 => 0.6216, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.09% (0.4994 => 0.5248, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.08% (0.2714 => 0.2852, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2738 => 0.2877, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.03% (0.2725 => 0.2862, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.00% (0.4361 => 0.4579, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.91% (0.2729 => 0.2863, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.91% (0.2792 => 0.2929, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.90% (0.2875 => 0.3016, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.84% (0.9697 => 1.0166, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 4.83% (0.9909 => 1.0388, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/random: 4.78% (0.2803 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.76% (0.2750 => 0.2881, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2780 => 0.2912, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.73% (0.2811 => 0.2944, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.71% (1.3152 => 1.3772, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.71% (0.2823 => 0.2956, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.68% (0.3096 => 0.3241, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.67% (0.4029 => 0.4217, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.66% (2.0673 => 2.1636, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/methcall: 4.66% (0.2813 => 0.2944, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.64% (0.2911 => 0.3046, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.63% (0.3930 => 0.4112, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.63% (0.3004 => 0.3143, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 4.59% (0.3267 => 0.3417, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 4.45% (0.3258 => 0.3403, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.40% (0.3362 => 0.3510, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.35% (0.3124 => 0.3260, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.32% (0.3195 => 0.3333, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary2: 4.31% (0.3317 => 0.3460, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (0.5026 => 0.5240, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.24% (0.3726 => 0.3884, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 4.24% (1.0781 => 1.1238, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.23% (2.7292 => 2.8446, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.22% (0.3060 => 0.3189, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.17% (4.2109 => 4.3864, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.14% (0.3625 => 0.3775, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.2866 => 0.2983, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3348 => 0.3482, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.96% (0.3282 => 0.3412, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.95% (0.2736 => 0.2844, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (1.9694 => 2.0451, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.3678 => 0.3819, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.83% (0.3477 => 0.3610, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.77% (1.9966 => 2.0719, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 3.57% (0.4146 => 0.4294, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.34% (0.3981 => 0.4114, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.32% (0.4251 => 0.4392, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (0.4658 => 0.4812, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.30% (5.5417 => 5.7247, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.25% (0.3845 => 0.3970, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.21% (0.3890 => 0.4015, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.21% (2.1013 => 2.1687, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.18% (0.3903 => 0.4027, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.09% (4.4195 => 4.5562, std. dev.: 0.0107) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.09% (0.4139 => 0.4267, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.99% (4.6177 => 4.7559, std. dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (2.1653 => 2.2292, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 2.75% (0.5012 => 0.5150, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.66% (1.8794 => 1.9293, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 2.61% (23.5202 => 24.1348, std. dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.60% (0.6435 => 0.6602, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.57% (0.7875 => 0.8077, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.39% (1.4269 => 1.4610, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 2.36% (0.5546 => 0.5677, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.99% (0.6634 => 0.6766, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 12.42% (2.5769 => 2.8969, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6720, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1662, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 4.54% (1.8057 => 1.8876, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2102, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4586, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2216, std. dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.06% (3.1169 => 3.1499, std. dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.49% (2.4764 => 2.3900, std. dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: -1.68% (11.9555 => 11.7547, std. dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5224, std. dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ary2: -9.41% (0.2402 => 0.2176, std. dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -7.99% (17.2379 => 15.8598, std. dev.: 0.1042) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7980, std. dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/dry: -3.71% (14.0481 => 13.5268, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.95% (0.6140 => 0.6020, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5757, std. dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.15% (3.3991 => 3.3600, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 13:58:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 15:58:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120725205821.7CFF92A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2370?compare_to=2367&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2370, Order: 160753, Start Time: 2012-07-25 19:44:41, End Time: 2012-07-25 20:58:42 To: 2367, Order: 160742, Start Time: 2012-07-25 18:02:33, End Time: 2012-07-25 19:16:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (146 on baseline) Performance Improvements: 1 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 1.28% (27.7089 => 28.0642, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.00% (9.8079 => 9.9063, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8167 => 8.5883, std. dev.: 0.0206) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.64% (2.0176 => 2.3129, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.80% (0.5818 => 0.6388, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.76% (0.5748 => 0.6309, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.56% (0.3578 => 0.3920, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.22% (0.3601 => 0.3933, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 9.19% (0.3646 => 0.3981, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.09% (0.3663 => 0.3996, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.08% (0.3623 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.07% (0.3650 => 0.3981, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.05% (0.3789 => 0.4132, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: 8.97% (0.3914 => 0.4265, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.87% (0.4003 => 0.4358, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.64% (0.7061 => 0.7671, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.63% (0.3940 => 0.4280, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.25% (1.3693 => 1.4822, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.30% (0.4328 => 0.4644, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (3.9660 => 4.2375, std. dev.: 0.0068) MultiSource/Applications/lambda-0_1_3/lambda: 6.71% (0.7038 => 0.7510, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.70% (0.2760 => 0.2945, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.69% (0.2781 => 0.2967, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.67% (0.5265 => 0.5616, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.65% (0.7710 => 0.8223, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 6.62% (0.4062 => 0.4331, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.61% (0.2966 => 0.3162, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.47% (0.2596 => 0.2764, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.40% (0.2782 => 0.2960, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.37% (0.2607 => 0.2773, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.32% (0.3022 => 0.3213, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.32% (0.3149 => 0.3348, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.26% (0.2765 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.25% (0.2655 => 0.2821, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2690 => 0.2857, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2628 => 0.2791, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.20% (0.2937 => 0.3119, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.16% (1.9828 => 2.1050, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.16% (0.2726 => 0.2894, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.16% (0.2761 => 0.2931, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.09% (0.2988 => 0.3170, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.08% (0.3489 => 0.3701, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.05% (0.3107 => 0.3295, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.90% (0.2696 => 0.2855, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.89% (0.3580 => 0.3791, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.87% (0.3899 => 0.4128, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.76% (0.3192 => 0.3376, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.74% (0.3485 => 0.3685, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.4379 => 0.4629, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.68% (0.3453 => 0.3649, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.57% (1.2193 => 1.2872, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.49% (0.4390 => 0.4631, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.45% (0.6959 => 0.7338, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.35% (0.4016 => 0.4231, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3534 => 0.3723, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (0.3756 => 0.3953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.19% (0.3293 => 0.3464, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.19% (0.9199 => 0.9676, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.12% (0.3868 => 0.4066, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.09% (0.5577 => 0.5861, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.07% (13.8202 => 14.5207, std. dev.: 0.0079) MultiSource/Applications/kimwitu++/kc: 4.94% (16.6129 => 17.4329, std. dev.: 0.0202) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.73% (13.2842 => 13.9126, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.70% (1.4563 => 1.5247, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.67% (7.2180 => 7.5548, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5637 => 0.5899, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.65% (1.1364 => 1.1892, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3246 => 0.3396, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.58% (1.3813 => 1.4445, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.49% (1.3819 => 1.4440, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 4.49% (0.7506 => 0.7843, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 4.38% (1.0594 => 1.1058, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.36% (1.1061 => 1.1543, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.32% (0.8310 => 0.8669, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 4.32% (1.2292 => 1.2823, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.31% (1.3245 => 1.3816, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.24% (1.9270 => 2.0088, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.22% (0.7460 => 0.7775, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 4.17% (3.8646 => 4.0259, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.01% (3.6692 => 3.8162, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.97% (4.3801 => 4.5540, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.97% (0.3755 => 0.3904, std. dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (4.4433 => 4.6181, std. dev.: 0.0070) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3220 => 0.3341, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.72% (0.4791 => 0.4969, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.50% (1.1333 => 1.1730, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 3.47% (2.1791 => 2.2548, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.38% (0.4113 => 0.4252, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.35% (4.9865 => 5.1533, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.33% (0.8698 => 0.8988, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.29% (0.3131 => 0.3234, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.13% (8.4961 => 8.7624, std. dev.: 0.0112) MultiSource/Applications/d/make_dparser: 3.08% (3.1889 => 3.2871, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.97% (0.6135 => 0.6317, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 2.88% (14.8535 => 15.2819, std. dev.: 0.0126) MultiSource/Applications/JM/ldecod/ldecod: 2.81% (6.5754 => 6.7602, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: 2.70% (14.5298 => 14.9222, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (3.2742 => 3.3620, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 2.65% (4.6629 => 4.7864, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.51% (16.2614 => 16.6694, std. dev.: 0.0251) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.43% (2.1007 => 2.1518, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.16% (1.5188 => 1.5516, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 1.89% (0.6250 => 0.6368, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.60% (0.9108 => 0.9254, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.28% (1.0313 => 1.0445, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (6.2785 => 6.3480, std. dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5168, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2629, std. dev.: 0.0200) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 5.75% (1.2998 => 1.3745, std. dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.49% (0.9996 => 1.0545, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7556, std. dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7315, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9658, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4775, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.69% (1.7688 => 1.8163, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5089 => 1.5327, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.44% (4.5928 => 4.6591, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.44% (2.0200 => 2.0491, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5112, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (1.9290 => 1.9561, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.26% (10.7476 => 10.8827, std. dev.: 0.0422) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2144, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.00% (3.1071 => 3.1383, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.22% (22.5627 => 21.1589, std. dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.36% (0.0997 => 0.0814, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.26% (1.2308 => 1.1045, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.90% (1.3780 => 1.3243, std. dev.: 0.0085) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5883, std. dev.: 0.0206) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9473, std. dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.49% (0.4867 => 0.4746, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2241, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5021, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.70% (20.3410 => 19.9953, std. dev.: 0.0395) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8649, std. dev.: 0.0147) MultiSource/Applications/minisat/minisat: -1.33% (9.3358 => 9.2119, std. dev.: 0.0100) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2486, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.05% (26.5159 => 26.2368, std. dev.: 0.0155) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 14:34:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 16:34:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120725213457.AD9CC2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2371?compare_to=2368&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2371, Order: 160753, Start Time: 2012-07-25 20:16:16, End Time: 2012-07-25 21:35:20 To: 2368, Order: 160743, Start Time: 2012-07-25 18:29:13, End Time: 2012-07-25 19:48:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (86 on baseline) Performance Improvements: 5 (25 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 928 (762 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (27.7144 => 28.0181, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.35% (13.8753 => 13.6883, std. dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.05% (81.6120 => 78.3084, std. dev.: 1.2303) MultiSource/Applications/lua/lua: -1.42% (26.5567 => 26.1790, std. dev.: 0.0100) MultiSource/Applications/siod/siod: -1.29% (3.2919 => 3.2493, std. dev.: 0.0075) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.08% (1.6976 => 1.6793, std. dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.03% (10.3673 => 13.6883, std. dev.: 0.0130) SingleSource/UnitTests/ObjC/trivial-interface: 12.76% (0.3473 => 0.3916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.61% (0.3497 => 0.3938, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 12.48% (0.3543 => 0.3985, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.48% (0.3543 => 0.3985, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 12.40% (0.3516 => 0.3952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.38% (0.3561 => 0.4002, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.07% (0.3694 => 0.4140, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.73% (0.3828 => 0.4277, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.68% (1.1194 => 1.2502, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/property: 11.58% (0.3886 => 0.4336, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.51% (0.3927 => 0.4379, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.73% (2.2022 => 2.3944, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 8.63% (0.1622 => 0.1762, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.58% (1.7609 => 1.9119, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.10% (0.1432 => 0.1548, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.57% (0.6030 => 0.6426, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.55% (0.5925 => 0.6313, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2065 => 0.2200, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 5.88% (0.7326 => 0.7757, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.85% (0.3177 => 0.3363, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.18% (0.4615 => 0.4854, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.4879 => 0.5121, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.86% (7.0540 => 7.3966, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/oourafft: 4.72% (0.3282 => 0.3437, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.63% (10.4361 => 10.9189, std. dev.: 0.0243) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.32% (0.8172 => 0.8525, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 4.29% (0.7433 => 0.7752, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 4.12% (9.4845 => 9.8753, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.9449 => 5.1477, std. dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.05% (5.0018 => 5.2045, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.93% (0.5569 => 0.5788, std. dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.72% (0.3121 => 0.3237, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (4.2646 => 4.4194, std. dev.: 0.0086) MultiSource/Applications/oggenc/oggenc: 3.53% (5.7591 => 5.9625, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.49% (8.1363 => 8.4203, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: 3.43% (0.3092 => 0.3198, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 3.42% (1.5603 => 1.6136, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 3.34% (0.7835 => 0.8097, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 3.33% (0.3180 => 0.3286, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.33% (0.3423 => 0.3537, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.31% (0.3109 => 0.3212, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.26% (1.1861 => 1.2248, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.4636 => 0.4783, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.01% (0.8067 => 0.8310, std. dev.: 0.0069) MultiSource/Applications/Burg/burg: 2.95% (1.1642 => 1.1986, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.93% (1.3050 => 1.3433, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (14.3668 => 14.7880, std. dev.: 0.0073) MultiSource/Applications/d/make_dparser: 2.89% (3.3354 => 3.4318, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.89% (1.5415 => 1.5860, std. dev.: 0.0063) MultiSource/Applications/treecc/treecc: 2.77% (2.0273 => 2.0834, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.4289 => 0.4406, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (0.5105 => 0.5242, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.62% (3.8723 => 3.9736, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 2.58% (0.4299 => 0.4410, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6675 => 0.6829, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.30% (2.0665 => 2.1140, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (1.5859 => 1.6217, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.20% (0.9765 => 0.9980, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.19% (2.2024 => 2.2507, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.19% (0.6450 => 0.6591, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.97% (1.4186 => 1.4465, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5981 => 0.6096, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 1.78% (1.2842 => 1.3071, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 1.70% (0.8921 => 0.9073, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.67% (17.1811 => 17.4674, std. dev.: 0.0134) MultiSource/Applications/siod/siod: 1.61% (2.2969 => 2.3339, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: 1.55% (0.7115 => 0.7225, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 1.52% (1.1840 => 1.2020, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.05% (1.0722 => 1.0835, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.48% (4.2280 => 4.3750, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7589, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2148, std. dev.: 0.0005) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2037, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.39% (11.6436 => 11.8049, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6885, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2191, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/oourafft: 1.04% (6.6465 => 6.7159, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.32% (5.2763 => 3.1487, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.08% (5.3855 => 3.7118, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.44% (5.3526 => 3.7232, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.19% (2.9384 => 2.5509, std. dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: -10.08% (22.1758 => 19.9400, std. dev.: 0.0356) SingleSource/UnitTests/Vector/constpool: -5.00% (54.1659 => 51.4586, std. dev.: 0.0240) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.74% (1.2373 => 1.1168, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -7.89% (1.5373 => 1.4160, std. dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.59% (1.9577 => 1.8679, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4814, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.12% (8.1563 => 7.9020, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4172, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0013, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists: -1.71% (12.5348 => 12.3201, std. dev.: 0.0079) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.26% (1.8329 => 1.8098, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -1.02% (3.2827 => 3.2493, std. dev.: 0.0075) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 15:40:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 17:40:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120725224017.BB6A62A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2372?compare_to=2370&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2372, Order: 160755, Start Time: 2012-07-25 21:26:32, End Time: 2012-07-25 22:40:38 To: 2370, Order: 160753, Start Time: 2012-07-25 19:44:41, End Time: 2012-07-25 20:58:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (137 on baseline) Performance Improvements: 4 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 949 (723 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.00% (3.6909 => 3.7279, std. dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.42% (2.1050 => 2.0752, std. dev.: 0.0035) MultiSource/Applications/hbd/hbd: -1.17% (1.4822 => 1.4649, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -1.09% (1.2823 => 1.2683, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.02% (1.3243 => 1.3108, std. dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.53% (2.0176 => 2.3107, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.06% (0.5818 => 0.6345, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.82% (0.5748 => 0.6255, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: 8.80% (0.3578 => 0.3893, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 8.61% (0.3601 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.56% (0.3646 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.44% (0.3663 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.41% (0.3650 => 0.3957, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.39% (0.3623 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3789 => 0.4104, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.25% (0.3914 => 0.4237, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.07% (0.3940 => 0.4258, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.02% (0.4003 => 0.4324, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.89% (0.7061 => 0.7618, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.76% (0.3130 => 0.3373, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 6.98% (1.3693 => 1.4649, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.56% (3.9660 => 4.2260, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.50% (0.7710 => 0.8211, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 6.44% (0.7038 => 0.7491, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.36% (0.2596 => 0.2761, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.21% (0.5265 => 0.5592, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.78% (0.4328 => 0.4578, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.49% (0.6959 => 0.7341, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.48% (0.4379 => 0.4619, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.29% (1.2193 => 1.2838, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.24% (0.4062 => 0.4275, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.11% (0.2781 => 0.2923, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.96% (0.2760 => 0.2897, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.95% (0.9199 => 0.9654, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.93% (0.3489 => 0.3661, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2782 => 0.2919, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.91% (0.5577 => 0.5851, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.91% (13.8202 => 14.4983, std. dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.86% (0.2966 => 0.3110, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.81% (0.2765 => 0.2898, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.80% (0.3899 => 0.4086, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.76% (0.2607 => 0.2731, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.72% (0.2690 => 0.2817, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.72% (0.3580 => 0.3749, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.66% (13.2842 => 13.9038, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.66% (1.9828 => 2.0752, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 4.62% (0.2726 => 0.2852, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.57% (0.3107 => 0.3249, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.57% (16.6129 => 17.3716, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/fibo: 4.57% (0.2628 => 0.2748, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.56% (0.2937 => 0.3071, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.55% (0.2988 => 0.3124, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.51% (0.3149 => 0.3291, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.49% (0.2761 => 0.2885, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3485 => 0.3641, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.2914 => 0.3043, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.42% (7.2180 => 7.5373, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.40% (1.4563 => 1.5204, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.5637 => 0.5884, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.38% (0.2696 => 0.2814, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.35% (1.3813 => 1.4414, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.34% (0.3246 => 0.3387, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.32% (1.1364 => 1.1855, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 4.23% (1.0594 => 1.1042, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.23% (0.3453 => 0.3599, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.21% (0.4390 => 0.4575, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 4.19% (1.1061 => 1.1524, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.18% (0.7506 => 0.7820, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.18% (1.3819 => 1.4396, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.3192 => 0.3325, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.14% (0.8310 => 0.8654, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.13% (0.4016 => 0.4182, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.06% (3.8646 => 4.0215, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/lists1: 4.05% (0.3534 => 0.3677, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 4.03% (1.9270 => 2.0046, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.01% (0.7460 => 0.7759, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.96% (1.3245 => 1.3769, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.89% (0.3756 => 0.3902, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3293 => 0.3420, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.3868 => 0.4015, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.73% (3.6692 => 3.8062, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.67% (4.4433 => 4.6063, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.67% (4.3801 => 4.5407, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 3.64% (0.2995 => 0.3104, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3220 => 0.3332, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.32% (2.1791 => 2.2515, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.24% (0.4791 => 0.4946, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.18% (1.2292 => 1.2683, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.16% (1.1333 => 1.1691, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.14% (4.9865 => 5.1432, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 2.90% (3.1889 => 3.2814, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.76% (8.4961 => 8.7304, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.72% (0.6283 => 0.6454, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.67% (0.6135 => 0.6299, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.64% (6.5754 => 6.7490, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 2.61% (14.8535 => 15.2414, std. dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.60% (0.8698 => 0.8924, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.47% (16.2614 => 16.6627, std. dev.: 0.0195) MultiSource/Applications/ClamAV/clamscan: 2.44% (14.5298 => 14.8841, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (3.2742 => 3.3494, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.18% (4.6629 => 4.7645, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.15% (1.5188 => 1.5515, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.27% (0.9108 => 0.9224, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.12% (1.0313 => 1.0429, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.39% (5.7573 => 7.5070, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/fbench: 24.69% (1.8175 => 2.2662, std. dev.: 0.0222) SingleSource/Benchmarks/Misc/mandel-2: 6.78% (1.2998 => 1.3879, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.30% (0.9996 => 1.0526, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/salsa20: 4.51% (7.4271 => 7.7620, std. dev.: 0.0153) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7314, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4768, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.59% (1.7688 => 1.8146, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.34% (0.9692 => 0.9919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5938, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.45% (4.5928 => 4.6595, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1967, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0407, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1397, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 1.00% (1.1560 => 1.1676, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.51% (22.5627 => 21.0928, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.95% (0.0997 => 0.0818, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2308 => 1.1107, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3108, std. dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9198, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5870, std. dev.: 0.0192) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9453, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.47% (0.4867 => 0.4747, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2241, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.07% (20.3410 => 19.9209, std. dev.: 0.0203) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5120, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.31% (2.5254 => 2.4923, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.31% (9.3358 => 9.2136, std. dev.: 0.0359) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8676, std. dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2494, std. dev.: 0.0068) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 16:22:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 18:22:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120725232206.F24172A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2373?compare_to=2371&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2373, Order: 160757, Start Time: 2012-07-25 22:03:21, End Time: 2012-07-25 23:22:26 To: 2371, Order: 160753, Start Time: 2012-07-25 20:16:16, End Time: 2012-07-25 21:35:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (77 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (771 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.32% (1.4160 => 1.4489, std. dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.42% (10.3673 => 13.6243, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 12.27% (0.3473 => 0.3899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.19% (0.3543 => 0.3975, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 12.01% (0.3497 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.00% (0.3516 => 0.3938, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 11.91% (0.3543 => 0.3965, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.88% (0.3561 => 0.3984, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.61% (0.3694 => 0.4123, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.58% (1.1194 => 1.2490, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3828 => 0.4264, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.32% (0.3886 => 0.4326, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.03% (0.3927 => 0.4360, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.69% (2.2022 => 2.3936, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.54% (1.7609 => 1.9112, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 8.08% (0.1622 => 0.1753, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 5.92% (0.5925 => 0.6276, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.85% (0.6030 => 0.6383, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 5.34% (0.7326 => 0.7717, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.31% (10.4361 => 10.9907, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.72% (7.0540 => 7.3868, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.65% (0.4879 => 0.5106, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.64% (0.4615 => 0.4829, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 4.63% (0.3282 => 0.3434, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.14% (4.9449 => 5.1496, std. dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (9.4845 => 9.8728, std. dev.: 0.0174) MultiSource/Applications/lambda-0_1_3/lambda: 3.91% (0.7433 => 0.7724, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (5.0018 => 5.1957, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.56% (0.8172 => 0.8463, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.34% (0.5860 => 0.6056, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.5569 => 0.5755, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (4.2646 => 4.4055, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.23% (8.1363 => 8.3992, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/18-imp/imp: 3.10% (0.3423 => 0.3529, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.05% (5.7591 => 5.9347, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.00% (0.7835 => 0.8070, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.1861 => 1.2208, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (14.3668 => 14.7690, std. dev.: 0.0298) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.74% (1.3050 => 1.3408, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.70% (3.3354 => 3.4254, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.57% (1.5415 => 1.5811, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.52% (2.0273 => 2.0784, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.49% (0.8067 => 0.8268, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 2.47% (1.5603 => 1.5988, std. dev.: 0.0078) MultiSource/Applications/Burg/burg: 2.37% (1.1642 => 1.1918, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.22% (0.4636 => 0.4739, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.15% (3.8723 => 3.9557, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.12% (0.5105 => 0.5213, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.94% (0.9765 => 0.9954, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6450 => 0.6573, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.81% (0.6675 => 0.6796, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (1.5859 => 1.6138, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.68% (17.1811 => 17.4703, std. dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.67% (1.4186 => 1.4423, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.66% (2.2024 => 2.2389, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 1.41% (0.8921 => 0.9047, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.31% (2.0665 => 2.0936, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.18% (1.1840 => 1.1980, std. dev.: 0.0046) MultiSource/Applications/siod/siod: 1.10% (2.2969 => 2.3221, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.04% (1.2842 => 1.2975, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.41% (4.2280 => 4.3720, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.26% (3.6395 => 3.7582, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.53% (1.0313 => 1.0574, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (1.5086 => 1.5365, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 1.73% (3.1578 => 3.2124, std. dev.: 0.0015) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2042, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.39% (2.6546 => 2.6915, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.39% (11.6436 => 11.8050, std. dev.: 0.0147) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2386, std. dev.: 0.0206) SingleSource/Benchmarks/Misc/oourafft: 1.04% (6.6465 => 6.7155, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.26% (5.2763 => 3.1520, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.08% (5.3855 => 3.7119, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.55% (5.3526 => 3.7176, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.29% (2.9384 => 2.5478, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -10.13% (22.1758 => 19.9284, std. dev.: 0.0196) SingleSource/UnitTests/Vector/constpool: -4.93% (54.1659 => 51.4934, std. dev.: 0.0301) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (3.8922 => 3.8477, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.82% (1.2373 => 1.1034, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5538, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -5.75% (1.5373 => 1.4489, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -4.81% (1.9577 => 1.8636, std. dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5957, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.19% (8.1563 => 7.8958, std. dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4815, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.82% (8.6802 => 8.4351, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0037, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: -1.66% (12.5348 => 12.3262, std. dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8086, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 16:47:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 18:47:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120725234704.29E5A2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2374?compare_to=2369&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2374, Order: 160755, Start Time: 2012-07-25 21:04:04, End Time: 2012-07-25 23:47:26 To: 2369, Order: 160741, Start Time: 2012-07-25 17:52:44, End Time: 2012-07-25 20:36:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 10 (72 on baseline) Performance Improvements: 6 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 938 (811 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.28% (0.0733 => 0.0845, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 14.75% (0.5831 => 0.6691, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 2.43% (0.6020 => 0.6166, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 2.31% (2.8969 => 2.9638, std. dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 2.05% (46.5436 => 47.4996, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.02% (105.5299 => 107.6650, std. dev.: 0.0417) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.94% (49.6285 => 50.5921, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.50% (2.0922 => 2.1236, std. dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.35% (129.4444 => 131.1867, std. dev.: 0.2326) MultiSource/Benchmarks/BitBench/five11/five11: 1.25% (8.4084 => 8.5133, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -2.13% (1.0166 => 0.9949, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -2.06% (1.0388 => 1.0174, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.76% (2.1636 => 2.1256, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -7.63% (28.1221 => 25.9769, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.12% (50.3521 => 49.7869, std. dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/hash2: -1.03% (9.6319 => 9.5329, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.19% (0.3446 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.18% (0.3442 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.16% (0.3488 => 0.3982, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 14.11% (0.3465 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.10% (0.3460 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.02% (0.3496 => 0.3986, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.95% (0.3469 => 0.3953, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.72% (0.3643 => 0.4143, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.42% (0.3650 => 0.4140, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.05% (0.3724 => 0.4210, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.07% (0.5826 => 0.6238, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 6.91% (0.5889 => 0.6296, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.78% (3.5627 => 3.7688, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.62% (1.6211 => 1.7122, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 5.45% (1.5932 => 1.6801, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.39% (0.5900 => 0.6218, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.36% (0.2014 => 0.2122, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.27% (0.4361 => 0.4591, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.23% (0.7171 => 0.7546, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.11% (0.4994 => 0.5249, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.97% (1.3152 => 1.3805, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.94% (2.7292 => 2.8641, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.94% (0.5000 => 0.5247, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 4.94% (0.4029 => 0.4228, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.91% (0.3930 => 0.4123, std. dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 4.74% (4.2109 => 4.4107, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.60% (0.5026 => 0.5257, std. dev.: 0.0079) MultiSource/Applications/d/make_dparser: 4.56% (1.0781 => 1.1273, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.2866 => 0.2989, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.07% (1.9694 => 2.0495, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (1.9966 => 2.0747, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 3.86% (2.1013 => 2.1825, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (0.4658 => 0.4828, std. dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 3.58% (5.5417 => 5.7401, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.57% (0.3890 => 0.4029, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.48% (4.4195 => 4.5731, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 3.39% (2.1653 => 2.2387, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.38% (4.6177 => 4.7737, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.3903 => 0.4033, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 3.10% (1.8794 => 1.9377, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.00% (0.4139 => 0.4263, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.93% (0.7875 => 0.8106, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.82% (2.0673 => 2.1256, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.82% (0.6634 => 0.6821, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.69% (1.4269 => 1.4653, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.67% (0.9909 => 1.0174, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 2.60% (0.9697 => 0.9949, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 2.51% (23.5202 => 24.1110, std. dev.: 0.0114) MultiSource/Applications/Burg/burg: 2.43% (0.5546 => 0.5681, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.62% (0.6435 => 0.6539, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.31% (2.0346 => 2.0612, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.12% (0.0734 => 0.0845, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9638, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.2122 => 0.2262, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6638, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8959, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1699, std. dev.: 0.0512) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (105.3826 => 107.6650, std. dev.: 0.0417) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1962, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.00% (2.0820 => 2.1236, std. dev.: 0.0082) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.4996, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5921, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2237, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.66% (2.4764 => 2.3857, std. dev.: 0.0078) MultiSource/Applications/kimwitu++/kc: -1.79% (11.9555 => 11.7413, std. dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5611, std. dev.: 0.0091) SingleSource/Benchmarks/Dhrystone/fldry: -9.02% (17.2379 => 15.6838, std. dev.: 0.1928) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7885, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -6.33% (0.2402 => 0.2250, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -3.81% (0.4438 => 0.4269, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: -3.60% (14.0481 => 13.5417, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5770, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 17:22:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 19:22:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120726002217.48AAF2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2375?compare_to=2372&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2375, Order: 160764, Start Time: 2012-07-25 23:08:31, End Time: 2012-07-26 00:22:38 To: 2372, Order: 160755, Start Time: 2012-07-25 21:26:32, End Time: 2012-07-25 22:40:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (143 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.06% (79.6582 => 80.4991, std. dev.: 0.1410) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.01% (3.7279 => 3.6902, std. dev.: 0.0141) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.25% (2.0176 => 2.3052, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/trivial-interface: 9.87% (0.3578 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.69% (0.5818 => 0.6382, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.66% (0.3601 => 0.3949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.63% (0.3646 => 0.3997, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.62% (0.3650 => 0.4001, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.56% (0.3663 => 0.4013, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 9.49% (0.3623 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.42% (0.3789 => 0.4146, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.38% (0.5748 => 0.6287, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 9.30% (0.3914 => 0.4278, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.21% (0.3940 => 0.4303, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 9.12% (0.4003 => 0.4368, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 8.55% (0.7061 => 0.7665, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.11% (1.3693 => 1.4666, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.7710 => 0.8250, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.86% (3.9660 => 4.2379, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.5265 => 0.5612, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.37% (0.7038 => 0.7486, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.24% (0.4328 => 0.4598, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.87% (0.4379 => 0.4636, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.85% (0.6959 => 0.7366, std. dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: 5.72% (0.2781 => 0.2940, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.63% (1.2193 => 1.2880, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash: 5.61% (0.4062 => 0.4290, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.43% (0.2782 => 0.2933, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3022 => 0.3184, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.33% (0.2607 => 0.2746, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.33% (0.9199 => 0.9689, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.24% (0.2690 => 0.2831, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.21% (0.2628 => 0.2765, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.19% (0.3489 => 0.3670, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.18% (0.5577 => 0.5866, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.16% (0.2655 => 0.2792, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 5.14% (0.2761 => 0.2903, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.14% (0.3580 => 0.3764, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.11% (0.2937 => 0.3087, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.09% (1.9828 => 2.0838, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 5.09% (13.8202 => 14.5230, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.06% (0.2966 => 0.3116, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.05% (0.3485 => 0.3661, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 5.04% (0.2243 => 0.2356, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.04% (0.2760 => 0.2899, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.3899 => 0.4094, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.99% (0.2726 => 0.2862, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.97% (0.2696 => 0.2830, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.92% (0.2765 => 0.2901, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.89% (0.3149 => 0.3303, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.84% (16.6129 => 17.4170, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.2988 => 0.3131, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.77% (0.2914 => 0.3053, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3107 => 0.3255, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.74% (7.2180 => 7.5601, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.72% (0.7506 => 0.7860, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.68% (0.5637 => 0.5901, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.66% (1.4563 => 1.5241, std. dev.: 0.0075) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.63% (1.3813 => 1.4453, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.60% (1.3819 => 1.4455, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.60% (0.4390 => 0.4592, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (13.2842 => 13.8934, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 4.54% (0.3192 => 0.3337, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3246 => 0.3393, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.52% (1.1364 => 1.1878, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.0594 => 1.1072, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.43% (0.4016 => 0.4194, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.43% (0.3453 => 0.3606, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 4.38% (1.1061 => 1.1546, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.36% (3.8646 => 4.0330, std. dev.: 0.0104) MultiSource/Applications/treecc/treecc: 4.35% (1.9270 => 2.0108, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.3245 => 1.3820, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.31% (0.8310 => 0.8668, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3756 => 0.3916, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.22% (0.7460 => 0.7775, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.22% (0.3293 => 0.3432, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.16% (0.3868 => 0.4029, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.97% (3.6692 => 3.8150, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.3801 => 4.5535, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.94% (4.4433 => 4.6183, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.2945 => 0.3060, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.49% (2.1791 => 2.2552, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.49% (1.2292 => 1.2721, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.49% (0.4791 => 0.4958, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.1333 => 1.1720, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 3.31% (0.4113 => 0.4249, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.27% (3.1889 => 3.2931, std. dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.15% (0.6135 => 0.6328, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.12% (0.3755 => 0.3872, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.97% (8.4961 => 8.7482, std. dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.96% (0.6283 => 0.6469, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.92% (4.9865 => 5.1321, std. dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: 2.88% (6.5754 => 6.7645, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 2.87% (14.8535 => 15.2792, std. dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.82% (0.8698 => 0.8943, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.68% (14.5298 => 14.9191, std. dev.: 0.0088) MultiSource/Applications/oggenc/oggenc: 2.61% (4.6629 => 4.7846, std. dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (3.2742 => 3.3558, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.44% (16.2614 => 16.6586, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (2.1007 => 2.1509, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5188 => 1.5527, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.58% (0.9108 => 0.9252, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.37% (1.0313 => 1.0454, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.15% (6.2785 => 6.3510, std. dev.: 0.0086) MultiSource/Applications/lua/lua: 1.02% (3.7467 => 3.7851, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.46% (5.7573 => 7.5111, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fbench: 25.02% (1.8175 => 2.2723, std. dev.: 0.0421) SingleSource/Benchmarks/Misc/mandel-2: 7.58% (1.2998 => 1.3983, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.20% (0.9996 => 1.0516, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 4.38% (7.4271 => 7.7522, std. dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7327, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.21% (12.0921 => 12.4797, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8166, std. dev.: 0.0182) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (1.5089 => 1.5353, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.63% (1.9290 => 1.9604, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5928 => 4.6653, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5943, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.17% (10.7476 => 10.8738, std. dev.: 0.0143) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1405, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.46% (22.5627 => 21.1056, std. dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2308 => 1.1099, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3053, std. dev.: 0.0063) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.8259 => 8.5731, std. dev.: 0.0172) MultiSource/Applications/spiff/spiff: -2.71% (3.0263 => 2.9444, std. dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.92% (6.3560 => 6.2339, std. dev.: 0.0146) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9831, std. dev.: 0.0366) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8649, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2507, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2214, std. dev.: 0.0433) MultiSource/Applications/lua/lua: -1.18% (26.5159 => 26.2041, std. dev.: 0.0176) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 18:09:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 20:09:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120726010903.A3CD02A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2376?compare_to=2373&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2376, Order: 160764, Start Time: 2012-07-25 23:50:32, End Time: 2012-07-26 01:09:25 To: 2373, Order: 160757, Start Time: 2012-07-25 22:03:21, End Time: 2012-07-25 23:22:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (76 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (772 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.38% (10.3673 => 13.7242, std. dev.: 0.0086) SingleSource/UnitTests/ObjC/trivial-interface: 12.96% (0.3473 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.67% (0.3497 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.64% (0.3561 => 0.4011, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.57% (0.3516 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.53% (0.3543 => 0.3987, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.50% (0.3543 => 0.3986, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.24% (0.3694 => 0.4146, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.86% (0.3828 => 0.4282, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.66% (0.3886 => 0.4339, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.62% (1.1194 => 1.2495, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.61% (0.3927 => 0.4383, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.63% (2.2022 => 2.3922, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.22% (1.7609 => 1.9056, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 7.52% (0.1622 => 0.1744, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.18% (0.1892 => 0.2009, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5925 => 0.6290, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.10% (0.6030 => 0.6398, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 5.58% (0.7326 => 0.7735, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 5.23% (10.4361 => 10.9814, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.88% (0.4879 => 0.5117, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 4.81% (0.3282 => 0.3440, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.79% (0.4615 => 0.4836, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.73% (7.0540 => 7.3877, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 4.21% (9.4845 => 9.8836, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.12% (0.8172 => 0.8509, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.85% (4.9449 => 5.1354, std. dev.: 0.0085) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.0018 => 5.1913, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.50% (0.5569 => 0.5764, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.34% (8.1363 => 8.4084, std. dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 3.31% (5.7591 => 5.9500, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.31% (0.5860 => 0.6054, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.30% (0.3121 => 0.3224, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.28% (4.2646 => 4.4045, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.10% (0.7835 => 0.8078, std. dev.: 0.0064) MultiSource/Benchmarks/McCat/18-imp/imp: 3.07% (0.3423 => 0.3528, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.90% (1.1861 => 1.2205, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.84% (1.3050 => 1.3421, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (14.3668 => 14.7693, std. dev.: 0.0236) MultiSource/Applications/d/make_dparser: 2.63% (3.3354 => 3.4230, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 2.56% (1.5603 => 1.6002, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.45% (0.8067 => 0.8265, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.43% (1.1642 => 1.1925, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.41% (1.5415 => 1.5786, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.33% (2.0273 => 2.0745, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.20% (0.4636 => 0.4738, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 1.98% (3.8723 => 3.9489, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.98% (0.9765 => 0.9958, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.97% (1.5859 => 1.6171, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.90% (0.6675 => 0.6802, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.88% (2.2024 => 2.2437, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.83% (0.6450 => 0.6568, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.76% (0.5981 => 0.6086, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.68% (1.4186 => 1.4425, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 1.46% (0.8921 => 0.9051, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.27% (17.1811 => 17.3993, std. dev.: 0.0193) MultiSource/Benchmarks/nbench/nbench: 1.24% (1.1840 => 1.1987, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.24% (2.0665 => 2.0921, std. dev.: 0.0056) MultiSource/Applications/siod/siod: 1.07% (2.2969 => 2.3214, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.42% (4.2280 => 4.3727, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7595, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.53% (1.0313 => 1.0574, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.78% (3.1578 => 3.2140, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (2.6546 => 2.6920, std. dev.: 0.0007) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2033, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.39% (11.6436 => 11.8049, std. dev.: 0.0071) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2405, std. dev.: 0.0381) SingleSource/Benchmarks/Misc/oourafft: 1.05% (6.6465 => 6.7166, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9196, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.25% (5.2763 => 3.1525, std. dev.: 0.0109) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.11% (5.3855 => 3.7101, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.54% (5.3526 => 3.7177, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.40% (2.9384 => 2.5448, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -10.36% (22.1758 => 19.8780, std. dev.: 0.0168) SingleSource/UnitTests/Vector/constpool: -5.16% (54.1659 => 51.3732, std. dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (3.8922 => 3.8496, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.34% (1.2373 => 1.1094, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -6.39% (1.5373 => 1.4390, std. dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/fldry: -4.60% (1.9577 => 1.8676, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5962, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4789, std. dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (8.1563 => 7.9104, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4252, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0026, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: -1.75% (12.5348 => 12.3156, std. dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.8329 => 1.8080, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 19:04:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 21:04:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120726020415.4BC2D2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2377?compare_to=2375&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2377, Order: 160766, Start Time: 2012-07-26 00:50:33, End Time: 2012-07-26 02:04:35 To: 2375, Order: 160764, Start Time: 2012-07-25 23:08:31, End Time: 2012-07-26 00:22:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (145 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.37% (1.3053 => 1.3232, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.66% (56.4973 => 54.9924, std. dev.: 0.3080) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.30% (2.0176 => 2.3062, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.75% (0.5818 => 0.6385, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.66% (0.5748 => 0.6303, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.25% (0.3578 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.14% (0.3601 => 0.3930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.04% (0.3650 => 0.3980, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 9.00% (0.3646 => 0.3974, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.99% (0.7061 => 0.7696, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3663 => 0.3987, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.81% (0.3914 => 0.4259, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.80% (0.3623 => 0.3942, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.76% (0.3789 => 0.4121, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.57% (0.4003 => 0.4346, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.48% (0.3940 => 0.4274, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.37% (0.1819 => 0.1953, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.10% (1.3693 => 1.4665, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.94% (3.9660 => 4.2413, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.90% (0.7710 => 0.8242, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.86% (0.4328 => 0.4625, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.84% (0.5265 => 0.5625, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.82% (0.2596 => 0.2773, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.69% (0.2721 => 0.2903, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.42% (0.7038 => 0.7490, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.4379 => 0.4640, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.91% (0.6959 => 0.7370, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 5.74% (0.4062 => 0.4295, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.67% (0.5577 => 0.5893, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.65% (0.2781 => 0.2938, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.59% (1.2193 => 1.2874, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.39% (0.2782 => 0.2932, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.36% (0.9199 => 0.9692, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.30% (0.3489 => 0.3674, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.28% (0.2690 => 0.2832, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2628 => 0.2766, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.24% (13.8202 => 14.5447, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.24% (0.2655 => 0.2794, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.23% (0.3899 => 0.4103, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.20% (0.3022 => 0.3179, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.17% (0.2765 => 0.2908, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.2937 => 0.3088, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.14% (0.3580 => 0.3764, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.12% (0.2966 => 0.3118, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.11% (1.9828 => 2.0841, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/except: 5.11% (0.2760 => 0.2901, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2761 => 0.2902, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.05% (0.3485 => 0.3661, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.04% (0.2696 => 0.2832, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.2925 => 0.3072, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.96% (0.3107 => 0.3261, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2726 => 0.2861, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.93% (16.6129 => 17.4312, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.87% (0.2914 => 0.3056, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.81% (1.4563 => 1.5264, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 4.80% (0.3149 => 0.3300, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.75% (7.2180 => 7.5608, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.69% (0.4390 => 0.4596, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.69% (13.2842 => 13.9067, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/matrix: 4.69% (0.2988 => 0.3128, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.66% (0.7506 => 0.7856, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.63% (0.5637 => 0.5898, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3246 => 0.3396, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.57% (0.3192 => 0.3338, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.56% (1.3819 => 1.4449, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.55% (1.1364 => 1.1881, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 4.54% (1.1061 => 1.1563, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.53% (1.3813 => 1.4439, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.47% (0.3534 => 0.3692, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.45% (3.8646 => 4.0365, std. dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 4.44% (1.0594 => 1.1064, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.43% (0.3453 => 0.3606, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.43% (1.9270 => 2.0123, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 4.38% (0.8310 => 0.8674, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.36% (0.4016 => 0.4191, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.33% (1.3245 => 1.3819, std. dev.: 0.0077) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.32% (0.7460 => 0.7782, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.29% (0.3756 => 0.3917, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.19% (0.3868 => 0.4030, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.16% (0.3293 => 0.3430, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.01% (3.6692 => 3.8163, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.95% (4.3801 => 4.5533, std. dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.2945 => 0.3060, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (4.4433 => 4.6156, std. dev.: 0.0048) MultiSource/Applications/siod/siod: 3.83% (2.1791 => 2.2626, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.66% (0.8698 => 0.9016, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 3.55% (1.2292 => 1.2728, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.49% (0.4791 => 0.4958, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.40% (1.1333 => 1.1718, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4113 => 0.4247, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 3.21% (3.1889 => 3.2913, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3755 => 0.3873, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.11% (0.6135 => 0.6326, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.10% (0.6283 => 0.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.00% (4.9865 => 5.1359, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 2.91% (8.4961 => 8.7434, std. dev.: 0.0162) MultiSource/Applications/JM/lencod/lencod: 2.82% (14.8535 => 15.2722, std. dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 2.81% (6.5754 => 6.7604, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 2.64% (4.6629 => 4.7860, std. dev.: 0.0142) MultiSource/Applications/ClamAV/clamscan: 2.61% (14.5298 => 14.9095, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.57% (2.1007 => 2.1547, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.51% (1.5188 => 1.5569, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.49% (16.2614 => 16.6668, std. dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (3.2742 => 3.3557, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.61% (0.9108 => 0.9255, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.43% (1.0313 => 1.0460, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.14% (6.2785 => 6.3502, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 1.11% (3.7467 => 3.7884, std. dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5134, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.61% (1.8175 => 2.2648, std. dev.: 0.0405) SingleSource/Benchmarks/Misc/mandel-2: 7.25% (1.2998 => 1.3941, std. dev.: 0.0187) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.10% (0.9996 => 1.0506, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: 4.40% (7.4271 => 7.7540, std. dev.: 0.0070) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7310, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9658, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4776, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8158, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5944, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.46% (4.5928 => 4.6598, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.45% (2.0200 => 2.0492, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (1.9290 => 1.9562, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.36% (22.5627 => 21.1283, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.85% (0.0997 => 0.0819, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2308 => 1.0999, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2637, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3740, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5153, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.98% (1.3780 => 1.3232, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.64% (3.0263 => 2.9464, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.5998, std. dev.: 0.0124) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.55% (0.4867 => 0.4743, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.34% (0.4533 => 0.4427, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2178, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5042, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.68% (20.3410 => 19.9993, std. dev.: 0.0178) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.61% (0.6589 => 0.6483, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2483, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2212, std. dev.: 0.0303) MultiSource/Applications/lua/lua: -1.12% (26.5159 => 26.2196, std. dev.: 0.0306) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8462, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 20:04:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 22:04:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120726030448.AD8E62A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2378?compare_to=2376&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2378, Order: 160768, Start Time: 2012-07-26 01:37:27, End Time: 2012-07-26 02:56:21 To: 2376, Order: 160764, Start Time: 2012-07-25 23:50:32, End Time: 2012-07-26 01:09:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (77 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (771 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.12% (3.7860 => 3.8662, std. dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.51% (55.4131 => 56.2524, std. dev.: 0.1913) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.21% (10.3673 => 13.8099, std. dev.: 0.0133) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3473 => 0.3903, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.18% (0.3497 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.14% (0.3516 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.11% (0.3543 => 0.3972, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.11% (0.3543 => 0.3972, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 12.08% (0.3561 => 0.3991, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.78% (0.3694 => 0.4129, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.44% (0.3828 => 0.4266, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.32% (0.3886 => 0.4326, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.22% (1.1194 => 1.2450, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.14% (2.2022 => 2.3815, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.66% (1.7609 => 1.8957, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.72% (0.5925 => 0.6264, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.72% (0.6030 => 0.6375, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.02% (0.7326 => 0.7694, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.4879 => 0.5119, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.76% (10.4361 => 10.9324, std. dev.: 0.0121) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.70% (0.4615 => 0.4832, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.41% (7.0540 => 7.3649, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/oourafft: 4.33% (0.3282 => 0.3424, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.93% (0.7433 => 0.7725, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 3.83% (9.4845 => 9.8482, std. dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.70% (4.9449 => 5.1280, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.65% (0.8172 => 0.8470, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.60% (5.0018 => 5.1818, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.54% (0.5569 => 0.5766, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.41% (0.5860 => 0.6060, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.34% (4.2646 => 4.4071, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 3.27% (0.3180 => 0.3284, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.27% (0.3121 => 0.3223, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.08% (0.7835 => 0.8076, std. dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 3.01% (5.7591 => 5.9322, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.00% (8.1363 => 8.3802, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.85% (1.1861 => 1.2199, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.74% (1.3050 => 1.3408, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.72% (14.3668 => 14.7578, std. dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.63% (0.8067 => 0.8279, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.55% (3.3354 => 3.4204, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.50% (1.1642 => 1.1933, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 2.41% (2.0273 => 2.0761, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.39% (1.5415 => 1.5784, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (1.5859 => 1.6217, std. dev.: 0.0061) MultiSource/Applications/hbd/hbd: 2.17% (1.5603 => 1.5941, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.15% (0.5105 => 0.5215, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.13% (3.8723 => 3.9549, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.06% (2.2024 => 2.2477, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.03% (0.9765 => 0.9963, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.83% (0.6450 => 0.6568, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.66% (1.4186 => 1.4422, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.57% (0.6675 => 0.6780, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 1.46% (0.8921 => 0.9051, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.37% (17.1811 => 17.4171, std. dev.: 0.0196) MultiSource/Applications/siod/siod: 1.31% (2.2969 => 2.3270, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 1.18% (1.1840 => 1.1980, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.12% (2.0665 => 2.0896, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.44% (4.2280 => 4.3734, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7515, std. dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.54% (1.0313 => 1.0575, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.33% (3.7781 => 3.8662, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5086 => 1.5344, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 1.70% (3.1578 => 3.2115, std. dev.: 0.0011) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2040, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8040, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6895, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2343, std. dev.: 0.0409) SingleSource/Benchmarks/Misc/oourafft: 1.04% (6.6465 => 6.7156, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.49% (0.8651 => 0.1688, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.33% (5.2763 => 3.1485, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.47% (5.3855 => 3.6906, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.87% (5.3526 => 3.7003, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.60% (2.9384 => 2.5389, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -10.32% (22.1758 => 19.8872, std. dev.: 0.0207) SingleSource/UnitTests/Vector/constpool: -5.16% (54.1659 => 51.3687, std. dev.: 0.1191) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (3.8922 => 3.8473, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2373 => 1.1041, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/mandel-2: -7.09% (1.5373 => 1.4283, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.92% (1.9577 => 1.8613, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5961, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4775, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.11% (8.1563 => 7.9027, std. dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4281, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9997, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: -1.70% (12.5348 => 12.3214, std. dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5126, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8094, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 20:06:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 22:06:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120726030643.4ADD52A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2379?compare_to=2374&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2379, Order: 160764, Start Time: 2012-07-26 00:15:16, End Time: 2012-07-26 02:58:25 To: 2374, Order: 160755, Start Time: 2012-07-25 21:04:04, End Time: 2012-07-25 23:47:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (67 on baseline) Performance Improvements: 1 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (816 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.26% (1.6801 => 1.7013, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.76% (15.6838 => 15.9593, std. dev.: 0.0576) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.07% (2.1236 => 2.1008, std. dev.: 0.0079) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.42% (0.3465 => 0.3930, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.32% (0.3446 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.31% (0.3442 => 0.3900, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.27% (0.3496 => 0.3960, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.25% (0.3488 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.17% (0.3469 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.74% (0.3643 => 0.4107, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.71% (0.3650 => 0.4114, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.30% (0.3724 => 0.4182, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.04% (0.1620 => 0.1734, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.79% (1.5932 => 1.7013, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.75% (0.5826 => 0.6219, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.59% (0.5889 => 0.6277, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.44% (3.5627 => 3.7565, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.21% (1.6211 => 1.7056, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.07% (0.5900 => 0.6199, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (0.4994 => 0.5247, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 4.89% (0.7171 => 0.7522, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.86% (0.4361 => 0.4573, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.79% (1.3152 => 1.3782, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.78% (0.5000 => 0.5239, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.3930 => 0.4116, std. dev.: 0.0063) MultiSource/Applications/d/make_dparser: 4.58% (1.0781 => 1.1275, std. dev.: 0.0104) MultiSource/Applications/spiff/spiff: 4.57% (0.4029 => 0.4213, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (0.5026 => 0.5251, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 4.25% (4.2109 => 4.3897, std. dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.23% (2.7292 => 2.8447, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.84% (0.2866 => 0.2976, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (0.3890 => 0.4033, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.62% (1.9694 => 2.0407, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (2.1013 => 2.1772, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.61% (1.9966 => 2.0687, std. dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 3.33% (5.5417 => 5.7261, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.20% (0.4658 => 0.4807, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (4.4195 => 4.5564, std. dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 3.03% (4.6177 => 4.7574, std. dev.: 0.0108) MultiSource/Applications/JM/ldecod/ldecod: 3.01% (2.1653 => 2.2305, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.00% (0.3903 => 0.4020, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.00% (0.4139 => 0.4263, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.79% (1.8794 => 1.9318, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.63% (0.7875 => 0.8082, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.44% (0.6634 => 0.6796, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.37% (1.4269 => 1.4607, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 2.26% (0.9697 => 0.9916, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.25% (0.5546 => 0.5671, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 2.20% (23.5202 => 24.0387, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 2.19% (0.9909 => 1.0126, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.17% (2.0673 => 2.1122, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.20% (2.0346 => 2.0590, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9638, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6700, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-2: 5.03% (1.8057 => 1.8966, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1718, std. dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6557, std. dev.: 0.0473) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1996, std. dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4586, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4965, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5922, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2234, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.63% (2.4764 => 2.3865, std. dev.: 0.0187) MultiSource/Applications/kimwitu++/kc: -2.05% (11.9555 => 11.7105, std. dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.99% (25.4195 => 16.5250, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary2: -8.03% (0.2402 => 0.2209, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7966, std. dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/fldry: -7.42% (17.2379 => 15.9593, std. dev.: 0.0576) SingleSource/Benchmarks/Shootout-C++/moments: -3.97% (0.4438 => 0.4262, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.52% (14.0481 => 13.5534, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.66% (10.7630 => 10.5840, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 20:46:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 22:46:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120726034616.F3C502A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2380?compare_to=2377&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2380, Order: 160772, Start Time: 2012-07-26 02:32:25, End Time: 2012-07-26 03:46:37 To: 2377, Order: 160766, Start Time: 2012-07-26 00:50:33, End Time: 2012-07-26 02:04:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (140 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.78% (79.8726 => 81.2930, std. dev.: 0.1973) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.13% (2.0176 => 2.3026, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.42% (0.3578 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.16% (0.3601 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.15% (0.3650 => 0.3984, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5748 => 0.6273, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.13% (0.5818 => 0.6349, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-4: 9.08% (0.3646 => 0.3977, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 9.01% (0.7061 => 0.7697, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.00% (0.3623 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.98% (0.3663 => 0.3992, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.89% (0.3914 => 0.4262, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.84% (0.3789 => 0.4124, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.67% (0.4003 => 0.4350, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.60% (0.3940 => 0.4279, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (0.7710 => 0.8233, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 6.72% (1.3693 => 1.4613, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.47% (0.2596 => 0.2764, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.44% (3.9660 => 4.2214, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.24% (0.7038 => 0.7477, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.23% (0.5265 => 0.5593, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 6.17% (0.4328 => 0.4595, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.64% (0.4062 => 0.4291, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (0.4379 => 0.4620, std. dev.: 0.0044) SingleSource/Regression/C++/ofstream_ctor: 5.43% (0.2781 => 0.2932, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.29% (0.6959 => 0.7327, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2782 => 0.2928, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.23% (0.3022 => 0.3180, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.17% (1.2193 => 1.2823, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.15% (0.3107 => 0.3267, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.11% (0.2760 => 0.2901, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.09% (0.2690 => 0.2827, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.08% (0.3149 => 0.3309, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.05% (1.9828 => 2.0830, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.05% (0.2655 => 0.2789, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.04% (0.3489 => 0.3665, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.03% (0.3580 => 0.3760, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.03% (0.3899 => 0.4095, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.03% (0.2726 => 0.2863, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.97% (0.2937 => 0.3083, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.94% (0.9199 => 0.9653, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.91% (0.2628 => 0.2757, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.89% (0.2761 => 0.2896, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.86% (0.2966 => 0.3110, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.82% (0.3485 => 0.3653, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.81% (0.5577 => 0.5845, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 4.74% (13.8202 => 14.4750, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.71% (0.2696 => 0.2823, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.65% (0.2988 => 0.3127, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.56% (0.4390 => 0.4590, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 4.54% (0.3192 => 0.3337, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 4.49% (0.3453 => 0.3608, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (13.2842 => 13.8757, std. dev.: 0.0248) MultiSource/Applications/kimwitu++/kc: 4.42% (16.6129 => 17.3476, std. dev.: 0.0159) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.41% (1.3819 => 1.4429, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.41% (1.3813 => 1.4422, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.40% (7.2180 => 7.5356, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.38% (0.4016 => 0.4192, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.34% (1.4563 => 1.5195, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.32% (0.2914 => 0.3040, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.31% (0.5637 => 0.5880, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.26% (0.7506 => 0.7826, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (3.8646 => 4.0282, std. dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (0.3756 => 0.3915, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.19% (1.1364 => 1.1840, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.16% (0.3293 => 0.3430, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.16% (0.3534 => 0.3681, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.16% (0.3246 => 0.3381, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.10% (1.1061 => 1.1515, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 4.08% (0.3868 => 0.4026, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.08% (1.3245 => 1.3786, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.07% (1.0594 => 1.1025, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 4.03% (0.8310 => 0.8645, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.92% (1.9270 => 2.0025, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.85% (0.7460 => 0.7747, std. dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 3.74% (0.2995 => 0.3107, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.67% (3.6692 => 3.8037, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 3.63% (0.2945 => 0.3052, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (4.3801 => 4.5362, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 3.54% (0.3220 => 0.3334, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.54% (4.4433 => 4.6005, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.37% (1.2292 => 1.2706, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.13% (0.4791 => 0.4941, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.1333 => 1.1680, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.01% (2.1791 => 2.2447, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 2.97% (0.4113 => 0.4235, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.94% (4.9865 => 5.1329, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.88% (0.3755 => 0.3863, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.84% (3.1889 => 3.2794, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.82% (0.6283 => 0.6460, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.79% (8.4961 => 8.7334, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.71% (0.8698 => 0.8934, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.64% (0.6135 => 0.6297, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.51% (6.5754 => 6.7407, std. dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 2.41% (14.8535 => 15.2116, std. dev.: 0.0141) MultiSource/Applications/ClamAV/clamscan: 2.39% (14.5298 => 14.8776, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.26% (3.2742 => 3.3482, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.1007 => 2.1481, std. dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 2.10% (16.2614 => 16.6022, std. dev.: 0.0134) MultiSource/Applications/oggenc/oggenc: 2.02% (4.6629 => 4.7572, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.90% (1.5188 => 1.5476, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.12% (0.9108 => 0.9210, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.05% (6.2785 => 6.3445, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5138, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 25.54% (1.8175 => 2.2816, std. dev.: 0.0360) SingleSource/Benchmarks/Misc/mandel-2: 8.26% (1.2998 => 1.4072, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.09% (0.9996 => 1.0505, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 4.30% (7.4271 => 7.7466, std. dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7316, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9887, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4765, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9771, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.76% (1.7688 => 1.8177, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5089 => 1.5356, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0067) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.44% (4.5928 => 4.6588, std. dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1393, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.54% (22.5627 => 21.0863, std. dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.88% (0.3511 => 0.3410, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.25% (0.0997 => 0.0815, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.92% (1.2308 => 1.1087, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2637, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.69% (1.3780 => 1.3134, std. dev.: 0.0112) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.56% (3.0263 => 2.9488, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6010, std. dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.55% (0.4867 => 0.4743, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.36% (0.4533 => 0.4426, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.92% (6.3560 => 6.2342, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.66% (20.3410 => 20.0039, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: -1.30% (5.3167 => 5.2475, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 21:51:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 25 Jul 2012 23:51:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120726045130.B476B2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2381?compare_to=2378&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2381, Order: 160774, Start Time: 2012-07-26 03:33:04, End Time: 2012-07-26 04:51:52 To: 2378, Order: 160768, Start Time: 2012-07-26 01:37:27, End Time: 2012-07-26 02:56:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (80 on baseline) Performance Improvements: 1 (25 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (768 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (13.8099 => 13.9682, std. dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.38% (80.3739 => 79.2686, std. dev.: 0.4277) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.73% (10.3673 => 13.9682, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/exceptions-2: 13.04% (0.3497 => 0.3953, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 12.96% (0.3473 => 0.3923, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.84% (0.3543 => 0.3998, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 12.80% (0.3516 => 0.3966, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 12.64% (0.3543 => 0.3991, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 12.58% (0.3561 => 0.4009, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 12.32% (0.3694 => 0.4149, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.12% (0.3828 => 0.4292, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.94% (0.3886 => 0.4350, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 11.92% (0.3927 => 0.4395, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.38% (1.1194 => 1.2468, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.97% (2.2022 => 2.3778, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.88% (1.7609 => 1.8997, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.18% (0.1892 => 0.2009, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5925 => 0.6290, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.3177 => 0.3370, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.6030 => 0.6395, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.90% (0.4615 => 0.4841, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 4.87% (10.4361 => 10.9446, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 4.83% (0.7326 => 0.7680, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.49% (0.4879 => 0.5098, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.38% (7.0540 => 7.3632, std. dev.: 0.0105) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.2554 => 0.2660, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 4.06% (0.7433 => 0.7735, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.98% (9.4845 => 9.8618, std. dev.: 0.0074) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.87% (0.8172 => 0.8488, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.9449 => 5.1359, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.71% (5.0018 => 5.1873, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.70% (4.2646 => 4.4222, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.66% (0.5569 => 0.5773, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 3.22% (0.3109 => 0.3209, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.19% (8.1363 => 8.3956, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 3.14% (5.7591 => 5.9399, std. dev.: 0.0159) MultiSource/Applications/spiff/spiff: 3.09% (0.7835 => 0.8077, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.99% (1.1861 => 1.2216, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.81% (1.3050 => 1.3417, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.73% (1.1642 => 1.1960, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.69% (14.3668 => 14.7537, std. dev.: 0.0050) MultiSource/Applications/d/make_dparser: 2.58% (3.3354 => 3.4215, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.52% (2.0273 => 2.0784, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.45% (0.8067 => 0.8265, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.39% (0.4636 => 0.4747, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.34% (1.5415 => 1.5775, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.25% (0.5105 => 0.5220, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 2.24% (1.5603 => 1.5952, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 2.14% (3.8723 => 3.9552, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.11% (1.5859 => 1.6194, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.08% (2.2024 => 2.2481, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.06% (0.9765 => 0.9966, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.90% (0.6675 => 0.6802, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.81% (0.5981 => 0.6089, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.78% (1.4186 => 1.4439, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.78% (0.6450 => 0.6565, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.44% (2.2969 => 2.3299, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.40% (2.0665 => 2.0955, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.34% (17.1811 => 17.4107, std. dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 1.28% (1.1840 => 1.1991, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.37% (4.2280 => 4.3706, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7495, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.53% (1.0313 => 1.0574, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (1.5086 => 1.5370, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 1.73% (3.1578 => 3.2124, std. dev.: 0.0016) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2037, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8044, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6892, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: 1.15% (9.1159 => 9.2210, std. dev.: 0.0281) SingleSource/Benchmarks/Misc/oourafft: 1.05% (6.6465 => 6.7166, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 1.01% (2.2771 => 2.3001, std. dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.43% (5.2763 => 3.1433, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.60% (5.3855 => 3.6835, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.97% (5.3526 => 3.6951, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.61% (2.9384 => 2.5385, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -10.33% (22.1758 => 19.8848, std. dev.: 0.0065) SingleSource/UnitTests/Vector/constpool: -5.23% (54.1659 => 51.3311, std. dev.: 0.0436) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.03% (3.8922 => 3.8522, std. dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.48% (1.2373 => 1.1076, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -6.17% (1.5373 => 1.4425, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: -4.91% (1.9577 => 1.8615, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4821, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.12% (8.1563 => 7.9015, std. dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4277, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9997, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3281, std. dev.: 0.0039) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.19% (1.8329 => 1.8110, std. dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 22:28:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 00:28:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120726052841.9A86F2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2382?compare_to=2380&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2382, Order: 160774, Start Time: 2012-07-26 04:14:51, End Time: 2012-07-26 05:29:02 To: 2380, Order: 160772, Start Time: 2012-07-26 02:32:25, End Time: 2012-07-26 03:46:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (146 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.47% (81.2930 => 80.0959, std. dev.: 0.3706) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.02% (2.0176 => 2.3207, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.42% (0.7061 => 0.7726, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.38% (0.5818 => 0.6364, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.28% (0.3578 => 0.3910, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.22% (0.5748 => 0.6278, std. dev.: 0.0098) SingleSource/UnitTests/ObjC/exceptions-2: 9.03% (0.3601 => 0.3926, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.02% (0.3646 => 0.3975, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.01% (0.3663 => 0.3993, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.97% (0.3789 => 0.4129, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.93% (0.3650 => 0.3976, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.89% (0.3623 => 0.3945, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.74% (0.3914 => 0.4256, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.62% (0.4003 => 0.4348, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.53% (0.3940 => 0.4276, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.15% (1.3693 => 1.4672, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.99% (0.7710 => 0.8249, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.93% (3.9660 => 4.2409, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.82% (0.5265 => 0.5624, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.71% (0.7038 => 0.7510, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.33% (0.4062 => 0.4319, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.08% (0.6959 => 0.7382, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4379 => 0.4639, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.65% (0.2781 => 0.2938, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.56% (0.3022 => 0.3190, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.55% (1.2193 => 1.2870, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.54% (0.3899 => 0.4115, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.39% (0.9199 => 0.9695, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 5.35% (13.8202 => 14.5599, std. dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.34% (0.3580 => 0.3771, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.31% (0.5577 => 0.5873, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.30% (0.3489 => 0.3674, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.28% (0.2782 => 0.2929, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.26% (0.2966 => 0.3122, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.26% (0.2607 => 0.2744, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.25% (1.9828 => 2.0869, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 5.23% (16.6129 => 17.4824, std. dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.20% (0.2655 => 0.2793, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 5.18% (0.2760 => 0.2903, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 5.17% (0.2243 => 0.2359, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2690 => 0.2829, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.14% (0.2765 => 0.2907, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.10% (0.2726 => 0.2865, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (0.2925 => 0.3074, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 5.08% (0.3149 => 0.3309, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.04% (0.2937 => 0.3085, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 4.99% (0.3107 => 0.3262, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.96% (0.2761 => 0.2898, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.95% (0.2628 => 0.2758, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.91% (0.3485 => 0.3656, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.90% (0.2696 => 0.2828, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.87% (0.2914 => 0.3056, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.80% (13.2842 => 13.9222, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 4.79% (1.1061 => 1.1591, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.2988 => 0.3131, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.76% (1.3813 => 1.4470, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 4.76% (0.7506 => 0.7863, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.75% (7.2180 => 7.5605, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.71% (0.3246 => 0.3399, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.69% (0.4390 => 0.4596, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.69% (1.4563 => 1.5246, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary2: 4.67% (0.3192 => 0.3341, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5637 => 0.5899, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.62% (1.9270 => 2.0161, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.3245 => 1.3856, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.61% (3.8646 => 4.0428, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sieve: 4.60% (0.3453 => 0.3612, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.59% (1.3819 => 1.4453, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.58% (1.1364 => 1.1884, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.51% (0.4016 => 0.4197, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: 4.50% (0.8310 => 0.8684, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3534 => 0.3691, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.40% (0.3293 => 0.3438, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.0594 => 1.1060, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.25% (0.7460 => 0.7777, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 4.24% (0.2995 => 0.3122, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.19% (0.3868 => 0.4030, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (3.6692 => 3.8196, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (4.3801 => 4.5555, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (4.4433 => 4.6192, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.2945 => 0.3060, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.89% (2.1791 => 2.2639, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.69% (1.2292 => 1.2745, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.53% (1.1333 => 1.1733, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.51% (0.4791 => 0.4959, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.36% (4.9865 => 5.1539, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 3.28% (0.4113 => 0.4248, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.22% (3.1889 => 3.2917, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.19% (0.6135 => 0.6331, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (8.4961 => 8.7603, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.09% (0.6283 => 0.6477, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3755 => 0.3870, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.99% (6.5754 => 6.7717, std. dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 2.83% (14.8535 => 15.2736, std. dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.81% (0.8698 => 0.8942, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.73% (14.5298 => 14.9261, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.58% (2.1007 => 2.1549, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.53% (3.2742 => 3.3572, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.46% (1.5188 => 1.5562, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.46% (16.2614 => 16.6612, std. dev.: 0.0123) MultiSource/Applications/oggenc/oggenc: 2.40% (4.6629 => 4.7746, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.62% (0.9108 => 0.9256, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.55% (1.0313 => 1.0473, std. dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.29% (6.2785 => 6.3595, std. dev.: 0.0063) MultiSource/Applications/lua/lua: 1.10% (3.7467 => 3.7879, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 24.63% (1.8175 => 2.2652, std. dev.: 0.0189) SingleSource/Benchmarks/Misc/mandel-2: 6.99% (1.2998 => 1.3906, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.30% (0.9996 => 1.0526, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: 4.39% (7.4271 => 7.7534, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7332, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9869, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4773, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8160, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5089 => 1.5360, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.50% (4.5928 => 4.6615, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.10% (22.5627 => 21.1871, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.85% (0.0997 => 0.0839, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2308 => 1.1046, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3085, std. dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9189, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.65% (3.0263 => 2.9461, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.5999, std. dev.: 0.0103) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/health/health: -2.47% (0.4533 => 0.4421, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.08% (6.6320 => 6.4940, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2256, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9616, std. dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0144) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4928, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2491, std. dev.: 0.0033) MultiSource/Applications/lua/lua: -1.16% (26.5159 => 26.2084, std. dev.: 0.0452) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.12% (3.8887 => 3.8450, std. dev.: 0.0072) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jul 25 23:17:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 01:17:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120726061739.7555D2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2383?compare_to=2379&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2383, Order: 160774, Start Time: 2012-07-26 03:34:50, End Time: 2012-07-26 06:18:01 To: 2379, Order: 160764, Start Time: 2012-07-26 00:15:16, End Time: 2012-07-26 02:58:25 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (68 on baseline) Performance Improvements: 1 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (815 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.34% (54.1969 => 54.9244, std. dev.: 0.0812) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.35% (15.9593 => 15.7436, std. dev.: 0.0745) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.97% (0.3465 => 0.3949, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3446 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.84% (0.3496 => 0.3980, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: 13.84% (0.3469 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.77% (0.3442 => 0.3916, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.70% (0.3460 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.62% (0.3488 => 0.3963, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions: 13.18% (0.3643 => 0.4123, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.01% (0.3650 => 0.4125, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.67% (0.3724 => 0.4196, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.04% (0.1620 => 0.1734, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.63% (0.5826 => 0.6212, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.52% (0.5889 => 0.6273, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.25% (1.5932 => 1.6927, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.54% (3.5627 => 3.7601, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.34% (1.6211 => 1.7076, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.09% (0.4994 => 0.5248, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.03% (0.5900 => 0.6197, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.86% (0.4361 => 0.4573, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.86% (0.5000 => 0.5243, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 4.85% (0.7171 => 0.7519, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.80% (1.3152 => 1.3783, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.54% (0.4029 => 0.4212, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.48% (0.3930 => 0.4106, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (2.7292 => 2.8513, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 4.47% (1.0781 => 1.1263, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.30% (0.5026 => 0.5242, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 4.11% (4.2109 => 4.3839, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.84% (0.2866 => 0.2976, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.76% (0.2736 => 0.2839, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.65% (1.9694 => 2.0413, std. dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.56% (1.9966 => 2.0677, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (2.1013 => 2.1739, std. dev.: 0.0103) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.39% (0.3890 => 0.4022, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.21% (4.4195 => 4.5612, std. dev.: 0.0097) MultiSource/Applications/SPASS/SPASS: 3.13% (5.5417 => 5.7154, std. dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.09% (0.4658 => 0.4802, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.06% (4.6177 => 4.7589, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 3.01% (2.1653 => 2.2305, std. dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.95% (0.3903 => 0.4018, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.78% (0.4139 => 0.4254, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 2.58% (1.8794 => 1.9279, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.43% (2.0673 => 2.1175, std. dev.: 0.0107) MultiSource/Applications/treecc/treecc: 2.41% (0.7875 => 0.8065, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.40% (0.9909 => 1.0147, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.29% (1.4269 => 1.4596, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.20% (0.5546 => 0.5668, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.14% (0.6634 => 0.6776, std. dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: 2.10% (23.5202 => 24.0152, std. dev.: 0.0156) MultiSource/Applications/hbd/hbd: 2.05% (0.9697 => 0.9896, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (2.5769 => 2.9635, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 6.64% (0.2122 => 0.2263, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6683, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8943, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1674, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.21% (105.3826 => 107.7133, std. dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1944, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4954, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5921, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2208, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.66% (2.4764 => 2.3857, std. dev.: 0.0065) MultiSource/Applications/kimwitu++/kc: -2.31% (11.9555 => 11.6797, std. dev.: 0.0145) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.05% (25.4195 => 16.5088, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/ary2: -9.24% (0.2402 => 0.2180, std. dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -8.67% (17.2379 => 15.7436, std. dev.: 0.0745) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8024, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: -3.97% (0.4438 => 0.4262, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.61% (14.0481 => 13.5412, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5766, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 02:36:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 04:36:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120726093645.011CF2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2384?compare_to=2382&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2384, Order: 160775, Start Time: 2012-07-26 08:22:51, End Time: 2012-07-26 09:37:05 To: 2382, Order: 160774, Start Time: 2012-07-26 04:14:51, End Time: 2012-07-26 05:29:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (149 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.16% (55.2323 => 56.4239, std. dev.: 0.0723) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.98% (2.0176 => 2.3199, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.38% (0.5818 => 0.6364, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.38% (0.5748 => 0.6287, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3578 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.30% (0.3601 => 0.3936, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.12% (0.3650 => 0.3983, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 9.05% (0.3646 => 0.3976, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.03% (0.3623 => 0.3950, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 8.98% (0.3663 => 0.3992, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 8.89% (0.3789 => 0.4126, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.79% (0.3914 => 0.4258, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.77% (0.4003 => 0.4354, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.53% (0.3940 => 0.4276, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 8.28% (0.7061 => 0.7646, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.05% (1.3693 => 1.4658, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.03% (3.9660 => 4.2450, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.82% (0.2596 => 0.2773, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.81% (0.7710 => 0.8235, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.70% (0.5265 => 0.5618, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.69% (0.2721 => 0.2903, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.38% (0.4328 => 0.4604, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.37% (0.7038 => 0.7486, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 5.81% (0.4062 => 0.4298, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.73% (0.6959 => 0.7358, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 5.65% (0.2781 => 0.2938, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.58% (1.2193 => 1.2873, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.38% (0.5577 => 0.5877, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.36% (0.2782 => 0.2931, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.34% (0.9199 => 0.9690, std. dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 5.32% (13.8202 => 14.5555, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2966 => 0.3123, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.22% (0.2760 => 0.2904, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.21% (1.9828 => 2.0861, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.20% (0.2690 => 0.2830, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.20% (0.2655 => 0.2793, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.19% (0.3489 => 0.3670, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.18% (0.2607 => 0.2742, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 5.17% (0.8310 => 0.8740, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.17% (0.3580 => 0.3765, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.13% (0.3899 => 0.4099, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (0.2765 => 0.2906, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.07% (0.2937 => 0.3086, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2628 => 0.2761, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.02% (0.3107 => 0.3263, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.02% (0.3149 => 0.3307, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.01% (16.6129 => 17.4457, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/methcall: 5.00% (0.2761 => 0.2899, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.95% (0.2243 => 0.2354, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.90% (0.7506 => 0.7874, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.90% (0.2696 => 0.2828, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.85% (0.3485 => 0.3654, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (1.4563 => 1.5268, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 4.79% (0.3192 => 0.3345, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.2988 => 0.3131, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.77% (13.2842 => 13.9184, std. dev.: 0.0171) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.77% (0.2914 => 0.3053, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.77% (7.2180 => 7.5622, std. dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.74% (0.4390 => 0.4598, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.71% (0.3246 => 0.3399, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.69% (1.1364 => 1.1897, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.67% (0.5637 => 0.5900, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.60% (0.3453 => 0.3612, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.59% (1.1061 => 1.1569, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.58% (0.4016 => 0.4200, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.47% (1.9270 => 2.0131, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3534 => 0.3691, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.40% (0.3293 => 0.3438, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.37% (1.0594 => 1.1057, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.34% (0.3756 => 0.3919, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.34% (3.8646 => 4.0323, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: 4.32% (0.3868 => 0.4035, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.29% (0.7460 => 0.7780, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.28% (1.3813 => 1.4404, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.24% (1.3245 => 1.3807, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.23% (1.3819 => 1.4403, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.09% (3.6692 => 3.8191, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 4.01% (0.3220 => 0.3349, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.3801 => 4.5544, std. dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 3.97% (0.2995 => 0.3114, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.95% (4.4433 => 4.6186, std. dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.82% (0.4791 => 0.4974, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.80% (1.1333 => 1.1764, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.2945 => 0.3056, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.71% (2.1791 => 2.2600, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.61% (1.2292 => 1.2736, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.44% (4.9865 => 5.1582, std. dev.: 0.0061) MultiSource/Applications/d/make_dparser: 3.35% (3.1889 => 3.2957, std. dev.: 0.0107) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 3.19% (0.4113 => 0.4244, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.15% (0.6283 => 0.6481, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (8.4961 => 8.7571, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.05% (0.8698 => 0.8963, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.04% (0.3755 => 0.3869, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.02% (0.6135 => 0.6320, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.91% (6.5754 => 6.7669, std. dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 2.83% (14.8535 => 15.2744, std. dev.: 0.0158) MultiSource/Applications/ClamAV/clamscan: 2.77% (14.5298 => 14.9330, std. dev.: 0.0162) MultiSource/Applications/sqlite3/sqlite3: 2.76% (16.2614 => 16.7108, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.59% (2.1007 => 2.1551, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.54% (3.2742 => 3.3574, std. dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 2.41% (4.6629 => 4.7753, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.27% (1.5188 => 1.5533, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.51% (0.6744 => 0.6846, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.49% (1.0313 => 1.0467, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.46% (0.9108 => 0.9241, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.24% (6.2785 => 6.3562, std. dev.: 0.0038) MultiSource/Applications/lua/lua: 1.15% (3.7467 => 3.7898, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5152, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2636, std. dev.: 0.0407) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4040, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.43% (0.9996 => 1.0539, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: 4.38% (7.4271 => 7.7521, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7325, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4775, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8154, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std. dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5928 => 4.6625, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9578, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.49% (1.5089 => 1.5314, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5950, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5077, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1936, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2144, std. dev.: 0.0032) MultiSource/Benchmarks/llubenchmark/llu: 1.11% (3.7731 => 3.8148, std. dev.: 0.0115) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1399, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.06% (22.5627 => 21.1955, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.55% (0.0997 => 0.0832, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2308 => 1.0999, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.18% (0.3139 => 0.2945, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.47% (1.3780 => 1.3164, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.66% (3.0263 => 2.9458, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5928, std. dev.: 0.0084) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.49% (0.4533 => 0.4420, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.28% (0.8342 => 0.8152, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9448, std. dev.: 0.0374) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2324, std. dev.: 0.0105) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5118, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8630, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.3167 => 5.2466, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2195, std. dev.: 0.0054) MultiSource/Applications/lua/lua: -1.00% (26.5159 => 26.2500, std. dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 02:41:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 04:41:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120726094127.AE0122A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2385?compare_to=2381&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2385, Order: 160775, Start Time: 2012-07-26 08:22:43, End Time: 2012-07-26 09:41:49 To: 2381, Order: 160774, Start Time: 2012-07-26 03:33:04, End Time: 2012-07-26 04:51:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (72 on baseline) Performance Improvements: 0 (26 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (775 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.35% (79.2686 => 81.1326, std. dev.: 0.3244) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.19% (55.4464 => 56.6599, std. dev.: 0.0135) MultiSource/Benchmarks/llubenchmark/llu: 1.50% (3.7967 => 3.8535, std. dev.: 0.0169) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.52% (10.3673 => 14.0496, std. dev.: 0.0162) SingleSource/UnitTests/ObjC/trivial-interface: 12.47% (0.3473 => 0.3906, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3497 => 0.3927, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3543 => 0.3974, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 12.05% (0.3543 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.00% (0.3516 => 0.3938, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.91% (0.3561 => 0.3985, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.67% (0.3694 => 0.4125, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3828 => 0.4262, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.18% (1.1194 => 1.2445, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.17% (0.3886 => 0.4320, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.95% (0.1622 => 0.1751, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.78% (2.2022 => 2.3735, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.59% (1.7609 => 1.8946, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 5.67% (0.5925 => 0.6261, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.67% (0.3177 => 0.3357, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 5.54% (0.6030 => 0.6364, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.70% (10.4361 => 10.9261, std. dev.: 0.0268) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.57% (0.4615 => 0.4826, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.47% (0.4879 => 0.5097, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 4.38% (0.7326 => 0.7647, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.23% (7.0540 => 7.3527, std. dev.: 0.0218) SingleSource/Benchmarks/Misc/oourafft: 3.99% (0.3282 => 0.3413, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.83% (9.4845 => 9.8477, std. dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.72% (0.5569 => 0.5776, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 3.71% (0.7433 => 0.7709, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.60% (0.8172 => 0.8466, std. dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.60% (5.0018 => 5.1817, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (4.9449 => 5.1218, std. dev.: 0.0111) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.33% (4.2646 => 4.4065, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.26% (0.5860 => 0.6051, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.13% (8.1363 => 8.3907, std. dev.: 0.0130) MultiSource/Benchmarks/McCat/18-imp/imp: 3.07% (0.3423 => 0.3528, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 2.88% (5.7591 => 5.9250, std. dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.83% (1.1861 => 1.2197, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (14.3668 => 14.7687, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.77% (1.3050 => 1.3412, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: 2.61% (3.3354 => 3.4223, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.59% (1.1642 => 1.1943, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.34% (1.5415 => 1.5775, std. dev.: 0.0068) MultiSource/Applications/treecc/treecc: 2.29% (2.0273 => 2.0738, std. dev.: 0.0074) MultiSource/Applications/lua/lua: 2.23% (3.8723 => 3.9588, std. dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.08% (0.5105 => 0.5211, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.00% (0.9765 => 0.9960, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.93% (2.2024 => 2.2449, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.92% (1.5859 => 1.6164, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.86% (0.6450 => 0.6570, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.82% (0.5981 => 0.6090, std. dev.: 0.0040) MultiSource/Applications/siod/siod: 1.75% (2.2969 => 2.3371, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.61% (1.4186 => 1.4415, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.57% (0.6675 => 0.6780, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.42% (0.8921 => 0.9048, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.37% (17.1811 => 17.4172, std. dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.11% (2.0665 => 2.0895, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.48% (4.2280 => 4.3752, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7471, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std. dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 2.00% (3.7781 => 3.8535, std. dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/hash2: 1.72% (3.1578 => 3.2120, std. dev.: 0.0018) MultiSource/Applications/aha/aha: 1.38% (3.1595 => 3.2032, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8038, std. dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6885, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2253, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 1.06% (6.6465 => 6.7168, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.05% (2.3135 => 2.3377, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.38% (5.2763 => 3.1455, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.57% (5.3855 => 3.6851, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.89% (5.3526 => 3.6993, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.69% (2.9384 => 2.5361, std. dev.: 0.0072) MultiSource/Applications/ClamAV/clamscan: -10.44% (22.1758 => 19.8613, std. dev.: 0.0578) SingleSource/UnitTests/Vector/constpool: -5.21% (54.1659 => 51.3453, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (3.8922 => 3.8462, std. dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.23% (0.0998 => 0.0846, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -11.31% (1.2373 => 1.0973, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/mandel-2: -8.93% (1.5373 => 1.4000, std. dev.: 0.0219) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5538, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.79% (1.9577 => 1.8639, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5962, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4823, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (8.1563 => 7.9052, std. dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.89% (8.6802 => 8.4291, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0048, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: -1.73% (12.5348 => 12.3180, std. dev.: 0.0064) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8092, std. dev.: 0.0008) MultiSource/Applications/siod/siod: -1.00% (3.2827 => 3.2498, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 04:05:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 06:05:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120726110556.699A52A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/2386?compare_to=2383&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2386, Order: 160775, Start Time: 2012-07-26 08:22:44, End Time: 2012-07-26 11:06:20 To: 2383, Order: 160774, Start Time: 2012-07-26 03:34:50, End Time: 2012-07-26 06:18:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (69 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (814 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.00% (124.4072 => 129.3830, std. dev.: 1.0579) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.02% (2.0349 => 2.0963, std. dev.: 0.0110) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.12% (0.3446 => 0.3898, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.07% (0.3465 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.06% (0.3460 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.04% (0.3488 => 0.3943, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 13.02% (0.3442 => 0.3890, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.99% (0.3496 => 0.3950, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.94% (0.3469 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.63% (0.3643 => 0.4103, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.52% (0.3650 => 0.4107, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.14% (0.3724 => 0.4176, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 6.64% (1.5932 => 1.6990, std. dev.: 0.0060) SingleSource/UnitTests/ObjC++/Hello: 6.49% (0.5826 => 0.6204, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.20% (0.5889 => 0.6254, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.38% (3.5627 => 3.7545, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.21% (1.6211 => 1.7056, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.02% (0.5000 => 0.5251, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.99% (0.4994 => 0.5243, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.98% (0.4361 => 0.4578, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.69% (1.3152 => 1.3769, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 4.69% (0.7171 => 0.7507, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.68% (0.3930 => 0.4114, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.64% (0.5900 => 0.6174, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 4.45% (1.0781 => 1.1261, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 4.43% (4.2109 => 4.3976, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 4.39% (0.4029 => 0.4206, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (0.5026 => 0.5240, std. dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.19% (2.7292 => 2.8436, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.2736 => 0.2843, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.84% (0.2866 => 0.2976, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.54% (1.9694 => 2.0392, std. dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 3.47% (5.5417 => 5.7341, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.42% (4.4195 => 4.5706, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.39% (0.4658 => 0.4816, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.37% (0.3890 => 0.4021, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.36% (2.1013 => 2.1720, std. dev.: 0.0123) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.35% (1.9966 => 2.0635, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.3903 => 0.4026, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 3.14% (2.1653 => 2.2332, std. dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 3.00% (4.6177 => 4.7562, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.90% (0.4139 => 0.4259, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 2.69% (1.8794 => 1.9299, std. dev.: 0.0052) MultiSource/Applications/treecc/treecc: 2.64% (0.7875 => 0.8083, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.55% (1.4269 => 1.4633, std. dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 2.45% (23.5202 => 24.0962, std. dev.: 0.0645) MultiSource/Applications/hexxagon/hexxagon: 2.39% (0.9909 => 1.0146, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.34% (2.0673 => 2.1157, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.34% (0.6634 => 0.6789, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 2.24% (0.5546 => 0.5670, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.18% (0.9697 => 0.9908, std. dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: 1.30% (2.0346 => 2.0610, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.04% (0.2162 => 0.3525, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.2122 => 0.2260, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6720, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8929, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1678, std. dev.: 0.0322) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.09% (105.3826 => 107.5816, std. dev.: 0.0389) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2023, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4946, std. dev.: 0.0245) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5922, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2227, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.72% (2.4764 => 2.3844, std. dev.: 0.0094) MultiSource/Applications/kimwitu++/kc: -1.87% (11.9555 => 11.7325, std. dev.: 0.0186) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5426, std. dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/fldry: -8.30% (17.2379 => 15.8073, std. dev.: 0.2618) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9790, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7884, std. dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/ary2: -7.54% (0.2402 => 0.2221, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -3.94% (0.4438 => 0.4263, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.57% (14.0481 => 13.5459, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5746, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 04:18:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 06:18:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120726111834.81D742A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2387?compare_to=2384&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2387, Order: 160778, Start Time: 2012-07-26 10:04:57, End Time: 2012-07-26 11:18:57 To: 2384, Order: 160775, Start Time: 2012-07-26 08:22:51, End Time: 2012-07-26 09:37:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (139 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.26% (80.5519 => 81.5635, std. dev.: 0.0633) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/football/football: -1.22% (0.8740 => 0.8633, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.33% (2.0176 => 2.2866, std. dev.: 0.0147) SingleSource/UnitTests/ObjC++/property-reference-object: 9.04% (0.5818 => 0.6344, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.83% (0.3578 => 0.3894, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.75% (0.5748 => 0.6251, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3646 => 0.3961, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.64% (0.3623 => 0.3936, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.64% (0.3601 => 0.3912, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.52% (0.3650 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.52% (0.3663 => 0.3975, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.47% (0.3789 => 0.4110, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.30% (0.3914 => 0.4239, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/property: 8.20% (0.3940 => 0.4263, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.19% (0.4003 => 0.4331, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.85% (0.7061 => 0.7615, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.51% (0.3130 => 0.3365, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.83% (1.3693 => 1.4628, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.28% (0.2721 => 0.2892, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.14% (3.9660 => 4.2097, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.13% (0.7710 => 0.8183, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2596 => 0.2754, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.93% (1.2193 => 1.2916, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.93% (0.5265 => 0.5577, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.88% (0.7038 => 0.7452, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.83% (0.4062 => 0.4299, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 5.68% (0.2781 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.52% (0.2607 => 0.2751, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.52% (0.2937 => 0.3099, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2690 => 0.2838, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.50% (0.2655 => 0.2801, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.44% (0.2628 => 0.2771, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.32% (0.2765 => 0.2912, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (1.9828 => 2.0857, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.4379 => 0.4605, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.14% (0.2760 => 0.2902, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.09% (0.2966 => 0.3117, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.3107 => 0.3265, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.08% (0.3580 => 0.3762, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.03% (0.3899 => 0.4095, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.00% (0.2761 => 0.2899, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.99% (0.3149 => 0.3306, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.96% (0.3485 => 0.3658, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.94% (0.6959 => 0.7303, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2988 => 0.3132, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.75% (0.9199 => 0.9636, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.73% (0.3192 => 0.3343, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.70% (0.5577 => 0.5839, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.61% (1.0594 => 1.1082, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 4.60% (0.3453 => 0.3612, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.58% (13.8202 => 14.4530, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/lists1: 4.53% (0.3534 => 0.3694, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.51% (0.4016 => 0.4197, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.36% (1.4563 => 1.5198, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 4.34% (0.3293 => 0.3436, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.28% (0.4390 => 0.4578, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.26% (1.3813 => 1.4402, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.25% (16.6129 => 17.3189, std. dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (0.3756 => 0.3914, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.19% (0.3868 => 0.4030, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.19% (0.2914 => 0.3036, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.15% (1.3819 => 1.4393, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.15% (0.5637 => 0.5871, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.15% (7.2180 => 7.5175, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 4.13% (0.7506 => 0.7816, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.12% (13.2842 => 13.8314, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.1364 => 1.1813, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 3.91% (1.1061 => 1.1494, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.91% (0.7460 => 0.7752, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 3.89% (0.8310 => 0.8633, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3246 => 0.3369, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.74% (3.8646 => 4.0092, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.66% (1.3245 => 1.3730, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.63% (1.9270 => 1.9969, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 3.60% (0.2945 => 0.3051, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (4.3801 => 4.5371, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.43% (1.2292 => 1.2714, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.36% (3.6692 => 3.7926, std. dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: 3.34% (0.2995 => 0.3095, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.34% (4.4433 => 4.5916, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.29% (0.3220 => 0.3326, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3755 => 0.3873, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.92% (0.4791 => 0.4931, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.86% (1.1333 => 1.1657, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 2.80% (0.4113 => 0.4228, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.79% (2.1791 => 2.2399, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 2.72% (3.1889 => 3.2756, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.64% (0.6283 => 0.6449, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.63% (0.8698 => 0.8927, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.62% (0.6135 => 0.6296, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.60% (4.9865 => 5.1159, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 2.40% (8.4961 => 8.7003, std. dev.: 0.0137) MultiSource/Applications/JM/ldecod/ldecod: 2.31% (6.5754 => 6.7272, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 2.29% (14.8535 => 15.1936, std. dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 2.20% (16.2614 => 16.6185, std. dev.: 0.0114) MultiSource/Applications/ClamAV/clamscan: 2.15% (14.5298 => 14.8426, std. dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 2.08% (4.6629 => 4.7599, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.95% (2.1007 => 2.1417, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (3.2742 => 3.3362, std. dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.65% (1.5188 => 1.5438, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5145, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 25.00% (1.8175 => 2.2719, std. dev.: 0.0468) SingleSource/Benchmarks/Misc/mandel-2: 7.30% (1.2998 => 1.3947, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.23% (0.9996 => 1.0519, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 4.37% (7.4271 => 7.7513, std. dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.2619 => 11.7305, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9663, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4774, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8165, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.28% (1.0310 => 1.0545, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5089 => 1.5332, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9585, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.5928 => 4.6610, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1967, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6469 => 3.6854, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1393, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.78% (22.5627 => 21.0329, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.85% (0.3511 => 0.3411, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -19.56% (0.0997 => 0.0802, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.67% (1.2308 => 1.0995, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.96% (2.6470 => 2.5156, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3133, std. dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.55% (3.0263 => 2.9491, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.49% (8.8259 => 8.6060, std. dev.: 0.0134) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.49% (0.4867 => 0.4746, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.28% (0.8342 => 0.8152, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2280, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5040, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9543, std. dev.: 0.0442) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8661, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2544, std. dev.: 0.0028) MultiSource/Applications/lua/lua: -1.11% (26.5159 => 26.2211, std. dev.: 0.0459) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2328, std. dev.: 0.0253) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 04:28:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 06:28:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120726112816.215502A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2388?compare_to=2385&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2388, Order: 160778, Start Time: 2012-07-26 10:09:50, End Time: 2012-07-26 11:28:39 To: 2385, Order: 160775, Start Time: 2012-07-26 08:22:43, End Time: 2012-07-26 09:41:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (82 on baseline) Performance Improvements: 1 (25 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (766 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.60% (1.0973 => 1.1149, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.10% (14.0496 => 13.8954, std. dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.03% (10.3673 => 13.8954, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 13.25% (0.3473 => 0.3933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.87% (0.3497 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.79% (0.3543 => 0.3996, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.74% (0.3516 => 0.3964, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3543 => 0.3992, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.64% (0.3561 => 0.4011, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/for-in: 12.37% (0.3694 => 0.4151, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.04% (0.3828 => 0.4289, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.99% (0.3886 => 0.4352, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.97% (0.3927 => 0.4397, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.43% (1.1194 => 1.2474, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.86% (0.1622 => 0.1782, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.73% (2.2022 => 2.3945, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.23% (1.7609 => 1.8882, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2065 => 0.2200, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.35% (0.5925 => 0.6301, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.22% (0.6030 => 0.6405, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.3177 => 0.3364, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 5.57% (10.4361 => 11.0174, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference: 5.15% (0.7326 => 0.7703, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.13% (7.0540 => 7.4162, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 5.06% (0.3282 => 0.3448, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4615 => 0.4848, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.73% (0.4879 => 0.5110, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.37% (9.4845 => 9.8988, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.03% (4.9449 => 5.1444, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 3.98% (0.7433 => 0.7729, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (5.0018 => 5.2008, std. dev.: 0.0117) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.96% (0.8172 => 0.8496, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.66% (0.5569 => 0.5773, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.62% (0.3121 => 0.3234, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.57% (8.1363 => 8.4265, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.57% (0.5860 => 0.6069, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.55% (4.2646 => 4.4159, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3180 => 0.3288, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.25% (0.7835 => 0.8090, std. dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 3.22% (5.7591 => 5.9444, std. dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.08% (1.1861 => 1.2226, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (14.3668 => 14.7944, std. dev.: 0.0166) MultiSource/Benchmarks/sim/sim: 2.95% (0.3387 => 0.3487, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.3050 => 1.3434, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 2.77% (1.1642 => 1.1965, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.75% (0.8067 => 0.8289, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.72% (3.3354 => 3.4261, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 2.66% (1.5603 => 1.6018, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.61% (1.5415 => 1.5818, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 2.56% (0.4299 => 0.4409, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.46% (2.0273 => 2.0771, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 2.27% (3.8723 => 3.9602, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.17% (0.9765 => 0.9977, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.12% (1.5859 => 1.6196, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.05% (0.6675 => 0.6812, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.03% (0.6450 => 0.6581, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.00% (2.2024 => 2.2464, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.5981 => 0.6100, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.88% (2.0665 => 2.1054, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.4186 => 1.4453, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 1.81% (0.6456 => 0.6573, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 1.66% (0.8921 => 0.9069, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.41% (17.1811 => 17.4232, std. dev.: 0.0156) MultiSource/Benchmarks/nbench/nbench: 1.38% (1.1840 => 1.2003, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.35% (2.2969 => 2.3280, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 1.25% (1.2842 => 1.3003, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.45% (4.2280 => 4.3739, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7491, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (1.5086 => 1.5347, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.63% (3.1578 => 3.2092, std. dev.: 0.0030) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2040, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2430, std. dev.: 0.0198) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.38% (2.6546 => 2.6913, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8040, std. dev.: 0.0145) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.03% (6.6465 => 6.7150, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.00% (2.8904 => 2.9194, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.46% (0.8651 => 0.1690, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.18% (5.2763 => 3.1563, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.13% (5.3855 => 3.7090, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.48% (5.3526 => 3.7212, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.35% (2.9384 => 2.5461, std. dev.: 0.0190) MultiSource/Applications/ClamAV/clamscan: -10.23% (22.1758 => 19.9083, std. dev.: 0.0158) SingleSource/UnitTests/Vector/constpool: -5.27% (54.1659 => 51.3092, std. dev.: 0.0349) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.83% (0.0998 => 0.0830, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -9.89% (1.2373 => 1.1149, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -9.02% (1.5373 => 1.3987, std. dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5538, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.88% (1.9577 => 1.8622, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4827, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.02% (8.1563 => 7.9099, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4252, std. dev.: 0.0181) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0047, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: -1.66% (12.5348 => 12.3270, std. dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.8329 => 1.8079, std. dev.: 0.0012) MultiSource/Applications/siod/siod: -1.03% (3.2827 => 3.2490, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 06:00:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 08:00:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120726130022.73D502A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2389?compare_to=2387&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2389, Order: 160782, Start Time: 2012-07-26 11:46:40, End Time: 2012-07-26 13:00:45 To: 2387, Order: 160778, Start Time: 2012-07-26 10:04:57, End Time: 2012-07-26 11:18:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (139 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.29% (54.4490 => 56.2390, std. dev.: 0.0539) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.75% (2.0176 => 2.2950, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.61% (0.3578 => 0.3922, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.41% (0.3601 => 0.3940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.39% (0.3663 => 0.4007, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.38% (0.5818 => 0.6364, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 9.35% (0.3646 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.26% (0.3789 => 0.4140, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.26% (0.3650 => 0.3988, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.22% (0.3623 => 0.3957, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.12% (0.5748 => 0.6272, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.02% (0.3914 => 0.4267, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.77% (0.4003 => 0.4354, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.76% (0.3940 => 0.4285, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.33% (0.7061 => 0.7649, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.76% (1.3693 => 1.4618, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.68% (0.7710 => 0.8225, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (0.4328 => 0.4611, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (3.9660 => 4.2183, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.28% (0.2596 => 0.2759, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.15% (0.5265 => 0.5589, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 5.98% (0.4062 => 0.4305, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 5.95% (0.7038 => 0.7457, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: 5.83% (0.2607 => 0.2759, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.83% (0.2781 => 0.2943, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.75% (0.2782 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.59% (0.2628 => 0.2775, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.57% (0.4379 => 0.4623, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.53% (0.2765 => 0.2918, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.49% (0.3022 => 0.3188, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.46% (1.9828 => 2.0910, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.42% (0.3580 => 0.3774, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.36% (0.2726 => 0.2872, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.28% (0.3899 => 0.4105, std. dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.24% (0.4390 => 0.4620, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.22% (0.3485 => 0.3667, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.22% (0.3489 => 0.3671, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.22% (0.2761 => 0.2905, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.20% (0.6959 => 0.7321, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.3107 => 0.3268, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.13% (0.5577 => 0.5863, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.12% (1.2193 => 1.2817, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 4.99% (0.2988 => 0.3137, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.92% (0.9199 => 0.9652, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 4.89% (0.3192 => 0.3348, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.81% (0.3453 => 0.3619, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.76% (13.8202 => 14.4776, std. dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/lists1: 4.75% (0.3534 => 0.3702, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.63% (0.4016 => 0.4202, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.50% (16.6129 => 17.3599, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/lists: 4.49% (0.3293 => 0.3441, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.47% (0.3756 => 0.3924, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.44% (0.7506 => 0.7839, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.42% (1.4563 => 1.5207, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/09-vor/vor: 4.41% (0.2925 => 0.3054, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.37% (7.2180 => 7.5332, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.33% (1.3813 => 1.4411, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.32% (0.2914 => 0.3040, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 4.29% (0.3868 => 0.4034, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.21% (1.3819 => 1.4401, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.1364 => 1.1842, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.19% (0.5637 => 0.5873, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.13% (13.2842 => 13.8333, std. dev.: 0.0169) MultiSource/Benchmarks/nbench/nbench: 4.12% (1.0594 => 1.1030, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.09% (0.7460 => 0.7765, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2945 => 0.3065, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.04% (0.3246 => 0.3377, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (0.8310 => 0.8642, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 3.98% (1.9270 => 2.0037, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.97% (1.1061 => 1.1500, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 3.87% (3.8646 => 4.0140, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.72% (4.3801 => 4.5429, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (1.3245 => 1.3737, std. dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 3.64% (0.2995 => 0.3104, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.62% (1.2292 => 1.2737, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.56% (3.6692 => 3.7998, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3220 => 0.3332, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.46% (4.4433 => 4.5970, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3755 => 0.3881, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1333 => 1.1677, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.01% (0.4791 => 0.4935, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.87% (2.1791 => 2.2416, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 2.86% (3.1889 => 3.2802, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.74% (4.9865 => 5.1230, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.74% (0.8698 => 0.8936, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.67% (0.6135 => 0.6299, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.62% (8.4961 => 8.7183, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.59% (0.6283 => 0.6446, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.51% (6.5754 => 6.7404, std. dev.: 0.0096) MultiSource/Applications/JM/lencod/lencod: 2.40% (14.8535 => 15.2102, std. dev.: 0.0071) MultiSource/Applications/ClamAV/clamscan: 2.38% (14.5298 => 14.8760, std. dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 2.28% (16.2614 => 16.6318, std. dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.03% (3.2742 => 3.3407, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.91% (2.1007 => 2.1409, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 1.82% (4.6629 => 4.7479, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.73% (1.5188 => 1.5451, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.03% (1.0313 => 1.0419, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5148, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2639, std. dev.: 0.0302) SingleSource/Benchmarks/Misc/mandel-2: 7.30% (1.2998 => 1.3947, std. dev.: 0.0197) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.18% (0.9996 => 1.0514, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/salsa20: 4.34% (7.4271 => 7.7498, std. dev.: 0.0242) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.2619 => 11.7304, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4777, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.74% (1.7688 => 1.8173, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0310 => 1.0562, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (0.9692 => 0.9910, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5928 => 4.6629, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.18% (1.9290 => 1.9518, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (3.1071 => 3.1389, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 1.00% (1.1560 => 1.1676, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.73% (22.5627 => 21.0444, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.00% (1.2308 => 1.1077, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.08% (1.3780 => 1.3080, std. dev.: 0.0076) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.83% (1.9762 => 1.9203, std. dev.: 0.0061) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9450, std. dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6076, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -2.29% (6.3560 => 6.2103, std. dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.12% (20.3410 => 19.9101, std. dev.: 0.0745) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5132, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.5254 => 2.4918, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -1.30% (5.3167 => 5.2476, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8665, std. dev.: 0.0168) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2207, std. dev.: 0.0065) MultiSource/Applications/lua/lua: -1.06% (26.5159 => 26.2355, std. dev.: 0.0188) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 06:14:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 08:14:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120726131444.697212A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2390?compare_to=2388&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2390, Order: 160782, Start Time: 2012-07-26 11:56:26, End Time: 2012-07-26 13:15:07 To: 2388, Order: 160778, Start Time: 2012-07-26 10:09:50, End Time: 2012-07-26 11:28:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (86 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (763 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.17% (13.8954 => 14.1970, std. dev.: 0.0107) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.94% (10.3673 => 14.1970, std. dev.: 0.0107) SingleSource/UnitTests/ObjC/trivial-interface: 13.39% (0.3473 => 0.3938, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.10% (0.3543 => 0.4007, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 13.07% (0.3543 => 0.4006, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.01% (0.3497 => 0.3952, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 12.89% (0.3561 => 0.4020, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.88% (0.3516 => 0.3969, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.62% (0.3694 => 0.4160, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.23% (0.3828 => 0.4296, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.20% (0.3927 => 0.4406, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.10% (1.1194 => 1.2549, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 12.09% (0.3886 => 0.4356, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 11.47% (0.1622 => 0.1808, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.14% (2.2022 => 2.4035, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.24% (0.1432 => 0.1550, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.65% (1.7609 => 1.8956, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.62% (0.5925 => 0.6317, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.43% (0.6030 => 0.6418, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.03% (10.4361 => 11.0658, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.77% (7.0540 => 7.4612, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 5.39% (0.7326 => 0.7721, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.39% (0.1892 => 0.1994, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 5.36% (0.3282 => 0.3458, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4615 => 0.4848, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.86% (0.4879 => 0.5116, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.34% (9.4845 => 9.8966, std. dev.: 0.0071) MultiSource/Applications/lambda-0_1_3/lambda: 4.24% (0.7433 => 0.7748, std. dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.9449 => 5.1477, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.09% (5.0018 => 5.2063, std. dev.: 0.0087) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.06% (0.8172 => 0.8504, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.90% (0.5569 => 0.5786, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.74% (0.2700 => 0.2801, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (4.2646 => 4.4194, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.60% (8.1363 => 8.4291, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3121 => 0.3233, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 3.46% (0.3180 => 0.3290, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: 3.45% (0.7835 => 0.8105, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1861 => 1.2222, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.01% (0.3387 => 0.3489, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.01% (1.3050 => 1.3443, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.00% (14.3668 => 14.7978, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.98% (0.8067 => 0.8307, std. dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 2.77% (5.7591 => 5.9188, std. dev.: 0.0070) MultiSource/Applications/Burg/burg: 2.71% (1.1642 => 1.1958, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 2.66% (3.3354 => 3.4241, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.59% (1.5603 => 1.6007, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.56% (1.5415 => 1.5809, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 2.55% (2.0273 => 2.0789, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.46% (0.4103 => 0.4204, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.31% (3.8723 => 3.9618, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.29% (0.5105 => 0.5222, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.20% (0.9765 => 0.9980, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.20% (0.4636 => 0.4738, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.18% (1.5859 => 1.6204, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.17% (0.6450 => 0.6590, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.16% (2.0665 => 2.1111, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.04% (0.6675 => 0.6811, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.01% (1.4186 => 1.4471, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.01% (0.5981 => 0.6101, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.94% (2.2024 => 2.2451, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 1.86% (0.6456 => 0.6576, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 1.65% (0.8921 => 0.9068, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.48% (1.1840 => 1.2015, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.47% (1.2842 => 1.3031, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.44% (17.1811 => 17.4287, std. dev.: 0.0120) MultiSource/Applications/siod/siod: 1.39% (2.2969 => 2.3289, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.45% (4.2280 => 4.3738, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7480, std. dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.54% (1.0313 => 1.0575, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.64% (3.1578 => 3.2096, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5086 => 1.5328, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: 1.46% (9.1159 => 9.2490, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/fbench: 1.40% (2.2771 => 2.3090, std. dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8039, std. dev.: 0.0149) MultiSource/Applications/aha/aha: 1.37% (3.1595 => 3.2029, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.36% (2.6546 => 2.6907, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 1.08% (6.6465 => 6.7181, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1618, std. dev.: 0.0159) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.66% (5.3855 => 3.7343, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.06% (5.3526 => 3.7436, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.00% (2.9384 => 2.5565, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.04% (22.1758 => 19.9488, std. dev.: 0.0093) SingleSource/UnitTests/Vector/constpool: -5.19% (54.1659 => 51.3563, std. dev.: 0.0292) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.83% (0.0998 => 0.0840, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -10.28% (1.2373 => 1.1101, std. dev.: 0.0275) SingleSource/Benchmarks/Misc/mandel-2: -7.83% (1.5373 => 1.4170, std. dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.45% (1.9577 => 1.8705, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.18% (8.1563 => 7.8970, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4814, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4283, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0004, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -1.78% (12.5348 => 12.3115, std. dev.: 0.0091) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8095, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 07:16:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 09:16:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120726141655.955AB2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2391?compare_to=2386&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2391, Order: 160780, Start Time: 2012-07-26 11:34:00, End Time: 2012-07-26 14:17:18 To: 2386, Order: 160775, Start Time: 2012-07-26 08:22:44, End Time: 2012-07-26 11:06:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (74 on baseline) Performance Improvements: 1 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (809 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 29.74% (57.7528 => 74.9277, std. dev.: 0.0308) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.57% (2.0963 => 2.1292, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.65% (1.6990 => 1.6710, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.22% (0.3442 => 0.3897, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 13.20% (0.3446 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.19% (0.3465 => 0.3922, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.13% (0.3496 => 0.3955, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.10% (0.3488 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3469 => 0.3923, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.82% (0.3643 => 0.4110, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.58% (0.3650 => 0.4109, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3724 => 0.4184, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.04% (0.1620 => 0.1734, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.92% (0.5826 => 0.6229, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.67% (0.5889 => 0.6282, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (1.6211 => 1.7127, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (3.5627 => 3.7639, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.32% (0.4361 => 0.4593, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 5.09% (0.7171 => 0.7536, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.93% (0.4994 => 0.5240, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (1.3152 => 1.3799, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 4.88% (1.5932 => 1.6710, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (0.3930 => 0.4121, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.83% (0.3792 => 0.3975, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.73% (0.5900 => 0.6179, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.70% (0.5000 => 0.5235, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.67% (0.4029 => 0.4217, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.62% (0.5026 => 0.5258, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 4.58% (1.0781 => 1.1275, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.54% (2.7292 => 2.8530, std. dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 4.52% (4.2109 => 4.4013, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.09% (0.2736 => 0.2848, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.2866 => 0.2983, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (1.9694 => 2.0455, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.74% (2.1013 => 2.1798, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.71% (1.9966 => 2.0706, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.60% (0.3890 => 0.4030, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.57% (5.5417 => 5.7394, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.54% (0.4658 => 0.4823, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.47% (4.4195 => 4.5730, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 3.40% (2.1653 => 2.2390, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.36% (4.6177 => 4.7728, std. dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.20% (0.3903 => 0.4028, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (2.0673 => 2.1293, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.92% (1.8794 => 1.9342, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 2.87% (0.9909 => 1.0193, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 2.84% (0.3726 => 0.3832, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.84% (0.7875 => 0.8099, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (0.3625 => 0.3725, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.61% (0.4139 => 0.4247, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 2.61% (1.4269 => 1.4641, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.56% (0.5546 => 0.5688, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.53% (0.9697 => 0.9942, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.51% (23.5202 => 24.1117, std. dev.: 0.0121) MultiSource/Applications/siod/siod: 2.43% (0.6634 => 0.6795, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.57% (0.6435 => 0.6536, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.27% (2.0346 => 2.0604, std. dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.12% (0.0734 => 0.0845, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (2.5769 => 2.9634, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.2122 => 0.2238, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6732, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-2: 4.90% (1.8057 => 1.8942, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1678, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.27% (2.0820 => 2.1292, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.20% (105.3826 => 107.6993, std. dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2066, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4982, std. dev.: 0.0232) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5916, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2212, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.38% (2.4764 => 2.3927, std. dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: -1.72% (11.9555 => 11.7502, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.03% (25.4195 => 16.5153, std. dev.: 0.0182) SingleSource/Benchmarks/Dhrystone/fldry: -8.25% (17.2379 => 15.8154, std. dev.: 0.0904) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7914, std. dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/ary2: -6.70% (0.2402 => 0.2241, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: -3.99% (0.4438 => 0.4261, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.66% (14.0481 => 13.5343, std. dev.: 0.0221) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5770, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 08:30:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 10:30:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120726153019.35B192A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2392?compare_to=2389&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2392, Order: 160783, Start Time: 2012-07-26 14:16:39, End Time: 2012-07-26 15:30:41 To: 2389, Order: 160782, Start Time: 2012-07-26 11:46:40, End Time: 2012-07-26 13:00:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (138 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.68% (2.0176 => 2.2936, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.67% (0.3578 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.55% (0.3601 => 0.3945, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.38% (0.3646 => 0.3988, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.35% (0.5818 => 0.6362, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.29% (0.3650 => 0.3989, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 9.28% (0.3663 => 0.4003, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.22% (0.3623 => 0.3957, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.19% (0.5748 => 0.6276, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.18% (0.3789 => 0.4137, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.07% (0.3914 => 0.4269, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.84% (0.4003 => 0.4357, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.84% (0.7061 => 0.7685, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/property: 8.81% (0.3940 => 0.4287, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.38% (0.3130 => 0.3361, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 6.73% (1.3693 => 1.4615, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.61% (0.7710 => 0.8220, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.40% (0.4328 => 0.4605, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.34% (3.9660 => 4.2176, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.15% (0.5265 => 0.5589, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 5.95% (0.7038 => 0.7457, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 5.91% (0.4062 => 0.4302, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 5.79% (0.2607 => 0.2758, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.79% (0.2781 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.79% (0.2782 => 0.2943, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.65% (0.2655 => 0.2805, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4379 => 0.4622, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.52% (0.6959 => 0.7343, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2765 => 0.2917, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.47% (0.2760 => 0.2911, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.44% (0.4390 => 0.4629, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (1.9828 => 2.0903, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3022 => 0.3185, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.36% (0.3489 => 0.3676, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.32% (0.2726 => 0.2871, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.29% (0.3192 => 0.3361, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.28% (0.3485 => 0.3669, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.26% (0.2966 => 0.3122, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.25% (0.3580 => 0.3768, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.18% (0.2761 => 0.2904, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.15% (0.3107 => 0.3267, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.13% (1.2193 => 1.2818, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 5.02% (0.2988 => 0.3138, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.3899 => 0.4094, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.94% (0.9199 => 0.9653, std. dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 4.79% (13.8202 => 14.4826, std. dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.73% (0.5577 => 0.5841, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.70% (0.3534 => 0.3700, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.58% (0.4016 => 0.4200, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.49% (0.3293 => 0.3441, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 4.47% (16.6129 => 17.3562, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/moments: 4.42% (0.3868 => 0.4039, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: 4.41% (0.7506 => 0.7837, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.39% (0.3756 => 0.3921, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.39% (1.4563 => 1.5202, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.38% (7.2180 => 7.5342, std. dev.: 0.0080) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.37% (1.3813 => 1.4416, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.28% (0.5637 => 0.5878, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.27% (1.3819 => 1.4409, std. dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.26% (0.2914 => 0.3038, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.23% (1.1364 => 1.1845, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.20% (13.2842 => 13.8417, std. dev.: 0.0132) MultiSource/Applications/Burg/burg: 4.04% (1.1061 => 1.1508, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 4.02% (1.0594 => 1.1020, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (0.8310 => 0.8642, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.98% (1.9270 => 2.0036, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.97% (0.3246 => 0.3375, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.94% (0.2945 => 0.3061, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.87% (3.8646 => 4.0143, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.86% (0.7460 => 0.7748, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (1.3245 => 1.3741, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.63% (1.2292 => 1.2738, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.62% (4.3801 => 4.5387, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.48% (3.6692 => 3.7968, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.44% (4.4433 => 4.5961, std. dev.: 0.0098) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3220 => 0.3329, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 3.37% (0.2995 => 0.3096, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3755 => 0.3881, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.23% (0.6135 => 0.6333, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.05% (0.4791 => 0.4937, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.95% (2.1791 => 2.2434, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.92% (1.1333 => 1.1664, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.89% (4.9865 => 5.1305, std. dev.: 0.0057) MultiSource/Applications/d/make_dparser: 2.82% (3.1889 => 3.2787, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 2.74% (8.4961 => 8.7292, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.74% (0.6283 => 0.6455, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.71% (0.8698 => 0.8934, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 2.50% (6.5754 => 6.7395, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 2.44% (14.5298 => 14.8845, std. dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 2.33% (14.8535 => 15.1993, std. dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 2.14% (16.2614 => 16.6100, std. dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (3.2742 => 3.3397, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.93% (2.1007 => 2.1412, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 1.88% (4.6629 => 4.7506, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.80% (1.5188 => 1.5462, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5130, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 25.27% (1.8175 => 2.2767, std. dev.: 0.0394) SingleSource/Benchmarks/Misc/mandel-2: 7.11% (1.2998 => 1.3922, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.95% (1.5824 => 1.6765, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.20% (0.9996 => 1.0516, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 4.38% (7.4271 => 7.7522, std. dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.2619 => 11.7309, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4776, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8159, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5089 => 1.5335, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5943, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.47% (4.5928 => 4.6605, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5112, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.28% (9.0760 => 9.1926, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.20% (1.9290 => 1.9521, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.01% (3.1071 => 3.1386, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.73% (22.5627 => 21.0447, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.08% (0.3511 => 0.3403, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.35% (0.0997 => 0.0824, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -10.58% (1.2308 => 1.1006, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std. dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9186, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5866, std. dev.: 0.0242) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9451, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.23% (20.3410 => 19.8866, std. dev.: 0.0514) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2188, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5036, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8603, std. dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2487, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8482, std. dev.: 0.0039) MultiSource/Applications/lua/lua: -1.00% (26.5159 => 26.2501, std. dev.: 0.0198) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 08:34:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 10:34:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120726153457.B89392A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2393?compare_to=2390&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2393, Order: 160783, Start Time: 2012-07-26 14:16:31, End Time: 2012-07-26 15:35:19 To: 2390, Order: 160782, Start Time: 2012-07-26 11:56:26, End Time: 2012-07-26 13:15:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (85 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.02% (10.3673 => 14.2053, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 13.27% (0.3473 => 0.3934, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 13.01% (0.3497 => 0.3952, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 12.98% (0.3543 => 0.4003, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.98% (0.3543 => 0.4003, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.91% (0.3516 => 0.3970, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 12.89% (0.3561 => 0.4020, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 12.75% (0.3694 => 0.4165, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.20% (0.3828 => 0.4295, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.17% (1.1194 => 1.2556, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 12.09% (0.3886 => 0.4356, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.04% (0.3927 => 0.4400, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 11.53% (0.1622 => 0.1809, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.15% (2.2022 => 2.4036, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.24% (0.1432 => 0.1550, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.2065 => 0.2226, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.69% (1.7609 => 1.8963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.60% (0.6030 => 0.6428, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 6.57% (0.5925 => 0.6314, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.3177 => 0.3370, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.06% (10.4361 => 11.0681, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.82% (7.0540 => 7.4645, std. dev.: 0.0111) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 5.39% (0.3282 => 0.3459, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 5.34% (0.7326 => 0.7717, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.98% (0.4615 => 0.4845, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.4879 => 0.5120, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.31% (9.4845 => 9.8937, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.30% (4.9449 => 5.1574, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.20% (0.5569 => 0.5803, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.14% (0.7433 => 0.7741, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.05% (0.8172 => 0.8503, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (5.0018 => 5.2033, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.01% (0.5860 => 0.6095, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.81% (0.2700 => 0.2803, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.75% (0.3121 => 0.3238, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.70% (4.2646 => 4.4223, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.63% (8.1363 => 8.4314, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: 3.49% (0.3092 => 0.3200, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.36% (0.3180 => 0.3287, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.36% (0.7835 => 0.8098, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1861 => 1.2228, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.07% (0.8067 => 0.8315, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.05% (14.3668 => 14.8051, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.99% (1.3050 => 1.3440, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.98% (1.5415 => 1.5875, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 2.89% (1.1642 => 1.1979, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.79% (5.7591 => 5.9198, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 2.72% (3.3354 => 3.4262, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 2.56% (1.5603 => 1.6003, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.49% (2.0273 => 2.0777, std. dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.39% (0.4636 => 0.4747, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.37% (0.5105 => 0.5226, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.32% (3.8723 => 3.9620, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.24% (0.9765 => 0.9984, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.19% (1.5859 => 1.6206, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (2.0665 => 2.1105, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.2024 => 2.2491, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 2.01% (0.6456 => 0.6586, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5981 => 0.6099, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.97% (0.6450 => 0.6577, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.96% (0.6675 => 0.6806, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.4186 => 1.4459, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/football/football: 1.70% (0.8921 => 0.9073, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.53% (17.1811 => 17.4432, std. dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: 1.51% (1.2842 => 1.3036, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.45% (1.1840 => 1.2012, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.37% (2.2969 => 2.3284, std. dev.: 0.0091) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.14% (7.9617 => 8.0521, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.45% (4.2280 => 4.3738, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7593, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.53% (1.0313 => 1.0574, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2159, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.57% (1.5086 => 1.5323, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8045, std. dev.: 0.0139) MultiSource/Applications/aha/aha: 1.38% (3.1595 => 3.2031, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2386, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6900, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 1.05% (6.6465 => 6.7160, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.06% (5.2763 => 3.1628, std. dev.: 0.0177) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.65% (5.3855 => 3.7348, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.99% (5.3526 => 3.7473, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.01% (2.9384 => 2.5562, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -10.06% (22.1758 => 19.9439, std. dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -5.11% (54.1659 => 51.4000, std. dev.: 0.0384) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.40% (1.2373 => 1.1086, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -8.66% (1.5373 => 1.4042, std. dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -4.45% (1.9577 => 1.8706, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4782, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.10% (8.1563 => 7.9033, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4162, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0002, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3234, std. dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8085, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 10:27:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 12:27:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120726172759.733DA2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2394?compare_to=2391&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2394, Order: 160783, Start Time: 2012-07-26 14:44:57, End Time: 2012-07-26 17:28:22 To: 2391, Order: 160780, Start Time: 2012-07-26 11:34:00, End Time: 2012-07-26 14:17:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (75 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (808 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 13.32% (0.3469 => 0.3931, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.30% (0.3465 => 0.3926, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.28% (0.3442 => 0.3899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.27% (0.3496 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.24% (0.3460 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.20% (0.3446 => 0.3901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.16% (0.3488 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.76% (0.3643 => 0.4108, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/parameter-passing: 12.16% (0.3724 => 0.4177, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.04% (0.1620 => 0.1734, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.95% (0.5826 => 0.6231, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.76% (0.5889 => 0.6287, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.75% (3.5627 => 3.7674, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.66% (1.6211 => 1.7129, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.39% (0.4361 => 0.4596, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.23% (0.7171 => 0.7546, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.2014 => 0.2115, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (1.3152 => 1.3799, std. dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 4.91% (1.5932 => 1.6715, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.89% (0.4029 => 0.4226, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.89% (0.4994 => 0.5238, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.89% (0.3930 => 0.4122, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.80% (0.5000 => 0.5240, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.75% (0.5900 => 0.6180, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 4.67% (1.0781 => 1.1284, std. dev.: 0.0092) MultiSource/Applications/ClamAV/clamscan: 4.64% (4.2109 => 4.4063, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (0.5026 => 0.5259, std. dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.54% (2.7292 => 2.8530, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.2866 => 0.2987, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.09% (0.2736 => 0.2848, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.97% (0.4658 => 0.4843, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (1.9694 => 2.0456, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (1.9966 => 2.0722, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (2.1013 => 2.1805, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.61% (5.5417 => 5.7419, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.60% (0.3890 => 0.4030, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.53% (4.4195 => 4.5755, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.48% (0.3903 => 0.4039, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 3.48% (2.1653 => 2.2406, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.45% (0.3271 => 0.3384, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.36% (4.6177 => 4.7728, std. dev.: 0.0122) MultiSource/Applications/hexxagon/hexxagon: 3.04% (0.9909 => 1.0210, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.02% (2.0673 => 2.1297, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.97% (0.3362 => 0.3462, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.92% (1.8794 => 1.9343, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.91% (0.7875 => 0.8104, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.80% (0.4139 => 0.4255, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 2.80% (1.4269 => 1.4668, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (0.3625 => 0.3726, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 2.76% (0.3726 => 0.3829, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.72% (0.5546 => 0.5697, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 2.64% (0.9697 => 0.9953, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.60% (23.5202 => 24.1320, std. dev.: 0.0097) MultiSource/Applications/siod/siod: 2.59% (0.6634 => 0.6806, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.63% (0.6435 => 0.6540, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.32% (2.0346 => 2.0615, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9636, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6683, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary: 5.00% (0.2122 => 0.2228, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1660, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-2: 4.48% (1.8057 => 1.8866, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.24% (105.3826 => 107.7437, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2061, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4586, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4965, std. dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.75% (3.1722 => 3.2277, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5922, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5146, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.60% (2.4764 => 2.3872, std. dev.: 0.0130) MultiSource/Applications/kimwitu++/kc: -1.71% (11.9555 => 11.7506, std. dev.: 0.0183) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.02% (25.4195 => 16.5167, std. dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/fldry: -8.96% (17.2379 => 15.6926, std. dev.: 0.3082) SingleSource/Benchmarks/Shootout-C++/ary2: -8.20% (0.2402 => 0.2205, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8013, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/moments: -3.92% (0.4438 => 0.4264, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -3.52% (14.0481 => 13.5542, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5184, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5763, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 10:50:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 12:50:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120726175055.558702A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2395?compare_to=2392&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2395, Order: 160784, Start Time: 2012-07-26 16:37:03, End Time: 2012-07-26 17:51:17 To: 2392, Order: 160783, Start Time: 2012-07-26 14:16:39, End Time: 2012-07-26 15:30:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (149 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.63% (0.5326 => 0.5466, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/lowercase: 1.42% (7.9455 => 8.0586, std. dev.: 0.0096) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.13% (2.0176 => 2.3026, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3578 => 0.3959, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference-object: 10.45% (0.5818 => 0.6426, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3601 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.40% (0.5748 => 0.6346, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.39% (0.3646 => 0.4025, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.38% (0.3650 => 0.4029, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 10.32% (0.3663 => 0.4041, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3623 => 0.3995, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.13% (0.3789 => 0.4173, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.07% (0.7061 => 0.7772, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 10.02% (0.3914 => 0.4306, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.87% (0.4003 => 0.4398, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.85% (0.3940 => 0.4328, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.71% (0.1986 => 0.2159, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.42% (0.1819 => 0.1954, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.17% (0.7710 => 0.8263, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 7.05% (1.3693 => 1.4659, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2596 => 0.2776, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.83% (3.9660 => 4.2368, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.76% (0.5265 => 0.5621, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 6.60% (0.4062 => 0.4330, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.58% (0.7038 => 0.7501, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (0.4328 => 0.4611, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.29% (0.2781 => 0.2956, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.6959 => 0.7377, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4379 => 0.4639, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.83% (0.2966 => 0.3139, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.82% (0.2782 => 0.2944, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.65% (0.1789 => 0.1890, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.62% (0.2937 => 0.3102, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.60% (1.9828 => 2.0938, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.59% (0.3580 => 0.3780, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.57% (1.2193 => 1.2872, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 5.54% (0.2761 => 0.2914, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.51% (0.3899 => 0.4114, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.51% (0.3192 => 0.3368, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.50% (0.3107 => 0.3278, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.47% (0.3489 => 0.3680, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.35% (0.2988 => 0.3148, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.31% (0.3485 => 0.3670, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.30% (0.9199 => 0.9687, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.24% (0.5577 => 0.5869, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.23% (0.2925 => 0.3078, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.18% (13.8202 => 14.5358, std. dev.: 0.0086) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.13% (1.3813 => 1.4522, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2243 => 0.2358, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.09% (16.6129 => 17.4580, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/lists: 5.07% (0.3293 => 0.3460, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.05% (0.4016 => 0.4219, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.03% (0.2127 => 0.2234, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4390 => 0.4607, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.93% (0.3756 => 0.3941, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.91% (7.2180 => 7.5722, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.2140 => 0.2245, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.89% (0.7506 => 0.7873, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.86% (1.3819 => 1.4490, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.75% (0.5637 => 0.5905, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.64% (1.1061 => 1.1574, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.61% (1.4563 => 1.5235, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 4.59% (3.8646 => 4.0421, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3246 => 0.3395, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.58% (0.3868 => 0.4045, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.54% (13.2842 => 13.8870, std. dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.51% (1.3245 => 1.3842, std. dev.: 0.0099) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.44% (1.1364 => 1.1868, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.42% (0.7460 => 0.7790, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.27% (1.9270 => 2.0093, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.20% (1.0594 => 1.1039, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2945 => 0.3066, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 4.09% (0.8310 => 0.8650, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (4.4433 => 4.6241, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (4.3801 => 4.5575, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.2292 => 1.2773, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.85% (3.6692 => 3.8103, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 3.74% (0.2995 => 0.3107, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.51% (2.1791 => 2.2555, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.44% (0.4791 => 0.4956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3755 => 0.3884, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.40% (1.1333 => 1.1718, std. dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 3.39% (0.3131 => 0.3237, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 3.36% (0.4113 => 0.4251, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (4.9865 => 5.1506, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.19% (0.6135 => 0.6331, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.12% (3.1889 => 3.2885, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.94% (0.6283 => 0.6468, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.89% (8.4961 => 8.7414, std. dev.: 0.0125) MultiSource/Applications/JM/ldecod/ldecod: 2.78% (6.5754 => 6.7581, std. dev.: 0.0206) MultiSource/Applications/ClamAV/clamscan: 2.61% (14.5298 => 14.9095, std. dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 2.55% (14.8535 => 15.2329, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (2.1007 => 2.1530, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.43% (16.2614 => 16.6560, std. dev.: 0.0198) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.36% (3.2742 => 3.3516, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.27% (4.6629 => 4.7686, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.20% (1.5188 => 1.5522, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.42% (0.9108 => 0.9237, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.35% (1.0313 => 1.0452, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.28% (6.2785 => 6.3589, std. dev.: 0.0089) MultiSource/Applications/lua/lua: 1.15% (3.7467 => 3.7899, std. dev.: 0.0167) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5215, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2614, std. dev.: 0.0429) SingleSource/Benchmarks/Misc/mandel-2: 7.83% (1.2998 => 1.4016, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.15% (0.9996 => 1.0511, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 4.29% (7.4271 => 7.7458, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7310, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4780, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8149, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.27% (1.0310 => 1.0544, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.89% (3.7731 => 3.8444, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5089 => 1.5327, std. dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4513, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.50% (4.5928 => 4.6617, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/fldry: 1.34% (1.9290 => 1.9548, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1400, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.32% (22.5627 => 21.1367, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.45% (0.0997 => 0.0833, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2308 => 1.1038, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3078, std. dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5934, std. dev.: 0.0126) MultiSource/Applications/spiff/spiff: -2.62% (3.0263 => 2.9469, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.51% (0.4867 => 0.4745, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2263, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.71% (20.3410 => 19.9932, std. dev.: 0.0470) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.3167 => 5.2461, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2241, std. dev.: 0.0254) MultiSource/Applications/lua/lua: -1.18% (26.5159 => 26.2019, std. dev.: 0.0390) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 10:55:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 12:55:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120726175525.259E22A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2396?compare_to=2393&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2396, Order: 160784, Start Time: 2012-07-26 16:36:57, End Time: 2012-07-26 17:55:47 To: 2393, Order: 160783, Start Time: 2012-07-26 14:16:31, End Time: 2012-07-26 15:35:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (75 on baseline) Performance Improvements: 8 (25 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 925 (773 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.57% (1.4042 => 1.4403, std. dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -7.22% (14.2053 => 13.1790, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.63% (7.4645 => 7.3427, std. dev.: 0.0190) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.51% (3.7473 => 3.6909, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.46% (3.7348 => 3.6803, std. dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: -1.24% (11.0681 => 10.9304, std. dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.07% (1.2556 => 1.2422, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.02% (8.0521 => 7.9703, std. dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -2.63% (0.5470 => 0.5326, std. dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.12% (10.3673 => 13.1790, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3473 => 0.3913, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.48% (0.3543 => 0.3985, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.47% (0.3497 => 0.3933, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.45% (0.3543 => 0.3984, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 12.36% (0.3561 => 0.4001, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.32% (0.3516 => 0.3949, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.07% (0.3694 => 0.4140, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.50% (0.3886 => 0.4333, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.46% (0.3927 => 0.4377, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.97% (1.1194 => 1.2422, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.06% (2.2022 => 2.3797, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.58% (0.1622 => 0.1745, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 6.98% (0.1432 => 0.1532, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.64% (1.7609 => 1.8779, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.34% (0.2065 => 0.2196, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 6.14% (0.5925 => 0.6289, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.14% (0.6030 => 0.6400, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.26% (0.3177 => 0.3344, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.01% (0.7326 => 0.7693, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 4.74% (10.4361 => 10.9304, std. dev.: 0.0136) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.57% (0.4615 => 0.4826, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 4.42% (0.3282 => 0.3427, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.09% (7.0540 => 7.3427, std. dev.: 0.0190) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.94% (0.4879 => 0.5071, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 3.90% (0.7433 => 0.7723, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.72% (9.4845 => 9.8376, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.71% (4.9449 => 5.1284, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.63% (0.8172 => 0.8469, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.0018 => 5.1779, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.5569 => 0.5755, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.24% (0.5860 => 0.6050, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.20% (0.3121 => 0.3221, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.14% (4.2646 => 4.3985, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.10% (8.1363 => 8.3886, std. dev.: 0.0113) MultiSource/Benchmarks/McCat/18-imp/imp: 3.07% (0.3423 => 0.3528, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 2.91% (0.7835 => 0.8063, std. dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 2.76% (5.7591 => 5.9179, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.66% (1.1861 => 1.2177, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.62% (1.3050 => 1.3392, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.59% (0.4636 => 0.4756, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.54% (14.3668 => 14.7315, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 2.42% (1.1642 => 1.1924, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 2.37% (3.3354 => 3.4146, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.29% (0.8067 => 0.8252, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.17% (1.5415 => 1.5750, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 2.11% (1.5603 => 1.5933, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.03% (2.0273 => 2.0685, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 1.98% (3.8723 => 3.9490, std. dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.93% (0.9765 => 0.9953, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.89% (2.0665 => 2.1056, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.78% (1.5859 => 1.6142, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (2.2024 => 2.2374, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.57% (0.6675 => 0.6780, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.57% (0.6450 => 0.6551, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.41% (1.4186 => 1.4386, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 1.27% (0.8921 => 0.9034, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.15% (17.1811 => 17.3795, std. dev.: 0.0191) MultiSource/Applications/hexxagon/hexxagon: 1.15% (1.2842 => 1.2990, std. dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9741, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.45% (4.2280 => 4.3740, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7554, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2136, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5086 => 1.5344, std. dev.: 0.0014) MultiSource/Applications/aha/aha: 1.43% (3.1595 => 3.2047, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (2.6546 => 2.6920, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.39% (11.6436 => 11.8055, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2311, std. dev.: 0.0159) SingleSource/Benchmarks/Misc/oourafft: 1.04% (6.6465 => 6.7158, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.51% (0.8651 => 0.1686, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.61% (5.2763 => 3.1335, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.66% (5.3855 => 3.6803, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.04% (5.3526 => 3.6909, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.74% (2.9384 => 2.5348, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -10.58% (22.1758 => 19.8289, std. dev.: 0.0111) SingleSource/UnitTests/Vector/constpool: -5.20% (54.1659 => 51.3498, std. dev.: 0.0341) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.29% (3.8922 => 3.8418, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.63% (0.0998 => 0.0832, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -10.76% (1.2373 => 1.1042, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -6.31% (1.5373 => 1.4403, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: -5.02% (1.9577 => 1.8595, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4788, std. dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4201, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9128, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9997, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/lists: -1.76% (12.5348 => 12.3140, std. dev.: 0.0055) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8092, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 12:42:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 14:42:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120726194205.485552A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/2398?compare_to=2396&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2398, Order: 160791, Start Time: 2012-07-26 18:23:36, End Time: 2012-07-26 19:42:28 To: 2396, Order: 160784, Start Time: 2012-07-26 16:36:57, End Time: 2012-07-26 17:55:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (86 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (763 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.03% (13.1790 => 13.8421, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.47% (1.8779 => 1.9055, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 1.29% (10.9304 => 11.0716, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.12% (3.6803 => 3.7216, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.01% (3.6909 => 3.7283, std. dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.52% (10.3673 => 13.8421, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/trivial-interface: 12.73% (0.3473 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.48% (0.3543 => 0.3985, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 12.44% (0.3497 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.36% (0.3543 => 0.3981, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-3: 12.34% (0.3516 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.33% (0.3561 => 0.4000, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.97% (0.3694 => 0.4136, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.77% (1.1194 => 1.2511, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/property: 11.55% (0.3886 => 0.4335, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.55% (0.3828 => 0.4270, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 11.46% (0.3927 => 0.4377, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.11% (2.2022 => 2.4029, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 8.94% (0.1622 => 0.1767, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.21% (1.7609 => 1.9055, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.04% (0.3817 => 0.4124, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.09% (10.4361 => 11.0716, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 5.82% (0.5925 => 0.6270, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.64% (0.6030 => 0.6370, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.16% (0.4879 => 0.5131, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 5.09% (0.3282 => 0.3449, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.95% (7.0540 => 7.4035, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.88% (0.4615 => 0.4840, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 4.65% (0.7326 => 0.7667, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.62% (0.2554 => 0.2672, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.45% (9.4845 => 9.9068, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (5.0018 => 5.2040, std. dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: 4.04% (0.7433 => 0.7733, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.9449 => 5.1417, std. dev.: 0.0072) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.84% (0.8172 => 0.8486, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.66% (0.5569 => 0.5773, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (4.2646 => 4.4121, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.42% (8.1363 => 8.4142, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3121 => 0.3227, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.38% (0.5860 => 0.6058, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 3.33% (0.3180 => 0.3286, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.24% (0.3423 => 0.3534, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.22% (0.3109 => 0.3209, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.18% (0.7835 => 0.8084, std. dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 3.17% (5.7591 => 5.9417, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1861 => 1.2227, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.92% (1.3050 => 1.3431, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.80% (0.4636 => 0.4766, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (14.3668 => 14.7694, std. dev.: 0.0185) MultiSource/Applications/hbd/hbd: 2.74% (1.5603 => 1.6031, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 2.70% (0.4299 => 0.4415, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.67% (3.3354 => 3.4244, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.59% (1.5415 => 1.5814, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.52% (0.8067 => 0.8270, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.50% (2.0273 => 2.0780, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.50% (1.1642 => 1.1933, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash: 2.45% (0.4289 => 0.4394, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (0.5105 => 0.5216, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.15% (3.8723 => 3.9556, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.06% (0.6450 => 0.6583, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.97% (0.9765 => 0.9957, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.96% (2.0665 => 2.1070, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6675 => 0.6797, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (2.2024 => 2.2426, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 1.80% (0.8921 => 0.9082, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.76% (1.4186 => 1.4436, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 1.67% (0.6456 => 0.6564, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.67% (0.5981 => 0.6081, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.59% (17.1811 => 17.4550, std. dev.: 0.0157) MultiSource/Benchmarks/nbench/nbench: 1.39% (1.1840 => 1.2004, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.31% (1.2842 => 1.3010, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.29% (2.2969 => 2.3266, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.06% (7.9617 => 8.0464, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.43% (4.2280 => 4.3730, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7541, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.08% (1.0313 => 1.0527, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 1.46% (3.1578 => 3.2039, std. dev.: 0.0058) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2037, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8042, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6900, std. dev.: 0.0033) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2367, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/fbench: 1.13% (2.2771 => 2.3029, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 1.05% (6.6465 => 6.7162, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3373, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.11% (5.2763 => 3.1598, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.90% (5.3855 => 3.7216, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.35% (5.3526 => 3.7283, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.22% (2.9384 => 2.5498, std. dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: -10.10% (22.1758 => 19.9364, std. dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: -4.96% (54.1659 => 51.4773, std. dev.: 0.0313) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.40% (1.2373 => 1.1086, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -8.12% (1.5373 => 1.4124, std. dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.90% (1.9577 => 1.8618, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4748, std. dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4186, std. dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9182, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0022, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3194, std. dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -1.02% (3.2827 => 3.2491, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 12:33:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 14:33:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120726193319.92FC92A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2397?compare_to=2395&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2397, Order: 160791, Start Time: 2012-07-26 18:19:23, End Time: 2012-07-26 19:33:42 To: 2395, Order: 160784, Start Time: 2012-07-26 16:37:03, End Time: 2012-07-26 17:51:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (142 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.47% (55.1465 => 56.5078, std. dev.: 0.0870) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.60% (2.0176 => 2.3121, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 9.25% (0.3578 => 0.3909, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.11% (0.3601 => 0.3929, std. dev.: 0.0078) SingleSource/UnitTests/ObjC++/property-reference: 9.06% (0.7061 => 0.7701, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.05% (0.3623 => 0.3951, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.05% (0.3646 => 0.3976, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.98% (0.3663 => 0.3992, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 8.95% (0.5818 => 0.6339, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.93% (0.3650 => 0.3976, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 8.84% (0.3789 => 0.4124, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.79% (0.5748 => 0.6253, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.71% (0.3914 => 0.4255, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.63% (0.3940 => 0.4280, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.59% (0.4003 => 0.4347, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.16% (1.3693 => 1.4673, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.2721 => 0.2913, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.84% (0.7710 => 0.8237, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.77% (3.9660 => 4.2344, std. dev.: 0.0134) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.48% (0.5265 => 0.5606, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 6.24% (0.7038 => 0.7477, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 6.01% (0.4062 => 0.4306, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.91% (0.4328 => 0.4584, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.82% (0.6959 => 0.7364, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.80% (0.4379 => 0.4633, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.48% (1.2193 => 1.2861, std. dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 5.36% (0.2781 => 0.2930, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.21% (0.2782 => 0.2927, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.16% (0.3489 => 0.3669, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.2937 => 0.3088, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.13% (0.2690 => 0.2828, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.12% (0.9199 => 0.9670, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 5.11% (13.8202 => 14.5267, std. dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.11% (0.5577 => 0.5862, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.06% (0.3022 => 0.3175, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.05% (0.2655 => 0.2789, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.03% (0.3580 => 0.3760, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.02% (0.2628 => 0.2760, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.3899 => 0.4094, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 4.92% (0.2726 => 0.2860, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.86% (0.2760 => 0.2894, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 4.83% (0.3107 => 0.3257, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.82% (0.2966 => 0.3109, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.81% (1.9828 => 2.0782, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.81% (0.2765 => 0.2898, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.80% (0.3149 => 0.3300, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.74% (0.2761 => 0.2892, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.74% (16.6129 => 17.3999, std. dev.: 0.0127) MultiSource/Applications/spiff/spiff: 4.73% (0.7506 => 0.7861, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.63% (0.2914 => 0.3049, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.62% (1.4563 => 1.5236, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 4.61% (0.3192 => 0.3339, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.59% (0.3485 => 0.3645, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.56% (7.2180 => 7.5472, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/matrix: 4.55% (0.2988 => 0.3124, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.54% (0.5637 => 0.5893, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.54% (13.2842 => 13.8870, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.51% (1.3819 => 1.4442, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 4.48% (1.1061 => 1.1556, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.46% (1.3813 => 1.4429, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.44% (0.4390 => 0.4585, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1049, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 4.29% (0.3453 => 0.3601, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.28% (1.1364 => 1.1850, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.25% (0.3246 => 0.3384, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.24% (3.8646 => 4.0285, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 4.24% (1.9270 => 2.0087, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 4.21% (0.8310 => 0.8660, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.19% (0.3293 => 0.3431, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.19% (0.3534 => 0.3682, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.18% (0.4016 => 0.4184, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.13% (1.3245 => 1.3792, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.10% (0.7460 => 0.7766, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (0.3756 => 0.3909, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/moments: 4.01% (0.3868 => 0.4023, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.3801 => 4.5514, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.90% (3.6692 => 3.8123, std. dev.: 0.0091) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (4.4433 => 4.6136, std. dev.: 0.0056) MultiSource/Benchmarks/McCat/18-imp/imp: 3.73% (0.3220 => 0.3340, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.71% (0.2995 => 0.3106, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.36% (2.1791 => 2.2524, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.36% (0.4791 => 0.4952, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.36% (1.2292 => 1.2705, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.28% (1.1333 => 1.1705, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4113 => 0.4247, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.16% (4.9865 => 5.1439, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.12% (0.3755 => 0.3872, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 2.95% (8.4961 => 8.7464, std. dev.: 0.0116) MultiSource/Applications/d/make_dparser: 2.94% (3.1889 => 3.2828, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.94% (0.6283 => 0.6468, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.90% (0.6135 => 0.6313, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 2.77% (6.5754 => 6.7578, std. dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.71% (0.8698 => 0.8934, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.61% (14.5298 => 14.9089, std. dev.: 0.0133) MultiSource/Applications/JM/lencod/lencod: 2.53% (14.8535 => 15.2292, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.39% (3.2742 => 3.3524, std. dev.: 0.0179) MultiSource/Applications/sqlite3/sqlite3: 2.37% (16.2614 => 16.6476, std. dev.: 0.0237) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.31% (2.1007 => 2.1493, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 2.28% (4.6629 => 4.7692, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.01% (1.5188 => 1.5494, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (0.9108 => 0.9247, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.12% (6.2785 => 6.3490, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5130, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2638, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: 8.05% (1.2998 => 1.4044, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.15% (0.9996 => 1.0511, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7555, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.2619 => 11.7331, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4768, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.62% (1.7688 => 1.8151, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4523, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.53% (1.5089 => 1.5320, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5944, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.47% (4.5928 => 4.6602, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.45% (2.0200 => 2.0492, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6862, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1395, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.44% (22.5627 => 21.1086, std. dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.85% (0.0997 => 0.0819, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1101, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3107, std. dev.: 0.0214) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5832, std. dev.: 0.0147) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9448, std. dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.49% (0.4867 => 0.4746, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -2.40% (0.4533 => 0.4424, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9541, std. dev.: 0.0223) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2390, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5106, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8658, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.31% (2.5254 => 2.4922, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2498, std. dev.: 0.0025) MultiSource/Applications/lua/lua: -1.13% (26.5159 => 26.2159, std. dev.: 0.0102) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 13:39:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 15:39:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120726203914.9C8F72A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2399?compare_to=2394&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2399, Order: 160788, Start Time: 2012-07-26 17:56:13, End Time: 2012-07-26 20:39:36 To: 2394, Order: 160783, Start Time: 2012-07-26 14:44:57, End Time: 2012-07-26 17:28:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (70 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 950 (813 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.12% (1.6715 => 1.6902, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.84% (15.6926 => 16.1377, std. dev.: 0.0774) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.65% (126.3430 => 129.6925, std. dev.: 0.5890) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.95% (2.0896 => 2.1303, std. dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 13.24% (0.3460 => 0.3918, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.15% (0.3446 => 0.3899, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.13% (0.3465 => 0.3920, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.07% (0.3442 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.07% (0.3496 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.99% (0.3488 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.97% (0.3469 => 0.3919, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.65% (0.3643 => 0.4104, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.63% (0.3650 => 0.4111, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.11% (0.3724 => 0.4175, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1620 => 0.1736, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.59% (0.5826 => 0.6210, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.18% (0.5889 => 0.6253, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.09% (1.5932 => 1.6902, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.50% (1.6211 => 1.7102, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.45% (3.5627 => 3.7567, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (0.4994 => 0.5247, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.2014 => 0.2116, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.79% (0.4361 => 0.4570, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.78% (0.5000 => 0.5239, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.77% (1.3152 => 1.3779, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 4.74% (0.7171 => 0.7511, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.67% (0.4029 => 0.4217, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.59% (0.5900 => 0.6171, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.58% (0.3930 => 0.4110, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 4.41% (1.0781 => 1.1256, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.32% (4.2109 => 4.3930, std. dev.: 0.0063) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (2.7292 => 2.8457, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (0.5026 => 0.5240, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.94% (0.2866 => 0.2979, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.76% (0.2736 => 0.2839, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.75% (1.9694 => 2.0432, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.58% (1.9966 => 2.0680, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.50% (0.3890 => 0.4026, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 3.45% (2.1013 => 2.1738, std. dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 3.18% (5.5417 => 5.7178, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.13% (0.4658 => 0.4804, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 3.08% (2.1653 => 2.2320, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.00% (0.4139 => 0.4263, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.97% (0.3903 => 0.4019, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (4.4195 => 4.5488, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 2.90% (4.6177 => 4.7518, std. dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 2.86% (1.8794 => 1.9331, std. dev.: 0.0073) MultiSource/Applications/treecc/treecc: 2.76% (0.7875 => 0.8092, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.58% (2.0673 => 2.1206, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 2.56% (0.9909 => 1.0163, std. dev.: 0.0041) MultiSource/Applications/lua/lua: 2.49% (1.4269 => 1.4624, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 2.45% (0.5546 => 0.5682, std. dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 2.40% (23.5202 => 24.0850, std. dev.: 0.0116) MultiSource/Applications/hbd/hbd: 2.21% (0.9697 => 0.9911, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.03% (0.6634 => 0.6769, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.16% (2.0346 => 2.0582, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (2.5769 => 2.9635, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6812, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 4.84% (1.8057 => 1.8931, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1668, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.32% (2.0820 => 2.1303, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6387, std. dev.: 0.0281) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1997, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4929, std. dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5904, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2259, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.72% (2.4764 => 2.3844, std. dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: -1.96% (11.9555 => 11.7214, std. dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.03% (25.4195 => 16.5156, std. dev.: 0.0265) SingleSource/Benchmarks/Shootout-C++/ary2: -8.33% (0.2402 => 0.2202, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7981, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: -6.38% (17.2379 => 16.1377, std. dev.: 0.0774) SingleSource/Benchmarks/Shootout-C++/moments: -3.97% (0.4438 => 0.4262, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -3.46% (14.0481 => 13.5620, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5734, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 14:15:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 16:15:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120726211546.A154F2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2400?compare_to=2397&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2400, Order: 160796, Start Time: 2012-07-26 20:01:45, End Time: 2012-07-26 21:16:08 To: 2397, Order: 160791, Start Time: 2012-07-26 18:19:23, End Time: 2012-07-26 19:33:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (148 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.10% (2.0176 => 2.3020, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.87% (0.3578 => 0.3931, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.66% (0.3601 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.66% (0.3623 => 0.3973, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.63% (0.3646 => 0.3997, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.56% (0.3663 => 0.4013, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.50% (0.5818 => 0.6371, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.48% (0.3650 => 0.3996, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.47% (0.3789 => 0.4148, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.43% (0.3914 => 0.4283, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.34% (0.5748 => 0.6285, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 9.21% (0.3940 => 0.4303, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.17% (0.4003 => 0.4370, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.78% (0.7061 => 0.7681, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.44% (0.7710 => 0.8284, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.39% (1.3693 => 1.4705, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.03% (3.9660 => 4.2447, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.2596 => 0.2777, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.2721 => 0.2909, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5265 => 0.5619, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 6.61% (0.7038 => 0.7503, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 6.50% (0.4062 => 0.4326, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.42% (0.4328 => 0.4606, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.82% (0.4379 => 0.4634, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.68% (0.6959 => 0.7354, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.67% (0.4390 => 0.4639, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 5.65% (0.2781 => 0.2938, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.62% (1.2193 => 1.2878, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.54% (0.2726 => 0.2877, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3022 => 0.3189, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.52% (0.2937 => 0.3099, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.47% (0.2760 => 0.2911, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.46% (0.2782 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.2607 => 0.2749, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.42% (0.2140 => 0.2256, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2690 => 0.2835, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.39% (0.3489 => 0.3677, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.36% (0.9199 => 0.9692, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.35% (0.2655 => 0.2797, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.32% (0.2765 => 0.2912, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.29% (0.2628 => 0.2767, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.28% (0.3580 => 0.3769, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.26% (1.9828 => 2.0870, std. dev.: 0.0108) MultiSource/Applications/SPASS/SPASS: 5.24% (13.8202 => 14.5438, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.24% (0.5577 => 0.5869, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 5.21% (0.3107 => 0.3269, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.18% (0.3899 => 0.4101, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.16% (0.3485 => 0.3665, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.14% (0.2761 => 0.2903, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2696 => 0.2833, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.08% (0.2127 => 0.2235, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.05% (0.2988 => 0.3139, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.01% (1.3819 => 1.4511, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 4.99% (0.2243 => 0.2355, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 4.92% (0.3192 => 0.3349, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.90% (1.3813 => 1.4490, std. dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 4.90% (16.6129 => 17.4262, std. dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.89% (7.2180 => 7.5710, std. dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.80% (1.4563 => 1.5262, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.77% (13.2842 => 13.9181, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/moments: 4.76% (0.3868 => 0.4052, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.71% (1.1364 => 1.1899, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 4.69% (0.7506 => 0.7858, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.68% (0.5637 => 0.5901, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.68% (0.8310 => 0.8699, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists1: 4.67% (0.3534 => 0.3699, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.66% (1.1061 => 1.1576, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.65% (0.3246 => 0.3397, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.56% (0.4016 => 0.4199, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.54% (1.3245 => 1.3846, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 4.51% (3.8646 => 4.0388, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.3756 => 0.3925, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.46% (0.3293 => 0.3440, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.45% (0.7460 => 0.7792, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 4.44% (1.9270 => 2.0126, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.35% (1.0594 => 1.1055, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.16% (3.6692 => 3.8220, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.14% (4.3801 => 4.5614, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.06% (4.4433 => 4.6236, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.2945 => 0.3060, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.84% (0.2995 => 0.3110, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.72% (1.2292 => 1.2749, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 3.66% (2.1791 => 2.2589, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3755 => 0.3883, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.40% (0.4791 => 0.4954, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.36% (1.1333 => 1.1714, std. dev.: 0.0050) MultiSource/Applications/d/make_dparser: 3.35% (3.1889 => 3.2957, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (4.9865 => 5.1508, std. dev.: 0.0063) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4113 => 0.4247, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.08% (0.6135 => 0.6324, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (8.4961 => 8.7543, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.95% (0.8698 => 0.8955, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.91% (6.5754 => 6.7669, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.88% (0.6283 => 0.6464, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.5298 => 14.9420, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 2.78% (14.8535 => 15.2667, std. dev.: 0.0132) MultiSource/Applications/sqlite3/sqlite3: 2.61% (16.2614 => 16.6856, std. dev.: 0.0322) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (2.1007 => 2.1509, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.37% (3.2742 => 3.3518, std. dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 2.33% (4.6629 => 4.7715, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.06% (1.5188 => 1.5501, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.54% (0.9108 => 0.9248, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.40% (1.0313 => 1.0457, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.31% (6.2785 => 6.3608, std. dev.: 0.0062) MultiSource/Applications/lua/lua: 1.25% (3.7467 => 3.7936, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 25.30% (1.8175 => 2.2773, std. dev.: 0.0391) SingleSource/Benchmarks/Misc/mandel-2: 7.88% (1.2998 => 1.4022, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.09% (0.9996 => 1.0505, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 4.47% (7.4271 => 7.7592, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.2619 => 11.7334, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4780, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.78% (1.7688 => 1.8179, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5089 => 1.5324, std. dev.: 0.0033) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 1.50% (4.5928 => 4.6615, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1682, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (3.1071 => 3.1388, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.5627 => 21.1490, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.95% (0.0997 => 0.0828, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -9.74% (1.2308 => 1.1109, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0026) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5853, std. dev.: 0.0209) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9451, std. dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -2.32% (0.4533 => 0.4428, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5044, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.88% (20.3410 => 19.9589, std. dev.: 0.0440) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2388, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.79% (0.6589 => 0.6471, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4929, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2515, std. dev.: 0.0039) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2233, std. dev.: 0.0162) MultiSource/Applications/lua/lua: -1.04% (26.5159 => 26.2402, std. dev.: 0.0173) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 14:28:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 16:28:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120726212848.007352A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2401?compare_to=2398&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2401, Order: 160796, Start Time: 2012-07-26 20:10:18, End Time: 2012-07-26 21:29:10 To: 2398, Order: 160791, Start Time: 2012-07-26 18:23:36, End Time: 2012-07-26 19:42:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (83 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (766 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 3.12% (51.4773 => 53.0843, std. dev.: 0.0141) MultiSource/Benchmarks/PAQ8p/paq8p: 1.18% (13.8421 => 14.0060, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.21% (55.3948 => 56.6200, std. dev.: 0.0572) SingleSource/Benchmarks/Misc/mandel-2: 2.10% (1.4124 => 1.4420, std. dev.: 0.0041) SingleSource/Regression/C/uint64_to_float: 1.93% (0.5346 => 0.5449, std. dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.10% (10.3673 => 14.0060, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/trivial-interface: 12.78% (0.3473 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.50% (0.3497 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.37% (0.3516 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.36% (0.3543 => 0.3981, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.33% (0.3543 => 0.3980, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: 12.30% (0.3561 => 0.3999, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.13% (1.1194 => 1.2552, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 11.99% (0.3694 => 0.4137, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.78% (0.3828 => 0.4279, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: 11.48% (0.3927 => 0.4378, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.06% (0.1622 => 0.1769, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.80% (2.2022 => 2.3961, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.97% (1.7609 => 1.9012, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.76% (0.1892 => 0.2001, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.69% (0.5925 => 0.6262, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.64% (0.6030 => 0.6370, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 5.60% (10.4361 => 11.0204, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.04% (0.4879 => 0.5125, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.4615 => 0.4846, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 4.88% (0.3282 => 0.3442, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.87% (7.0540 => 7.3978, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference: 4.48% (0.7326 => 0.7654, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 4.19% (9.4845 => 9.8818, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.16% (0.7433 => 0.7742, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.01% (0.8172 => 0.8500, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.9449 => 5.1418, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.0018 => 5.1986, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.57% (4.2646 => 4.4168, std. dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.50% (0.5860 => 0.6065, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.49% (8.1363 => 8.4201, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 3.36% (0.3423 => 0.3538, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.15% (0.7835 => 0.8082, std. dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 3.14% (5.7591 => 5.9398, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.11% (1.3050 => 1.3456, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.05% (1.1861 => 1.2223, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (14.3668 => 14.7997, std. dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.73% (0.8067 => 0.8287, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.71% (1.1642 => 1.1958, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.65% (0.4636 => 0.4759, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.64% (3.3354 => 3.4236, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.56% (2.0273 => 2.0793, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 2.56% (1.5603 => 1.6002, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.51% (0.5105 => 0.5233, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.5415 => 1.5785, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.27% (3.8723 => 3.9602, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.24% (0.9765 => 0.9984, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.11% (0.5981 => 0.6107, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.2024 => 2.2472, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.00% (1.5859 => 1.6176, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6450 => 0.6574, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6675 => 0.6797, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.83% (1.4186 => 1.4445, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 1.73% (0.8921 => 0.9075, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 1.67% (0.6456 => 0.6564, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.61% (17.1811 => 17.4582, std. dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.57% (2.0665 => 2.0989, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.41% (1.1840 => 1.2007, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.26% (2.2969 => 2.3259, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.13% (1.2842 => 1.2987, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.07% (1.0722 => 1.0837, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9741, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.45% (4.2280 => 4.3739, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.25% (3.6395 => 3.7577, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2151, std. dev.: 0.0004) MultiSource/Applications/aha/aha: 1.43% (3.1595 => 3.2046, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8043, std. dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.38% (2.6546 => 2.6912, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2266, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/oourafft: 1.05% (6.6465 => 6.7164, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.15% (5.2763 => 3.1579, std. dev.: 0.0091) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.03% (5.3855 => 3.7144, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.39% (5.3526 => 3.7257, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.80% (2.9384 => 2.5623, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -10.05% (22.1758 => 19.9470, std. dev.: 0.0122) SingleSource/UnitTests/Vector/constpool: -2.00% (54.1659 => 53.0843, std. dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.73% (0.0998 => 0.0841, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.55% (1.2373 => 1.1068, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -6.20% (1.5373 => 1.4420, std. dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -4.63% (1.9577 => 1.8671, std. dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5957, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4804, std. dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.06% (8.1563 => 7.9066, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4243, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0002, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3295, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8086, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 15:58:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 17:58:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120726225800.A1FDF2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2402?compare_to=2400&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2402, Order: 160813, Start Time: 2012-07-26 21:44:03, End Time: 2012-07-26 22:58:21 To: 2400, Order: 160796, Start Time: 2012-07-26 20:01:45, End Time: 2012-07-26 21:16:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (144 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.01% (2.0176 => 2.3003, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.07% (0.5818 => 0.6404, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.00% (0.5748 => 0.6323, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.97% (0.7061 => 0.7765, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.78% (0.3578 => 0.3928, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 9.66% (0.3601 => 0.3949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.60% (0.3646 => 0.3996, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.56% (0.3650 => 0.3999, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 9.45% (0.3663 => 0.4009, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 9.44% (0.3623 => 0.3965, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.34% (0.3789 => 0.4143, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.17% (0.3914 => 0.4273, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.17% (0.4003 => 0.4370, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.06% (0.3940 => 0.4297, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 7.33% (1.3693 => 1.4697, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.09% (0.4062 => 0.4350, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (3.9660 => 4.2296, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.59% (0.7710 => 0.8218, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.2721 => 0.2898, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.47% (0.2596 => 0.2764, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.36% (0.2781 => 0.2958, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.35% (0.7038 => 0.7485, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.29% (0.5265 => 0.5596, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.22% (0.2765 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.15% (0.2782 => 0.2953, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.10% (0.2607 => 0.2766, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 6.02% (0.2726 => 0.2890, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2655 => 0.2814, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 5.99% (0.2690 => 0.2851, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 5.91% (0.2760 => 0.2923, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.89% (0.2937 => 0.3110, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.3107 => 0.3290, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.76% (0.2761 => 0.2920, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: 5.75% (0.3149 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.70% (1.9828 => 2.0959, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.66% (0.2966 => 0.3134, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.61% (0.3580 => 0.3781, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.60% (0.2696 => 0.2847, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.57% (0.4379 => 0.4623, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3489 => 0.3683, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.56% (0.2988 => 0.3154, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.3192 => 0.3367, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.44% (0.3453 => 0.3641, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.43% (0.6959 => 0.7337, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.41% (1.2193 => 1.2853, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.41% (0.3899 => 0.4110, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.40% (0.5577 => 0.5878, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.39% (0.3485 => 0.3673, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.32% (0.2914 => 0.3069, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: 5.13% (0.3293 => 0.3462, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.06% (13.8202 => 14.5193, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists1: 5.04% (0.3534 => 0.3712, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4390 => 0.4607, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.88% (0.9199 => 0.9648, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (0.3756 => 0.3938, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 4.72% (16.6129 => 17.3969, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.72% (1.3819 => 1.4471, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.72% (0.7506 => 0.7860, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.71% (1.3813 => 1.4464, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 4.71% (0.3868 => 0.4050, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.56% (1.4563 => 1.5227, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.55% (7.2180 => 7.5463, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.47% (13.2842 => 13.8783, std. dev.: 0.0172) MultiSource/Applications/Burg/burg: 4.45% (1.1061 => 1.1553, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.2945 => 0.3075, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.33% (1.1364 => 1.1856, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.29% (0.5637 => 0.5879, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.19% (0.3246 => 0.3382, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.19% (3.8646 => 4.0265, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.3245 => 1.3795, std. dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 4.14% (1.0594 => 1.1033, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 4.03% (0.8310 => 0.8645, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.02% (0.7460 => 0.7760, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.96% (1.2292 => 1.2779, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.95% (1.9270 => 2.0032, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.3801 => 4.5493, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.81% (4.4433 => 4.6128, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3220 => 0.3341, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 3.74% (0.2995 => 0.3107, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.66% (3.6692 => 3.8035, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3755 => 0.3890, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.39% (2.1791 => 2.2529, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.38% (0.4791 => 0.4953, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.21% (0.8698 => 0.8977, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.18% (1.1333 => 1.1693, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.12% (4.9865 => 5.1423, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.99% (0.6283 => 0.6471, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.96% (3.1889 => 3.2834, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 2.92% (8.4961 => 8.7441, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 2.92% (0.4113 => 0.4233, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.82% (0.6135 => 0.6308, std. dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (6.5754 => 6.7561, std. dev.: 0.0141) MultiSource/Applications/ClamAV/clamscan: 2.59% (14.5298 => 14.9061, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.57% (2.1007 => 2.1547, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 2.55% (14.8535 => 15.2321, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (3.2742 => 3.3548, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 2.46% (16.2614 => 16.6611, std. dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.39% (1.5188 => 1.5551, std. dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 2.21% (4.6629 => 4.7659, std. dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/bigfib: 1.74% (0.6250 => 0.6359, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.37% (0.9108 => 0.9233, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.31% (1.0313 => 1.0448, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.08% (6.2785 => 6.3460, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fbench: 24.97% (1.8175 => 2.2713, std. dev.: 0.0320) SingleSource/Benchmarks/Misc/mandel-2: 8.19% (1.2998 => 1.4062, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.15% (0.9996 => 1.0511, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7555, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.2619 => 11.7317, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4776, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8166, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5928 => 4.6631, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.5089 => 1.5318, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5950, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5113, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0095) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1403, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 1.00% (1.1560 => 1.1676, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.5627 => 21.1310, std. dev.: 0.0174) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.88% (0.3511 => 0.3410, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.75% (0.0997 => 0.0840, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.74% (1.2308 => 1.0986, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std. dev.: 0.0079) SingleSource/UnitTests/Vector/multiplies: -4.97% (2.6470 => 2.5154, std. dev.: 0.0042) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9189, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5931, std. dev.: 0.0151) MultiSource/Applications/spiff/spiff: -2.56% (3.0263 => 2.9487, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.53% (0.4867 => 0.4744, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: -2.43% (0.4533 => 0.4423, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2252, std. dev.: 0.0125) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5028, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9738, std. dev.: 0.0780) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.34% (5.3167 => 5.2452, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8657, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4927, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.02% (26.5159 => 26.2464, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8496, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 16:17:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 18:17:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120726231708.A30B42A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2403?compare_to=2401&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2403, Order: 160814, Start Time: 2012-07-26 21:58:42, End Time: 2012-07-26 23:17:31 To: 2401, Order: 160796, Start Time: 2012-07-26 20:10:18, End Time: 2012-07-26 21:29:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (83 on baseline) Performance Improvements: 2 (25 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/power/power: 5.95% (1.1253 => 1.1923, std. dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.74% (79.1174 => 80.4923, std. dev.: 0.2514) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.39% (53.0843 => 51.2858, std. dev.: 0.0238) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (14.0060 => 13.8592, std. dev.: 0.0097) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.68% (10.3673 => 13.8592, std. dev.: 0.0097) SingleSource/UnitTests/ObjC/trivial-interface: 12.93% (0.3473 => 0.3922, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: 12.64% (0.3497 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.56% (0.3543 => 0.3988, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.50% (0.3543 => 0.3986, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.46% (0.3516 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.44% (0.3561 => 0.4004, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.13% (0.3694 => 0.4142, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 11.70% (0.3828 => 0.4276, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.63% (0.3886 => 0.4338, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.59% (0.3927 => 0.4382, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2484, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.37% (2.2022 => 2.3865, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.88% (1.7609 => 1.8996, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.33% (0.5925 => 0.6300, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 6.24% (0.6030 => 0.6406, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.67% (0.3177 => 0.3357, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 5.23% (10.4361 => 10.9822, std. dev.: 0.0163) SingleSource/UnitTests/ObjC++/property-reference: 5.19% (0.7326 => 0.7706, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.81% (7.0540 => 7.3930, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.75% (0.4615 => 0.4834, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.61% (0.4879 => 0.5104, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 4.20% (0.3282 => 0.3420, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.11% (0.8172 => 0.8508, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.09% (0.7433 => 0.7737, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (9.4845 => 9.8600, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.95% (4.9449 => 5.1402, std. dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.0018 => 5.1949, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.73% (0.5569 => 0.5777, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.72% (0.5860 => 0.6078, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.56% (4.2646 => 4.4165, std. dev.: 0.0111) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.29% (8.1363 => 8.4042, std. dev.: 0.0062) MultiSource/Benchmarks/McCat/18-imp/imp: 3.24% (0.3423 => 0.3534, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.08% (14.3668 => 14.8097, std. dev.: 0.0052) MultiSource/Applications/spiff/spiff: 3.08% (0.7835 => 0.8076, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.98% (1.3050 => 1.3439, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.96% (1.1861 => 1.2212, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.79% (5.7591 => 5.9197, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 2.69% (3.3354 => 3.4252, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.64% (2.0273 => 2.0808, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 2.64% (1.1642 => 1.1949, std. dev.: 0.0032) MultiSource/Applications/hbd/hbd: 2.59% (1.5603 => 1.6007, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.52% (1.5415 => 1.5803, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.45% (0.5105 => 0.5230, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 2.37% (0.4299 => 0.4401, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.37% (0.8067 => 0.8258, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 2.29% (3.8723 => 3.9609, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.13% (0.9765 => 0.9973, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.11% (2.2024 => 2.2489, std. dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.99% (1.5859 => 1.6175, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 1.95% (0.8921 => 0.9095, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.94% (0.6450 => 0.6575, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5981 => 0.6092, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.80% (0.6675 => 0.6795, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.73% (17.1811 => 17.4777, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.69% (1.4186 => 1.4426, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 1.69% (0.6456 => 0.6565, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.54% (2.0665 => 2.0983, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.42% (1.1840 => 1.2008, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.25% (2.2969 => 2.3255, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.05% (1.0722 => 1.0835, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.05% (1.2842 => 1.2977, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 5.73% (1.1277 => 1.1923, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.46% (4.2280 => 4.3744, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7526, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5086 => 1.5343, std. dev.: 0.0004) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2039, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.38% (2.6546 => 2.6913, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8043, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2323, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/oourafft: 1.06% (6.6465 => 6.7168, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.45% (5.2763 => 3.1420, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.29% (5.3855 => 3.7005, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.76% (5.3526 => 3.7062, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.44% (2.9384 => 2.5434, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.17% (22.1758 => 19.9208, std. dev.: 0.0121) SingleSource/UnitTests/Vector/constpool: -5.32% (54.1659 => 51.2858, std. dev.: 0.0238) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.03% (3.8922 => 3.8522, std. dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.00% (1.2373 => 1.1012, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel-2: -8.66% (1.5373 => 1.4042, std. dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -4.88% (1.9577 => 1.8621, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5961, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4786, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4159, std. dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.02% (8.1563 => 7.9101, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0007, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3194, std. dev.: 0.0039) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.34% (1.8329 => 1.8083, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 16:50:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 18:50:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120726235017.E4E522A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2404?compare_to=2399&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2404, Order: 160810, Start Time: 2012-07-26 21:07:31, End Time: 2012-07-26 23:50:40 To: 2399, Order: 160788, Start Time: 2012-07-26 17:56:13, End Time: 2012-07-26 20:39:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (77 on baseline) Performance Improvements: 1 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (806 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.30% (54.0902 => 54.7954, std. dev.: 0.0517) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.18% (1.6902 => 1.6702, std. dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.97% (0.3465 => 0.3949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.90% (0.3460 => 0.3941, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3446 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.86% (0.3442 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.84% (0.3496 => 0.3980, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.79% (0.3488 => 0.3969, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 13.72% (0.3469 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.34% (0.3650 => 0.4137, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: 13.29% (0.3643 => 0.4127, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.76% (0.3724 => 0.4199, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.71% (0.5826 => 0.6275, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.52% (0.5889 => 0.6332, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.1620 => 0.1740, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.01% (3.5627 => 3.7768, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (1.6211 => 1.7181, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 5.83% (0.7171 => 0.7589, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.36% (0.2014 => 0.2122, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.30% (0.3792 => 0.3993, std. dev.: 0.0076) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.5900 => 0.6207, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.18% (0.4361 => 0.4587, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.09% (1.3152 => 1.3822, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (0.4994 => 0.5247, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.06% (0.3930 => 0.4129, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.96% (0.4029 => 0.4229, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.85% (2.7292 => 2.8617, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 4.83% (1.5932 => 1.6702, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.78% (0.5026 => 0.5266, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.76% (0.5000 => 0.5238, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 4.53% (4.2109 => 4.4015, std. dev.: 0.0100) MultiSource/Applications/d/make_dparser: 4.49% (1.0781 => 1.1265, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.33% (0.2866 => 0.2990, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.13% (0.2736 => 0.2849, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (1.9966 => 2.0760, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (1.9694 => 2.0470, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 3.82% (2.1013 => 2.1815, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.73% (0.3890 => 0.4035, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (0.4658 => 0.4831, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.66% (5.5417 => 5.7447, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 3.56% (2.1653 => 2.2423, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.56% (4.6177 => 4.7819, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.41% (4.4195 => 4.5704, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.3903 => 0.4033, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (2.0673 => 2.1340, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.19% (0.9909 => 1.0225, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (1.8794 => 1.9393, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.03% (0.7875 => 0.8114, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.00% (0.3362 => 0.3463, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.92% (0.4139 => 0.4260, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.89% (0.9697 => 0.9977, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 2.85% (0.5546 => 0.5704, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (0.3625 => 0.3725, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.75% (1.4269 => 1.4662, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 2.74% (0.3726 => 0.3828, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4146 => 0.4252, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.46% (0.6634 => 0.6797, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.23% (23.5202 => 24.0451, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.79% (0.6435 => 0.6550, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.35% (2.0346 => 2.0620, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.06% (0.5917 => 0.6690, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.98% (0.2122 => 0.2249, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6682, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-2: 5.02% (1.8057 => 1.8963, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1667, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6747, std. dev.: 0.0462) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1941, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4584, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5005, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5919, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2250, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5124, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.01% (2.4764 => 2.4019, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -1.43% (11.9555 => 11.7849, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.05% (25.4195 => 16.5097, std. dev.: 0.0229) SingleSource/Benchmarks/Dhrystone/fldry: -8.94% (17.2379 => 15.6966, std. dev.: 0.2862) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9778, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.57% (35.5013 => 32.8130, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary2: -6.83% (0.2402 => 0.2238, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: -3.90% (0.4438 => 0.4265, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -3.50% (14.0481 => 13.5568, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5800, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 19:38:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 21:38:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120727023843.110F22A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2405?compare_to=2403&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2405, Order: 160845, Start Time: 2012-07-27 01:20:28, End Time: 2012-07-27 02:39:04 To: 2403, Order: 160814, Start Time: 2012-07-26 21:58:42, End Time: 2012-07-26 23:17:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (81 on baseline) Performance Improvements: 9 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 925 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -10.27% (51.2858 => 46.0202, std. dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4209, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: -6.37% (1.1923 => 1.1164, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -5.12% (1.5692 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5858 => 1.5055, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: -4.95% (1.8529 => 1.7611, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8341 => 8.6803, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.74% (9.5832 => 9.4166, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.69% (1.3587 => 1.3357, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.24% (10.3673 => 13.9167, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/trivial-interface: 12.73% (0.3473 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.50% (0.3497 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.40% (0.3516 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.36% (0.3543 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.33% (0.3543 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.30% (0.3561 => 0.3999, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/for-in: 11.99% (0.3694 => 0.4137, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 11.45% (0.3886 => 0.4331, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.38% (0.3927 => 0.4374, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.24% (1.1194 => 1.2452, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 8.38% (0.1622 => 0.1758, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.32% (2.2022 => 2.3854, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.34% (1.7609 => 1.8902, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.04% (0.5925 => 0.6283, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.97% (0.6030 => 0.6390, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.3177 => 0.3358, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 5.07% (10.4361 => 10.9648, std. dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.96% (0.4615 => 0.4844, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 4.79% (0.7326 => 0.7677, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.73% (7.0540 => 7.3874, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.61% (0.4879 => 0.5104, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.20% (4.9449 => 5.1524, std. dev.: 0.0068) MultiSource/Applications/lambda-0_1_3/lambda: 4.16% (0.7433 => 0.7742, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (9.4845 => 9.8722, std. dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (5.0018 => 5.2029, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.98% (0.8172 => 0.8497, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.74% (0.2700 => 0.2801, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.73% (0.5569 => 0.5777, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.70% (4.2646 => 4.4223, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.35% (8.1363 => 8.4091, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.30% (14.3668 => 14.8411, std. dev.: 0.0157) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.25% (5.7591 => 5.9464, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.23% (0.7835 => 0.8088, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.13% (1.1861 => 1.2232, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.8067 => 0.8316, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.02% (1.3050 => 1.3444, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 2.95% (0.3387 => 0.3487, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.89% (1.5415 => 1.5860, std. dev.: 0.0088) MultiSource/Applications/Burg/burg: 2.83% (1.1642 => 1.1972, std. dev.: 0.0069) MultiSource/Applications/d/make_dparser: 2.82% (3.3354 => 3.4296, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 2.70% (2.0273 => 2.0820, std. dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.67% (0.4636 => 0.4760, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.54% (1.5603 => 1.6000, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.37% (3.8723 => 3.9641, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.28% (2.2024 => 2.2527, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (0.5105 => 0.5219, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.19% (0.9765 => 0.9979, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5981 => 0.6106, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.04% (1.5859 => 1.6183, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.98% (0.6450 => 0.6578, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.4186 => 1.4459, std. dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 1.87% (17.1811 => 17.5024, std. dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.80% (0.6675 => 0.6795, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 1.79% (0.8921 => 0.9081, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.38% (2.2969 => 2.3285, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.21% (1.0722 => 1.0852, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.15% (2.0665 => 2.0902, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9740, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.06% (4.2280 => 4.3995, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.00% (3.6395 => 3.7488, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (1.5086 => 1.5362, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.68% (3.1578 => 3.2110, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8322, std. dev.: 0.0014) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2307, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3373, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.49% (0.8651 => 0.1688, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.55% (5.2763 => 3.1369, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.34% (5.3855 => 3.6978, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.66% (5.3526 => 3.7117, std. dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -15.04% (54.1659 => 46.0202, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.45% (2.9384 => 2.5433, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -10.18% (22.1758 => 19.9172, std. dev.: 0.0263) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4209, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -11.02% (1.2373 => 1.1010, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel-2: -8.90% (1.5373 => 1.4005, std. dev.: 0.0241) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -4.67% (1.9577 => 1.8662, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4816, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.05% (8.1563 => 7.9077, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4170, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9987, std. dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4808 => 0.4690, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.76% (12.5348 => 12.3143, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.54% (9.5636 => 9.4166, std. dev.: 0.0077) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.38% (1.8329 => 1.8076, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -1.02% (3.2827 => 3.2493, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 19:38:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 21:38:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120727023856.DD8012A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2406?compare_to=2402&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2406, Order: 160845, Start Time: 2012-07-27 01:25:09, End Time: 2012-07-27 02:39:18 To: 2402, Order: 160813, Start Time: 2012-07-26 21:44:03, End Time: 2012-07-26 22:58:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (147 on baseline) Performance Improvements: 2 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.55% (0.5325 => 0.5461, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -20.39% (25.8750 => 20.5994, std. dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3482 => 7.2182, std. dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.69% (2.0176 => 2.3140, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5818 => 0.6360, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.31% (0.3578 => 0.3911, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 9.28% (0.7061 => 0.7716, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 9.16% (0.3646 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.12% (0.3663 => 0.3997, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.08% (0.3789 => 0.4133, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.05% (0.3601 => 0.3927, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 8.94% (0.5748 => 0.6262, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.93% (0.3650 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.92% (0.3623 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.79% (0.3914 => 0.4258, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 8.63% (0.3940 => 0.4280, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.57% (0.4003 => 0.4346, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.11% (1.3693 => 1.4666, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.07% (0.5265 => 0.5637, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.02% (0.7710 => 0.8251, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (3.9660 => 4.2428, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2596 => 0.2776, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.42% (0.7038 => 0.7490, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.29% (0.3022 => 0.3212, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 5.96% (0.4328 => 0.4586, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.87% (0.4379 => 0.4636, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.83% (0.2760 => 0.2921, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.81% (1.2193 => 1.2901, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.68% (0.6959 => 0.7354, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.56% (0.5577 => 0.5887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.44% (0.4062 => 0.4283, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.39% (1.4563 => 1.5348, std. dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.26% (0.4390 => 0.4621, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.9199 => 0.9680, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 5.21% (0.2781 => 0.2926, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.19% (13.8202 => 14.5369, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/matrix: 5.12% (0.2988 => 0.3141, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.96% (0.2782 => 0.2920, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.95% (0.3899 => 0.4092, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 4.93% (16.6129 => 17.4322, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.93% (0.3489 => 0.3661, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.91% (0.2690 => 0.2822, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.87% (0.2607 => 0.2734, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.86% (0.2966 => 0.3110, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2726 => 0.2858, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 4.84% (0.3453 => 0.3620, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.84% (0.7506 => 0.7869, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.83% (0.3580 => 0.3753, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.82% (0.3485 => 0.3653, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.80% (0.2937 => 0.3078, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.79% (1.1061 => 1.1591, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.77% (13.2842 => 13.9177, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.77% (1.9828 => 2.0773, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 4.76% (0.2628 => 0.2753, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.73% (0.3149 => 0.3298, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3107 => 0.3254, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.73% (0.4016 => 0.4206, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.72% (7.2180 => 7.5590, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 4.69% (1.0594 => 1.1091, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 4.63% (0.8310 => 0.8695, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.63% (1.1364 => 1.1890, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 4.60% (0.2761 => 0.2888, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.60% (3.8646 => 4.0422, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.56% (0.5637 => 0.5894, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.3293 => 0.3443, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.54% (1.3819 => 1.4446, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.53% (1.3245 => 1.3845, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.53% (0.2696 => 0.2818, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.51% (1.9270 => 2.0139, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.47% (0.3246 => 0.3391, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.45% (0.3192 => 0.3334, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.29% (1.3813 => 1.4406, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (0.3756 => 0.3915, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (0.7460 => 0.7772, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 4.13% (0.3534 => 0.3680, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (4.3801 => 4.5606, std. dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.09% (3.6692 => 3.8192, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.01% (0.3868 => 0.4023, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (4.4433 => 4.6211, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.94% (0.3220 => 0.3347, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.80% (2.1791 => 2.2619, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.80% (0.4791 => 0.4973, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.46% (1.1333 => 1.1725, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 3.40% (0.4113 => 0.4253, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.39% (1.2292 => 1.2709, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.31% (4.9865 => 5.1514, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 3.22% (3.1889 => 3.2915, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.18% (0.6283 => 0.6483, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 3.16% (8.4961 => 8.7648, std. dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.15% (0.6135 => 0.6328, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 3.01% (6.5754 => 6.7732, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3755 => 0.3864, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.90% (14.8535 => 15.2838, std. dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.83% (0.8698 => 0.8944, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.71% (2.1007 => 2.1577, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.69% (16.2614 => 16.6994, std. dev.: 0.0197) MultiSource/Applications/ClamAV/clamscan: 2.64% (14.5298 => 14.9127, std. dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.62% (3.2742 => 3.3599, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.47% (1.5188 => 1.5563, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.08% (4.6629 => 4.7597, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.54% (0.9108 => 0.9248, std. dev.: 0.0036) MultiSource/Applications/lemon/lemon: 1.52% (1.0313 => 1.0470, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.20% (3.7467 => 3.7917, std. dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.09% (6.2785 => 6.3468, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/fbench: 24.57% (1.8175 => 2.2641, std. dev.: 0.0516) SingleSource/Benchmarks/Misc/mandel-2: 7.60% (1.2998 => 1.3986, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.19% (0.9996 => 1.0515, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7553, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7056, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4771, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.74% (1.7688 => 1.8173, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.27% (1.0310 => 1.0544, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.45% (4.5928 => 4.6592, std. dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.33% (1.9290 => 1.9547, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 1.14% (3.7731 => 3.8160, std. dev.: 0.0070) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1406, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.18% (22.5627 => 21.1677, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.45% (0.0997 => 0.0823, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -10.74% (1.2308 => 1.0986, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.76% (1.3780 => 1.3124, std. dev.: 0.0116) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9198, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.62% (3.0263 => 2.9469, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6038, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.24% (6.3560 => 6.2136, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9061, std. dev.: 0.0426) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5014, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3305 => 7.2182, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8626, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2472, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2306, std. dev.: 0.0346) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 21:03:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 23:03:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120727040338.7C8D42A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2407?compare_to=2404&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2407, Order: 160845, Start Time: 2012-07-27 01:20:30, End Time: 2012-07-27 04:04:01 To: 2404, Order: 160810, Start Time: 2012-07-26 21:07:31, End Time: 2012-07-26 23:50:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (69 on baseline) Performance Improvements: 4 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 950 (813 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: -1.72% (0.6332 => 0.6223, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -1.72% (0.6275 => 0.6167, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -1.55% (0.7589 => 0.7471, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/build2: -3.89% (11.2308 => 10.7939, std. dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3446 => 0.3870, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.27% (0.3465 => 0.3890, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/for-in: 12.24% (0.3496 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3460 => 0.3883, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.22% (0.3469 => 0.3893, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.20% (0.3442 => 0.3862, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.10% (0.3488 => 0.3910, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.83% (0.3643 => 0.4074, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 11.70% (0.3650 => 0.4077, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.36% (0.3724 => 0.4147, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.85% (0.5826 => 0.6167, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 5.67% (0.5889 => 0.6223, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.48% (3.5627 => 3.7578, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.45% (1.6211 => 1.7094, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.18% (1.5932 => 1.6758, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.14% (0.4361 => 0.4585, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.74% (0.5026 => 0.5264, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.71% (1.3152 => 1.3772, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.68% (0.3930 => 0.4114, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.63% (0.4994 => 0.5225, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.53% (0.5900 => 0.6167, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.46% (0.5000 => 0.5223, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.42% (0.4029 => 0.4207, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 4.34% (1.0781 => 1.1249, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.21% (4.2109 => 4.3881, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.18% (0.7171 => 0.7471, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.01% (0.2866 => 0.2981, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.82% (2.7292 => 2.8334, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.67% (5.5417 => 5.7450, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.50% (0.3890 => 0.4026, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (0.4658 => 0.4819, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.44% (2.1013 => 2.1735, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.42% (1.9694 => 2.0368, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.33% (1.9966 => 2.0631, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (4.4195 => 4.5548, std. dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 2.95% (4.6177 => 4.7541, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 2.93% (2.1653 => 2.2288, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.84% (0.3903 => 0.4014, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.83% (0.7875 => 0.8098, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.72% (1.8794 => 1.9305, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.59% (0.4139 => 0.4246, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.56% (0.5546 => 0.5688, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 2.54% (1.4269 => 1.4631, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 2.54% (23.5202 => 24.1166, std. dev.: 0.0149) MultiSource/Applications/hexxagon/hexxagon: 2.52% (0.9909 => 1.0159, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 2.44% (0.6634 => 0.6796, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.40% (2.0673 => 2.1169, std. dev.: 0.0093) MultiSource/Applications/hbd/hbd: 2.38% (0.9697 => 0.9928, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.58% (2.0346 => 2.0668, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9636, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6792, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1686, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 4.55% (1.8057 => 1.8878, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6914, std. dev.: 0.0361) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1958, std. dev.: 0.0446) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4948, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5918, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2236, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5119, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.80% (2.4764 => 2.3822, std. dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: -1.67% (11.9555 => 11.7562, std. dev.: 0.0157) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.05% (25.4195 => 16.5090, std. dev.: 0.0232) SingleSource/Benchmarks/Dhrystone/fldry: -8.76% (17.2379 => 15.7276, std. dev.: 0.2281) SingleSource/Benchmarks/Shootout-C++/ary2: -8.74% (0.2402 => 0.2192, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9742, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7924, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/moments: -3.94% (0.4438 => 0.4263, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7939, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: -3.59% (14.0481 => 13.5441, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5757, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 21:20:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 23:20:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120727042051.65C412A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2408?compare_to=2406&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2408, Order: 160846, Start Time: 2012-07-27 03:07:14, End Time: 2012-07-27 04:21:13 To: 2406, Order: 160845, Start Time: 2012-07-27 01:25:09, End Time: 2012-07-27 02:39:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (145 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.50% (78.0574 => 80.0110, std. dev.: 0.5201) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.74% (2.0176 => 2.3150, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 9.47% (0.7061 => 0.7730, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.42% (0.5818 => 0.6366, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.31% (0.3578 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.15% (0.5748 => 0.6274, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 9.09% (0.3663 => 0.3996, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.03% (0.3789 => 0.4131, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.03% (0.3601 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.00% (0.3646 => 0.3974, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.94% (0.3623 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.88% (0.3650 => 0.3974, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 8.64% (0.3914 => 0.4252, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.57% (0.4003 => 0.4346, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.48% (0.3940 => 0.4274, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 7.00% (1.3693 => 1.4651, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.93% (3.9660 => 4.2409, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5265 => 0.5619, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.68% (0.7710 => 0.8225, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.52% (0.7038 => 0.7497, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.96% (0.4328 => 0.4586, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.76% (0.4062 => 0.4296, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.75% (0.4379 => 0.4631, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.66% (0.6959 => 0.7353, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.59% (0.3022 => 0.3191, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.57% (1.2193 => 1.2872, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.53% (0.2765 => 0.2918, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2781 => 0.2933, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 5.40% (0.2760 => 0.2909, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.26% (13.8202 => 14.5478, std. dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.20% (0.9199 => 0.9677, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.2140 => 0.2251, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.13% (0.5577 => 0.5863, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.09% (0.2988 => 0.3140, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.02% (0.3489 => 0.3664, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.95% (0.2607 => 0.2736, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2782 => 0.2919, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.89% (0.3107 => 0.3259, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.89% (0.3580 => 0.3755, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 4.88% (0.2726 => 0.2859, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.88% (16.6129 => 17.4229, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.86% (1.4563 => 1.5271, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.86% (0.2966 => 0.3110, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.85% (0.3485 => 0.3654, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.84% (13.2842 => 13.9269, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/random: 4.83% (0.2690 => 0.2820, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.83% (0.2628 => 0.2755, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.83% (1.9828 => 2.0785, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 4.80% (0.2937 => 0.3078, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.78% (0.2655 => 0.2782, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.77% (0.3899 => 0.4085, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.77% (0.2914 => 0.3053, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.77% (0.7506 => 0.7864, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.73% (0.4016 => 0.4206, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.67% (7.2180 => 7.5550, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 4.64% (0.3192 => 0.3340, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.64% (0.2761 => 0.2889, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.60% (0.2696 => 0.2820, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.57% (1.1061 => 1.1566, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.52% (0.5637 => 0.5892, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.52% (1.3819 => 1.4443, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.48% (1.1364 => 1.1873, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 4.45% (1.9270 => 2.0128, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.42% (3.8646 => 4.0353, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.42% (1.3245 => 1.3830, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.41% (1.3813 => 1.4422, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.41% (0.3246 => 0.3389, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.37% (0.4390 => 0.4582, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 4.32% (0.8310 => 0.8669, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 4.25% (0.3293 => 0.3433, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.24% (0.3534 => 0.3684, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.23% (1.0594 => 1.1042, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.14% (0.7460 => 0.7769, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.10% (0.3756 => 0.3910, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.03% (4.3801 => 4.5566, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (4.4433 => 4.6210, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 3.97% (0.2995 => 0.3114, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.96% (0.3868 => 0.4021, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.95% (3.6692 => 3.8142, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 3.67% (2.1791 => 2.2590, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (0.4791 => 0.4966, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.47% (1.1333 => 1.1726, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.42% (1.2292 => 1.2712, std. dev.: 0.0114) MultiSource/Benchmarks/sim/sim: 3.39% (0.3131 => 0.3237, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 3.33% (0.4113 => 0.4250, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (4.9865 => 5.1519, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.22% (0.6283 => 0.6485, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.20% (6.5754 => 6.7859, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 3.16% (8.4961 => 8.7642, std. dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.15% (0.6135 => 0.6328, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 3.08% (3.1889 => 3.2872, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3755 => 0.3864, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.85% (0.8698 => 0.8946, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 2.83% (14.8535 => 15.2735, std. dev.: 0.0161) MultiSource/Applications/ClamAV/clamscan: 2.62% (14.5298 => 14.9111, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.59% (3.2742 => 3.3591, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.57% (1.5188 => 1.5579, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 2.53% (16.2614 => 16.6732, std. dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.53% (2.1007 => 2.1538, std. dev.: 0.0195) MultiSource/Applications/oggenc/oggenc: 2.20% (4.6629 => 4.7654, std. dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.56% (0.9108 => 0.9250, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.51% (1.0313 => 1.0469, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.16% (3.7467 => 3.7903, std. dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.15% (6.2785 => 6.3509, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5174, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 24.87% (1.8175 => 2.2696, std. dev.: 0.0481) SingleSource/Benchmarks/Misc/mandel-2: 8.39% (1.2998 => 1.4088, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.47% (0.9996 => 1.0543, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 4.44% (7.4271 => 7.7569, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7065, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9885, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4772, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.7688 => 1.8141, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.57% (1.5089 => 1.5326, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.42% (4.5928 => 4.6579, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5073, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1404, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.11% (22.5627 => 21.1838, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.58% (1.0460 => 0.8621, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2308 => 1.1042, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.31% (1.3780 => 1.3048, std. dev.: 0.0080) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9189, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9476, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5994, std. dev.: 0.0187) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9727, std. dev.: 0.0366) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2461, std. dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3305 => 7.2191, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4929, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2491, std. dev.: 0.0057) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2187, std. dev.: 0.0444) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8683, std. dev.: 0.0022) MultiSource/Applications/lua/lua: -1.07% (26.5159 => 26.2329, std. dev.: 0.0181) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 21:25:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 26 Jul 2012 23:25:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120727042517.F247D2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2409?compare_to=2405&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2409, Order: 160846, Start Time: 2012-07-27 03:07:02, End Time: 2012-07-27 04:25:40 To: 2405, Order: 160845, Start Time: 2012-07-27 01:20:28, End Time: 2012-07-27 02:39:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (82 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.85% (27.9266 => 29.5596, std. dev.: 0.1342) SingleSource/Benchmarks/Misc/mandel-2: 3.33% (1.4005 => 1.4471, std. dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.72% (55.0877 => 56.5850, std. dev.: 0.0948) SingleSource/Benchmarks/McGill/chomp: 1.28% (1.1010 => 1.1151, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.10% (80.5413 => 81.4289, std. dev.: 0.0857) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.17% (10.3673 => 13.9097, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 12.55% (0.3473 => 0.3909, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.35% (0.3497 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.33% (0.3543 => 0.3980, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 12.33% (0.3561 => 0.4000, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.29% (0.3516 => 0.3948, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.28% (0.3543 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.88% (1.1194 => 1.2524, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.37% (0.3886 => 0.4328, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.28% (0.3927 => 0.4370, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.65% (2.2022 => 2.3927, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/richards_benchmark: 8.14% (0.1622 => 0.1754, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.89% (1.7609 => 1.8998, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1892 => 0.2021, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 6.33% (0.6030 => 0.6412, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.28% (0.5925 => 0.6297, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.3177 => 0.3370, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 5.20% (10.4361 => 10.9783, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.10% (7.0540 => 7.4137, std. dev.: 0.0102) SingleSource/UnitTests/ObjC++/property-reference: 5.06% (0.7326 => 0.7697, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.90% (0.4879 => 0.5118, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.85% (0.4615 => 0.4839, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.26% (9.4845 => 9.8884, std. dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: 4.20% (0.7433 => 0.7745, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.19% (4.9449 => 5.1519, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (5.0018 => 5.2034, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.94% (0.3121 => 0.3244, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.74% (0.8172 => 0.8478, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.62% (4.2646 => 4.4188, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.57% (0.5860 => 0.6069, std. dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 3.41% (0.3109 => 0.3215, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.38% (8.1363 => 8.4115, std. dev.: 0.0143) MultiSource/Benchmarks/McCat/18-imp/imp: 3.36% (0.3423 => 0.3538, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.30% (14.3668 => 14.8407, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 3.27% (0.3180 => 0.3284, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 3.21% (5.7591 => 5.9442, std. dev.: 0.0103) MultiSource/Applications/spiff/spiff: 3.18% (0.7835 => 0.8084, std. dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 3.10% (0.3387 => 0.3492, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1861 => 1.2227, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.02% (1.3050 => 1.3444, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.82% (3.3354 => 3.4293, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.78% (1.1642 => 1.1966, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.72% (1.5415 => 1.5834, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.70% (2.0273 => 2.0821, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.67% (0.8067 => 0.8282, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 2.54% (1.5603 => 1.6000, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.44% (3.8723 => 3.9666, std. dev.: 0.0179) MultiSource/Benchmarks/McCat/05-eks/eks: 2.40% (0.4299 => 0.4402, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.18% (2.2024 => 2.2505, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.17% (0.9765 => 0.9977, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (1.5859 => 1.6203, std. dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.16% (0.4636 => 0.4736, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.08% (0.6450 => 0.6584, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5981 => 0.6103, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.95% (1.4186 => 1.4462, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.89% (17.1811 => 17.5055, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6675 => 0.6799, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 1.78% (0.8921 => 0.9080, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.64% (2.2969 => 2.3346, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.44% (1.1840 => 1.2011, std. dev.: 0.0055) MultiSource/Applications/lemon/lemon: 1.21% (1.0722 => 1.0852, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.00% (2.0665 => 2.0872, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.95% (4.2280 => 4.3950, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.32% (3.6395 => 3.7602, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5086 => 1.5346, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 1.61% (11.6436 => 11.8315, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 1.47% (9.1159 => 9.2497, std. dev.: 0.0028) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2039, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 1.06% (2.2771 => 2.3013, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.37% (5.2763 => 3.1461, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.08% (5.3855 => 3.7115, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.44% (5.3526 => 3.7231, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0340, std. dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.06% (2.9384 => 2.5546, std. dev.: 0.0209) MultiSource/Applications/ClamAV/clamscan: -10.01% (22.1758 => 19.9553, std. dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4258, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.33% (0.0998 => 0.0855, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.88% (1.2373 => 1.1151, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -5.87% (1.5373 => 1.4471, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -4.65% (1.9577 => 1.8667, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4828, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.06% (8.1563 => 7.9065, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4241, std. dev.: 0.0215) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0050, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: -1.68% (12.5348 => 12.3242, std. dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4187, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8092, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 23:10:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 01:10:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120727061000.1D2A52A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2410?compare_to=2408&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2410, Order: 160847, Start Time: 2012-07-27 04:56:36, End Time: 2012-07-27 06:10:21 To: 2408, Order: 160846, Start Time: 2012-07-27 03:07:14, End Time: 2012-07-27 04:21:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (140 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.27% (2.0176 => 2.3056, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.08% (0.5818 => 0.6346, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.98% (0.7061 => 0.7695, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.91% (0.5748 => 0.6260, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.33% (0.3578 => 0.3876, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.16% (0.3601 => 0.3895, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.06% (0.3646 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.05% (0.3663 => 0.3958, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.03% (0.3623 => 0.3914, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.02% (0.3789 => 0.4093, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.95% (0.3650 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.87% (0.3914 => 0.4222, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.82% (0.4003 => 0.4316, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.69% (0.3940 => 0.4243, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.92% (1.3693 => 1.4641, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 6.73% (0.7038 => 0.7512, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.61% (0.5265 => 0.5613, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.60% (0.4062 => 0.4330, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.54% (0.7710 => 0.8214, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2781 => 0.2962, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (3.9660 => 4.2234, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 6.40% (0.4328 => 0.4605, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.21% (0.2721 => 0.2890, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.98% (0.3899 => 0.4132, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 5.76% (0.2760 => 0.2919, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hello: 5.68% (0.2607 => 0.2755, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.67% (0.3489 => 0.3687, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.65% (0.2726 => 0.2880, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 5.61% (0.2690 => 0.2841, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.2655 => 0.2804, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.60% (0.6959 => 0.7349, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2765 => 0.2919, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.50% (0.3580 => 0.3777, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.50% (1.9828 => 2.0918, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.48% (0.3485 => 0.3676, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.46% (0.3149 => 0.3321, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.45% (0.2937 => 0.3097, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.44% (0.2628 => 0.2771, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2761 => 0.2910, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.39% (0.4379 => 0.4615, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.29% (1.2193 => 1.2838, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.24% (0.9199 => 0.9681, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: 5.22% (0.2988 => 0.3144, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.17% (16.6129 => 17.4722, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.13% (0.5577 => 0.5863, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2696 => 0.2834, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.04% (0.3453 => 0.3627, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.99% (13.8202 => 14.5099, std. dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.99% (0.4390 => 0.4609, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.60% (0.3868 => 0.4046, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.58% (0.3534 => 0.3696, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.56% (0.2914 => 0.3047, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 4.55% (0.2925 => 0.3058, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.50% (1.4563 => 1.5219, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 4.50% (1.1061 => 1.1559, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.44% (13.2842 => 13.8735, std. dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.40% (0.5637 => 0.5885, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.37% (7.2180 => 7.5337, std. dev.: 0.0070) MultiSource/Applications/spiff/spiff: 4.32% (0.7506 => 0.7830, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.30% (1.1364 => 1.1853, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 4.29% (3.8646 => 4.0305, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.26% (1.3819 => 1.4407, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.25% (0.3246 => 0.3384, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.18% (1.3813 => 1.4390, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (0.8310 => 0.8652, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.11% (1.9270 => 2.0062, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.09% (1.3245 => 1.3787, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2945 => 0.3065, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.03% (0.7460 => 0.7761, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.00% (1.0594 => 1.1018, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.99% (1.2292 => 1.2783, std. dev.: 0.0132) MultiSource/Applications/sgefa/sgefa: 3.71% (0.2995 => 0.3106, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.64% (4.3801 => 4.5394, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.57% (4.4433 => 4.6021, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 3.57% (0.3220 => 0.3335, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.56% (3.6692 => 3.7998, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 3.54% (2.1791 => 2.2562, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.40% (0.4791 => 0.4954, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3755 => 0.3881, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (4.9865 => 5.1521, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.1333 => 1.1695, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.02% (0.8698 => 0.8961, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.97% (3.1889 => 3.2837, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.91% (0.6283 => 0.6466, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4113 => 0.4227, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.76% (8.4961 => 8.7307, std. dev.: 0.0167) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.75% (0.6135 => 0.6304, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.67% (2.1007 => 2.1567, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (6.5754 => 6.7461, std. dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.51% (3.2742 => 3.3563, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.49% (14.8535 => 15.2229, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 2.45% (14.5298 => 14.8862, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 2.38% (16.2614 => 16.6490, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 2.19% (4.6629 => 4.7650, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.23% (1.0313 => 1.0440, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/fbench: 24.76% (1.8175 => 2.2675, std. dev.: 0.0441) SingleSource/Benchmarks/Misc/mandel-2: 7.32% (1.2998 => 1.3949, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.38% (0.9996 => 1.0534, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7545, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7031, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4770, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.59% (1.7688 => 1.8147, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.26% (1.0310 => 1.0543, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5089 => 1.5361, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4522, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5950, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.47% (4.5928 => 4.6605, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1682, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1392, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.34% (22.5627 => 21.1327, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.70% (0.6576 => 0.6464, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.65% (0.0997 => 0.0821, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -10.31% (1.2308 => 1.1039, std. dev.: 0.0053) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.32% (1.3780 => 1.3047, std. dev.: 0.0082) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.12% (0.4867 => 0.4715, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.75% (1.9762 => 1.9218, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5833, std. dev.: 0.0122) MultiSource/Applications/spiff/spiff: -2.57% (3.0263 => 2.9485, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.06% (6.6320 => 6.4954, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2255, std. dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.02% (20.3410 => 19.9305, std. dev.: 0.0326) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6589 => 0.6484, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3305 => 7.2177, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.3167 => 5.2465, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.12% (9.3358 => 9.2311, std. dev.: 0.0249) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8481, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jul 26 23:14:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 01:14:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120727061444.37E912A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2411?compare_to=2409&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2411, Order: 160847, Start Time: 2012-07-27 04:56:35, End Time: 2012-07-27 06:15:06 To: 2409, Order: 160846, Start Time: 2012-07-27 03:07:02, End Time: 2012-07-27 04:25:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (90 on baseline) Performance Improvements: 3 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (749 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.30% (2.0872 => 2.1143, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.18% (1.2942 => 1.3095, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.39% (13.9097 => 13.4384, std. dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.32% (81.4289 => 79.5425, std. dev.: 0.5842) SingleSource/Benchmarks/Misc/mandel-2: -1.15% (1.4471 => 1.4305, std. dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.62% (10.3673 => 13.4384, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 12.27% (0.3473 => 0.3899, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.04% (0.3497 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3561 => 0.3988, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.95% (0.3516 => 0.3936, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.94% (1.1194 => 1.2531, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.88% (0.3543 => 0.3964, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.64% (0.3694 => 0.4124, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3828 => 0.4258, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.08% (0.3927 => 0.4362, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.78% (2.2022 => 2.3955, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 7.89% (0.1622 => 0.1750, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.81% (1.7609 => 1.8985, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.25% (0.6030 => 0.6407, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5925 => 0.6293, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.3177 => 0.3364, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 5.33% (10.4361 => 10.9928, std. dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference: 5.23% (0.7326 => 0.7709, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.04% (0.4879 => 0.5125, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.98% (0.4615 => 0.4845, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.80% (7.0540 => 7.3927, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.39% (0.7433 => 0.7759, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.31% (9.4845 => 9.8936, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.25% (4.9449 => 5.1550, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.15% (5.0018 => 5.2096, std. dev.: 0.0137) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.02% (0.5569 => 0.5793, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.88% (0.8172 => 0.8489, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.68% (4.2646 => 4.4214, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.67% (0.5860 => 0.6075, std. dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 3.60% (0.3109 => 0.3221, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.53% (0.3423 => 0.3544, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.47% (8.1363 => 8.4188, std. dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.3121 => 0.3228, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.41% (14.3668 => 14.8568, std. dev.: 0.0169) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3180 => 0.3288, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.34% (0.7835 => 0.8097, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.29% (5.7591 => 5.9485, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.27% (1.1861 => 1.2249, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.26% (1.3050 => 1.3476, std. dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.13% (0.3387 => 0.3493, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.13% (0.4636 => 0.4781, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.09% (1.1642 => 1.2002, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.05% (0.8067 => 0.8313, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.03% (3.3354 => 3.4363, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (1.5415 => 1.5857, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.83% (0.4103 => 0.4219, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.78% (1.5603 => 1.6036, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.77% (0.3650 => 0.3751, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 2.76% (2.0273 => 2.0832, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.72% (0.3826 => 0.3930, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.59% (0.4289 => 0.4400, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.59% (0.3865 => 0.3965, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.59% (0.5105 => 0.5237, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.57% (3.8723 => 3.9717, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.56% (2.2024 => 2.2587, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 2.51% (0.4299 => 0.4407, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.42% (0.9765 => 1.0001, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.39% (1.5859 => 1.6238, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.34% (0.6675 => 0.6831, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.31% (2.0665 => 2.1143, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (0.4620 => 0.4725, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.18% (0.6456 => 0.6597, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.09% (1.4186 => 1.4483, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.07% (0.8921 => 0.9106, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.04% (17.1811 => 17.5315, std. dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.02% (0.5981 => 0.6102, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.97% (1.2842 => 1.3095, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.66% (2.2969 => 2.3350, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 1.66% (1.1840 => 1.2036, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.36% (1.0722 => 1.0868, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (4.2280 => 4.4001, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (3.6395 => 3.7600, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.61% (11.6436 => 11.8307, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.59% (1.5086 => 1.5326, std. dev.: 0.0027) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2043, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.06% (9.1159 => 9.2123, std. dev.: 0.0210) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.26% (5.2763 => 3.1519, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.11% (5.3855 => 3.7099, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.47% (5.3526 => 3.7217, std. dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1127, std. dev.: 0.0160) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.97% (2.9384 => 2.5573, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -9.96% (22.1758 => 19.9678, std. dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.19% (1.2373 => 1.1112, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: -6.95% (1.5373 => 1.4305, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.59% (1.5835 => 1.5108, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.53% (1.9577 => 1.8691, std. dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4767, std. dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.13% (8.6802 => 8.4085, std. dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (8.1563 => 7.9086, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0010, std. dev.: 0.0099) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.48% (0.4808 => 0.4689, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.33% (1.3677 => 1.3358, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6800, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -1.66% (12.5348 => 12.3265, std. dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4178, std. dev.: 0.0088) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8094, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 00:18:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 02:18:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120727071831.22E922A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2412?compare_to=2407&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2412, Order: 160846, Start Time: 2012-07-27 04:31:46, End Time: 2012-07-27 07:18:53 To: 2407, Order: 160845, Start Time: 2012-07-27 01:20:30, End Time: 2012-07-27 04:04:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (47 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (836 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.33% (0.3446 => 0.3871, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.32% (0.3465 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.28% (0.3460 => 0.3885, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.28% (0.3469 => 0.3895, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 12.26% (0.3442 => 0.3864, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.24% (0.3496 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.18% (0.3488 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.83% (0.3643 => 0.4074, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.70% (0.3650 => 0.4077, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3724 => 0.4146, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5826 => 0.6188, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.10% (0.5889 => 0.6248, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.06% (1.5932 => 1.6738, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.62% (0.7171 => 0.7502, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.39% (4.2109 => 4.3956, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.34% (0.4029 => 0.4204, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 4.29% (1.0781 => 1.1243, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.64% (5.5417 => 5.7435, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 3.49% (2.1013 => 2.1747, std. dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 3.11% (4.6177 => 4.7615, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.96% (2.1653 => 2.2295, std. dev.: 0.0044) MultiSource/Applications/treecc/treecc: 2.83% (0.7875 => 0.8098, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.68% (0.6634 => 0.6812, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 2.63% (23.5202 => 24.1377, std. dev.: 0.0317) MultiSource/Applications/lua/lua: 2.61% (1.4269 => 1.4642, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.43% (0.9909 => 1.0150, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.42% (0.5546 => 0.5680, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.36% (0.9697 => 0.9926, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.58% (2.0346 => 2.0668, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9638, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6764, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1703, std. dev.: 0.0186) SingleSource/Benchmarks/Misc/flops-2: 4.56% (1.8057 => 1.8881, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.15% (105.3826 => 107.6451, std. dev.: 0.0244) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1944, std. dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4586, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4928, std. dev.: 0.0126) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5918, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2215, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5122, std. dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.11% (2.0820 => 2.1051, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.09% (2.4764 => 2.3751, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5410, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ary2: -10.37% (0.2402 => 0.2153, std. dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/fldry: -8.92% (17.2379 => 15.7000, std. dev.: 0.1702) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7945, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/moments: -3.92% (0.4438 => 0.4264, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.73% (11.2080 => 10.7902, std. dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: -3.59% (14.0481 => 13.5433, std. dev.: 0.0248) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5774, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 01:07:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 03:07:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120727080716.360942A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2413?compare_to=2410&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2413, Order: 160851, Start Time: 2012-07-27 06:50:39, End Time: 2012-07-27 08:07:38 To: 2410, Order: 160847, Start Time: 2012-07-27 04:56:36, End Time: 2012-07-27 06:10:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (129 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (731 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.22% (78.3501 => 80.0860, std. dev.: 0.5518) SingleSource/Benchmarks/Misc/mandel-2: 1.20% (1.3949 => 1.4117, std. dev.: 0.0055) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.29% (2.0176 => 2.3059, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.14% (0.5818 => 0.6350, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.92% (0.5748 => 0.6261, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.30% (0.3578 => 0.3875, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.19% (0.3601 => 0.3896, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 8.19% (0.7061 => 0.7639, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 8.09% (0.3646 => 0.3941, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.00% (0.3650 => 0.3942, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 8.00% (0.3663 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.98% (0.3623 => 0.3912, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.97% (0.3789 => 0.4091, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.89% (0.3914 => 0.4223, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.4003 => 0.4314, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.72% (0.3940 => 0.4244, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.25% (0.1986 => 0.2130, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.11% (0.7710 => 0.8258, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 7.00% (1.3693 => 1.4652, std. dev.: 0.0205) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.69% (0.5265 => 0.5617, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (3.9660 => 4.2232, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash2: 6.38% (0.4328 => 0.4604, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.36% (0.2781 => 0.2958, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.17% (0.2721 => 0.2889, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.01% (0.4062 => 0.4306, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.00% (0.2782 => 0.2949, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.98% (0.3899 => 0.4132, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.89% (0.6959 => 0.7369, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.69% (0.2760 => 0.2917, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.65% (0.3489 => 0.3686, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.61% (0.2690 => 0.2841, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.61% (0.2726 => 0.2879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2607 => 0.2753, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3022 => 0.3189, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1865 => 0.1968, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.48% (0.2628 => 0.2772, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.46% (1.9828 => 2.0911, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.4379 => 0.4618, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.44% (0.3107 => 0.3276, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.43% (0.2966 => 0.3127, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.42% (0.2655 => 0.2799, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.42% (0.3580 => 0.3774, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.38% (0.2937 => 0.3095, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.36% (0.2761 => 0.2909, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.34% (0.3485 => 0.3671, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.34% (0.3149 => 0.3317, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.29% (0.3192 => 0.3361, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.29% (1.2193 => 1.2838, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.14% (16.6129 => 17.4674, std. dev.: 0.0291) SingleSource/Benchmarks/Shootout-C++/lists: 5.07% (0.3293 => 0.3460, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.07% (0.9199 => 0.9665, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 4.98% (0.3453 => 0.3625, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4390 => 0.4607, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.91% (0.5577 => 0.5851, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.68% (0.4016 => 0.4204, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.58% (0.3534 => 0.3696, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.53% (13.2842 => 13.8858, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: 4.47% (0.3868 => 0.4041, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.45% (1.4563 => 1.5211, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 4.39% (3.8646 => 4.0344, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.5637 => 0.5884, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.36% (1.1364 => 1.1860, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.35% (7.2180 => 7.5320, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/football/football: 4.34% (0.8310 => 0.8671, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.34% (0.3246 => 0.3387, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.28% (1.3813 => 1.4404, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.26% (1.3819 => 1.4407, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 4.10% (1.2292 => 1.2796, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2945 => 0.3065, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.01% (0.7460 => 0.7759, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.98% (1.3245 => 1.3772, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.94% (1.0594 => 1.1011, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.73% (3.6692 => 3.8060, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.67% (4.3801 => 4.5409, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.65% (4.4433 => 4.6056, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 3.63% (0.3220 => 0.3337, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.42% (0.4791 => 0.4955, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.36% (4.9865 => 5.1538, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3755 => 0.3878, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.20% (1.1333 => 1.1696, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.06% (0.8698 => 0.8964, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.98% (0.6283 => 0.6470, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.82% (8.4961 => 8.7355, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.77% (0.6135 => 0.6305, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 2.65% (0.4113 => 0.4222, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.1007 => 2.1541, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (3.2742 => 3.3558, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.18% (1.5188 => 1.5519, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.27% (0.9108 => 0.9224, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.18% (3.7467 => 3.7909, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 30.42% (5.7573 => 7.5088, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/fbench: 24.70% (1.8175 => 2.2665, std. dev.: 0.0461) SingleSource/Benchmarks/Misc/mandel-2: 8.61% (1.2998 => 1.4117, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.15% (0.9996 => 1.0511, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/salsa20: 4.48% (7.4271 => 7.7599, std. dev.: 0.0207) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7057, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4774, std. dev.: 0.0217) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8165, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5334, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5953, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.32% (1.9290 => 1.9544, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 1.08% (1.1560 => 1.1685, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.04% (3.6469 => 3.6849, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1390, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.31% (22.5627 => 21.1399, std. dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.66% (0.6576 => 0.6467, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.46% (0.0997 => 0.0813, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.19% (1.2308 => 1.1054, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5137, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3119, std. dev.: 0.0149) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: -2.58% (3.0263 => 2.9482, std. dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5984, std. dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2253, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.93% (20.3410 => 19.9490, std. dev.: 0.0463) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5103, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.62% (7.3305 => 7.2115, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.32% (2.5254 => 2.4921, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2470, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8663, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 01:11:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 03:11:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120727081158.3C5462A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2414?compare_to=2411&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2414, Order: 160851, Start Time: 2012-07-27 06:50:40, End Time: 2012-07-27 08:12:20 To: 2411, Order: 160847, Start Time: 2012-07-27 04:56:35, End Time: 2012-07-27 06:15:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (85 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (755 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (0.8489 => 0.8623, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -2.29% (1.4305 => 1.3978, std. dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.56% (10.3673 => 13.4316, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3473 => 0.3900, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.14% (0.3543 => 0.3973, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 12.12% (0.3497 => 0.3921, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.00% (0.3516 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.97% (0.3543 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.93% (0.3561 => 0.3986, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.89% (1.1194 => 1.2525, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 11.67% (0.3694 => 0.4125, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3828 => 0.4262, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.17% (0.3886 => 0.4320, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.84% (2.2022 => 2.3968, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.94% (1.7609 => 1.9008, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: 7.89% (0.1622 => 0.1750, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.2065 => 0.2224, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.55% (0.3177 => 0.3385, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.44% (0.1584 => 0.1686, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 6.33% (0.5925 => 0.6300, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.15% (0.6030 => 0.6401, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.52% (0.8172 => 0.8623, std. dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 5.45% (10.4361 => 11.0047, std. dev.: 0.1792) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.42% (0.4615 => 0.4865, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 5.20% (0.7326 => 0.7707, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.02% (0.4879 => 0.5124, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.00% (0.2758 => 0.2896, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.94% (7.0540 => 7.4024, std. dev.: 0.0103) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.71% (0.3121 => 0.3268, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 4.63% (0.3282 => 0.3434, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.49% (9.4845 => 9.9100, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.47% (0.5569 => 0.5818, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.41% (4.9449 => 5.1629, std. dev.: 0.0133) MultiSource/Applications/lambda-0_1_3/lambda: 4.40% (0.7433 => 0.7760, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.31% (5.0018 => 5.2176, std. dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: 4.23% (0.2554 => 0.2662, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.08% (0.5860 => 0.6099, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.80% (4.2646 => 4.4265, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.62% (0.8067 => 0.8359, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.58% (8.1363 => 8.4278, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.53% (14.3668 => 14.8734, std. dev.: 0.0085) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3423 => 0.3543, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.46% (0.3180 => 0.3290, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.36% (1.3050 => 1.3488, std. dev.: 0.0051) MultiSource/Benchmarks/sim/sim: 3.34% (0.3387 => 0.3500, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.29% (0.4103 => 0.4238, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.25% (1.1861 => 1.2247, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 3.24% (0.4289 => 0.4428, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.08% (0.4636 => 0.4779, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (1.5415 => 1.5850, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 2.79% (1.5603 => 1.6038, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.77% (0.3650 => 0.3751, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.71% (3.8723 => 3.9773, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.67% (0.3826 => 0.3928, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.66% (0.5105 => 0.5241, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.62% (1.4186 => 1.4557, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.59% (2.2024 => 2.2594, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.54% (0.3935 => 0.4035, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.49% (0.4064 => 0.4165, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 2.44% (0.4299 => 0.4404, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.5859 => 1.6242, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.38% (0.9765 => 0.9997, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.32% (2.0665 => 2.1144, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 2.29% (0.6456 => 0.6604, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6450 => 0.6594, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 2.19% (1.2842 => 1.3123, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (0.6675 => 0.6821, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.14% (0.5981 => 0.6109, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: 1.84% (0.7115 => 0.7246, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.81% (1.1840 => 1.2054, std. dev.: 0.0076) MultiSource/Applications/lemon/lemon: 1.46% (1.0722 => 1.0879, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9740, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.38% (4.2280 => 4.4131, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7529, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.53% (1.0313 => 1.0574, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2159, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8320, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/fbench: 1.49% (2.2771 => 2.3111, std. dev.: 0.0034) MultiSource/Applications/aha/aha: 1.38% (3.1595 => 3.2030, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2395, std. dev.: 0.0258) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.10% (1.3045 => 1.3188, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.22% (5.2763 => 3.1543, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.07% (5.3855 => 3.7120, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.42% (5.3526 => 3.7243, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0865, std. dev.: 0.0233) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.00% (2.9384 => 2.5563, std. dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: -9.91% (22.1758 => 19.9787, std. dev.: 0.4171) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4202, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.12% (1.2373 => 1.1121, std. dev.: 0.0239) SingleSource/Benchmarks/Misc/mandel-2: -9.07% (1.5373 => 1.3978, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.01% (1.5835 => 1.5041, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.44% (1.9577 => 1.8708, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4697, std. dev.: 0.0149) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (8.1563 => 7.9050, std. dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.89% (8.6802 => 8.4297, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9994, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.33% (1.3677 => 1.3358, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3194, std. dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4175, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.32% (1.8329 => 1.8087, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 02:49:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 04:49:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120727094926.A2D8D2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2415?compare_to=2413&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2415, Order: 160852, Start Time: 2012-07-27 08:35:47, End Time: 2012-07-27 09:49:47 To: 2413, Order: 160851, Start Time: 2012-07-27 06:50:39, End Time: 2012-07-27 08:07:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (140 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.13% (80.0860 => 80.9915, std. dev.: 0.1093) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.30% (2.0176 => 2.3061, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.06% (0.5818 => 0.6345, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.92% (0.5748 => 0.6261, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.41% (0.3578 => 0.3879, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.22% (0.3601 => 0.3897, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 8.15% (0.3646 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.03% (0.7061 => 0.7628, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.98% (0.3623 => 0.3912, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.97% (0.3663 => 0.3955, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.97% (0.3789 => 0.4091, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.92% (0.3650 => 0.3939, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 7.84% (0.3914 => 0.4221, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.82% (0.4003 => 0.4316, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.64% (0.3940 => 0.4241, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.40% (0.1986 => 0.2133, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 7.09% (1.3693 => 1.4664, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.91% (0.7710 => 0.8243, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.66% (0.7038 => 0.7507, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 6.57% (0.4062 => 0.4329, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (0.4328 => 0.4611, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.53% (3.9660 => 4.2250, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2781 => 0.2962, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.50% (0.5265 => 0.5607, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.43% (0.2596 => 0.2763, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.28% (0.2721 => 0.2892, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.85% (0.3899 => 0.4127, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 5.72% (0.2607 => 0.2756, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3107 => 0.3283, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.66% (0.6959 => 0.7353, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.59% (0.3022 => 0.3191, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.59% (0.3489 => 0.3684, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.59% (1.9828 => 2.0936, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/except: 5.58% (0.2760 => 0.2914, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.58% (0.2726 => 0.2878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2765 => 0.2919, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.54% (0.2655 => 0.2802, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.46% (0.3149 => 0.3321, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (0.3485 => 0.3675, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.42% (0.3580 => 0.3774, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2761 => 0.2910, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.37% (0.4379 => 0.4614, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.36% (0.5577 => 0.5876, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 5.31% (0.2937 => 0.3093, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.19% (0.2696 => 0.2836, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.14% (0.3192 => 0.3356, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.13% (0.9199 => 0.9671, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 5.13% (16.6129 => 17.4649, std. dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/matrix: 5.12% (0.2988 => 0.3141, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.10% (0.4390 => 0.4614, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.10% (1.2193 => 1.2815, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 4.98% (0.3453 => 0.3625, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.97% (13.8202 => 14.5071, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: 4.80% (0.3293 => 0.3451, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.78% (0.4016 => 0.4208, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.71% (0.3868 => 0.4050, std. dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.63% (0.2914 => 0.3049, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.62% (1.4563 => 1.5236, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.58% (0.2925 => 0.3059, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.56% (0.3534 => 0.3695, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.3756 => 0.3925, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (13.2842 => 13.8760, std. dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.45% (0.5637 => 0.5888, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: 4.42% (0.7506 => 0.7838, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.37% (7.2180 => 7.5336, std. dev.: 0.0092) MultiSource/Applications/Burg/burg: 4.37% (1.1061 => 1.1544, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.36% (0.7460 => 0.7785, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.34% (1.3813 => 1.4413, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.32% (1.1364 => 1.1855, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.28% (1.3819 => 1.4411, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.28% (0.3246 => 0.3385, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.25% (3.8646 => 4.0290, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 4.15% (1.9270 => 2.0070, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (0.8310 => 0.8652, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.11% (1.3245 => 1.3789, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.04% (1.2292 => 1.2789, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 3.96% (1.0594 => 1.1014, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.68% (4.3801 => 4.5412, std. dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 3.67% (0.2995 => 0.3105, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (4.4433 => 4.6061, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.59% (3.6692 => 3.8011, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 3.46% (2.1791 => 2.2546, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3755 => 0.3881, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.35% (4.9865 => 5.1536, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.34% (0.4791 => 0.4951, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.24% (1.1333 => 1.1700, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.13% (0.6135 => 0.6327, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.01% (0.8698 => 0.8960, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.90% (0.6283 => 0.6465, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.89% (3.1889 => 3.2812, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4113 => 0.4227, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 2.77% (8.4961 => 8.7312, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.62% (6.5754 => 6.7480, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.54% (3.2742 => 3.3575, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.54% (14.8535 => 15.2302, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (2.1007 => 2.1537, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 2.44% (14.5298 => 14.8845, std. dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 2.42% (16.2614 => 16.6547, std. dev.: 0.0151) MultiSource/Applications/oggenc/oggenc: 2.17% (4.6629 => 4.7643, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.16% (1.5188 => 1.5516, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.30% (0.9108 => 0.9226, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.25% (1.0313 => 1.0442, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5202, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/fbench: 23.86% (1.8175 => 2.2511, std. dev.: 0.0423) SingleSource/Benchmarks/Misc/mandel-2: 8.04% (1.2998 => 1.4043, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.42% (0.9996 => 1.0538, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 4.40% (7.4271 => 7.7541, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7060, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4780, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.64% (1.7688 => 1.8155, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5089 => 1.5356, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5928 => 4.6625, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1934, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.11% (3.1071 => 3.1416, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6469 => 3.6855, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.40% (22.5627 => 21.1178, std. dev.: 0.0197) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.61% (0.6576 => 0.6470, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.05% (0.0997 => 0.0817, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.35% (1.2308 => 1.1034, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3130, std. dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9195, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9452, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.37% (8.8259 => 8.6170, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.22% (6.3560 => 6.2146, std. dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.21% (20.3410 => 19.8910, std. dev.: 0.0747) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5062, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.68% (7.3305 => 7.2071, std. dev.: 0.0312) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2485, std. dev.: 0.0069) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8690, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2237, std. dev.: 0.0044) MultiSource/Applications/lua/lua: -1.03% (26.5159 => 26.2441, std. dev.: 0.0091) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 02:59:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 04:59:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120727095957.A5BDF2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2416?compare_to=2414&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2416, Order: 160852, Start Time: 2012-07-27 08:40:28, End Time: 2012-07-27 09:59:29 To: 2414, Order: 160851, Start Time: 2012-07-27 06:50:40, End Time: 2012-07-27 08:12:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (87 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (753 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 3.43% (1.3978 => 1.4458, std. dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.58% (10.3673 => 13.4336, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 12.27% (0.3473 => 0.3899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.10% (0.3497 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.97% (0.3516 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.97% (0.3543 => 0.3967, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.94% (1.1194 => 1.2531, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.91% (0.3543 => 0.3965, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.88% (0.3561 => 0.3984, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.69% (0.3694 => 0.4126, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.29% (0.3828 => 0.4260, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.05% (0.3927 => 0.4361, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.81% (2.2022 => 2.3963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 7.89% (0.1622 => 0.1750, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.81% (1.7609 => 1.8985, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.83% (0.3177 => 0.3394, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 6.31% (0.5925 => 0.6299, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 6.17% (0.6030 => 0.6402, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.87% (0.7326 => 0.7756, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.41% (10.4361 => 11.0012, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.12% (0.4879 => 0.5129, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4615 => 0.4848, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.00% (7.0540 => 7.4064, std. dev.: 0.0170) SingleSource/Benchmarks/Misc/oourafft: 4.63% (0.3282 => 0.3434, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.56% (0.5569 => 0.5823, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 4.37% (9.4845 => 9.8988, std. dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: 4.36% (0.7433 => 0.7757, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.33% (0.8172 => 0.8526, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.27% (4.9449 => 5.1561, std. dev.: 0.0081) MultiSource/Applications/spiff/spiff: 4.25% (0.7835 => 0.8168, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.23% (5.0018 => 5.2132, std. dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.67% (4.2646 => 4.4211, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.58% (0.5860 => 0.6070, std. dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 3.57% (0.3109 => 0.3220, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.49% (0.3121 => 0.3230, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.48% (8.1363 => 8.4196, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.47% (14.3668 => 14.8658, std. dev.: 0.0121) MultiSource/Benchmarks/McCat/09-vor/vor: 3.43% (0.3180 => 0.3289, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.37% (0.3387 => 0.3501, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 3.32% (5.7591 => 5.9505, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.24% (1.3050 => 1.3473, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.21% (1.1861 => 1.2242, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 3.12% (3.3354 => 3.4394, std. dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.11% (0.4636 => 0.4780, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.05% (0.8067 => 0.8313, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.5415 => 1.5885, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 2.94% (1.1642 => 1.1984, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.93% (0.3826 => 0.3938, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.90% (0.4103 => 0.4222, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 2.83% (1.5603 => 1.6045, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 2.83% (2.0273 => 2.0847, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 2.82% (3.8723 => 3.9815, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.78% (0.5105 => 0.5247, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4289 => 0.4399, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (2.2024 => 2.2580, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.52% (0.9765 => 1.0011, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.50% (2.0665 => 2.1181, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 2.35% (0.4299 => 0.4400, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.33% (1.5859 => 1.6229, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.33% (0.6450 => 0.6600, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (0.6675 => 0.6819, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.14% (0.5981 => 0.6109, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 2.14% (0.6456 => 0.6594, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 2.07% (0.8921 => 0.9106, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.05% (17.1811 => 17.5339, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.03% (1.4186 => 1.4474, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 2.01% (1.2842 => 1.3100, std. dev.: 0.0048) MultiSource/Applications/siod/siod: 1.77% (2.2969 => 2.3375, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: 1.67% (0.7115 => 0.7234, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.49% (1.1840 => 1.2016, std. dev.: 0.0055) MultiSource/Applications/lemon/lemon: 1.43% (1.0722 => 1.0875, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.74% (4.2280 => 4.3863, std. dev.: 0.0170) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.26% (3.6395 => 3.7581, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 1.79% (3.1578 => 3.2143, std. dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8325, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5086 => 1.5329, std. dev.: 0.0017) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2034, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2249, std. dev.: 0.0137) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.12% (5.2763 => 3.1593, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.05% (5.3855 => 3.7133, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.42% (5.3526 => 3.7241, std. dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.88% (54.1659 => 46.1034, std. dev.: 0.0170) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.87% (2.9384 => 2.5602, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -9.94% (22.1758 => 19.9723, std. dev.: 0.0341) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.83% (1.2373 => 1.1033, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -5.95% (1.5373 => 1.4458, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.88% (1.9577 => 1.8622, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4856, std. dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9041, std. dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.6802 => 8.4324, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0003, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.73% (12.5348 => 12.3185, std. dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4171, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8089, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 5.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 03:30:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 05:30:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120727103022.18A9A2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2417?compare_to=2412&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2417, Order: 160852, Start Time: 2012-07-27 07:47:10, End Time: 2012-07-27 10:30:44 To: 2412, Order: 160846, Start Time: 2012-07-27 04:31:46, End Time: 2012-07-27 07:18:53 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (85 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (797 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.12% (1.0150 => 1.0264, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.07% (2.1146 => 2.1372, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.15% (54.1560 => 54.7811, std. dev.: 0.0597) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.64% (0.3496 => 0.3938, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.58% (0.3465 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.58% (0.3442 => 0.3875, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.57% (0.3446 => 0.3879, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.51% (0.3469 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.47% (0.3488 => 0.3923, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3460 => 0.3890, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 12.05% (0.3643 => 0.4082, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.00% (0.3650 => 0.4088, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.65% (0.3724 => 0.4158, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.81% (0.5826 => 0.6223, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.79% (0.1620 => 0.1730, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 6.55% (0.5889 => 0.6275, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.64% (1.5932 => 1.6831, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.27% (1.6211 => 1.7066, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.23% (3.5627 => 3.7489, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 5.03% (0.7171 => 0.7532, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.84% (0.4361 => 0.4572, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.75% (1.3152 => 1.3777, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.63% (0.4994 => 0.5225, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.62% (0.5026 => 0.5258, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.56% (0.5900 => 0.6169, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (0.5000 => 0.5224, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.48% (0.3930 => 0.4106, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.37% (0.4029 => 0.4205, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 4.36% (1.0781 => 1.1251, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.17% (0.2736 => 0.2850, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 3.92% (4.2109 => 4.3759, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.2866 => 0.2978, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.90% (0.2875 => 0.2987, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.65% (0.2738 => 0.2838, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.63% (2.7292 => 2.8284, std. dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: 3.63% (0.3004 => 0.3113, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.62% (0.2792 => 0.2893, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.58% (0.9909 => 1.0264, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.51% (0.3195 => 0.3307, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.43% (1.9694 => 2.0369, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.38% (2.0673 => 2.1372, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.24% (0.3267 => 0.3373, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.23% (0.3096 => 0.3196, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.22% (2.1013 => 2.1690, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.20% (1.9966 => 2.0605, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.20% (0.4658 => 0.4807, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.19% (0.3890 => 0.4014, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3317 => 0.3421, std. dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 3.07% (5.5417 => 5.7121, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/lists: 3.02% (0.3348 => 0.3449, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.00% (0.3903 => 0.4020, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 2.90% (1.8794 => 1.9339, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 2.85% (0.3678 => 0.3783, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 2.84% (0.3726 => 0.3832, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (0.3625 => 0.3727, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (4.4195 => 4.5437, std. dev.: 0.0036) MultiSource/Applications/hbd/hbd: 2.77% (0.9697 => 0.9966, std. dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (2.1653 => 2.2248, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 2.70% (0.4146 => 0.4258, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 2.69% (4.6177 => 4.7419, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 2.56% (0.4251 => 0.4360, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.54% (0.4139 => 0.4244, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 2.51% (23.5202 => 24.1097, std. dev.: 0.0154) MultiSource/Applications/treecc/treecc: 2.48% (0.7875 => 0.8070, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 2.24% (0.5546 => 0.5670, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.20% (0.6634 => 0.6780, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 2.12% (1.4269 => 1.4571, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.5012 => 0.5112, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.99% (0.6435 => 0.6563, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.00% (2.0346 => 2.0550, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.06% (0.5917 => 0.6690, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 6.36% (0.2122 => 0.2257, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6739, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-2: 4.98% (1.8057 => 1.8956, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1730, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.22% (105.3826 => 107.7174, std. dev.: 0.0312) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2091, std. dev.: 0.0567) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4584, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5031, std. dev.: 0.0221) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5905, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2228, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.65% (2.4764 => 2.3859, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: -1.65% (11.9555 => 11.7581, std. dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.03% (25.4195 => 16.5157, std. dev.: 0.0130) SingleSource/Benchmarks/Dhrystone/fldry: -9.97% (17.2379 => 15.5200, std. dev.: 0.2649) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7911, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary2: -7.54% (0.2402 => 0.2221, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: -3.99% (0.4438 => 0.4261, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7939, std. dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -3.49% (14.0481 => 13.5573, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5811, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 04:31:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 06:31:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120727113116.BEAE82A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2418?compare_to=2415&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2418, Order: 160854, Start Time: 2012-07-27 10:17:47, End Time: 2012-07-27 11:31:39 To: 2415, Order: 160852, Start Time: 2012-07-27 08:35:47, End Time: 2012-07-27 09:49:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (140 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.28% (54.7121 => 56.5055, std. dev.: 0.0935) SingleSource/Benchmarks/Misc/lowercase: 1.35% (7.9537 => 8.0612, std. dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.78% (3.8381 => 3.7696, std. dev.: 0.0242) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.78% (2.0176 => 2.2956, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.04% (0.5818 => 0.6344, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.99% (0.5748 => 0.6265, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.97% (0.3578 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.83% (0.3601 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.80% (0.3646 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.71% (0.3650 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.65% (0.7061 => 0.7672, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.60% (0.3789 => 0.4115, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: 8.60% (0.3663 => 0.3978, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.58% (0.3623 => 0.3934, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 8.38% (0.3914 => 0.4242, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/parameter-passing: 8.22% (0.4003 => 0.4332, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.20% (0.3940 => 0.4263, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.57% (0.3130 => 0.3367, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.19% (0.7710 => 0.8264, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 6.86% (1.3693 => 1.4632, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.36% (0.2596 => 0.2761, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.26% (0.4328 => 0.4599, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.24% (3.9660 => 4.2135, std. dev.: 0.0101) MultiSource/Applications/lambda-0_1_3/lambda: 6.21% (0.7038 => 0.7475, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.13% (0.5265 => 0.5588, std. dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: 6.11% (0.2781 => 0.2951, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.92% (0.2721 => 0.2882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.76% (0.4062 => 0.4296, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.72% (0.2782 => 0.2941, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.49% (0.6959 => 0.7341, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2607 => 0.2750, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.36% (0.3899 => 0.4108, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.30% (0.4379 => 0.4611, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.29% (0.2761 => 0.2907, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.25% (0.2760 => 0.2905, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.16% (1.2193 => 1.2822, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.16% (0.2966 => 0.3119, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.15% (0.4390 => 0.4616, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.14% (0.2628 => 0.2763, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.06% (0.2765 => 0.2905, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.06% (0.3580 => 0.3761, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.05% (0.3485 => 0.3661, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.02% (1.9828 => 2.0824, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.02% (0.3107 => 0.3263, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.99% (0.3489 => 0.3663, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.98% (0.2690 => 0.2824, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.96% (0.9199 => 0.9655, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2726 => 0.2861, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.93% (0.2655 => 0.2786, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.89% (0.2988 => 0.3134, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.82% (0.2696 => 0.2826, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 4.81% (0.3453 => 0.3619, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.79% (0.5577 => 0.5844, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 4.77% (0.2937 => 0.3077, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.73% (0.3149 => 0.3298, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.70% (0.3192 => 0.3342, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.60% (16.6129 => 17.3778, std. dev.: 0.0104) MultiSource/Applications/SPASS/SPASS: 4.59% (13.8202 => 14.4542, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.55% (1.4563 => 1.5225, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 4.52% (0.3293 => 0.3442, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.51% (0.4016 => 0.4197, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.39% (0.2914 => 0.3042, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.33% (0.7506 => 0.7831, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.31% (0.5637 => 0.5880, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.30% (1.3819 => 1.4413, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.27% (0.2925 => 0.3050, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists1: 4.27% (0.3534 => 0.3685, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.26% (13.2842 => 13.8503, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.25% (7.2180 => 7.5249, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.25% (1.3813 => 1.4400, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 4.21% (0.3868 => 0.4031, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (0.3756 => 0.3914, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.10% (1.1364 => 1.1830, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.07% (1.3245 => 1.3784, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.07% (0.3246 => 0.3378, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.02% (3.8646 => 4.0201, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 3.97% (1.0594 => 1.1015, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 3.97% (0.8310 => 0.8640, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 3.96% (1.1061 => 1.1499, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.94% (0.7460 => 0.7754, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.81% (1.9270 => 2.0004, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.2945 => 0.3056, std. dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 3.74% (0.2995 => 0.3107, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.68% (1.2292 => 1.2744, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.55% (4.3801 => 4.5358, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.52% (3.6692 => 3.7985, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.51% (4.4433 => 4.5992, std. dev.: 0.0104) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3220 => 0.3330, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.32% (0.4791 => 0.4950, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.30% (2.1791 => 2.2511, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.19% (4.9865 => 5.1454, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.05% (1.1333 => 1.1679, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3755 => 0.3867, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 2.92% (0.4113 => 0.4233, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.84% (8.4961 => 8.7373, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.79% (3.1889 => 3.2779, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.72% (0.6135 => 0.6302, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.70% (0.8698 => 0.8933, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.63% (0.6283 => 0.6448, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.48% (2.1007 => 2.1527, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (6.5754 => 6.7360, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 2.44% (14.5298 => 14.8839, std. dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: 2.42% (16.2614 => 16.6544, std. dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.25% (3.2742 => 3.3478, std. dev.: 0.0066) MultiSource/Applications/oggenc/oggenc: 2.25% (4.6629 => 4.7676, std. dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 2.21% (14.8535 => 15.1814, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.92% (1.5188 => 1.5479, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.15% (0.9108 => 0.9213, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.09% (1.0313 => 1.0425, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5122, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2638, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: 9.02% (1.2998 => 1.4171, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.24% (0.9996 => 1.0520, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 4.50% (7.4271 => 7.7615, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.90% (11.2619 => 11.7016, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4773, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9772, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.58% (1.7688 => 1.8144, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0310 => 1.0567, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5089 => 1.5356, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5928 => 4.6628, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 1.34% (1.9290 => 1.9548, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1406, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.36% (22.5627 => 21.1270, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.28% (0.3511 => 0.3396, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.66% (0.6576 => 0.6467, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.17% (0.8818 => 0.8715, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.95% (0.0997 => 0.0828, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.50% (1.2308 => 1.1016, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3180, std. dev.: 0.0067) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9198, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: -2.63% (3.0263 => 2.9466, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5945, std. dev.: 0.0173) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5076, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2369, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.78% (0.6589 => 0.6472, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3305 => 7.2173, std. dev.: 0.0248) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.52% (20.3410 => 20.0327, std. dev.: 0.0279) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8698, std. dev.: 0.0173) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2564, std. dev.: 0.0036) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2301, std. dev.: 0.0099) MultiSource/Applications/lua/lua: -1.08% (26.5159 => 26.2306, std. dev.: 0.0250) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 04:47:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 06:47:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120727114734.51A8B2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2419?compare_to=2416&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2419, Order: 160854, Start Time: 2012-07-27 10:29:00, End Time: 2012-07-27 11:47:57 To: 2416, Order: 160852, Start Time: 2012-07-27 08:40:28, End Time: 2012-07-27 09:59:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (84 on baseline) Performance Improvements: 2 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (755 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.26% (13.4336 => 13.1296, std. dev.: 0.0175) SingleSource/UnitTests/ObjC++/property-reference: -1.57% (0.7756 => 0.7634, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.64% (10.3673 => 13.1296, std. dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.00% (1.1194 => 1.2537, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.52% (0.3473 => 0.3873, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.35% (0.3561 => 0.3965, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 11.27% (0.3497 => 0.3891, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.26% (0.3543 => 0.3942, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.18% (0.3516 => 0.3909, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3543 => 0.3938, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 10.96% (0.3694 => 0.4099, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: 10.55% (0.3828 => 0.4232, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.45% (0.3886 => 0.4292, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.34% (0.3927 => 0.4333, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.38% (2.2022 => 2.3867, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.23% (1.7609 => 1.9058, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.12% (0.2065 => 0.2212, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (0.1622 => 0.1731, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.19% (0.1906 => 0.2024, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 5.94% (10.4361 => 11.0564, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.63% (0.3177 => 0.3356, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 5.33% (0.5925 => 0.6241, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.4615 => 0.4860, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 5.29% (0.6030 => 0.6349, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.88% (0.4879 => 0.5117, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 4.75% (0.3282 => 0.3438, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.29% (7.0540 => 7.3567, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.28% (4.9449 => 5.1564, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 4.20% (0.7326 => 0.7634, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (9.4845 => 9.8787, std. dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 4.06% (0.7433 => 0.7735, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.94% (0.8172 => 0.8494, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (5.0018 => 5.1974, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.65% (0.5860 => 0.6074, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.5569 => 0.5769, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (4.2646 => 4.4121, std. dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3121 => 0.3227, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 3.19% (0.7835 => 0.8085, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3423 => 0.3532, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.15% (8.1363 => 8.3923, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.93% (0.3826 => 0.3938, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.1861 => 1.2208, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.91% (14.3668 => 14.7851, std. dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: 2.85% (5.7591 => 5.9231, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.78% (1.3050 => 1.3413, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.72% (0.4636 => 0.4762, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.66% (0.5981 => 0.6140, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.5415 => 1.5823, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 2.63% (2.0273 => 2.0806, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.59% (1.1642 => 1.1944, std. dev.: 0.0083) MultiSource/Applications/d/make_dparser: 2.59% (3.3354 => 3.4218, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 2.54% (1.5603 => 1.5999, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.49% (0.4103 => 0.4205, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.47% (0.5105 => 0.5231, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.33% (3.8723 => 3.9626, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.21% (0.9765 => 0.9981, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6450 => 0.6585, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 2.06% (0.8921 => 0.9105, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.05% (1.5859 => 1.6184, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.2024 => 2.2461, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.94% (1.4186 => 1.4461, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (0.6675 => 0.6790, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 1.58% (0.6456 => 0.6558, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.57% (17.1811 => 17.4505, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.48% (2.0665 => 2.0970, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 1.41% (2.2969 => 2.3292, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 1.24% (1.1840 => 1.1987, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.10% (1.2842 => 1.2983, std. dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.04% (1.0722 => 1.0833, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.17% (4.2280 => 4.4043, std. dev.: 0.0404) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7570, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.53% (1.0313 => 1.0574, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.86% (3.1578 => 3.2166, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (1.5086 => 1.5347, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8336, std. dev.: 0.0012) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2043, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2373, std. dev.: 0.0097) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.10% (5.2763 => 3.1605, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.44% (5.3855 => 3.6924, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.67% (5.3526 => 3.7110, std. dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -15.02% (54.1659 => 46.0305, std. dev.: 0.0280) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.01% (2.9384 => 2.5560, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.28% (22.1758 => 19.8963, std. dev.: 0.0441) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.07% (3.8922 => 3.8507, std. dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.33% (0.0998 => 0.0855, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.48% (1.2373 => 1.1076, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel-2: -7.34% (1.5373 => 1.4245, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5535, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5099, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -4.38% (1.9577 => 1.8719, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4679, std. dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9045, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4157, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0007, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.33% (1.3677 => 1.3358, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.76% (12.5348 => 12.3146, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4186, std. dev.: 0.0091) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8093, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 06:13:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 08:13:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120727131315.6EEC02A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2420?compare_to=2418&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2420, Order: 160855, Start Time: 2012-07-27 11:59:38, End Time: 2012-07-27 13:13:39 To: 2418, Order: 160854, Start Time: 2012-07-27 10:17:47, End Time: 2012-07-27 11:31:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (139 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.90% (2.0176 => 2.2981, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.72% (0.4003 => 0.4392, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 9.49% (0.7061 => 0.7731, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.49% (0.5818 => 0.6370, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.27% (0.5748 => 0.6281, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.97% (0.3578 => 0.3899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.78% (0.3646 => 0.3966, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.78% (0.3601 => 0.3917, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.67% (0.3623 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.63% (0.3789 => 0.4116, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 8.57% (0.3663 => 0.3977, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.55% (0.3650 => 0.3962, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 8.43% (0.3914 => 0.4244, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.17% (0.3940 => 0.4262, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.76% (0.3130 => 0.3373, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.26% (0.1819 => 0.1951, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.04% (0.7710 => 0.8253, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 6.76% (1.3693 => 1.4619, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.42% (0.5265 => 0.5603, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (3.9660 => 4.2191, std. dev.: 0.0072) MultiSource/Applications/lambda-0_1_3/lambda: 6.35% (0.7038 => 0.7485, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.28% (0.2596 => 0.2759, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 6.25% (0.4062 => 0.4316, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.10% (0.2721 => 0.2887, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.10% (0.4328 => 0.4592, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.83% (0.2781 => 0.2943, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.62% (0.6959 => 0.7350, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.51% (0.3899 => 0.4114, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.49% (0.3022 => 0.3188, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.4379 => 0.4616, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.24% (0.5577 => 0.5869, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.22% (1.2193 => 1.2829, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.20% (0.2655 => 0.2793, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.16% (0.2966 => 0.3119, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.14% (0.2607 => 0.2741, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.14% (0.2765 => 0.2907, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.13% (0.2690 => 0.2828, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.10% (0.2726 => 0.2865, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.08% (0.3485 => 0.3662, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2628 => 0.2761, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.05% (1.9828 => 2.0830, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 5.03% (0.2761 => 0.2900, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.03% (0.9199 => 0.9662, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.02% (0.3489 => 0.3664, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.96% (0.3107 => 0.3261, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 4.94% (0.2937 => 0.3082, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.92% (0.3293 => 0.3455, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 4.89% (0.2988 => 0.3134, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.86% (0.2696 => 0.2827, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.86% (0.3192 => 0.3347, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.80% (0.3149 => 0.3300, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 4.70% (16.6129 => 17.3938, std. dev.: 0.0070) MultiSource/Applications/SPASS/SPASS: 4.68% (13.8202 => 14.4664, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/sieve: 4.52% (0.3453 => 0.3609, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.51% (1.4563 => 1.5220, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.44% (0.4390 => 0.4585, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.2914 => 0.3043, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.41% (1.3819 => 1.4429, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.37% (1.3813 => 1.4416, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.36% (0.3534 => 0.3688, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.34% (0.2925 => 0.3052, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.31% (0.3246 => 0.3386, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.31% (0.4016 => 0.4189, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.30% (1.1364 => 1.1853, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.29% (7.2180 => 7.5275, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.24% (1.1061 => 1.1530, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.24% (0.5637 => 0.5876, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.24% (0.7506 => 0.7824, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.23% (13.2842 => 13.8461, std. dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.18% (0.3756 => 0.3913, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.17% (3.8646 => 4.0259, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.12% (0.7460 => 0.7767, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3868 => 0.4027, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.01% (0.8310 => 0.8643, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.98% (1.0594 => 1.1016, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 3.94% (1.9270 => 2.0030, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.89% (1.3245 => 1.3760, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 3.80% (0.2945 => 0.3057, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.66% (1.2292 => 1.2742, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.63% (0.3220 => 0.3337, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.59% (3.6692 => 3.8008, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (4.3801 => 4.5369, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.54% (4.4433 => 4.6007, std. dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 3.47% (0.2995 => 0.3099, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.30% (0.4791 => 0.4949, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.28% (2.1791 => 2.2506, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.12% (4.9865 => 5.1423, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.01% (1.1333 => 1.1674, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 2.97% (3.1889 => 3.2835, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.80% (0.6283 => 0.6459, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.78% (0.8698 => 0.8940, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.74% (0.6135 => 0.6303, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 2.70% (8.4961 => 8.7259, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 2.70% (0.4113 => 0.4224, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.70% (4.6629 => 4.7886, std. dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 2.50% (14.5298 => 14.8936, std. dev.: 0.0097) MultiSource/Applications/JM/ldecod/ldecod: 2.42% (6.5754 => 6.7346, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.40% (16.2614 => 16.6510, std. dev.: 0.0296) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.38% (3.2742 => 3.3522, std. dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 2.32% (14.8535 => 15.1986, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.31% (2.1007 => 2.1493, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.88% (1.5188 => 1.5474, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.21% (0.9108 => 0.9218, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.14% (1.0313 => 1.0431, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5158, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: 7.58% (1.2998 => 1.3983, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.18% (0.9996 => 1.0514, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 4.45% (7.4271 => 7.7578, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7029, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 3.72% (1.9144 => 1.9857, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4773, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8170, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.59% (1.5089 => 1.5329, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 1.50% (5.5130 => 5.5955, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.42% (4.5928 => 4.6579, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2144, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1400, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.41% (22.5627 => 21.1157, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.16% (0.3511 => 0.3400, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.65% (0.0997 => 0.0821, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1101, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.18% (0.3139 => 0.2945, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.19% (1.3780 => 1.3202, std. dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9195, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5878, std. dev.: 0.0152) MultiSource/Applications/spiff/spiff: -2.65% (3.0263 => 2.9462, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2203, std. dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.05% (20.3410 => 19.9239, std. dev.: 0.0298) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5006, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.75% (0.6589 => 0.6474, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3305 => 7.2234, std. dev.: 0.0080) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.32% (2.5254 => 2.4921, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2493, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8702, std. dev.: 0.0153) MultiSource/Applications/lua/lua: -1.09% (26.5159 => 26.2276, std. dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8492, std. dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 06:34:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 08:34:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120727133440.CAAB02A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2421?compare_to=2419&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2421, Order: 160855, Start Time: 2012-07-27 12:16:01, End Time: 2012-07-27 13:35:05 To: 2419, Order: 160854, Start Time: 2012-07-27 10:29:00, End Time: 2012-07-27 11:47:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (78 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (761 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.59% (1.4245 => 1.4472, std. dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.84% (10.3673 => 13.1500, std. dev.: 0.0075) SingleSource/UnitTests/ObjC/trivial-interface: 11.49% (0.3473 => 0.3872, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.49% (0.3543 => 0.3950, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 11.27% (0.3497 => 0.3891, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.23% (0.3516 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.18% (0.3543 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.18% (0.3561 => 0.3959, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.18% (1.1194 => 1.2445, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.68% (0.3828 => 0.4237, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.47% (0.3886 => 0.4293, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.34% (0.3927 => 0.4333, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.12% (2.2022 => 2.3811, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.53% (1.7609 => 1.8935, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5925 => 0.6293, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 6.07% (0.6030 => 0.6396, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.96% (0.2065 => 0.2188, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 5.74% (10.4361 => 11.0354, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.38% (0.3177 => 0.3348, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 5.00% (0.7326 => 0.7692, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.84% (0.3282 => 0.3441, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.72% (0.4615 => 0.4833, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.70% (0.8172 => 0.8556, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.61% (0.4879 => 0.5104, std. dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 4.08% (0.7433 => 0.7736, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 4.08% (9.4845 => 9.8711, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (5.0018 => 5.1980, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.83% (7.0540 => 7.3243, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.80% (4.9449 => 5.1328, std. dev.: 0.0063) MultiSource/Applications/spiff/spiff: 3.64% (0.7835 => 0.8120, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.56% (0.3121 => 0.3232, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (4.2646 => 4.4123, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.43% (0.5569 => 0.5760, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.31% (0.5860 => 0.6054, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 3.22% (5.7591 => 5.9446, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 3.15% (1.5603 => 1.6095, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.10% (8.1363 => 8.3883, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.94% (14.3668 => 14.7895, std. dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.1861 => 1.2208, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.92% (1.3050 => 1.3431, std. dev.: 0.0057) MultiSource/Applications/d/make_dparser: 2.73% (3.3354 => 3.4265, std. dev.: 0.0051) MultiSource/Applications/treecc/treecc: 2.63% (2.0273 => 2.0807, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.61% (0.4636 => 0.4757, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 2.57% (1.1642 => 1.1941, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.56% (1.5415 => 1.5810, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.46% (0.9765 => 1.0005, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.41% (0.5105 => 0.5228, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.36% (0.8067 => 0.8257, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.33% (3.8723 => 3.9627, std. dev.: 0.0290) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.19% (1.5859 => 1.6207, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.16% (2.2024 => 2.2500, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.94% (0.5981 => 0.6097, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.88% (0.6450 => 0.6571, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 1.84% (0.6456 => 0.6575, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6675 => 0.6797, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 1.82% (0.8921 => 0.9083, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.77% (1.4186 => 1.4437, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.73% (17.1811 => 17.4784, std. dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.62% (2.0665 => 2.1000, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.34% (1.1840 => 1.1999, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.30% (2.2969 => 2.3267, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 1.25% (1.2842 => 1.3003, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.19% (1.0722 => 1.0850, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.70% (4.2280 => 4.3844, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7593, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.54% (1.0313 => 1.0575, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8329, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5086 => 1.5329, std. dev.: 0.0016) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2038, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2242, std. dev.: 0.0153) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3373, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.50% (0.8651 => 0.1687, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.28% (5.2763 => 3.1512, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.68% (5.3855 => 3.6796, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.12% (5.3526 => 3.6870, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0013, std. dev.: 0.0221) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.59% (2.9384 => 2.5391, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -10.38% (22.1758 => 19.8747, std. dev.: 0.0376) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.55% (1.6925 => 1.4294, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.23% (1.2373 => 1.1107, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5538, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -5.86% (1.5373 => 1.4472, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -4.60% (1.9577 => 1.8677, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4806, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (8.1563 => 7.9109, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4289, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0015, std. dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.33% (1.3677 => 1.3358, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3195, std. dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4177, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.42% (1.8329 => 1.8069, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 06:41:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 08:41:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120727134136.BE45B2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2422?compare_to=2417&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2422, Order: 160855, Start Time: 2012-07-27 10:58:41, End Time: 2012-07-27 13:42:01 To: 2417, Order: 160852, Start Time: 2012-07-27 07:47:10, End Time: 2012-07-27 10:30:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (71 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (811 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.69% (1.6831 => 1.7115, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.81% (0.3465 => 0.3909, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.77% (0.3446 => 0.3886, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.73% (0.3442 => 0.3880, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.72% (0.3460 => 0.3900, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.71% (0.3469 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.64% (0.3488 => 0.3929, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.64% (0.3496 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.27% (0.3643 => 0.4090, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.11% (0.3650 => 0.4092, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.68% (0.3724 => 0.4159, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.28% (0.3792 => 0.4106, std. dev.: 0.0077) MultiSource/Applications/oggenc/oggenc: 7.43% (1.5932 => 1.7115, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.88% (0.5826 => 0.6227, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.76% (0.5889 => 0.6287, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.36% (1.6211 => 1.7080, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.05% (3.5627 => 3.7426, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: 5.05% (0.7171 => 0.7533, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.98% (0.5000 => 0.5249, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (0.4994 => 0.5237, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.84% (1.3152 => 1.3789, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.69% (0.4029 => 0.4218, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.62% (0.5026 => 0.5258, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.51% (0.5900 => 0.6166, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.49% (0.4361 => 0.4557, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.45% (0.3930 => 0.4105, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 4.24% (1.0781 => 1.1238, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.95% (4.2109 => 4.3773, std. dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.63% (2.7292 => 2.8283, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.2866 => 0.2969, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (1.9966 => 2.0663, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 3.36% (2.1013 => 2.1718, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.33% (1.9694 => 2.0350, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.26% (0.3890 => 0.4017, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.18% (0.3362 => 0.3469, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.18% (0.9909 => 1.0224, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.15% (5.5417 => 5.7161, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 2.94% (2.1653 => 2.2290, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.92% (0.4139 => 0.4260, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.92% (0.4658 => 0.4794, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 2.87% (0.9697 => 0.9975, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.84% (0.3903 => 0.4014, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 2.75% (4.6177 => 4.7448, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.74% (2.0673 => 2.1240, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.72% (4.4195 => 4.5399, std. dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 2.55% (23.5202 => 24.1206, std. dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: 2.43% (1.8794 => 1.9250, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 2.37% (0.7875 => 0.8062, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 2.28% (1.4269 => 1.4594, std. dev.: 0.0066) MultiSource/Applications/siod/siod: 2.17% (0.6634 => 0.6778, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.11% (0.5546 => 0.5663, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.76% (0.6435 => 0.6548, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.11% (2.0346 => 2.0571, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 7.87% (0.2122 => 0.2289, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6745, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-2: 4.99% (1.8057 => 1.8958, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1671, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6572, std. dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2101, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4987, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5919, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2209, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.07% (2.4764 => 2.3755, std. dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: -1.58% (11.9555 => 11.7670, std. dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.03% (25.4195 => 16.5160, std. dev.: 0.0189) SingleSource/Benchmarks/Dhrystone/fldry: -8.85% (17.2379 => 15.7118, std. dev.: 0.0747) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7982, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary2: -7.37% (0.2402 => 0.2225, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: -3.92% (0.4438 => 0.4264, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7989, std. dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/dry: -3.64% (14.0481 => 13.5370, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5751, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 07:55:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 09:55:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120727145530.511602A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2423?compare_to=2420&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2423, Order: 160857, Start Time: 2012-07-27 13:41:37, End Time: 2012-07-27 14:55:53 To: 2420, Order: 160855, Start Time: 2012-07-27 11:59:38, End Time: 2012-07-27 13:13:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (139 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.03% (78.7308 => 81.1148, std. dev.: 0.7145) SingleSource/Benchmarks/Misc/mandel-2: 1.38% (1.3983 => 1.4176, std. dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.78% (2.0176 => 2.2957, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.76% (0.5818 => 0.6386, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.53% (0.3578 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.46% (0.3646 => 0.3991, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.44% (0.3601 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.43% (0.5748 => 0.6290, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 9.40% (0.3789 => 0.4145, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.39% (0.3663 => 0.4007, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.39% (0.7061 => 0.7724, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.23% (0.3650 => 0.3987, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.22% (0.3623 => 0.3957, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.99% (0.3914 => 0.4266, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.84% (0.4003 => 0.4357, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.76% (0.3940 => 0.4285, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.70% (0.3130 => 0.3371, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.7710 => 0.8250, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 6.82% (1.3693 => 1.4627, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.42% (3.9660 => 4.2208, std. dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: 6.37% (0.7038 => 0.7486, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.32% (0.2596 => 0.2760, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.21% (0.5265 => 0.5592, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4328 => 0.4593, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.03% (0.2721 => 0.2885, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.79% (0.2781 => 0.2942, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3899 => 0.4118, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.61% (0.4062 => 0.4290, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2782 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.40% (0.2760 => 0.2909, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.39% (0.4379 => 0.4615, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.34% (0.3580 => 0.3771, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.33% (0.3022 => 0.3183, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.6959 => 0.7322, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.20% (0.9199 => 0.9677, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.18% (1.2193 => 1.2824, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 5.14% (0.2607 => 0.2741, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.13% (0.2690 => 0.2828, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.12% (0.2966 => 0.3118, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2628 => 0.2761, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.05% (0.2655 => 0.2789, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 5.03% (0.2726 => 0.2863, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.02% (0.3485 => 0.3660, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.98% (1.9828 => 2.0815, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.93% (0.3489 => 0.3661, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.90% (0.5577 => 0.5850, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.83% (0.2937 => 0.3079, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.83% (1.4563 => 1.5267, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary: 4.83% (0.3107 => 0.3257, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.83% (0.3149 => 0.3301, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 4.79% (0.3192 => 0.3345, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.77% (13.8202 => 14.4790, std. dev.: 0.0055) MultiSource/Applications/kimwitu++/kc: 4.70% (16.6129 => 17.3932, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3293 => 0.3446, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.58% (0.3453 => 0.3611, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.56% (0.4390 => 0.4590, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.52% (1.3819 => 1.4443, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.50% (0.7506 => 0.7844, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 4.41% (0.2925 => 0.3054, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.31% (7.2180 => 7.5294, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.31% (0.4016 => 0.4189, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.29% (1.3813 => 1.4406, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.26% (0.2914 => 0.3038, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.24% (13.2842 => 13.8481, std. dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.22% (0.5637 => 0.5875, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (0.3756 => 0.3914, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.1364 => 1.1842, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.15% (3.8646 => 4.0251, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.3245 => 1.3795, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.13% (0.3246 => 0.3380, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (0.8310 => 0.8652, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3868 => 0.4027, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.07% (1.1061 => 1.1511, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.05% (0.7460 => 0.7762, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 4.04% (1.9270 => 2.0049, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.89% (1.0594 => 1.1006, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.2945 => 0.3055, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.73% (4.3801 => 4.5436, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 3.63% (1.2292 => 1.2738, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.62% (3.6692 => 3.8021, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (4.4433 => 4.6028, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 3.54% (0.3220 => 0.3334, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.54% (0.2995 => 0.3101, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.29% (2.1791 => 2.2507, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.26% (0.4791 => 0.4947, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.17% (1.1333 => 1.1692, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.12% (4.9865 => 5.1422, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.97% (3.1889 => 3.2836, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.93% (0.3755 => 0.3865, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 2.86% (8.4961 => 8.7394, std. dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.82% (0.8698 => 0.8943, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.79% (0.6135 => 0.6306, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.79% (0.6283 => 0.6458, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 2.75% (0.4113 => 0.4226, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.64% (4.6629 => 4.7858, std. dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: 2.47% (16.2614 => 16.6623, std. dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: 2.47% (14.5298 => 14.8880, std. dev.: 0.0136) MultiSource/Applications/JM/ldecod/ldecod: 2.43% (6.5754 => 6.7354, std. dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 2.34% (14.8535 => 15.2008, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.32% (2.1007 => 2.1494, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.24% (3.2742 => 3.3477, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.00% (1.5188 => 1.5492, std. dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.19% (0.9108 => 0.9216, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.16% (1.0313 => 1.0433, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5173, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2600, std. dev.: 0.0269) SingleSource/Benchmarks/Misc/mandel-2: 9.06% (1.2998 => 1.4176, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.16% (0.9996 => 1.0512, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7548, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7050, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4770, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.00% (1.9199 => 1.9775, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8158, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5089 => 1.5332, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 1.51% (4.5928 => 4.6623, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5950, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0494, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.12% (1.9290 => 1.9507, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1398, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.42% (22.5627 => 21.1144, std. dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.3511 => 0.3397, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.85% (0.0997 => 0.0819, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.57% (1.2308 => 1.1007, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3089, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9198, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.62% (3.0263 => 2.9471, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5987, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2178, std. dev.: 0.0112) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5035, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.89% (20.3410 => 19.9571, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3305 => 7.2151, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2505, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2248, std. dev.: 0.0260) MultiSource/Applications/lua/lua: -1.01% (26.5159 => 26.2492, std. dev.: 0.0268) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 08:21:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 10:21:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120727152123.3F2902A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2424?compare_to=2421&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2424, Order: 160857, Start Time: 2012-07-27 14:03:01, End Time: 2012-07-27 15:21:47 To: 2421, Order: 160855, Start Time: 2012-07-27 12:16:01, End Time: 2012-07-27 13:35:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (77 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (763 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.45% (78.1618 => 80.0760, std. dev.: 0.6306) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.86% (10.3673 => 13.1522, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.21% (1.1194 => 1.2561, std. dev.: 0.0106) SingleSource/UnitTests/ObjC/trivial-interface: 12.04% (0.3473 => 0.3891, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.84% (0.3497 => 0.3911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.83% (0.3516 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.71% (0.3543 => 0.3958, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 11.68% (0.3561 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.42% (0.3694 => 0.4116, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.86% (0.3886 => 0.4308, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.50% (2.2022 => 2.3893, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.16% (1.7609 => 1.9046, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.07% (0.2065 => 0.2211, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 6.26% (0.5925 => 0.6296, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.22% (0.4615 => 0.4902, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: 6.09% (0.6030 => 0.6397, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1906 => 0.2020, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.75% (10.4361 => 11.0364, std. dev.: 0.0087) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.51% (0.3177 => 0.3352, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.23% (0.4879 => 0.5134, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 5.00% (0.7326 => 0.7692, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.94% (0.3282 => 0.3444, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.17% (7.0540 => 7.3479, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.13% (4.9449 => 5.1490, std. dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 4.05% (0.7433 => 0.7734, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.05% (9.4845 => 9.8685, std. dev.: 0.0113) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.01% (5.0018 => 5.2025, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.88% (0.5569 => 0.5785, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.67% (0.5860 => 0.6075, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.50% (0.8172 => 0.8458, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.41% (4.2646 => 4.4099, std. dev.: 0.0102) MultiSource/Benchmarks/McCat/18-imp/imp: 3.33% (0.3423 => 0.3537, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.22% (0.3109 => 0.3209, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.13% (8.1363 => 8.3910, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (14.3668 => 14.8066, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.03% (1.3050 => 1.3446, std. dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 3.03% (5.7591 => 5.9337, std. dev.: 0.0089) MultiSource/Applications/hbd/hbd: 3.03% (1.5603 => 1.6076, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.1861 => 1.2209, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 2.92% (0.7835 => 0.8064, std. dev.: 0.0056) MultiSource/Applications/d/make_dparser: 2.73% (3.3354 => 3.4263, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.60% (0.8067 => 0.8277, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 2.54% (1.1642 => 1.1938, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.42% (0.4636 => 0.4748, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.39% (1.5415 => 1.5783, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.37% (2.0273 => 2.0754, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.37% (0.5105 => 0.5226, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.26% (3.8723 => 3.9598, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.16% (2.2024 => 2.2499, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.04% (1.4186 => 1.4475, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.02% (0.9765 => 0.9962, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.98% (1.5859 => 1.6173, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6450 => 0.6573, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 1.88% (0.8921 => 0.9089, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 1.86% (0.6456 => 0.6576, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.76% (17.1811 => 17.4834, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.71% (2.0665 => 2.1019, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.36% (1.1840 => 1.2001, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.32% (1.2842 => 1.3011, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.24% (1.0722 => 1.0855, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.49% (4.2280 => 4.4180, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7541, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2163, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5086 => 1.5338, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.61% (11.6436 => 11.8308, std. dev.: 0.0016) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2038, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.10% (9.1159 => 9.2161, std. dev.: 0.0334) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9195, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1301, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1618, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.42% (5.3855 => 3.6934, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.76% (5.3526 => 3.7059, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.98% (54.1659 => 46.0524, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.15% (2.9384 => 2.5519, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -10.20% (22.1758 => 19.9136, std. dev.: 0.0289) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.13% (0.0998 => 0.0857, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.24% (1.2373 => 1.1106, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-5: -6.88% (1.5835 => 1.4746, std. dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -6.05% (1.5373 => 1.4443, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.80% (1.9577 => 1.8637, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4859, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.02% (8.1563 => 7.9097, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.79% (8.6802 => 8.4377, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9995, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.33% (1.3677 => 1.3358, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6782, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3227, std. dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4190, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.24% (1.8329 => 1.8102, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 09:52:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 11:52:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120727165257.E04452A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2425?compare_to=2422&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2425, Order: 160857, Start Time: 2012-07-27 14:10:00, End Time: 2012-07-27 16:53:21 To: 2422, Order: 160855, Start Time: 2012-07-27 10:58:41, End Time: 2012-07-27 13:42:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (72 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (810 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.18% (52.5445 => 54.2166, std. dev.: 0.3490) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.07% (0.3465 => 0.3918, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 13.03% (0.3469 => 0.3921, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.03% (0.3446 => 0.3895, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 12.99% (0.3442 => 0.3889, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.95% (0.3460 => 0.3908, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.87% (0.3488 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.87% (0.3496 => 0.3946, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.52% (0.3643 => 0.4099, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/property: 12.38% (0.3650 => 0.4102, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.06% (0.3724 => 0.4173, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.85% (1.5932 => 1.7023, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 6.78% (0.5826 => 0.6221, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.50% (0.5889 => 0.6272, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.24% (1.6211 => 1.7061, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.19% (0.5026 => 0.5287, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (0.4994 => 0.5247, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.02% (3.5627 => 3.7417, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 4.99% (0.7171 => 0.7529, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.90% (0.5000 => 0.5245, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.80% (0.5900 => 0.6183, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.75% (1.3152 => 1.3777, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.61% (0.3930 => 0.4111, std. dev.: 0.0064) MultiSource/Applications/spiff/spiff: 4.59% (0.4029 => 0.4214, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.59% (0.4361 => 0.4561, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.43% (0.2866 => 0.2993, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 4.25% (1.0781 => 1.1239, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 4.24% (4.2109 => 4.3896, std. dev.: 0.0089) MultiSource/Benchmarks/nbench/nbench: 4.01% (0.2566 => 0.2669, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.2736 => 0.2842, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.81% (2.7292 => 2.8332, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (1.9694 => 2.0408, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.51% (1.9966 => 2.0666, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.21% (0.4139 => 0.4272, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.19% (5.5417 => 5.7184, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.16% (0.3890 => 0.4013, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.06% (0.3362 => 0.3465, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.05% (0.4658 => 0.4800, std. dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 3.00% (4.6177 => 4.7562, std. dev.: 0.0124) MultiSource/Benchmarks/mafft/pairlocalalign: 2.98% (2.1013 => 2.1640, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.97% (0.7875 => 0.8109, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.97% (4.4195 => 4.5506, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 2.93% (0.9909 => 1.0199, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (0.3903 => 0.4016, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 2.88% (2.1653 => 2.2277, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 2.80% (1.8794 => 1.9320, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.57% (2.0673 => 2.1205, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 2.50% (23.5202 => 24.1093, std. dev.: 0.0066) MultiSource/Applications/Burg/burg: 2.47% (0.5546 => 0.5683, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.40% (1.4269 => 1.4611, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 2.18% (0.9697 => 0.9908, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.99% (0.6634 => 0.6766, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.57% (0.6435 => 0.6536, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.26% (2.0346 => 2.0603, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.04% (0.2162 => 0.3525, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.12% (0.0734 => 0.0845, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.13% (0.2122 => 0.2252, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6765, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8960, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1662, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6620, std. dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2032, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4939, std. dev.: 0.0085) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.74% (3.1722 => 3.2273, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5910, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.39% (2.4764 => 2.3677, std. dev.: 0.0076) MultiSource/Applications/kimwitu++/kc: -1.57% (11.9555 => 11.7677, std. dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.15% (25.4195 => 16.4838, std. dev.: 0.0385) SingleSource/Benchmarks/Dhrystone/fldry: -9.26% (17.2379 => 15.6423, std. dev.: 0.2321) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7948, std. dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/ary2: -7.45% (0.2402 => 0.2223, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: -4.01% (0.4438 => 0.4260, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.74% (11.2080 => 10.7883, std. dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/dry: -3.60% (14.0481 => 13.5424, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5766, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 11:16:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 13:16:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120727181627.B6B1E2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2426?compare_to=2423&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2426, Order: 160865, Start Time: 2012-07-27 17:02:54, End Time: 2012-07-27 18:16:52 To: 2423, Order: 160857, Start Time: 2012-07-27 13:41:37, End Time: 2012-07-27 14:55:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (138 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.24% (54.2346 => 56.5322, std. dev.: 0.0496) SingleSource/Regression/C/uint64_to_float: 2.25% (0.5325 => 0.5445, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.94% (1.4176 => 1.3901, std. dev.: 0.0093) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.41% (2.0176 => 2.2881, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference-object: 9.54% (0.5818 => 0.6373, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.52% (0.7061 => 0.7733, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 9.31% (0.5748 => 0.6283, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/trivial-interface: 9.08% (0.3578 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.91% (0.3601 => 0.3922, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.91% (0.3646 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.87% (0.3663 => 0.3988, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 8.83% (0.3623 => 0.3943, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.82% (0.3650 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.79% (0.3789 => 0.4122, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.66% (0.3914 => 0.4253, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.49% (0.4003 => 0.4343, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.38% (0.3940 => 0.4270, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.77% (1.3693 => 1.4620, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.41% (0.7710 => 0.8204, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.33% (3.9660 => 4.2169, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.31% (0.5265 => 0.5597, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 6.28% (0.4062 => 0.4317, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 6.22% (0.7038 => 0.7476, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2596 => 0.2757, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4328 => 0.4593, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.92% (0.2721 => 0.2882, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.86% (0.2781 => 0.2944, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2966 => 0.3132, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/except: 5.58% (0.2760 => 0.2914, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.4379 => 0.4616, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.23% (0.3022 => 0.3180, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.19% (0.3485 => 0.3666, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.18% (0.3899 => 0.4101, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2690 => 0.2829, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.12% (0.2988 => 0.3141, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2761 => 0.2902, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.10% (0.4390 => 0.4614, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.10% (0.2607 => 0.2740, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.10% (0.2726 => 0.2865, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.06% (0.6959 => 0.7311, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.04% (1.2193 => 1.2807, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.00% (1.9828 => 2.0819, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 4.99% (0.3107 => 0.3262, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.97% (0.3580 => 0.3758, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.96% (0.3489 => 0.3662, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.94% (0.2937 => 0.3082, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.92% (0.3149 => 0.3304, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.90% (0.5577 => 0.5850, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.82% (0.9199 => 0.9642, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.71% (0.3293 => 0.3448, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.58% (0.4016 => 0.4200, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.58% (13.8202 => 14.4528, std. dev.: 0.0103) MultiSource/Applications/kimwitu++/kc: 4.52% (16.6129 => 17.3636, std. dev.: 0.0165) MultiSource/Benchmarks/McCat/09-vor/vor: 4.38% (0.2925 => 0.3053, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.36% (13.2842 => 13.8640, std. dev.: 0.0166) MultiSource/Applications/spiff/spiff: 4.36% (0.7506 => 0.7833, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.4563 => 1.5186, std. dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (0.3756 => 0.3915, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.22% (7.2180 => 7.5229, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.22% (0.2914 => 0.3037, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.21% (0.3868 => 0.4031, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.20% (0.5637 => 0.5874, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 4.19% (0.3534 => 0.3682, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.16% (1.1061 => 1.1521, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.10% (1.1364 => 1.1830, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.01% (1.3819 => 1.4373, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.00% (1.3813 => 1.4365, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.95% (3.8646 => 4.0174, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.94% (0.3246 => 0.3374, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.93% (1.9270 => 2.0027, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 3.91% (0.8310 => 0.8635, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.85% (1.3245 => 1.3755, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.71% (0.7460 => 0.7737, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.2945 => 0.3054, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.64% (1.0594 => 1.0980, std. dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.2292 => 1.2730, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (4.3801 => 4.5361, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.54% (4.4433 => 4.6007, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3220 => 0.3329, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.34% (3.6692 => 3.7918, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 3.13% (2.1791 => 2.2474, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.12% (4.9865 => 5.1420, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.09% (0.4791 => 0.4939, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.96% (1.1333 => 1.1669, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3755 => 0.3864, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.85% (3.1889 => 3.2798, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.71% (0.8698 => 0.8934, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.61% (0.6283 => 0.6447, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.58% (0.6135 => 0.6293, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 2.48% (0.4113 => 0.4215, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.41% (8.4961 => 8.7009, std. dev.: 0.0108) MultiSource/Applications/oggenc/oggenc: 2.35% (4.6629 => 4.7727, std. dev.: 0.0160) MultiSource/Applications/sqlite3/sqlite3: 2.30% (16.2614 => 16.6357, std. dev.: 0.0245) MultiSource/Applications/ClamAV/clamscan: 2.29% (14.5298 => 14.8626, std. dev.: 0.0125) MultiSource/Applications/JM/ldecod/ldecod: 2.28% (6.5754 => 6.7256, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 2.22% (14.8535 => 15.1836, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.11% (2.1007 => 2.1451, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.11% (3.2742 => 3.3434, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.85% (1.5188 => 1.5469, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.07% (1.0313 => 1.0423, std. dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 25.07% (1.8175 => 2.2731, std. dev.: 0.0388) SingleSource/Benchmarks/Misc/mandel-2: 6.95% (1.2998 => 1.3901, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.49% (0.9996 => 1.0545, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 4.43% (7.4271 => 7.7561, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7037, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4774, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8156, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.5928 => 4.6609, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.26% (1.9290 => 1.9534, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1402, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1223, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.36% (0.3511 => 0.3393, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.67% (0.6576 => 0.6466, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.19% (0.8818 => 0.8713, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.75% (0.0997 => 0.0840, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.61% (1.2308 => 1.1002, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5137, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3119, std. dev.: 0.0042) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9187, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.64% (3.0263 => 2.9464, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.46% (8.8259 => 8.6087, std. dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.33% (0.8342 => 0.8148, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.31% (20.3410 => 19.8709, std. dev.: 0.0463) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2252, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5089, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3305 => 7.2175, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.34% (5.3167 => 5.2454, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8664, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2217, std. dev.: 0.0431) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 11:21:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 13:21:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120727182103.730882A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2427?compare_to=2424&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2427, Order: 160865, Start Time: 2012-07-27 17:02:52, End Time: 2012-07-27 18:21:28 To: 2424, Order: 160857, Start Time: 2012-07-27 14:03:01, End Time: 2012-07-27 15:21:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (82 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.80% (54.8669 => 56.4023, std. dev.: 0.2040) SingleSource/Benchmarks/Misc/flops-5: 2.02% (1.4746 => 1.5044, std. dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.95% (10.3673 => 13.1608, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 12.47% (0.3473 => 0.3906, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.45% (0.3543 => 0.3984, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 12.35% (0.3497 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3516 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.19% (0.3543 => 0.3975, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.13% (0.3561 => 0.3993, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.86% (0.3694 => 0.4132, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.52% (0.3828 => 0.4269, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.42% (1.1194 => 1.2472, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.47% (1.7609 => 1.9100, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.36% (2.2022 => 2.3862, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.46% (0.2065 => 0.2219, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1892 => 0.2022, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.67% (0.3177 => 0.3389, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5925 => 0.6287, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.97% (0.6030 => 0.6390, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.54% (10.4361 => 11.0145, std. dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.53% (0.4615 => 0.4870, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.37% (0.4879 => 0.5141, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.94% (7.0540 => 7.4024, std. dev.: 0.0081) SingleSource/UnitTests/ObjC++/property-reference: 4.86% (0.7326 => 0.7682, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 4.18% (9.4845 => 9.8814, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.16% (0.8172 => 0.8512, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (4.9449 => 5.1439, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/oourafft: 4.02% (0.3282 => 0.3414, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.93% (0.7433 => 0.7725, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.80% (5.0018 => 5.1919, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.5569 => 0.5771, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.50% (0.5860 => 0.6065, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.40% (4.2646 => 4.4094, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.19% (5.7591 => 5.9431, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.16% (8.1363 => 8.3934, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.13% (0.7835 => 0.8080, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.94% (1.5603 => 1.6061, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.89% (1.3050 => 1.3427, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.88% (1.1861 => 1.2203, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.86% (14.3668 => 14.7778, std. dev.: 0.0170) MultiSource/Applications/Burg/burg: 2.67% (1.1642 => 1.1953, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.62% (1.5415 => 1.5819, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 2.56% (3.3354 => 3.4208, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.52% (2.0273 => 2.0783, std. dev.: 0.0112) MultiSource/Applications/lua/lua: 2.40% (3.8723 => 3.9653, std. dev.: 0.0126) MultiSource/Benchmarks/McCat/05-eks/eks: 2.35% (0.4299 => 0.4400, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.29% (0.8067 => 0.8252, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.22% (0.4636 => 0.4739, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.5105 => 0.5218, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.06% (2.2024 => 2.2477, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.01% (1.5859 => 1.6177, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.98% (0.9765 => 0.9958, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6450 => 0.6573, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.81% (0.6675 => 0.6796, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.80% (0.6456 => 0.6572, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.76% (0.5981 => 0.6086, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.76% (1.4186 => 1.4435, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 1.75% (0.8921 => 0.9077, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.50% (2.0665 => 2.0974, std. dev.: 0.0027) MultiSource/Applications/siod/siod: 1.37% (2.2969 => 2.3283, std. dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 1.31% (17.1811 => 17.4062, std. dev.: 0.0159) MultiSource/Benchmarks/nbench/nbench: 1.29% (1.1840 => 1.1993, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.28% (1.2842 => 1.3006, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.03% (1.0722 => 1.0832, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.38% (4.2280 => 4.4131, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7536, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.53% (1.0313 => 1.0574, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2159, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8326, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5086 => 1.5324, std. dev.: 0.0014) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2036, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 1.17% (2.2771 => 2.3038, std. dev.: 0.0045) MultiSource/Applications/minisat/minisat: 1.08% (9.1159 => 9.2141, std. dev.: 0.0207) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9196, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1320, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.87% (5.2763 => 3.1725, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.24% (5.3855 => 3.7030, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.59% (5.3526 => 3.7153, std. dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -14.97% (54.1659 => 46.0568, std. dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.22% (2.9384 => 2.5499, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -10.36% (22.1758 => 19.8776, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (3.8922 => 3.8490, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.83% (0.0998 => 0.0840, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.10% (1.2373 => 1.1123, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -5.53% (1.5373 => 1.4523, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5044, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -4.69% (1.9577 => 1.8658, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4895, std. dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9041, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4203, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0028, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3224, std. dev.: 0.0048) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4174, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 12:58:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 14:58:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120727195828.6DC5C2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2428?compare_to=2426&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2428, Order: 160874, Start Time: 2012-07-27 18:44:49, End Time: 2012-07-27 19:58:52 To: 2426, Order: 160865, Start Time: 2012-07-27 17:02:54, End Time: 2012-07-27 18:16:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (138 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.01% (1.1002 => 1.1113, std. dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.44% (2.0176 => 2.2888, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.49% (0.5818 => 0.6370, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 9.45% (0.7061 => 0.7728, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 9.34% (0.5748 => 0.6285, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.22% (0.3578 => 0.3908, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.97% (0.3601 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.93% (0.3663 => 0.3990, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.91% (0.3646 => 0.3971, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 8.86% (0.3623 => 0.3944, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.85% (0.3650 => 0.3973, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.79% (0.3789 => 0.4122, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.64% (0.3914 => 0.4252, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.57% (0.4003 => 0.4346, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.43% (0.3940 => 0.4272, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.54% (0.3130 => 0.3366, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.72% (0.7710 => 0.8228, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 6.67% (1.3693 => 1.4606, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.57% (0.5265 => 0.5611, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.37% (3.9660 => 4.2185, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.32% (0.2596 => 0.2760, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 6.28% (0.7038 => 0.7480, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4328 => 0.4593, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.03% (0.2721 => 0.2885, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 5.90% (0.2781 => 0.2945, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 5.69% (0.2760 => 0.2917, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.61% (0.4062 => 0.4290, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.4379 => 0.4618, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.34% (0.3485 => 0.3671, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.29% (0.5577 => 0.5872, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.26% (0.4390 => 0.4621, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.26% (0.6959 => 0.7325, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 5.22% (0.2988 => 0.3144, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.21% (0.3899 => 0.4102, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.17% (0.2765 => 0.2908, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.16% (0.2655 => 0.2792, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.16% (0.3489 => 0.3669, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.15% (1.9828 => 2.0850, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.12% (1.2193 => 1.2817, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.10% (0.2726 => 0.2865, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.07% (0.2761 => 0.2901, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.02% (0.2607 => 0.2738, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.02% (0.2690 => 0.2825, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.98% (0.3192 => 0.3351, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.97% (0.3580 => 0.3758, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.96% (0.3107 => 0.3261, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.87% (0.2937 => 0.3080, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.83% (0.9199 => 0.9643, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.76% (13.8202 => 14.4777, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.71% (0.2696 => 0.2823, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.71% (0.3293 => 0.3448, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 4.65% (16.6129 => 17.3851, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (1.4563 => 1.5239, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.3453 => 0.3610, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.44% (0.2925 => 0.3055, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.39% (13.2842 => 13.8680, std. dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.38% (0.4016 => 0.4192, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.37% (0.3756 => 0.3920, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.36% (0.2914 => 0.3041, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.35% (7.2180 => 7.5317, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 4.33% (0.7506 => 0.7831, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 4.33% (0.3534 => 0.3687, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.19% (3.8646 => 4.0267, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.16% (1.1364 => 1.1837, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.13% (0.5637 => 0.5870, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3868 => 0.4027, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.10% (0.3246 => 0.3379, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 4.08% (1.1061 => 1.1512, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.03% (1.3245 => 1.3779, std. dev.: 0.0111) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.00% (1.3813 => 1.4366, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.96% (0.8310 => 0.8639, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.95% (0.7460 => 0.7755, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.91% (1.3819 => 1.4360, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.88% (1.9270 => 2.0018, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (4.4433 => 4.6099, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.2945 => 0.3054, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.69% (1.0594 => 1.0985, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (4.3801 => 4.5371, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 3.58% (1.2292 => 1.2732, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.45% (3.6692 => 3.7959, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3220 => 0.3330, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.34% (2.1791 => 2.2518, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.19% (0.4791 => 0.4944, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.14% (1.1333 => 1.1689, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.13% (4.9865 => 5.1425, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.88% (0.3755 => 0.3863, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.83% (3.1889 => 3.2791, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.78% (0.8698 => 0.8940, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.69% (0.6283 => 0.6452, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 2.65% (0.4113 => 0.4222, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.61% (0.6135 => 0.6295, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 2.43% (16.2614 => 16.6568, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 2.38% (6.5754 => 6.7318, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 2.37% (8.4961 => 8.6974, std. dev.: 0.0109) MultiSource/Applications/oggenc/oggenc: 2.37% (4.6629 => 4.7732, std. dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: 2.28% (14.5298 => 14.8614, std. dev.: 0.0087) MultiSource/Applications/JM/lencod/lencod: 2.26% (14.8535 => 15.1898, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (2.1007 => 2.1474, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.11% (3.2742 => 3.3433, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.79% (1.5188 => 1.5460, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.11% (1.0313 => 1.0427, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5173, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/fbench: 24.91% (1.8175 => 2.2703, std. dev.: 0.0467) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.38% (1.2998 => 1.3827, std. dev.: 0.0217) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.11% (0.9996 => 1.0507, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 4.39% (7.4271 => 7.7529, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7033, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4766, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8161, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0310 => 1.0556, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (1.5089 => 1.5338, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5951, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.47% (4.5928 => 4.6602, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.18% (3.1071 => 3.1438, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1683, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.45% (22.5627 => 21.1076, std. dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.30% (0.3511 => 0.3395, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.85% (0.0997 => 0.0839, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.71% (1.2308 => 1.1113, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.11% (1.3780 => 1.3076, std. dev.: 0.0054) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9474, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6023, std. dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2224, std. dev.: 0.0102) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5038, std. dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.83% (20.3410 => 19.9686, std. dev.: 0.0458) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.62% (0.6589 => 0.6482, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.36% (7.3305 => 7.2309, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8670, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2490, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2248, std. dev.: 0.0303) MultiSource/Applications/lua/lua: -1.12% (26.5159 => 26.2185, std. dev.: 0.0229) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 13:04:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 15:04:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120727200423.D96AE2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2429?compare_to=2425&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2429, Order: 160866, Start Time: 2012-07-27 17:21:18, End Time: 2012-07-27 20:04:47 To: 2425, Order: 160857, Start Time: 2012-07-27 14:10:00, End Time: 2012-07-27 16:53:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (68 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (815 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.41% (125.6565 => 129.9430, std. dev.: 0.3887) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.23% (0.3446 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.18% (0.3460 => 0.3916, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.13% (0.3465 => 0.3920, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3442 => 0.3893, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.07% (0.3496 => 0.3953, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 12.97% (0.3469 => 0.3919, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.96% (0.3488 => 0.3940, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 12.60% (0.3650 => 0.4110, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.57% (0.3643 => 0.4101, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.14% (0.3724 => 0.4176, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.92% (0.5826 => 0.6229, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 6.69% (1.5932 => 1.6998, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference-object: 6.61% (0.5889 => 0.6278, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.40% (1.6211 => 1.7086, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.38% (0.7171 => 0.7557, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.25% (3.5627 => 3.7498, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.11% (0.3930 => 0.4131, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.95% (0.4994 => 0.5241, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.86% (0.4029 => 0.4225, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (0.5000 => 0.5237, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (0.5026 => 0.5261, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.62% (1.3152 => 1.3760, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.56% (0.4361 => 0.4560, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 4.44% (1.0781 => 1.1260, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 4.29% (4.2109 => 4.3914, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.2866 => 0.2987, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.19% (0.5900 => 0.6147, std. dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.79% (2.7292 => 2.8327, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (1.9966 => 2.0682, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.56% (0.4658 => 0.4824, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.54% (1.9694 => 2.0392, std. dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 3.35% (5.5417 => 5.7271, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.29% (0.3890 => 0.4018, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.19% (0.4139 => 0.4271, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.18% (4.4195 => 4.5601, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (2.1013 => 2.1674, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 3.06% (0.7875 => 0.8116, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 3.06% (4.6177 => 4.7589, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.01% (0.9909 => 1.0207, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 3.01% (2.1653 => 2.2304, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: 2.87% (1.8794 => 1.9333, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.77% (0.3903 => 0.4011, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.68% (2.0673 => 2.1227, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.62% (23.5202 => 24.1376, std. dev.: 0.0045) MultiSource/Applications/lua/lua: 2.40% (1.4269 => 1.4612, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 2.29% (0.9697 => 0.9919, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 2.20% (0.5546 => 0.5668, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.19% (0.6634 => 0.6779, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.71% (0.6435 => 0.6545, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (2.5769 => 2.9635, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6772, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary: 4.95% (0.2122 => 0.2227, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 4.85% (1.8057 => 1.8933, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1660, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6376, std. dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2014, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4940, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5904, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2233, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5122, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.45% (11.9555 => 11.7827, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.98% (25.4195 => 16.5288, std. dev.: 0.0233) SingleSource/Benchmarks/Dhrystone/fldry: -8.36% (17.2379 => 15.7960, std. dev.: 0.1709) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8084, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary2: -6.87% (0.2402 => 0.2237, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: -4.01% (0.4438 => 0.4260, std. dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7958, std. dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: -3.61% (14.0481 => 13.5407, std. dev.: 0.0176) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5797, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 13:07:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 15:07:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120727200758.59DD52A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2430?compare_to=2427&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2430, Order: 160874, Start Time: 2012-07-27 18:49:25, End Time: 2012-07-27 20:08:22 To: 2427, Order: 160865, Start Time: 2012-07-27 17:02:52, End Time: 2012-07-27 18:21:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (80 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.39% (3.7727 => 3.8252, std. dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.91% (10.3673 => 13.1569, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/trivial-interface: 12.50% (0.3473 => 0.3907, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3497 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.19% (0.3543 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3516 => 0.3944, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3543 => 0.3974, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 12.13% (0.3561 => 0.3993, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.91% (0.3694 => 0.4134, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 11.47% (0.3828 => 0.4267, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.45% (1.1194 => 1.2476, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 11.32% (0.3886 => 0.4326, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.36% (2.2022 => 2.3862, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.34% (1.7609 => 1.9078, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 6.98% (0.1432 => 0.1532, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 5.99% (0.5925 => 0.6280, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.97% (0.6030 => 0.6390, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.53% (10.4361 => 11.0133, std. dev.: 0.0230) SingleSource/UnitTests/ObjC++/property-reference: 5.35% (0.7326 => 0.7718, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.4879 => 0.5120, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.75% (0.4615 => 0.4834, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.61% (7.0540 => 7.3791, std. dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (9.4845 => 9.8790, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.02% (0.3282 => 0.3414, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.90% (0.7433 => 0.7723, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.78% (5.0018 => 5.1910, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.78% (4.9449 => 5.1317, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.76% (0.8172 => 0.8479, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.70% (0.5569 => 0.5775, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 3.41% (0.3109 => 0.3215, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.38% (0.5860 => 0.6058, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.33% (0.3121 => 0.3225, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.33% (4.2646 => 4.4066, std. dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 3.22% (5.7591 => 5.9445, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 3.13% (0.3423 => 0.3530, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 3.06% (0.7835 => 0.8075, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.05% (8.1363 => 8.3846, std. dev.: 0.0049) MultiSource/Applications/hbd/hbd: 2.94% (1.5603 => 1.6062, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.85% (1.1861 => 1.2199, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.84% (14.3668 => 14.7753, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.74% (1.3050 => 1.3408, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.59% (1.1642 => 1.1943, std. dev.: 0.0060) MultiSource/Applications/d/make_dparser: 2.52% (3.3354 => 3.4196, std. dev.: 0.0065) MultiSource/Applications/treecc/treecc: 2.52% (2.0273 => 2.0784, std. dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: 2.37% (0.4299 => 0.4401, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.26% (1.5415 => 1.5764, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.23% (0.8067 => 0.8247, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.20% (0.4636 => 0.4738, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 2.11% (3.8723 => 3.9541, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.11% (0.9765 => 0.9971, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.10% (0.5105 => 0.5212, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.87% (2.2024 => 2.2436, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.86% (0.6450 => 0.6570, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.84% (1.4186 => 1.4447, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.84% (0.5981 => 0.6091, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.81% (1.5859 => 1.6146, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 1.76% (0.8921 => 0.9078, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 1.72% (0.6456 => 0.6567, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.63% (0.6675 => 0.6784, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.49% (2.0665 => 2.0972, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.33% (17.1811 => 17.4102, std. dev.: 0.0203) MultiSource/Applications/hexxagon/hexxagon: 1.32% (1.2842 => 1.3011, std. dev.: 0.0046) MultiSource/Applications/siod/siod: 1.09% (2.2969 => 2.3220, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.03% (4.2280 => 4.3982, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7494, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5086 => 1.5351, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.64% (3.1578 => 3.2095, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8318, std. dev.: 0.0015) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2041, std. dev.: 0.0007) MultiSource/Benchmarks/llubenchmark/llu: 1.25% (3.7781 => 3.8252, std. dev.: 0.0087) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2242, std. dev.: 0.0395) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.93% (5.2763 => 3.1696, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6988, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.67% (5.3526 => 3.7111, std. dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -15.10% (54.1659 => 45.9889, std. dev.: 0.0447) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.24% (2.9384 => 2.5495, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -10.35% (22.1758 => 19.8811, std. dev.: 0.0341) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (3.8922 => 3.8496, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4219, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.53% (0.0998 => 0.0843, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1072, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -6.61% (1.5373 => 1.4357, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -4.76% (1.9577 => 1.8645, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4791, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (8.1563 => 7.9081, std. dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4166, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9994, std. dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6818, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.71% (12.5348 => 12.3209, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4172, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.35% (1.8329 => 1.8082, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0006) MultiSource/Applications/siod/siod: -1.03% (3.2827 => 3.2490, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 14:40:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 16:40:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120727214032.A82C72A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2431?compare_to=2428&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2431, Order: 160886, Start Time: 2012-07-27 20:26:49, End Time: 2012-07-27 21:40:55 To: 2428, Order: 160874, Start Time: 2012-07-27 18:44:49, End Time: 2012-07-27 19:58:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (139 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.25% (1.3827 => 1.4000, std. dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.04% (1.2944 => 1.3079, std. dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.18% (2.0176 => 2.3037, std. dev.: 0.0129) SingleSource/UnitTests/ObjC++/property-reference-object: 9.57% (0.5818 => 0.6375, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.57% (0.7061 => 0.7737, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.50% (0.5748 => 0.6294, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 8.75% (0.3578 => 0.3891, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.61% (0.3601 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.58% (0.3646 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.44% (0.3663 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.42% (0.3623 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3789 => 0.4107, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.36% (0.3650 => 0.3955, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 8.25% (0.3914 => 0.4237, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 8.07% (0.4003 => 0.4326, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 7.99% (0.3940 => 0.4255, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.25% (0.1986 => 0.2130, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 7.03% (1.3693 => 1.4656, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.02% (0.7710 => 0.8251, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.98% (0.4328 => 0.4630, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.94% (0.2781 => 0.2974, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.79% (0.4062 => 0.4338, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.54% (0.2782 => 0.2964, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.48% (0.7038 => 0.7494, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.43% (0.2596 => 0.2763, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.39% (3.9660 => 4.2193, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.15% (0.5265 => 0.5589, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.15% (0.3580 => 0.3800, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.14% (0.2655 => 0.2818, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 6.14% (0.2607 => 0.2767, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.13% (0.2690 => 0.2855, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.11% (0.2765 => 0.2934, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2628 => 0.2788, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 5.98% (0.2726 => 0.2889, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2761 => 0.2925, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.92% (0.2937 => 0.3111, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.92% (0.2721 => 0.2882, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.90% (0.3899 => 0.4129, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.86% (0.3022 => 0.3199, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 5.83% (0.2760 => 0.2921, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.83% (0.2966 => 0.3139, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.76% (0.3107 => 0.3286, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.75% (0.2696 => 0.2851, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.72% (0.3149 => 0.3329, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.71% (0.3485 => 0.3684, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.67% (0.4390 => 0.4639, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.65% (1.9828 => 2.0948, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.46% (0.2988 => 0.3151, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.42% (0.6959 => 0.7336, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 5.36% (0.3192 => 0.3363, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.34% (0.4379 => 0.4613, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.33% (0.3453 => 0.3637, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.17% (1.2193 => 1.2823, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 5.12% (0.3534 => 0.3715, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.05% (0.4016 => 0.4219, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.03% (0.9199 => 0.9662, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 4.95% (0.3293 => 0.3456, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.82% (0.5577 => 0.5846, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.81% (13.8202 => 14.4846, std. dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (0.3756 => 0.3935, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.74% (16.6129 => 17.4008, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.58% (0.3868 => 0.4045, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.39% (13.2842 => 13.8674, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.35% (1.4563 => 1.5196, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.34% (1.3819 => 1.4419, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.33% (1.3813 => 1.4411, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 4.33% (1.2292 => 1.2824, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.26% (0.2914 => 0.3038, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.20% (0.5637 => 0.5874, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.20% (3.8646 => 4.0270, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.19% (0.3246 => 0.3382, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 4.19% (0.8310 => 0.8658, std. dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.16% (1.1364 => 1.1837, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 4.10% (1.1061 => 1.1515, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.09% (7.2180 => 7.5133, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.06% (0.7460 => 0.7763, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 3.98% (0.7506 => 0.7805, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.96% (1.3245 => 1.3770, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.92% (1.0594 => 1.1009, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 3.84% (0.2995 => 0.3110, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.83% (1.9270 => 2.0009, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.62% (0.3755 => 0.3891, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.54% (4.3801 => 4.5351, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.51% (4.4433 => 4.5994, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.50% (3.6692 => 3.7976, std. dev.: 0.0112) MultiSource/Benchmarks/McCat/18-imp/imp: 3.35% (0.3220 => 0.3328, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.24% (0.4791 => 0.4946, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.19% (4.9865 => 5.1458, std. dev.: 0.0131) MultiSource/Applications/siod/siod: 3.05% (2.1791 => 2.2456, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.02% (0.8698 => 0.8961, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.00% (1.1333 => 1.1673, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 2.97% (0.4113 => 0.4235, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.82% (0.6283 => 0.6460, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.77% (3.1889 => 3.2772, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.71% (0.6135 => 0.6301, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 2.69% (8.4961 => 8.7247, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 2.59% (4.6629 => 4.7837, std. dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.45% (2.1007 => 2.1522, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.42% (6.5754 => 6.7342, std. dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 2.39% (14.5298 => 14.8770, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (3.2742 => 3.3507, std. dev.: 0.0138) MultiSource/Applications/sqlite3/sqlite3: 2.23% (16.2614 => 16.6245, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 2.20% (14.8535 => 15.1803, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.91% (1.5188 => 1.5478, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.12% (1.0313 => 1.0428, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5134, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.93% (1.8175 => 2.2706, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/mandel-2: 7.71% (1.2998 => 1.4000, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.12% (0.9996 => 1.0508, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: 4.44% (7.4271 => 7.7571, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7046, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4771, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.78% (1.9199 => 1.9733, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.62% (1.7688 => 1.8151, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0310 => 1.0558, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.24% (0.9692 => 0.9909, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.57% (1.5089 => 1.5326, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.5928 => 4.6609, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5940, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1396, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.43% (22.5627 => 21.1111, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.36% (0.3511 => 0.3393, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.82% (0.6576 => 0.6456, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.05% (0.0997 => 0.0837, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.24% (1.2308 => 1.1048, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0054) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3107, std. dev.: 0.0088) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.82% (1.9762 => 1.9205, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5940, std. dev.: 0.0078) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9472, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.08% (20.3410 => 19.9173, std. dev.: 0.0399) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2281, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5034, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3305 => 7.2194, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2554, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.10% (26.5159 => 26.2246, std. dev.: 0.0225) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 14:54:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 16:54:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120727215440.1128E2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2432?compare_to=2430&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2432, Order: 160886, Start Time: 2012-07-27 20:36:25, End Time: 2012-07-27 21:55:03 To: 2430, Order: 160874, Start Time: 2012-07-27 18:49:25, End Time: 2012-07-27 20:08:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (74 on baseline) Performance Improvements: 2 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (763 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.91% (13.1569 => 13.5404, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.14% (78.6378 => 81.1061, std. dev.: 0.2686) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.48% (11.0133 => 10.8500, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.02% (1.9078 => 1.8883, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.61% (10.3673 => 13.5404, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.59% (0.0834 => 0.0939, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.32% (0.3473 => 0.3901, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.07% (0.3497 => 0.3919, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.97% (0.3516 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.97% (0.3543 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.96% (0.3561 => 0.3987, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.64% (0.3694 => 0.4124, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.43% (1.1194 => 1.2473, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3828 => 0.4262, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.07% (0.3886 => 0.4316, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.92% (0.3927 => 0.4356, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.20% (0.1892 => 0.2066, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.20% (2.2022 => 2.3827, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.23% (1.7609 => 1.8883, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.28% (0.5925 => 0.6297, std. dev.: 0.0063) SingleSource/UnitTests/ObjC++/property-reference-object: 6.27% (0.6030 => 0.6408, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.60% (0.3177 => 0.3355, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 5.06% (0.7326 => 0.7697, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.76% (0.4879 => 0.5111, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.49% (0.4615 => 0.4822, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.31% (7.0540 => 7.3583, std. dev.: 0.0085) MultiSource/Applications/lambda-0_1_3/lambda: 4.10% (0.7433 => 0.7738, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 3.97% (10.4361 => 10.8500, std. dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 3.79% (9.4845 => 9.8437, std. dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.61% (4.9449 => 5.1232, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.54% (0.5569 => 0.5766, std. dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 3.50% (5.7591 => 5.9608, std. dev.: 0.0164) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (5.0018 => 5.1764, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.49% (0.8172 => 0.8457, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.48% (0.5860 => 0.6064, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.20% (4.2646 => 4.4012, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: 3.13% (0.7835 => 0.8080, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.87% (14.3668 => 14.7786, std. dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.86% (8.1363 => 8.3693, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.76% (1.1861 => 1.2188, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.72% (1.3050 => 1.3405, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.59% (1.1642 => 1.1944, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.59% (0.8067 => 0.8276, std. dev.: 0.0054) MultiSource/Applications/treecc/treecc: 2.55% (2.0273 => 2.0789, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 2.51% (1.5603 => 1.5995, std. dev.: 0.0041) MultiSource/Applications/d/make_dparser: 2.51% (3.3354 => 3.4191, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.37% (0.4636 => 0.4746, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.29% (1.5415 => 1.5768, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (0.5105 => 0.5216, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.15% (0.9765 => 0.9975, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.05% (3.8723 => 3.9518, std. dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.05% (2.2024 => 2.2475, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.90% (1.5859 => 1.6160, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.89% (0.6675 => 0.6801, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.81% (0.6450 => 0.6567, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.81% (1.4186 => 1.4443, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 1.72% (0.6456 => 0.6567, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.71% (2.0665 => 2.1019, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.71% (0.5981 => 0.6083, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 1.64% (0.8921 => 0.9067, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.48% (17.1811 => 17.4349, std. dev.: 0.0194) MultiSource/Applications/siod/siod: 1.36% (2.2969 => 2.3281, std. dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 1.11% (1.1840 => 1.1971, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.77% (4.2280 => 4.3873, std. dev.: 0.0158) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.25% (3.6395 => 3.7579, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.54% (1.0313 => 1.0575, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2161, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 1.60% (11.6436 => 11.8304, std. dev.: 0.0023) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2034, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2339, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1296, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.49% (0.8651 => 0.1688, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.32% (5.2763 => 3.1488, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.65% (5.3855 => 3.6810, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.88% (5.3526 => 3.6995, std. dev.: 0.0107) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0779, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.84% (2.9384 => 2.5610, std. dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: -10.50% (22.1758 => 19.8476, std. dev.: 0.0315) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (3.8922 => 3.8482, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2373 => 1.1164, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -5.84% (1.5373 => 1.4475, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-5: -5.04% (1.5835 => 1.5037, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.77% (1.9577 => 1.8644, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4777, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9131, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4285, std. dev.: 0.0221) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0053, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3187, std. dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4188, std. dev.: 0.0064) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.35% (1.8329 => 1.8082, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0005) MultiSource/Applications/siod/siod: -1.00% (3.2827 => 3.2498, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 16:15:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 18:15:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120727231552.B73432A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2433?compare_to=2429&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2433, Order: 160886, Start Time: 2012-07-27 20:32:43, End Time: 2012-07-27 23:16:16 To: 2429, Order: 160866, Start Time: 2012-07-27 17:21:18, End Time: 2012-07-27 20:04:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (72 on baseline) Performance Improvements: 1 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (810 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.01% (1.6998 => 1.7169, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.05% (2.7949 => 2.8243, std. dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.56% (2.4080 => 2.3704, std. dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 14.66% (0.3792 => 0.4348, std. dev.: 0.0161) SingleSource/UnitTests/ObjC/exceptions-2: 12.86% (0.3446 => 0.3889, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.73% (0.3442 => 0.3880, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.64% (0.3465 => 0.3903, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: 12.59% (0.3496 => 0.3936, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.53% (0.3488 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.51% (0.3460 => 0.3893, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 12.51% (0.3469 => 0.3903, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.24% (0.3643 => 0.4089, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.03% (0.3650 => 0.4089, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.76% (0.3724 => 0.4162, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.76% (1.5932 => 1.7169, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 7.11% (0.5826 => 0.6240, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.86% (0.5889 => 0.6293, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.91% (0.4994 => 0.5289, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.65% (0.7171 => 0.7576, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.35% (0.5026 => 0.5295, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.95% (0.5900 => 0.6192, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.80% (3.5627 => 3.7337, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.79% (1.6211 => 1.6988, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.68% (0.5000 => 0.5234, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.44% (1.3152 => 1.3736, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.43% (0.4361 => 0.4554, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 4.32% (0.4029 => 0.4203, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.10% (0.3930 => 0.4091, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 4.03% (1.0781 => 1.1215, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 3.79% (4.2109 => 4.3703, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.69% (0.2875 => 0.2981, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.59% (0.9909 => 1.0265, std. dev.: 0.0109) SingleSource/Regression/C++/ofstream_ctor: 3.40% (0.3004 => 0.3106, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.3362 => 0.3476, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.26% (0.3195 => 0.3299, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.24% (0.4139 => 0.4273, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.19% (1.9694 => 2.0322, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.17% (2.0673 => 2.1329, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.07% (2.7292 => 2.8129, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 3.05% (23.5202 => 24.2373, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.03% (0.3890 => 0.4008, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.98% (5.5417 => 5.7069, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.93% (1.9966 => 2.0551, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (0.3625 => 0.3731, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.89% (2.1653 => 2.2279, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.86% (4.4195 => 4.5460, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 2.79% (2.1013 => 2.1599, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.71% (0.4658 => 0.4784, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 2.66% (4.6177 => 4.7407, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 2.64% (0.9697 => 0.9953, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.59% (0.3903 => 0.4004, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.36% (0.7875 => 0.8061, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.31% (1.8794 => 1.9229, std. dev.: 0.0065) MultiSource/Applications/siod/siod: 2.10% (0.6634 => 0.6773, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.07% (1.4269 => 1.4565, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.86% (0.5546 => 0.5649, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.79% (0.6435 => 0.6550, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.04% (0.2162 => 0.3525, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.12% (0.0734 => 0.0845, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (2.5769 => 2.9635, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.23% (0.2122 => 0.2233, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6748, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1685, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-2: 4.47% (1.8057 => 1.8865, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6859, std. dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2080, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4584, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4916, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5915, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2237, std. dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.28% (2.4764 => 2.3704, std. dev.: 0.0063) MultiSource/Applications/kimwitu++/kc: -1.80% (11.9555 => 11.7401, std. dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.98% (25.4195 => 16.5284, std. dev.: 0.0148) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9742, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8041, std. dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/fldry: -7.59% (17.2379 => 15.9293, std. dev.: 0.1243) SingleSource/Benchmarks/Shootout-C++/ary2: -7.04% (0.2402 => 0.2233, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: -3.90% (0.4438 => 0.4265, std. dev.: 0.0039) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7986, std. dev.: 0.0122) SingleSource/Benchmarks/Dhrystone/dry: -3.61% (14.0481 => 13.5415, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5754, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 16:22:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 18:22:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120727232235.ABB572A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2434?compare_to=2431&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2434, Order: 160895, Start Time: 2012-07-27 22:08:56, End Time: 2012-07-27 23:23:00 To: 2431, Order: 160886, Start Time: 2012-07-27 20:26:49, End Time: 2012-07-27 21:40:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (145 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.11% (1.4000 => 1.4156, std. dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.09% (2.0176 => 2.3221, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.71% (0.5818 => 0.6383, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.62% (0.7061 => 0.7740, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 9.57% (0.5748 => 0.6298, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3578 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.11% (0.3646 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.10% (0.3650 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.08% (0.3601 => 0.3928, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/synchronized: 9.01% (0.3663 => 0.3993, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.97% (0.3789 => 0.4129, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.97% (0.3623 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.84% (0.3914 => 0.4260, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.65% (0.3940 => 0.4281, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.64% (0.4003 => 0.4349, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.12% (0.3130 => 0.3384, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.64% (0.1819 => 0.1958, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.28% (1.3693 => 1.4690, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.90% (0.7710 => 0.8242, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 6.85% (0.7038 => 0.7520, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (3.9660 => 4.2375, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.5265 => 0.5612, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.49% (0.4328 => 0.4609, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.40% (0.2781 => 0.2959, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.15% (0.2782 => 0.2953, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 5.98% (0.4062 => 0.4305, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3899 => 0.4123, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 5.72% (0.2607 => 0.2756, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.69% (0.4379 => 0.4628, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.63% (0.6959 => 0.7351, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.56% (0.3022 => 0.3190, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.56% (0.5577 => 0.5887, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.48% (0.2628 => 0.2772, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.47% (0.3580 => 0.3776, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.47% (1.2193 => 1.2860, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.46% (1.9828 => 2.0910, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.42% (0.3485 => 0.3674, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2761 => 0.2910, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.39% (0.2726 => 0.2873, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 5.31% (0.2937 => 0.3093, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.28% (13.8202 => 14.5505, std. dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.3107 => 0.3271, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.27% (0.3489 => 0.3673, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.14% (0.9199 => 0.9672, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.07% (16.6129 => 17.4555, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/matrix: 5.05% (0.2988 => 0.3139, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 4.98% (0.3192 => 0.3351, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.85% (1.4563 => 1.5270, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.80% (13.2842 => 13.9222, std. dev.: 0.0109) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.78% (0.4390 => 0.4600, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 4.75% (0.3453 => 0.3617, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.73% (1.3813 => 1.4467, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.72% (0.5637 => 0.5903, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.71% (0.3293 => 0.3448, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.69% (1.1364 => 1.1897, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.67% (7.2180 => 7.5549, std. dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.66% (0.4016 => 0.4203, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.57% (0.7506 => 0.7849, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.54% (1.3819 => 1.4447, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.54% (1.1061 => 1.1563, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3246 => 0.3392, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.44% (0.8310 => 0.8679, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.39% (1.9270 => 2.0115, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.32% (0.3868 => 0.4035, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.28% (1.0594 => 1.1047, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.26% (3.8646 => 4.0291, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.25% (0.7460 => 0.7777, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 4.24% (0.2945 => 0.3070, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.18% (1.3245 => 1.3799, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.07% (4.3801 => 4.5583, std. dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 4.04% (1.2292 => 1.2788, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (4.4433 => 4.6221, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.96% (3.6692 => 3.8144, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0044) MultiSource/Applications/siod/siod: 3.77% (2.1791 => 2.2613, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.55% (0.4791 => 0.4961, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.51% (4.9865 => 5.1617, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3755 => 0.3885, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.46% (1.1333 => 1.1725, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 3.20% (3.1889 => 3.2909, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 3.19% (0.3131 => 0.3231, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.10% (0.8698 => 0.8968, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.01% (0.4113 => 0.4237, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.99% (0.6283 => 0.6471, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 2.89% (8.4961 => 8.7416, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.77% (2.1007 => 2.1589, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (6.5754 => 6.7566, std. dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: 2.63% (14.5298 => 14.9124, std. dev.: 0.0127) MultiSource/Applications/JM/lencod/lencod: 2.62% (14.8535 => 15.2431, std. dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 2.62% (16.2614 => 16.6872, std. dev.: 0.0267) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.58% (3.2742 => 3.3586, std. dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: 2.47% (4.6629 => 4.7779, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.38% (1.5188 => 1.5550, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.78% (0.6250 => 0.6361, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.47% (1.0313 => 1.0465, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.46% (0.9108 => 0.9241, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.30% (3.7467 => 3.7954, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5160, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2594, std. dev.: 0.0432) SingleSource/Benchmarks/Misc/mandel-2: 8.91% (1.2998 => 1.4156, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.19% (0.9996 => 1.0515, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 4.44% (7.4271 => 7.7570, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7019, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 3.77% (1.9144 => 1.9866, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4776, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5337, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std. dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 1.51% (4.5928 => 4.6620, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5953, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1393, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.20% (22.5627 => 21.1627, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.85% (0.0997 => 0.0839, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.54% (1.2308 => 1.1011, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.22% (1.3780 => 1.3199, std. dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.82% (8.8259 => 8.5767, std. dev.: 0.0089) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9452, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2264, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (20.3410 => 19.9620, std. dev.: 0.0616) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5126, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3305 => 7.2152, std. dev.: 0.0371) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0197) MultiSource/Applications/minisat/minisat: -1.35% (9.3358 => 9.2099, std. dev.: 0.0123) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2503, std. dev.: 0.0024) MultiSource/Applications/lua/lua: -1.12% (26.5159 => 26.2201, std. dev.: 0.0249) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8462, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 16:41:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 18:41:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120727234144.9EB782A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2435?compare_to=2432&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2435, Order: 160897, Start Time: 2012-07-27 22:23:19, End Time: 2012-07-27 23:42:07 To: 2432, Order: 160886, Start Time: 2012-07-27 20:36:25, End Time: 2012-07-27 21:55:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (84 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (756 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.16% (13.5404 => 13.6980, std. dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.01% (54.9523 => 56.6086, std. dev.: 0.0100) MultiSource/Benchmarks/llubenchmark/llu: 1.44% (3.7908 => 3.8455, std. dev.: 0.0131) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.13% (10.3673 => 13.6980, std. dev.: 0.0068) SingleSource/UnitTests/ObjC/trivial-interface: 13.16% (0.3473 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.90% (0.3497 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3516 => 0.3967, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.81% (0.3543 => 0.3997, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: 12.78% (0.3561 => 0.4016, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.73% (0.3543 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.37% (0.3694 => 0.4151, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.15% (0.3828 => 0.4293, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.88% (1.1194 => 1.2524, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.76% (0.3886 => 0.4343, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.69% (0.3927 => 0.4386, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.75% (2.2022 => 2.3949, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.23% (1.7609 => 1.9059, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.94% (0.5925 => 0.6336, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.77% (0.6030 => 0.6438, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2065 => 0.2200, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.66% (0.7326 => 0.7741, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.12% (0.4879 => 0.5129, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3282 => 0.3446, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.99% (10.4361 => 10.9570, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.85% (0.4615 => 0.4839, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.85% (7.0540 => 7.3958, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 4.24% (9.4845 => 9.8866, std. dev.: 0.0130) MultiSource/Applications/lambda-0_1_3/lambda: 4.20% (0.7433 => 0.7745, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.15% (4.9449 => 5.1502, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 3.92% (0.2554 => 0.2654, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.90% (5.0018 => 5.1969, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.82% (0.5569 => 0.5782, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.78% (0.8172 => 0.8481, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (4.2646 => 4.4171, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.57% (0.5860 => 0.6069, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.39% (8.1363 => 8.4120, std. dev.: 0.0073) MultiSource/Applications/oggenc/oggenc: 3.37% (5.7591 => 5.9531, std. dev.: 0.0138) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.33% (0.3423 => 0.3537, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.26% (14.3668 => 14.8356, std. dev.: 0.0104) MultiSource/Applications/spiff/spiff: 3.25% (0.7835 => 0.8090, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.15% (1.1861 => 1.2235, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.14% (1.3050 => 1.3460, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.84% (0.8067 => 0.8296, std. dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.80% (0.4636 => 0.4766, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 2.78% (3.3354 => 3.4280, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 2.74% (1.1642 => 1.1961, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.73% (1.5415 => 1.5836, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 2.69% (1.5603 => 1.6023, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.67% (0.5020 => 0.5154, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.66% (0.5105 => 0.5241, std. dev.: 0.0047) MultiSource/Applications/treecc/treecc: 2.64% (2.0273 => 2.0809, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 2.40% (3.8723 => 3.9652, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.36% (0.9765 => 0.9995, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5859 => 1.6226, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.25% (2.2024 => 2.2520, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.14% (1.4186 => 1.4489, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 2.11% (0.6456 => 0.6592, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5981 => 0.6103, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.02% (0.6675 => 0.6810, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.01% (2.0665 => 2.1080, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6450 => 0.6573, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 1.87% (0.8921 => 0.9088, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.87% (17.1811 => 17.5017, std. dev.: 0.0162) MultiSource/Applications/minisat/minisat: 1.56% (0.7115 => 0.7226, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.55% (1.1840 => 1.2023, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.51% (1.2842 => 1.3036, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.39% (2.2969 => 2.3288, std. dev.: 0.0058) MultiSource/Applications/lemon/lemon: 1.18% (1.0722 => 1.0849, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.94% (4.2280 => 4.3945, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.13% (3.6395 => 3.7534, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.09% (1.0313 => 1.0529, std. dev.: 0.0030) MultiSource/Benchmarks/llubenchmark/llu: 1.78% (3.7781 => 3.8455, std. dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2136, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8318, std. dev.: 0.0024) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2044, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2322, std. dev.: 0.0194) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.05% (2.3135 => 2.3377, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.09% (5.2763 => 3.1609, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6986, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.63% (5.3526 => 3.7132, std. dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0730, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.20% (2.9384 => 2.5506, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.09% (22.1758 => 19.9393, std. dev.: 0.0324) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4210, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.67% (1.2373 => 1.1053, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: -7.14% (1.5373 => 1.4275, std. dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5098, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5961, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.42% (1.9577 => 1.8711, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4919, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4133, std. dev.: 0.0182) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (8.1563 => 7.9093, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0001, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.33% (1.3677 => 1.3358, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3231, std. dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4183, std. dev.: 0.0076) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.22% (1.8329 => 1.8105, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 18:04:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 20:04:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120728010443.CFB9C2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2436?compare_to=2434&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2436, Order: 160900, Start Time: 2012-07-27 23:51:03, End Time: 2012-07-28 01:05:06 To: 2434, Order: 160895, Start Time: 2012-07-27 22:08:56, End Time: 2012-07-27 23:23:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (142 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.08% (54.7395 => 56.4275, std. dev.: 0.0617) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.39% (78.2240 => 80.0935, std. dev.: 0.5952) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.02% (1.4156 => 1.4012, std. dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.95% (2.0176 => 2.2991, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 10.01% (0.3578 => 0.3936, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.83% (0.3601 => 0.3955, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.82% (0.3646 => 0.4004, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.70% (0.3650 => 0.4004, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 9.66% (0.3663 => 0.4017, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.66% (0.3623 => 0.3973, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.66% (0.3789 => 0.4155, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.45% (0.3914 => 0.4284, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.33% (0.5818 => 0.6361, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.18% (0.7061 => 0.7709, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.17% (0.4003 => 0.4370, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.16% (0.3940 => 0.4301, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5748 => 0.6269, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.50% (0.7710 => 0.8288, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 7.02% (1.3693 => 1.4654, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.2596 => 0.2777, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.96% (3.9660 => 4.2422, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.5265 => 0.5612, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 6.52% (0.7038 => 0.7497, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 6.15% (0.4328 => 0.4594, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.06% (0.2721 => 0.2886, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.90% (0.2781 => 0.2945, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.82% (0.4379 => 0.4634, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.79% (0.2782 => 0.2943, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.44% (0.4062 => 0.4283, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.43% (1.2193 => 1.2855, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.43% (0.2690 => 0.2836, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.41% (0.2607 => 0.2748, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.39% (0.3899 => 0.4109, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.27% (0.6959 => 0.7326, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2628 => 0.2766, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.24% (0.2765 => 0.2910, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.18% (0.2761 => 0.2904, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.18% (0.2937 => 0.3089, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.12% (1.9828 => 2.0843, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/except: 5.11% (0.2760 => 0.2901, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.11% (0.3485 => 0.3663, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.09% (0.2966 => 0.3117, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.09% (13.8202 => 14.5231, std. dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.06% (0.3580 => 0.3761, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.05% (0.9199 => 0.9664, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.02% (0.3489 => 0.3664, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.01% (0.2696 => 0.2831, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.98% (0.5577 => 0.5855, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: 4.96% (0.3107 => 0.3261, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.2988 => 0.3133, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.83% (0.3149 => 0.3301, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.80% (1.4563 => 1.5262, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.69% (16.6129 => 17.3915, std. dev.: 0.0167) MultiSource/Applications/spiff/spiff: 4.68% (0.7506 => 0.7857, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.67% (7.2180 => 7.5552, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary2: 4.67% (0.3192 => 0.3341, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (13.2842 => 13.8994, std. dev.: 0.0122) MultiSource/Benchmarks/McCat/09-vor/vor: 4.62% (0.2925 => 0.3060, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.58% (0.4390 => 0.4591, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.51% (1.1364 => 1.1877, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.49% (0.3293 => 0.3441, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.49% (0.3453 => 0.3608, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.45% (0.5637 => 0.5888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.42% (0.3756 => 0.3922, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.41% (0.3534 => 0.3690, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.41% (0.4016 => 0.4193, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.37% (0.3246 => 0.3388, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 4.33% (1.9270 => 2.0105, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.29% (1.3245 => 1.3813, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 4.24% (0.2995 => 0.3122, std. dev.: 0.0046) MultiSource/Applications/Burg/burg: 4.24% (1.1061 => 1.1530, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.22% (0.7460 => 0.7775, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 4.21% (0.8310 => 0.8660, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 4.20% (3.8646 => 4.0268, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.16% (1.3813 => 1.4387, std. dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 4.12% (1.0594 => 1.1030, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.07% (1.3819 => 1.4382, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 3.87% (0.2945 => 0.3059, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (4.3801 => 4.5472, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.77% (4.4433 => 4.6106, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3220 => 0.3341, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.73% (3.6692 => 3.8060, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 3.69% (1.2292 => 1.2745, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.52% (1.1333 => 1.1732, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 3.49% (2.1791 => 2.2552, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.36% (0.6135 => 0.6341, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3755 => 0.3878, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.21% (0.4791 => 0.4945, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 3.04% (0.4113 => 0.4238, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.98% (3.1889 => 3.2840, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.94% (4.9865 => 5.1332, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.81% (0.8698 => 0.8942, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.74% (8.4961 => 8.7293, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 2.70% (14.5298 => 14.9225, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.66% (0.6283 => 0.6450, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.64% (16.2614 => 16.6911, std. dev.: 0.0212) MultiSource/Applications/JM/ldecod/ldecod: 2.62% (6.5754 => 6.7477, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.61% (2.1007 => 2.1555, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.51% (3.2742 => 3.3563, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 2.46% (14.8535 => 15.2183, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.34% (1.5188 => 1.5543, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 2.30% (4.6629 => 4.7702, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.42% (0.9108 => 0.9237, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.00% (3.7467 => 3.7842, std. dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5190, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 26.69% (1.8175 => 2.3025, std. dev.: 0.0326) SingleSource/Benchmarks/Misc/mandel-2: 7.80% (1.2998 => 1.4012, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.33% (0.9996 => 1.0529, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: 4.29% (7.4271 => 7.7460, std. dev.: 0.0083) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7080, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4784, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8153, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.38% (1.0310 => 1.0555, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5089 => 1.5361, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.5928 => 4.6609, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5945, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.22% (1.9290 => 1.9526, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2143, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1683, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1390, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.63% (22.5627 => 21.0660, std. dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.33% (0.3511 => 0.3394, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.45% (0.0997 => 0.0833, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2308 => 1.0982, std. dev.: 0.0076) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3086, std. dev.: 0.0061) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std. dev.: 0.0118) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9480, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5993, std. dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2363, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (20.3410 => 19.9622, std. dev.: 0.0311) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5085, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.62% (7.3305 => 7.2118, std. dev.: 0.0313) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std. dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: -1.34% (5.3167 => 5.2457, std. dev.: 0.0081) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2298, std. dev.: 0.0070) MultiSource/Applications/lua/lua: -1.02% (26.5159 => 26.2455, std. dev.: 0.0187) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 18:28:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 20:28:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120728012833.63B392A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2437?compare_to=2435&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2437, Order: 160901, Start Time: 2012-07-28 00:10:10, End Time: 2012-07-28 01:28:56 To: 2435, Order: 160897, Start Time: 2012-07-27 22:23:19, End Time: 2012-07-27 23:42:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (79 on baseline) Performance Improvements: 2 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.42% (13.6980 => 13.5040, std. dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.23% (3.8455 => 3.7983, std. dev.: 0.0091) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.26% (10.3673 => 13.5040, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3473 => 0.3911, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 12.61% (0.3497 => 0.3938, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.42% (0.3543 => 0.3983, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 12.34% (0.3516 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.31% (0.3543 => 0.3979, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.24% (0.3561 => 0.3997, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.07% (0.3694 => 0.4140, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.70% (0.3828 => 0.4276, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.48% (0.3927 => 0.4378, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.32% (0.3886 => 0.4326, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.17% (1.1194 => 1.2444, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.83% (2.2022 => 2.3746, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.33% (1.7609 => 1.8900, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1892 => 0.2021, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.99% (0.5925 => 0.6280, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.92% (0.6030 => 0.6387, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.3177 => 0.3361, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 4.76% (0.7326 => 0.7675, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.64% (0.4615 => 0.4829, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.43% (0.4879 => 0.5095, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.28% (7.0540 => 7.3561, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/oourafft: 4.20% (0.3282 => 0.3420, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.18% (10.4361 => 10.8719, std. dev.: 0.0118) MultiSource/Applications/lambda-0_1_3/lambda: 4.08% (0.7433 => 0.7736, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.99% (0.8172 => 0.8498, std. dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 3.90% (9.4845 => 9.8544, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.77% (4.9449 => 5.1313, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.71% (5.0018 => 5.1876, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.65% (0.5569 => 0.5772, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.41% (4.2646 => 4.4102, std. dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.31% (0.5860 => 0.6054, std. dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.24% (0.3121 => 0.3222, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.20% (0.7835 => 0.8086, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 3.18% (0.3180 => 0.3281, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.17% (8.1363 => 8.3940, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 3.13% (0.3423 => 0.3530, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (14.3668 => 14.8063, std. dev.: 0.0086) MultiSource/Applications/oggenc/oggenc: 3.02% (5.7591 => 5.9329, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.96% (1.3050 => 1.3436, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.1861 => 1.2209, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.74% (0.4636 => 0.4763, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.64% (1.1642 => 1.1949, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 2.61% (3.3354 => 3.4225, std. dev.: 0.0035) MultiSource/Applications/lua/lua: 2.52% (3.8723 => 3.9698, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.52% (1.5415 => 1.5803, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.51% (2.0273 => 2.0781, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 2.47% (1.5603 => 1.5989, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.41% (2.0665 => 2.1164, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.37% (0.8067 => 0.8258, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.26% (0.9765 => 0.9986, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.15% (0.5105 => 0.5215, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.09% (0.6456 => 0.6591, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.2024 => 2.2472, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.89% (0.5981 => 0.6094, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.77% (0.6675 => 0.6793, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.77% (0.6450 => 0.6564, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.75% (17.1811 => 17.4825, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.71% (1.4186 => 1.4429, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: 1.41% (0.7115 => 0.7215, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 1.32% (1.2842 => 1.3012, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.30% (2.2969 => 2.3268, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 1.28% (1.1840 => 1.1991, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.07% (1.0722 => 1.0837, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.46% (4.2280 => 4.4166, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7493, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.83% (3.1578 => 3.2157, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8324, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.43% (1.5086 => 1.5302, std. dev.: 0.0051) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2042, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2296, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/fbench: 1.13% (2.2771 => 2.3029, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1259, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.50% (0.8651 => 0.1687, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.25% (5.2763 => 3.1525, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.66% (5.3855 => 3.6802, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.01% (5.3526 => 3.6929, std. dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -15.00% (54.1659 => 46.0409, std. dev.: 0.0358) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.28% (2.9384 => 2.5482, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -10.37% (22.1758 => 19.8751, std. dev.: 0.0323) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.01% (3.8922 => 3.8527, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4203, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.01% (1.2373 => 1.1134, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -8.42% (1.5373 => 1.4078, std. dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5535, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -4.64% (1.9577 => 1.8668, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5961, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4870, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.02% (8.1563 => 7.9097, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4232, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0023, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.87% (12.5348 => 12.3010, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4185, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8093, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0006) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2496, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 19:27:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 21:27:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120728022732.7DD452A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2438?compare_to=2433&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2438, Order: 160900, Start Time: 2012-07-27 23:44:15, End Time: 2012-07-28 02:27:57 To: 2433, Order: 160886, Start Time: 2012-07-27 20:32:43, End Time: 2012-07-27 23:16:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 6 (91 on baseline) Performance Improvements: 1 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 947 (791 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.52% (2.8129 => 2.8556, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 1.15% (2.1599 => 2.1847, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.03% (3.7337 => 3.7720, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.08% (122.6184 => 130.0731, std. dev.: 0.9385) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.66% (2.0793 => 2.1138, std. dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.35% (54.1649 => 54.8983, std. dev.: 0.0331) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.77% (1.7169 => 1.6865, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.05% (0.3446 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.87% (0.3496 => 0.3981, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.86% (0.3442 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.85% (0.3465 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.78% (0.3469 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.76% (0.3460 => 0.3936, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.73% (0.3488 => 0.3967, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.26% (0.3643 => 0.4126, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.21% (0.3650 => 0.4132, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.89% (0.3724 => 0.4204, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.72% (0.5826 => 0.6276, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.45% (0.5889 => 0.6328, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1620 => 0.1736, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.87% (3.5627 => 3.7720, std. dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 5.86% (1.5932 => 1.6865, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.80% (0.7171 => 0.7587, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (1.6211 => 1.7148, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.47% (0.4994 => 0.5267, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.31% (0.5026 => 0.5293, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.18% (1.3152 => 1.3833, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.11% (0.4361 => 0.4584, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.02% (0.5900 => 0.6196, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.98% (0.5000 => 0.5249, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.94% (0.4029 => 0.4228, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.94% (0.3930 => 0.4124, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.74% (4.2109 => 4.4104, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 4.73% (1.0781 => 1.1291, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.63% (2.7292 => 2.8556, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.2866 => 0.2989, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.09% (0.2736 => 0.2848, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.09% (0.2738 => 0.2850, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.97% (2.1013 => 2.1847, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.95% (1.9694 => 2.0471, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 3.92% (5.5417 => 5.7591, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (0.3890 => 0.4042, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.84% (1.9966 => 2.0732, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (0.3195 => 0.3317, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.76% (0.3004 => 0.3117, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.63% (0.4658 => 0.4827, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.62% (0.9909 => 1.0268, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 3.55% (4.6177 => 4.7814, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.48% (2.0673 => 2.1393, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.42% (0.3625 => 0.3749, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.38% (0.3845 => 0.3975, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.35% (4.4195 => 4.5675, std. dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: 3.32% (2.1653 => 2.2371, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.30% (0.3124 => 0.3227, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.28% (0.3258 => 0.3365, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.26% (0.3096 => 0.3197, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.24% (0.3267 => 0.3373, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.20% (0.7875 => 0.8127, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 3.17% (23.5202 => 24.2649, std. dev.: 0.0113) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.17% (0.4139 => 0.4270, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.08% (0.3282 => 0.3383, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.08% (0.3317 => 0.3419, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.07% (0.3903 => 0.4023, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 3.02% (0.3348 => 0.3449, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.94% (1.4269 => 1.4689, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists1: 2.93% (0.3477 => 0.3579, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 2.91% (0.3678 => 0.3785, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.88% (1.8794 => 1.9335, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 2.87% (0.3726 => 0.3833, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.85% (0.9697 => 0.9973, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 2.82% (0.6634 => 0.6821, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.70% (0.5546 => 0.5696, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.65% (0.4146 => 0.4256, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.54% (0.3981 => 0.4082, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.52% (0.4251 => 0.4358, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.08% (0.5012 => 0.5116, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.6435 => 0.6568, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.66% (2.0346 => 2.0683, std. dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9639, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6738, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 5.06% (1.8057 => 1.8970, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1683, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (105.3826 => 107.6658, std. dev.: 0.0249) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2011, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4586, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4970, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.76% (3.1722 => 3.2279, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5906, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.53% (2.0820 => 2.1138, std. dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.62% (2.4764 => 2.3867, std. dev.: 0.0337) MultiSource/Applications/kimwitu++/kc: -1.12% (11.9555 => 11.8212, std. dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.09% (25.4195 => 16.4995, std. dev.: 0.0174) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8085, std. dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/fldry: -7.46% (17.2379 => 15.9523, std. dev.: 0.1170) SingleSource/Benchmarks/Shootout-C++/ary2: -7.16% (0.2402 => 0.2230, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: -4.01% (0.4438 => 0.4260, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7964, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: -3.63% (14.0481 => 13.5384, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5783, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 19:46:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 21:46:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120728024642.2344F2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2439?compare_to=2436&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2439, Order: 160908, Start Time: 2012-07-28 01:33:06, End Time: 2012-07-28 02:47:04 To: 2436, Order: 160900, Start Time: 2012-07-27 23:51:03, End Time: 2012-07-28 01:05:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (147 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.50% (3.7854 => 3.8420, std. dev.: 0.0138) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.85% (2.3025 => 2.2599, std. dev.: 0.0153) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.08% (2.0176 => 2.3218, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.06% (0.3578 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.89% (0.3601 => 0.3957, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.85% (0.3646 => 0.4005, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.84% (0.3650 => 0.4009, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 9.75% (0.3663 => 0.4020, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.74% (0.3623 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.55% (0.3789 => 0.4151, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.53% (0.3914 => 0.4287, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.37% (0.4003 => 0.4378, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.34% (0.3940 => 0.4308, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.23% (0.5818 => 0.6355, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5748 => 0.6267, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.98% (0.7061 => 0.7695, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.57% (0.7710 => 0.8294, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.11% (1.3693 => 1.4667, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.01% (3.9660 => 4.2442, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.01% (0.2596 => 0.2778, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.85% (0.7038 => 0.7520, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5265 => 0.5619, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (0.4328 => 0.4611, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.15% (0.2781 => 0.2952, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.00% (0.2782 => 0.2949, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.97% (0.4390 => 0.4652, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.88% (0.4062 => 0.4301, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.82% (0.3022 => 0.3198, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.68% (0.6959 => 0.7354, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.57% (0.3899 => 0.4116, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2760 => 0.2913, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.52% (0.2607 => 0.2751, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2690 => 0.2838, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2761 => 0.2912, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (1.2193 => 1.2859, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.44% (0.2628 => 0.2771, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.36% (1.9828 => 2.0891, std. dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.34% (0.3485 => 0.3671, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.33% (0.5577 => 0.5874, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 5.31% (0.2937 => 0.3093, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.29% (13.8202 => 14.5511, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.25% (0.3580 => 0.3768, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.25% (0.2726 => 0.2869, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.21% (0.3107 => 0.3269, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.20% (0.2925 => 0.3077, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.20% (0.9199 => 0.9677, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.16% (0.2696 => 0.2835, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 5.09% (16.6129 => 17.4577, std. dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/ary3: 5.08% (0.3149 => 0.3309, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.05% (0.2988 => 0.3139, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.02% (1.4563 => 1.5294, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2127 => 0.2233, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.93% (13.2842 => 13.9397, std. dev.: 0.0150) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.84% (0.3453 => 0.3620, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.84% (7.2180 => 7.5670, std. dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.80% (0.2914 => 0.3054, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.76% (0.3192 => 0.3344, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.76% (1.1364 => 1.1905, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: 4.74% (0.7506 => 0.7862, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5637 => 0.5902, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists1: 4.70% (0.3534 => 0.3700, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.68% (1.1061 => 1.1579, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.66% (0.4016 => 0.4203, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3293 => 0.3446, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.58% (1.3819 => 1.4452, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 4.56% (1.9270 => 2.0148, std. dev.: 0.0091) MultiSource/Benchmarks/MallocBench/gs/gs: 4.53% (3.8646 => 4.0398, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3246 => 0.3393, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.49% (1.3813 => 1.4433, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.37% (1.3245 => 1.3824, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.32% (1.0594 => 1.1052, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 4.31% (0.8310 => 0.8668, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.29% (0.7460 => 0.7780, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 4.27% (0.3868 => 0.4033, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2945 => 0.3066, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.09% (4.3801 => 4.5592, std. dev.: 0.0106) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.01% (4.4433 => 4.6216, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.94% (3.6692 => 3.8139, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.87% (2.1791 => 2.2635, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.82% (1.2292 => 1.2762, std. dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: 3.77% (0.2995 => 0.3108, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.57% (0.4791 => 0.4962, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.45% (1.1333 => 1.1724, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (4.9865 => 5.1523, std. dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.30% (0.3755 => 0.3879, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.24% (3.1889 => 3.2923, std. dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 3.19% (0.3131 => 0.3231, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.02% (0.6135 => 0.6320, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.01% (0.6283 => 0.6472, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.94% (0.8698 => 0.8954, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 2.94% (0.4113 => 0.4234, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (6.5754 => 6.7659, std. dev.: 0.0170) MultiSource/Applications/sqlite3/sqlite3: 2.84% (16.2614 => 16.7229, std. dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 2.80% (8.4961 => 8.7336, std. dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 2.78% (14.5298 => 14.9335, std. dev.: 0.0164) MultiSource/Applications/JM/lencod/lencod: 2.74% (14.8535 => 15.2601, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.1007 => 2.1571, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.39% (4.6629 => 4.7744, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.26% (3.2742 => 3.3483, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.21% (1.5188 => 1.5524, std. dev.: 0.0033) MultiSource/Applications/lemon/lemon: 1.53% (1.0313 => 1.0471, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.41% (0.9108 => 0.9236, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.25% (3.7467 => 3.7935, std. dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (6.2785 => 6.3483, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.46% (5.7573 => 7.5109, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 24.34% (1.8175 => 2.2599, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/mandel-2: 7.80% (1.2998 => 1.4012, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.06% (0.9996 => 1.0502, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/salsa20: 4.35% (7.4271 => 7.7504, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7071, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4771, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8150, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.83% (3.7731 => 3.8420, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5089 => 1.5357, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.56% (1.4298 => 1.4521, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5944, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.47% (4.5928 => 4.6601, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0494, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1682, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1393, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.34% (22.5627 => 21.1329, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.20% (0.8818 => 0.8712, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.35% (0.0997 => 0.0824, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -9.99% (1.2308 => 1.1078, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3086, std. dev.: 0.0113) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.58% (3.0263 => 2.9481, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6020, std. dev.: 0.0200) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.33% (0.8342 => 0.8148, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.26% (6.3560 => 6.2122, std. dev.: 0.0115) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5022, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9834, std. dev.: 0.0316) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.56% (7.3305 => 7.2162, std. dev.: 0.0293) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.3167 => 5.2465, std. dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4928, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2318, std. dev.: 0.0250) MultiSource/Applications/lua/lua: -1.10% (26.5159 => 26.2247, std. dev.: 0.0203) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 20:15:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 22:15:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120728031518.522102A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2440?compare_to=2437&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2440, Order: 160908, Start Time: 2012-07-28 01:57:00, End Time: 2012-07-28 03:15:43 To: 2437, Order: 160901, Start Time: 2012-07-28 00:10:10, End Time: 2012-07-28 01:28:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (80 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.03% (1.8900 => 1.9095, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.99% (79.8626 => 81.4554, std. dev.: 0.0354) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.13% (2.1164 => 2.0925, std. dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.82% (10.3673 => 13.5624, std. dev.: 0.0123) SingleSource/UnitTests/ObjC/trivial-interface: 12.78% (0.3473 => 0.3917, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.62% (0.3543 => 0.3990, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 12.44% (0.3497 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3516 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.41% (0.3561 => 0.4003, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.39% (0.3543 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.05% (0.3694 => 0.4139, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.78% (0.3828 => 0.4279, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.48% (0.3927 => 0.4378, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.48% (0.3886 => 0.4332, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.45% (1.1194 => 1.2476, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.48% (2.2022 => 2.3890, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.44% (1.7609 => 1.9095, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.17% (0.3177 => 0.3373, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.97% (0.1892 => 0.2005, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.91% (0.5925 => 0.6275, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 5.77% (0.6030 => 0.6378, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.26% (0.7326 => 0.7711, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.19% (0.4879 => 0.5132, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.08% (10.4361 => 10.9661, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.4615 => 0.4846, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.66% (7.0540 => 7.3825, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.3282 => 0.3429, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.32% (9.4845 => 9.8940, std. dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.06% (0.7433 => 0.7735, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (5.0018 => 5.2007, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.9449 => 5.1407, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.88% (0.8172 => 0.8489, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 3.58% (0.3180 => 0.3294, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.57% (4.2646 => 4.4169, std. dev.: 0.0087) MultiSource/Benchmarks/McCat/18-imp/imp: 3.53% (0.3423 => 0.3544, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.50% (0.5860 => 0.6065, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.47% (8.1363 => 8.4185, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3121 => 0.3227, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.14% (1.3050 => 1.3460, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.13% (0.7835 => 0.8080, std. dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 3.09% (5.7591 => 5.9372, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (14.3668 => 14.8061, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1861 => 1.2221, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.83% (1.1642 => 1.1972, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.79% (1.5603 => 1.6039, std. dev.: 0.0037) MultiSource/Applications/treecc/treecc: 2.79% (2.0273 => 2.0838, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 2.61% (0.4299 => 0.4411, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.60% (0.8067 => 0.8277, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.59% (3.3354 => 3.4217, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.52% (1.5415 => 1.5804, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.33% (3.8723 => 3.9624, std. dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.26% (0.4636 => 0.4741, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.20% (0.9765 => 0.9980, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.15% (0.5105 => 0.5215, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.14% (2.2024 => 2.2495, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.09% (1.5859 => 1.6190, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.06% (0.6450 => 0.6583, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.4186 => 1.4469, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.87% (0.5981 => 0.6093, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 1.86% (0.8921 => 0.9087, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.78% (0.6675 => 0.6794, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.61% (0.6456 => 0.6560, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.57% (2.2969 => 2.3330, std. dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.50% (17.1811 => 17.4393, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.29% (1.1840 => 1.1993, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.26% (2.0665 => 2.0925, std. dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.11% (1.0722 => 1.0841, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.69% (4.2280 => 4.3839, std. dev.: 0.0186) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7588, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.53% (1.0313 => 1.0574, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.05% (1.5086 => 1.5396, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8344, std. dev.: 0.0007) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2398, std. dev.: 0.0283) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.98% (5.2763 => 3.1667, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.22% (5.3855 => 3.7039, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.67% (5.3526 => 3.7107, std. dev.: 0.0071) SingleSource/UnitTests/Vector/constpool: -15.08% (54.1659 => 45.9956, std. dev.: 0.0306) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.27% (2.9384 => 2.5484, std. dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: -10.18% (22.1758 => 19.9178, std. dev.: 0.0225) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.39% (1.2373 => 1.1087, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel-2: -7.59% (1.5373 => 1.4206, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.93% (1.9577 => 1.8612, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4879, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.06% (8.1563 => 7.9067, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4259, std. dev.: 0.0185) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0026, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -1.73% (12.5348 => 12.3185, std. dev.: 0.0055) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4184, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8093, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 21:28:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 27 Jul 2012 23:28:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120728042829.EDFF82A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2441?compare_to=2439&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2441, Order: 160910, Start Time: 2012-07-28 03:14:59, End Time: 2012-07-28 04:28:53 To: 2439, Order: 160908, Start Time: 2012-07-28 01:33:06, End Time: 2012-07-28 02:47:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (145 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.60% (54.5586 => 56.5247, std. dev.: 0.1269) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.59% (2.0176 => 2.3322, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/trivial-interface: 9.64% (0.3578 => 0.3923, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.47% (0.3663 => 0.4010, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.47% (0.3601 => 0.3942, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.42% (0.3789 => 0.4146, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-4: 9.38% (0.3646 => 0.3988, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.34% (0.3650 => 0.3991, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5818 => 0.6360, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.30% (0.3623 => 0.3960, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.20% (0.3914 => 0.4274, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5748 => 0.6270, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 8.97% (0.4003 => 0.4362, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.93% (0.3940 => 0.4292, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.91% (0.7061 => 0.7690, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.34% (0.3130 => 0.3391, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.26% (0.1819 => 0.1951, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.00% (3.9660 => 4.2435, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 6.97% (1.3693 => 1.4647, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.94% (0.7710 => 0.8245, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.84% (0.5265 => 0.5625, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.82% (0.2596 => 0.2773, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.78% (0.7038 => 0.7515, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.25% (0.4062 => 0.4316, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4328 => 0.4593, std. dev.: 0.0033) SingleSource/Regression/C++/ofstream_ctor: 5.86% (0.2781 => 0.2944, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.80% (0.4379 => 0.4633, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.79% (0.6959 => 0.7362, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.79% (0.2782 => 0.2943, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.63% (0.2966 => 0.3133, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.55% (1.2193 => 1.2870, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.40% (0.5577 => 0.5878, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.39% (13.8202 => 14.5657, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.39% (0.3899 => 0.4109, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2690 => 0.2834, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.31% (0.3580 => 0.3770, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.26% (0.9199 => 0.9683, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 5.25% (0.2760 => 0.2905, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.23% (0.3022 => 0.3180, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.20% (0.2655 => 0.2793, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.18% (0.2628 => 0.2764, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.14% (16.6129 => 17.4665, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.11% (0.3485 => 0.3663, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2761 => 0.2902, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.05% (1.9828 => 2.0829, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.04% (0.3489 => 0.3665, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.2925 => 0.3072, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.01% (0.2696 => 0.2831, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.01% (0.2937 => 0.3084, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.99% (0.2726 => 0.2862, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.92% (0.3107 => 0.3260, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.89% (13.2842 => 13.9336, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/matrix: 4.89% (0.2988 => 0.3134, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.86% (0.3149 => 0.3302, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.77% (1.4563 => 1.5258, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.74% (7.2180 => 7.5601, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: 4.70% (0.7506 => 0.7859, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.67% (0.4390 => 0.4595, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.66% (1.1364 => 1.1893, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5637 => 0.5899, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.62% (1.9270 => 2.0161, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3246 => 0.3396, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.3819 => 1.4457, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.58% (1.1061 => 1.1568, std. dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 4.58% (3.8646 => 4.0415, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sieve: 4.58% (0.3453 => 0.3611, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.57% (0.3192 => 0.3338, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.55% (1.3813 => 1.4441, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 4.46% (0.3293 => 0.3440, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3534 => 0.3691, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.41% (0.4016 => 0.4193, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.3245 => 1.3828, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.37% (1.0594 => 1.1057, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.37% (0.3756 => 0.3920, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.34% (0.8310 => 0.8671, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.33% (0.7460 => 0.7783, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3868 => 0.4027, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (4.4433 => 4.6208, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.3801 => 4.5544, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 3.97% (0.2945 => 0.3062, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.87% (3.6692 => 3.8113, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 3.77% (2.1791 => 2.2612, std. dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: 3.65% (1.2292 => 1.2741, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.56% (1.1333 => 1.1736, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.46% (0.4791 => 0.4957, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.31% (3.1889 => 3.2946, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.30% (4.9865 => 5.1513, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3755 => 0.3873, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 3.01% (0.4113 => 0.4237, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.98% (0.6135 => 0.6318, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.93% (6.5754 => 6.7681, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 2.91% (8.4961 => 8.7436, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.91% (0.6283 => 0.6466, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.90% (0.8698 => 0.8950, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.79% (16.2614 => 16.7155, std. dev.: 0.0142) MultiSource/Applications/ClamAV/clamscan: 2.72% (14.5298 => 14.9244, std. dev.: 0.0104) MultiSource/Applications/oggenc/oggenc: 2.67% (4.6629 => 4.7873, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.67% (2.1007 => 2.1567, std. dev.: 0.0217) MultiSource/Applications/JM/lencod/lencod: 2.62% (14.8535 => 15.2426, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.43% (1.5188 => 1.5557, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.39% (3.2742 => 3.3524, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.76% (1.0313 => 1.0494, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.60% (0.9108 => 0.9254, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.30% (3.7467 => 3.7953, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.63% (5.7573 => 7.5205, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 26.26% (1.8175 => 2.2948, std. dev.: 0.0329) SingleSource/Benchmarks/Misc/mandel-2: 8.52% (1.2998 => 1.4105, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.32% (0.9996 => 1.0528, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7544, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.97% (11.2619 => 11.7086, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9664, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4771, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8158, std. dev.: 0.0170) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.5928 => 4.6607, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1402, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6469 => 3.6841, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.5627 => 21.1412, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.19% (0.8818 => 0.8713, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.35% (0.0997 => 0.0834, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.83% (1.2308 => 1.0975, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.43% (1.3780 => 1.3169, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.12% (0.4867 => 0.4715, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.8259 => 8.5738, std. dev.: 0.0195) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9453, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9376, std. dev.: 0.1051) SingleSource/Benchmarks/Shootout/lists: -1.92% (6.3560 => 6.2342, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5060, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3305 => 7.2167, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2480, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4932, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.15% (26.5159 => 26.2121, std. dev.: 0.0407) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8463, std. dev.: 0.0036) MultiSource/Applications/minisat/minisat: -1.03% (9.3358 => 9.2399, std. dev.: 0.0232) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 22:01:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 00:01:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120728050151.8957D2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2442?compare_to=2440&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2442, Order: 160911, Start Time: 2012-07-28 03:43:35, End Time: 2012-07-28 05:02:15 To: 2440, Order: 160908, Start Time: 2012-07-28 01:57:00, End Time: 2012-07-28 03:15:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (80 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.49% (10.3673 => 13.6322, std. dev.: 0.0104) SingleSource/UnitTests/ObjC/trivial-interface: 13.22% (0.3473 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.04% (0.3497 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.98% (0.3543 => 0.4003, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 12.91% (0.3516 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.89% (0.3561 => 0.4020, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.84% (0.3543 => 0.3998, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.56% (0.3694 => 0.4158, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.15% (0.3828 => 0.4293, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.84% (0.3927 => 0.4392, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/property: 11.84% (0.3886 => 0.4346, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.44% (1.1194 => 1.2475, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.41% (2.2022 => 2.3873, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.08% (1.7609 => 1.9031, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5925 => 0.6290, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.3177 => 0.3370, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.07% (0.6030 => 0.6396, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.54% (0.3121 => 0.3294, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 5.02% (0.7326 => 0.7694, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.96% (0.4615 => 0.4844, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.82% (0.4879 => 0.5114, std. dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 4.80% (10.4361 => 10.9370, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.76% (7.0540 => 7.3897, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/oourafft: 4.33% (0.3282 => 0.3424, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.24% (0.5569 => 0.5805, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 4.14% (0.7433 => 0.7741, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 4.06% (9.4845 => 9.8694, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (4.9449 => 5.1388, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.84% (0.8172 => 0.8486, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.81% (5.0018 => 5.1926, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.48% (4.2646 => 4.4130, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.45% (0.5860 => 0.6062, std. dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.33% (0.3180 => 0.3286, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.31% (8.1363 => 8.4058, std. dev.: 0.0071) MultiSource/Applications/oggenc/oggenc: 3.22% (5.7591 => 5.9446, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.18% (0.7835 => 0.8084, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.99% (1.3050 => 1.3440, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (14.3668 => 14.7955, std. dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.1861 => 1.2209, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 2.78% (1.1642 => 1.1966, std. dev.: 0.0115) MultiSource/Applications/hbd/hbd: 2.71% (1.5603 => 1.6026, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.61% (1.5415 => 1.5817, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.58% (3.3354 => 3.4216, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.50% (2.0273 => 2.0780, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.48% (0.4636 => 0.4751, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 2.40% (0.4299 => 0.4402, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.31% (0.5105 => 0.5223, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.22% (3.8723 => 3.9583, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.07% (0.9765 => 0.9967, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 2.04% (0.6456 => 0.6588, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.2024 => 2.2474, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.4186 => 1.4469, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5981 => 0.6096, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6450 => 0.6573, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.89% (1.5859 => 1.6159, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.83% (2.0665 => 2.1044, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.77% (0.6675 => 0.6793, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 1.63% (0.8921 => 0.9066, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.45% (17.1811 => 17.4300, std. dev.: 0.0199) MultiSource/Applications/siod/siod: 1.42% (2.2969 => 2.3296, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 1.27% (1.2842 => 1.3005, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.25% (1.1840 => 1.1988, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.76% (4.2280 => 4.3869, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7538, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.72% (3.1578 => 3.2121, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5086 => 1.5345, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8323, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.45% (9.1159 => 9.2480, std. dev.: 0.0103) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2040, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.00% (2.8904 => 2.9194, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.03% (5.2763 => 3.1640, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.25% (5.3855 => 3.7025, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.65% (5.3526 => 3.7121, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0021, std. dev.: 0.0216) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.23% (2.9384 => 2.5497, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.20% (22.1758 => 19.9130, std. dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.16% (3.8922 => 3.8470, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.45% (1.2373 => 1.1080, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -7.58% (1.5373 => 1.4208, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -4.57% (1.9577 => 1.8682, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.30% (8.1563 => 7.8871, std. dev.: 0.0140) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4855, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4140, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0019, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3195, std. dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4183, std. dev.: 0.0086) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8096, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -1.02% (3.2827 => 3.2492, std. dev.: 0.0084) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 22:38:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 00:38:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120728053833.DE4B22A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2443?compare_to=2438&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2443, Order: 160910, Start Time: 2012-07-28 02:55:48, End Time: 2012-07-28 05:38:56 To: 2438, Order: 160900, Start Time: 2012-07-27 23:44:15, End Time: 2012-07-28 02:27:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (74 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (808 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.67% (0.6285 => 0.6390, std. dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.78% (0.3446 => 0.3921, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.74% (0.3465 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.64% (0.3496 => 0.3973, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.64% (0.3460 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.58% (0.3469 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.57% (0.3442 => 0.3909, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.53% (0.3488 => 0.3960, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.15% (0.3643 => 0.4122, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.10% (0.3650 => 0.4128, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.70% (0.3724 => 0.4197, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 12.39% (0.3792 => 0.4262, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.1620 => 0.1733, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.56% (0.5826 => 0.6208, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.32% (0.5889 => 0.6261, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.25% (1.5932 => 1.6927, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.39% (0.4994 => 0.5263, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.36% (1.6211 => 1.7080, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.29% (3.5627 => 3.7512, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.11% (0.5026 => 0.5283, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.81% (1.3152 => 1.3784, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 4.77% (0.7171 => 0.7513, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.75% (0.4361 => 0.4568, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (0.5000 => 0.5237, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.59% (0.5900 => 0.6171, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.53% (0.3930 => 0.4108, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 4.52% (1.0781 => 1.1268, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.44% (0.4029 => 0.4208, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 4.25% (4.2109 => 4.3900, std. dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.16% (2.7292 => 2.8426, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.77% (0.2866 => 0.2974, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.73% (0.2736 => 0.2838, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (1.9694 => 2.0408, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.60% (1.9966 => 2.0685, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.50% (0.3890 => 0.4026, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.45% (5.5417 => 5.7327, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (0.3195 => 0.3303, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.26% (0.4658 => 0.4810, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (2.1013 => 2.1675, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.15% (0.9909 => 1.0221, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.09% (2.0673 => 2.1312, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.05% (4.6177 => 4.7586, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 3.02% (2.1653 => 2.2308, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 2.99% (0.4146 => 0.4270, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (4.4195 => 4.5516, std. dev.: 0.0117) MultiSource/Benchmarks/Bullet/bullet: 2.88% (23.5202 => 24.1965, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (0.3625 => 0.3728, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 2.84% (1.8794 => 1.9328, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.83% (0.4139 => 0.4256, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.77% (0.3903 => 0.4011, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.69% (0.7875 => 0.8087, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.59% (1.4269 => 1.4638, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 2.37% (0.6634 => 0.6791, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.36% (0.5546 => 0.5677, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.34% (0.9697 => 0.9924, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.88% (0.6435 => 0.6556, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.22% (2.0346 => 2.0595, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9638, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.41% (0.2122 => 0.2258, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6681, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-2: 4.93% (1.8057 => 1.8947, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1687, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6873, std. dev.: 0.0292) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2077, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4952, std. dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2216, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5146, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.09% (2.4764 => 2.3750, std. dev.: 0.0221) MultiSource/Applications/kimwitu++/kc: -1.47% (11.9555 => 11.7794, std. dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.02% (25.4195 => 16.5167, std. dev.: 0.0125) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7896, std. dev.: 0.0123) SingleSource/Benchmarks/Dhrystone/fldry: -6.85% (17.2379 => 16.0573, std. dev.: 0.0439) SingleSource/Benchmarks/Shootout-C++/ary2: -5.95% (0.2402 => 0.2259, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: -3.92% (0.4438 => 0.4264, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7982, std. dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/dry: -3.59% (14.0481 => 13.5443, std. dev.: 0.0189) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5698, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 23:10:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 01:10:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120728061011.E3EAF2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2444?compare_to=2441&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2444, Order: 160912, Start Time: 2012-07-28 04:56:47, End Time: 2012-07-28 06:10:35 To: 2441, Order: 160910, Start Time: 2012-07-28 03:14:59, End Time: 2012-07-28 04:28:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (144 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.73% (2.2948 => 2.2552, std. dev.: 0.0091) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.57% (2.0176 => 2.3318, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.67% (0.3578 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.52% (0.3646 => 0.3993, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.44% (0.3601 => 0.3941, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.42% (0.3650 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.36% (0.3623 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.34% (0.3663 => 0.4005, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.30% (0.5818 => 0.6359, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.29% (0.3789 => 0.4141, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 9.24% (0.5748 => 0.6279, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.20% (0.3914 => 0.4274, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 9.09% (0.4003 => 0.4367, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 8.91% (0.3940 => 0.4291, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.91% (0.7061 => 0.7690, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.12% (0.3130 => 0.3384, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1819 => 0.1952, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.05% (1.3693 => 1.4659, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.96% (3.9660 => 4.2422, std. dev.: 0.0080) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.84% (0.7710 => 0.8237, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.82% (0.5265 => 0.5624, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.66% (0.7038 => 0.7507, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.97% (0.2781 => 0.2947, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4379 => 0.4637, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.75% (0.2782 => 0.2942, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.69% (0.4062 => 0.4293, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.63% (0.6959 => 0.7351, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.59% (1.2193 => 1.2875, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.44% (0.3899 => 0.4111, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.43% (0.2966 => 0.3127, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.41% (0.2607 => 0.2748, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.29% (0.2760 => 0.2906, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.28% (13.8202 => 14.5505, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.28% (0.3580 => 0.3769, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.28% (0.2690 => 0.2832, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.25% (0.5577 => 0.5870, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.25% (0.3485 => 0.3668, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.9199 => 0.9680, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.21% (0.2628 => 0.2765, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.20% (0.2655 => 0.2793, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 5.14% (0.2761 => 0.2903, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.11% (0.2937 => 0.3087, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.10% (0.3489 => 0.3667, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.10% (0.2726 => 0.2865, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.07% (1.9828 => 2.0834, std. dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: 5.05% (16.6129 => 17.4518, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/ary: 5.02% (0.3107 => 0.3263, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.01% (0.2696 => 0.2831, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.92% (0.2988 => 0.3135, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.89% (0.3149 => 0.3303, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.85% (1.4563 => 1.5269, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.83% (13.2842 => 13.9261, std. dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.80% (0.2914 => 0.3054, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.75% (0.5637 => 0.5905, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.74% (0.4390 => 0.4598, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.71% (7.2180 => 7.5582, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.1364 => 1.1896, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary2: 4.64% (0.3192 => 0.3340, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.60% (0.7506 => 0.7851, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3246 => 0.3395, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.54% (1.3813 => 1.4440, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.52% (1.3819 => 1.4444, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 4.50% (0.3534 => 0.3693, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.47% (1.9270 => 2.0131, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: 4.46% (0.3293 => 0.3440, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.46% (1.1061 => 1.1554, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.42% (0.3756 => 0.3922, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 4.36% (3.8646 => 4.0331, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 4.34% (0.8310 => 0.8671, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.31% (1.3245 => 1.3816, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1049, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.26% (0.7460 => 0.7778, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3868 => 0.4027, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.01% (0.2945 => 0.3063, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.95% (4.3801 => 4.5532, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (4.4433 => 4.6158, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.88% (3.6692 => 3.8114, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.69% (1.2292 => 1.2746, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.59% (2.1791 => 2.2574, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.55% (0.4791 => 0.4961, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.37% (1.1333 => 1.1715, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.28% (4.9865 => 5.1499, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.25% (3.1889 => 3.2924, std. dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 3.23% (0.3131 => 0.3232, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.20% (0.3755 => 0.3875, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 2.94% (0.4113 => 0.4234, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.93% (0.6135 => 0.6315, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.91% (0.6283 => 0.6466, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.91% (0.8698 => 0.8951, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 2.84% (8.4961 => 8.7372, std. dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (6.5754 => 6.7617, std. dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 2.74% (16.2614 => 16.7071, std. dev.: 0.0217) MultiSource/Applications/ClamAV/clamscan: 2.72% (14.5298 => 14.9249, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.65% (2.1007 => 2.1564, std. dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 2.64% (14.8535 => 15.2451, std. dev.: 0.0116) MultiSource/Applications/oggenc/oggenc: 2.57% (4.6629 => 4.7828, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (3.2742 => 3.3510, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.33% (1.5188 => 1.5542, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (0.9108 => 0.9247, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 1.26% (3.7467 => 3.7939, std. dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.81% (0.4846 => 0.6969, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5153, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fbench: 24.08% (1.8175 => 2.2552, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/mandel-2: 7.56% (1.2998 => 1.3981, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.15% (0.9996 => 1.0511, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7551, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7029, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4778, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8166, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0310 => 1.0563, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5089 => 1.5361, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5928 => 4.6626, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5953, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.39% (1.9290 => 1.9558, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1397, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.36% (22.5627 => 21.1269, std. dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.24% (0.8818 => 0.8709, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.05% (0.0997 => 0.0827, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -9.98% (1.2308 => 1.1080, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.29% (1.3780 => 1.3051, std. dev.: 0.0064) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5832, std. dev.: 0.0115) MultiSource/Applications/spiff/spiff: -2.66% (3.0263 => 2.9458, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2286, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9439, std. dev.: 0.0090) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5060, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3305 => 7.2134, std. dev.: 0.0230) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8626, std. dev.: 0.0170) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.5254 => 2.4926, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2270, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2565, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0061) MultiSource/Applications/lua/lua: -1.04% (26.5159 => 26.2410, std. dev.: 0.0114) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jul 27 23:48:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 01:48:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120728064835.5309C2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2445?compare_to=2442&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2445, Order: 160912, Start Time: 2012-07-28 05:30:14, End Time: 2012-07-28 06:48:59 To: 2442, Order: 160911, Start Time: 2012-07-28 03:43:35, End Time: 2012-07-28 05:02:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (81 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.58% (55.2268 => 56.0975, std. dev.: 0.2342) SingleSource/Benchmarks/Misc/mandel-2: 1.55% (1.4208 => 1.4428, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/lowercase: 1.49% (7.9451 => 8.0631, std. dev.: 0.0193) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.45% (10.3673 => 13.6280, std. dev.: 0.0230) SingleSource/UnitTests/ObjC/trivial-interface: 13.19% (0.3473 => 0.3931, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.00% (0.3516 => 0.3973, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.93% (0.3497 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.92% (0.3561 => 0.4021, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.81% (0.3543 => 0.3997, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.81% (0.3543 => 0.3997, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 12.48% (0.3694 => 0.4155, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.28% (0.3828 => 0.4298, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.94% (0.3886 => 0.4350, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.69% (0.3927 => 0.4386, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2483, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.41% (2.2022 => 2.3875, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.13% (1.7609 => 1.9041, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.19% (0.5925 => 0.6292, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.14% (0.1906 => 0.2023, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.12% (0.6030 => 0.6399, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.97% (0.1892 => 0.2005, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.66% (0.7326 => 0.7741, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.35% (0.4615 => 0.4862, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 4.78% (10.4361 => 10.9350, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.68% (7.0540 => 7.3839, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/oourafft: 4.42% (0.3282 => 0.3427, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.12% (0.7433 => 0.7739, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 4.05% (9.4845 => 9.8686, std. dev.: 0.0194) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.80% (4.9449 => 5.1327, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.78% (5.0018 => 5.1911, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.78% (0.8172 => 0.8481, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.65% (0.5569 => 0.5772, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.45% (4.2646 => 4.4117, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.33% (8.1363 => 8.4072, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.33% (0.5860 => 0.6055, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 3.27% (0.3180 => 0.3284, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.20% (5.7591 => 5.9432, std. dev.: 0.0150) MultiSource/Applications/spiff/spiff: 3.19% (0.7835 => 0.8085, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3423 => 0.3532, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (14.3668 => 14.7954, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.3050 => 1.3434, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.88% (1.1861 => 1.2203, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.81% (1.5603 => 1.6041, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 2.71% (1.1642 => 1.1958, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.63% (1.5415 => 1.5821, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.62% (3.3354 => 3.4228, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.56% (2.0273 => 2.0792, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.44% (0.4636 => 0.4749, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.43% (0.8067 => 0.8263, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.31% (3.8723 => 3.9618, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (0.5105 => 0.5219, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.07% (0.9765 => 0.9967, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.02% (2.2024 => 2.2469, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (1.5859 => 1.6166, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 1.91% (0.6456 => 0.6579, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5981 => 0.6092, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.85% (1.4186 => 1.4449, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.78% (0.6450 => 0.6565, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.74% (2.0665 => 2.1024, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 1.67% (0.8921 => 0.9070, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.51% (17.1811 => 17.4408, std. dev.: 0.0133) MultiSource/Applications/siod/siod: 1.43% (2.2969 => 2.3297, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 1.26% (1.1840 => 1.1989, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 1.21% (1.2842 => 1.2997, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.77% (4.2280 => 4.3873, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7507, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.54% (1.0313 => 1.0575, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5086 => 1.5344, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.61% (11.6436 => 11.8315, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 1.40% (2.2771 => 2.3090, std. dev.: 0.0076) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2036, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2228, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.03% (2.8904 => 2.9202, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.05% (5.2763 => 3.1634, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.29% (5.3855 => 3.7006, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.56% (5.3526 => 3.7166, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0341, std. dev.: 0.0221) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.20% (2.9384 => 2.5506, std. dev.: 0.0196) MultiSource/Applications/ClamAV/clamscan: -10.28% (22.1758 => 19.8967, std. dev.: 0.0460) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (3.8922 => 3.8477, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.03% (0.0998 => 0.0858, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -9.74% (1.2373 => 1.1168, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -6.15% (1.5373 => 1.4428, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5033, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.75% (1.9577 => 1.8648, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4887, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9155, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4283, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0016, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.33% (1.3677 => 1.3358, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.71% (12.5348 => 12.3202, std. dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4183, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.23% (1.8329 => 1.8104, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 01:53:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 03:53:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120728085344.3D0C72A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2446?compare_to=2443&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2446, Order: 160912, Start Time: 2012-07-28 06:06:44, End Time: 2012-07-28 08:54:04 To: 2443, Order: 160910, Start Time: 2012-07-28 02:55:48, End Time: 2012-07-28 05:38:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (67 on baseline) Performance Improvements: 1 (10 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (817 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 28.06% (0.4262 => 0.5458, std. dev.: 0.0210) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.43% (61.1921 => 74.9146, std. dev.: 0.0343) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.56% (0.6390 => 0.6290, std. dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 43.93% (0.3792 => 0.5458, std. dev.: 0.0210) SingleSource/UnitTests/ObjC/exceptions-2: 13.84% (0.3446 => 0.3923, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3465 => 0.3942, std. dev.: 0.0082) SingleSource/UnitTests/ObjC/trivial-interface: 13.74% (0.3442 => 0.3915, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.68% (0.3488 => 0.3965, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions-3: 13.61% (0.3460 => 0.3931, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/for-in: 13.59% (0.3496 => 0.3971, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/synchronized: 13.58% (0.3469 => 0.3940, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions: 13.15% (0.3643 => 0.4122, std. dev.: 0.0087) SingleSource/UnitTests/ObjC/property: 13.01% (0.3650 => 0.4125, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/parameter-passing: 12.73% (0.3724 => 0.4198, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.79% (0.1620 => 0.1730, std. dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 6.29% (1.5932 => 1.6934, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 6.16% (0.5889 => 0.6252, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.39% (0.5900 => 0.6218, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.39% (1.6211 => 1.7084, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.36% (3.5627 => 3.7537, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.29% (0.4994 => 0.5258, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.89% (1.3152 => 1.3795, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.86% (0.5000 => 0.5243, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.70% (0.4361 => 0.4566, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.57% (0.4029 => 0.4213, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 4.54% (1.0781 => 1.1270, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.53% (0.3930 => 0.4108, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.44% (0.5026 => 0.5249, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 4.37% (4.2109 => 4.3950, std. dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 4.05% (0.2566 => 0.2670, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.99% (2.7292 => 2.8380, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.98% (0.2866 => 0.2980, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.93% (0.3890 => 0.4043, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (1.9694 => 2.0464, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.73% (0.2736 => 0.2838, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.68% (1.9966 => 2.0700, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.63% (0.4658 => 0.4827, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.54% (5.5417 => 5.7378, std. dev.: 0.0126) MultiSource/Applications/JM/ldecod/ldecod: 3.21% (2.1653 => 2.2347, std. dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 3.16% (0.9909 => 1.0222, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 3.16% (4.6177 => 4.7634, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 3.10% (1.8794 => 1.9376, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.05% (0.3903 => 0.4022, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.92% (4.4195 => 4.5486, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.89% (2.0673 => 2.1271, std. dev.: 0.0063) MultiSource/Benchmarks/Bullet/bullet: 2.84% (23.5202 => 24.1881, std. dev.: 0.0118) MultiSource/Applications/treecc/treecc: 2.74% (0.7875 => 0.8091, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.73% (0.4139 => 0.4252, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.60% (1.4269 => 1.4640, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 2.58% (0.5546 => 0.5689, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.26% (0.9697 => 0.9916, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.77% (0.6435 => 0.6549, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.16% (2.0346 => 2.0582, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (2.5769 => 2.9634, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-2: 5.11% (1.8057 => 1.8980, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (12.0509 => 12.6604, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1687, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6637, std. dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4937, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 1.83% (15.8721 => 16.1621, std. dev.: 0.0249) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5927, std. dev.: 0.0257) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2210, std. dev.: 0.0132) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.53% (11.9555 => 11.7730, std. dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.02% (25.4195 => 16.5169, std. dev.: 0.0129) SingleSource/Benchmarks/Dhrystone/fldry: -8.53% (17.2379 => 15.7681, std. dev.: 0.3361) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7993, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary2: -6.49% (0.2402 => 0.2246, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -3.94% (0.4438 => 0.4263, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -3.57% (14.0481 => 13.5462, std. dev.: 0.1375) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5817, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 5.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 02:52:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 04:52:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120728095222.5AAA82A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2447?compare_to=2444&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2447, Order: 160913, Start Time: 2012-07-28 08:38:42, End Time: 2012-07-28 09:52:45 To: 2444, Order: 160912, Start Time: 2012-07-28 04:56:47, End Time: 2012-07-28 06:10:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (144 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.54% (2.0176 => 2.3312, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.73% (0.3578 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.50% (0.3601 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.49% (0.3646 => 0.3992, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.45% (0.3650 => 0.3995, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 9.41% (0.3623 => 0.3964, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.36% (0.3663 => 0.4006, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.32% (0.3789 => 0.4142, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5818 => 0.6360, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.22% (0.3914 => 0.4275, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.15% (0.5748 => 0.6274, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.04% (0.4003 => 0.4365, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.88% (0.3940 => 0.4290, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.37% (0.7061 => 0.7652, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.31% (0.3130 => 0.3390, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.26% (0.1819 => 0.1951, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.96% (3.9660 => 4.2419, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.95% (1.3693 => 1.4644, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.86% (0.2596 => 0.2774, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.76% (0.7710 => 0.8231, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 6.75% (0.7038 => 0.7513, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5265 => 0.5619, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.2721 => 0.2898, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.22% (0.4328 => 0.4597, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.73% (0.4379 => 0.4630, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.66% (0.4062 => 0.4292, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.64% (0.2782 => 0.2939, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.58% (0.6959 => 0.7347, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.55% (1.2193 => 1.2870, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.36% (0.5577 => 0.5876, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.36% (0.3899 => 0.4108, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2690 => 0.2834, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.33% (0.2760 => 0.2907, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2966 => 0.3123, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.27% (13.8202 => 14.5479, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (1.9828 => 2.0858, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/methcall: 5.18% (0.2761 => 0.2904, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.17% (0.9199 => 0.9675, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.16% (0.2655 => 0.2792, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.11% (0.3580 => 0.3763, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.11% (0.3485 => 0.3663, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.10% (0.2726 => 0.2865, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (0.2628 => 0.2762, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.10% (0.3022 => 0.3176, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.07% (0.2937 => 0.3086, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.03% (16.6129 => 17.4484, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.02% (0.3489 => 0.3664, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.96% (0.3107 => 0.3261, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.95% (0.3149 => 0.3305, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.95% (0.2243 => 0.2354, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.92% (0.2988 => 0.3135, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (13.2842 => 13.9305, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.86% (0.2696 => 0.2827, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.81% (1.4563 => 1.5263, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.72% (1.1364 => 1.1900, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.67% (7.2180 => 7.5553, std. dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.63% (0.5637 => 0.5898, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.61% (0.3192 => 0.3339, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.58% (0.4390 => 0.4591, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 4.56% (0.7506 => 0.7848, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.53% (0.3534 => 0.3694, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.52% (0.3293 => 0.3442, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.52% (1.3813 => 1.4438, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sieve: 4.52% (0.3453 => 0.3609, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3246 => 0.3392, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.46% (1.3819 => 1.4436, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 4.44% (1.9270 => 2.0125, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/football/football: 4.42% (0.8310 => 0.8677, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.41% (0.4016 => 0.4193, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.39% (0.3756 => 0.3921, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.35% (3.8646 => 4.0328, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 4.32% (1.1061 => 1.1539, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.32% (1.3245 => 1.3817, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.30% (0.7460 => 0.7781, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.2292 => 1.2816, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.26% (1.0594 => 1.1045, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3868 => 0.4027, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 4.04% (0.3220 => 0.3350, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 4.01% (0.2945 => 0.3063, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (4.4433 => 4.6193, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 3.95% (2.1791 => 2.2651, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.3801 => 4.5491, std. dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 3.84% (0.2995 => 0.3110, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.82% (3.6692 => 3.8094, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.46% (1.1333 => 1.1725, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.36% (4.9865 => 5.1542, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3755 => 0.3881, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.23% (0.3131 => 0.3232, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.21% (3.1889 => 3.2914, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.01% (0.6283 => 0.6472, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 2.99% (0.4113 => 0.4236, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.95% (0.6135 => 0.6316, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.90% (0.8698 => 0.8950, std. dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: 2.84% (6.5754 => 6.7623, std. dev.: 0.0176) MultiSource/Benchmarks/mafft/pairlocalalign: 2.82% (8.4961 => 8.7353, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 2.79% (16.2614 => 16.7154, std. dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: 2.74% (14.5298 => 14.9274, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.65% (2.1007 => 2.1564, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 2.65% (14.8535 => 15.2472, std. dev.: 0.0204) MultiSource/Applications/oggenc/oggenc: 2.53% (4.6629 => 4.7811, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.37% (3.2742 => 3.3519, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.25% (1.5188 => 1.5529, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.57% (1.0313 => 1.0475, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (0.9108 => 0.9243, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.20% (3.7467 => 3.7917, std. dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5139, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/fbench: 24.87% (1.8175 => 2.2696, std. dev.: 0.0275) SingleSource/Benchmarks/Misc/mandel-2: 7.80% (1.2998 => 1.4012, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.22% (0.9996 => 1.0518, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: 4.50% (7.4271 => 7.7613, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7041, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4768, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8150, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (0.9692 => 0.9911, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5352, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4523, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.55% (4.5928 => 4.6638, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5943, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.45% (2.0200 => 2.0493, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5108, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 1.07% (1.1560 => 1.1684, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.41% (22.5627 => 21.1165, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2308 => 1.0982, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std. dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5846, std. dev.: 0.0130) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9472, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.97% (20.3410 => 19.9397, std. dev.: 0.0704) SingleSource/Benchmarks/Shootout/lists: -1.93% (6.3560 => 6.2334, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5062, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2127, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0042, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.37% (5.3167 => 5.2441, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2267, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 02:57:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 04:57:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120728095755.DFAF42A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2448?compare_to=2445&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2448, Order: 160913, Start Time: 2012-07-28 08:38:42, End Time: 2012-07-28 09:57:34 To: 2445, Order: 160912, Start Time: 2012-07-28 05:30:14, End Time: 2012-07-28 06:48:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (80 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.14% (79.3551 => 80.2571, std. dev.: 0.3275) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.58% (10.3673 => 13.6416, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/trivial-interface: 13.25% (0.3473 => 0.3933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.04% (0.3497 => 0.3953, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.87% (0.3543 => 0.3999, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 12.86% (0.3516 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.81% (0.3543 => 0.3997, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.78% (0.3561 => 0.4016, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.51% (0.3694 => 0.4156, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.12% (0.3828 => 0.4292, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3927 => 0.4393, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.86% (0.3886 => 0.4347, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.44% (1.1194 => 1.2475, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.45% (2.2022 => 2.3882, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.24% (1.7609 => 1.9060, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5925 => 0.6287, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 6.07% (0.6030 => 0.6396, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.03% (0.4615 => 0.4847, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 4.94% (0.7326 => 0.7688, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.90% (0.4879 => 0.5118, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 4.84% (10.4361 => 10.9410, std. dev.: 0.0277) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.67% (7.0540 => 7.3836, std. dev.: 0.0188) SingleSource/Benchmarks/Misc/oourafft: 4.51% (0.3282 => 0.3430, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 4.40% (0.7433 => 0.7760, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (9.4845 => 9.8788, std. dev.: 0.0096) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.01% (5.0018 => 5.2022, std. dev.: 0.0127) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.92% (0.8172 => 0.8492, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.9449 => 5.1357, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.84% (0.5860 => 0.6085, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.77% (0.5569 => 0.5779, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.66% (4.2646 => 4.4208, std. dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.43% (0.3180 => 0.3289, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.36% (0.3423 => 0.3538, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.32% (5.7591 => 5.9503, std. dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.31% (8.1363 => 8.4060, std. dev.: 0.0116) MultiSource/Applications/spiff/spiff: 3.25% (0.7835 => 0.8090, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.08% (1.1861 => 1.2226, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.08% (14.3668 => 14.8088, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.06% (1.3050 => 1.3449, std. dev.: 0.0036) MultiSource/Applications/hbd/hbd: 2.95% (1.5603 => 1.6063, std. dev.: 0.0093) MultiSource/Applications/Burg/burg: 2.76% (1.1642 => 1.1963, std. dev.: 0.0107) MultiSource/Applications/d/make_dparser: 2.67% (3.3354 => 3.4246, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (1.5415 => 1.5822, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 2.63% (0.4299 => 0.4412, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.60% (2.0273 => 2.0800, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.45% (0.5105 => 0.5230, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 2.42% (3.8723 => 3.9661, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.29% (2.2024 => 2.2529, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.19% (0.9765 => 0.9979, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.13% (1.5859 => 1.6197, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.04% (0.6675 => 0.6811, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.03% (1.4186 => 1.4474, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/bigfib: 1.98% (0.6456 => 0.6584, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.97% (0.6450 => 0.6577, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.96% (0.5981 => 0.6098, std. dev.: 0.0041) MultiSource/Applications/siod/siod: 1.64% (2.2969 => 2.3345, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 1.63% (0.8921 => 0.9066, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.61% (2.0665 => 2.0998, std. dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 1.57% (17.1811 => 17.4514, std. dev.: 0.0257) MultiSource/Applications/minisat/minisat: 1.41% (0.7115 => 0.7215, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 1.37% (1.1840 => 1.2002, std. dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 1.19% (1.2842 => 1.2995, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.11% (1.0722 => 1.0841, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.33% (4.2280 => 4.4111, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7501, std. dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (1.5086 => 1.5365, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2159, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8326, std. dev.: 0.0017) MultiSource/Applications/aha/aha: 1.38% (3.1595 => 3.2032, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2284, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.05% (2.3135 => 2.3377, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1614, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.23% (5.3855 => 3.7037, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.65% (5.3526 => 3.7119, std. dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -15.00% (54.1659 => 46.0430, std. dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.26% (2.9384 => 2.5489, std. dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: -10.06% (22.1758 => 19.9450, std. dev.: 0.0386) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.53% (0.0998 => 0.0843, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1166, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -8.53% (1.5373 => 1.4061, std. dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -4.48% (1.9577 => 1.8700, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4790, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.15% (8.1563 => 7.8990, std. dev.: 0.0126) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4279, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0016, std. dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3283, std. dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4177, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.38% (1.8329 => 1.8076, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2495, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 04:36:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 06:36:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120728113651.ECD262A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2449?compare_to=2447&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2449, Order: 160914, Start Time: 2012-07-28 10:22:48, End Time: 2012-07-28 11:37:14 To: 2447, Order: 160913, Start Time: 2012-07-28 08:38:42, End Time: 2012-07-28 09:52:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (144 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.85% (54.7924 => 56.3535, std. dev.: 0.1351) MultiSource/Benchmarks/llubenchmark/llu: 1.69% (3.7700 => 3.8338, std. dev.: 0.0150) SingleSource/Benchmarks/McGill/chomp: 1.12% (1.0982 => 1.1105, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.21% (2.0176 => 2.3245, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 10.26% (0.3578 => 0.3945, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 10.02% (0.3663 => 0.4030, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.00% (0.3650 => 0.4015, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-4: 9.98% (0.3646 => 0.4010, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-2: 9.97% (0.3601 => 0.3960, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 9.94% (0.3623 => 0.3983, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 9.71% (0.3789 => 0.4157, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 9.66% (0.3914 => 0.4292, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/property: 9.52% (0.3940 => 0.4315, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/parameter-passing: 9.42% (0.4003 => 0.4380, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 9.37% (0.5818 => 0.6363, std. dev.: 0.0072) SingleSource/UnitTests/ObjC++/Hello: 9.27% (0.5748 => 0.6281, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference: 8.36% (0.7061 => 0.7651, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.27% (0.3130 => 0.3389, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.26% (0.1986 => 0.2150, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.48% (0.7710 => 0.8287, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.08% (1.3693 => 1.4663, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.90% (3.9660 => 4.2396, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.89% (0.5265 => 0.5628, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.55% (0.7038 => 0.7499, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.33% (0.4328 => 0.4602, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.06% (0.2655 => 0.2816, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.79% (0.2782 => 0.2943, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.71% (0.4062 => 0.4294, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.4379 => 0.4629, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2607 => 0.2753, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.56% (0.6959 => 0.7346, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.49% (0.3899 => 0.4113, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.43% (0.2690 => 0.2836, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1865 => 0.1965, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.36% (0.2966 => 0.3125, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.36% (1.2193 => 1.2846, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.29% (0.2761 => 0.2907, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.25% (0.2760 => 0.2905, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.24% (0.2765 => 0.2910, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.22% (0.3485 => 0.3667, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.22% (13.8202 => 14.5412, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/fibo: 5.21% (0.2628 => 0.2765, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.20% (1.9828 => 2.0859, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.19% (0.3489 => 0.3670, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.17% (0.3580 => 0.3765, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.15% (0.9199 => 0.9673, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.15% (0.3107 => 0.3267, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.2937 => 0.3088, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.13% (0.5577 => 0.5863, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.04% (0.2696 => 0.2832, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.00% (16.6129 => 17.4431, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.97% (0.4390 => 0.4608, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 4.95% (0.3149 => 0.3305, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.2988 => 0.3133, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.72% (0.2925 => 0.3063, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.72% (0.7506 => 0.7860, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.68% (13.2842 => 13.9060, std. dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/ary2: 4.64% (0.3192 => 0.3340, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.63% (0.3453 => 0.3613, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.61% (7.2180 => 7.5505, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.59% (1.4563 => 1.5232, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/lists: 4.59% (0.3293 => 0.3444, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 4.58% (0.3534 => 0.3696, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.5637 => 0.5895, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.58% (1.1364 => 1.1884, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.51% (1.3819 => 1.4442, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.46% (1.9270 => 2.0129, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 4.43% (1.1061 => 1.1551, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.42% (0.3756 => 0.3922, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.41% (0.3246 => 0.3389, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.3813 => 1.4419, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.35% (1.3245 => 1.3821, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 4.30% (3.8646 => 4.0309, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 4.25% (0.8310 => 0.8663, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.23% (1.0594 => 1.1042, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 4.21% (0.3868 => 0.4031, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.09% (0.7460 => 0.7765, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2945 => 0.3064, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (4.4433 => 4.6204, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 3.96% (2.1791 => 2.2653, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.89% (4.3801 => 4.5504, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 3.82% (1.2292 => 1.2762, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.79% (3.6692 => 3.8082, std. dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 3.67% (0.2995 => 0.3105, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.66% (0.3220 => 0.3338, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.34% (0.4791 => 0.4951, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.34% (1.1333 => 1.1711, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.23% (4.9865 => 5.1474, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.22% (0.3755 => 0.3876, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 3.18% (3.1889 => 3.2904, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.01% (0.8698 => 0.8960, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.89% (0.6135 => 0.6312, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (6.5754 => 6.7587, std. dev.: 0.0144) MultiSource/Applications/sqlite3/sqlite3: 2.77% (16.2614 => 16.7111, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.71% (0.6283 => 0.6453, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.68% (8.4961 => 8.7240, std. dev.: 0.0181) MultiSource/Applications/JM/lencod/lencod: 2.62% (14.8535 => 15.2432, std. dev.: 0.0108) MultiSource/Applications/ClamAV/clamscan: 2.58% (14.5298 => 14.9046, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (2.1007 => 2.1526, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.36% (4.6629 => 4.7728, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (3.2742 => 3.3490, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.06% (1.5188 => 1.5501, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.37% (0.9108 => 0.9233, std. dev.: 0.0048) MultiSource/Applications/lemon/lemon: 1.37% (1.0313 => 1.0454, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.11% (3.7467 => 3.7882, std. dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/fbench: 24.80% (1.8175 => 2.2682, std. dev.: 0.0537) SingleSource/Benchmarks/Misc/mandel-2: 8.39% (1.2998 => 1.4088, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.37% (0.9996 => 1.0533, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 4.37% (7.4271 => 7.7520, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7054, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9658, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4778, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8160, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5349, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0011) MultiSource/Benchmarks/llubenchmark/llu: 1.61% (3.7731 => 3.8338, std. dev.: 0.0150) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9592, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.47% (4.5928 => 4.6605, std. dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.41% (22.5627 => 21.1157, std. dev.: 0.0244) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.30% (0.3511 => 0.3395, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.17% (0.8818 => 0.8715, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.85% (0.0997 => 0.0829, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1105, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.26% (1.3780 => 1.3055, std. dev.: 0.0081) SingleSource/UnitTests/Vector/multiplies: -4.96% (2.6470 => 2.5158, std. dev.: 0.0080) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.62% (3.0263 => 2.9470, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.43% (8.8259 => 8.6118, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2220, std. dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.03% (20.3410 => 19.9289, std. dev.: 0.0785) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.56% (7.3305 => 7.2161, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8567, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2167, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2555, std. dev.: 0.0043) MultiSource/Applications/lua/lua: -1.12% (26.5159 => 26.2192, std. dev.: 0.0281) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 04:45:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 06:45:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120728114528.2AB1D2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2450?compare_to=2448&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2450, Order: 160914, Start Time: 2012-07-28 10:27:09, End Time: 2012-07-28 11:45:53 To: 2448, Order: 160913, Start Time: 2012-07-28 08:38:42, End Time: 2012-07-28 09:57:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (81 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (760 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.59% (10.3673 => 13.6419, std. dev.: 0.0156) SingleSource/UnitTests/ObjC/trivial-interface: 13.19% (0.3473 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.07% (0.3497 => 0.3954, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 12.90% (0.3543 => 0.4000, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.87% (0.3543 => 0.3999, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3516 => 0.3967, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 12.72% (0.3561 => 0.4014, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.62% (0.3694 => 0.4160, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 12.17% (0.3828 => 0.4294, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 11.92% (0.3927 => 0.4395, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 11.84% (0.3886 => 0.4346, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.48% (1.1194 => 1.2479, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.47% (2.2022 => 2.3888, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.18% (1.7609 => 1.9049, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.83% (0.2065 => 0.2206, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.08% (0.5925 => 0.6285, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.3177 => 0.3370, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.6030 => 0.6393, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.4615 => 0.4867, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 5.04% (0.7326 => 0.7695, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.4879 => 0.5121, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 4.87% (10.4361 => 10.9444, std. dev.: 0.0141) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.66% (7.0540 => 7.3830, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 4.42% (0.3282 => 0.3427, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.35% (0.5569 => 0.5811, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.17% (0.8172 => 0.8513, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 4.17% (0.7433 => 0.7743, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 4.11% (9.4845 => 9.8741, std. dev.: 0.0074) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.99% (0.2758 => 0.2868, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.89% (4.9449 => 5.1375, std. dev.: 0.0115) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (5.0018 => 5.1961, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (4.2646 => 4.4194, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.43% (0.5860 => 0.6061, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.3121 => 0.3228, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 3.43% (0.3180 => 0.3289, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 3.31% (0.3109 => 0.3212, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 3.28% (5.7591 => 5.9480, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.28% (8.1363 => 8.4030, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.23% (1.3050 => 1.3471, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 3.15% (0.7835 => 0.8082, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (14.3668 => 14.8058, std. dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1861 => 1.2221, std. dev.: 0.0038) MultiSource/Applications/hbd/hbd: 2.79% (1.5603 => 1.6038, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 2.72% (1.1642 => 1.1959, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.8067 => 0.8285, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 2.69% (2.0273 => 2.0818, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 2.65% (0.4299 => 0.4413, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 2.64% (3.3354 => 3.4236, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.58% (1.5415 => 1.5813, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 2.57% (3.8723 => 3.9717, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.35% (0.5105 => 0.5225, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.18% (2.2024 => 2.2504, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.15% (0.9765 => 0.9975, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.01% (0.6675 => 0.6809, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.4186 => 1.4459, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.91% (0.5981 => 0.6095, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 1.91% (0.6456 => 0.6579, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 1.75% (0.8921 => 0.9077, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.65% (2.0665 => 2.1006, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.62% (2.2969 => 2.3340, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.59% (17.1811 => 17.4544, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 1.37% (1.1840 => 1.2002, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 1.21% (1.2842 => 1.2997, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.03% (1.0722 => 1.0832, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.05% (4.2280 => 4.3993, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7489, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.53% (1.0313 => 1.0574, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.83% (3.1578 => 3.2155, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5086 => 1.5342, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.61% (11.6436 => 11.8315, std. dev.: 0.0021) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2039, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2308, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/fbench: 1.15% (2.2771 => 2.3034, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.07% (5.2763 => 3.1620, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.23% (5.3855 => 3.7034, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.61% (5.3526 => 3.7142, std. dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0380, std. dev.: 0.0342) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.25% (2.9384 => 2.5491, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -10.17% (22.1758 => 19.9212, std. dev.: 0.0238) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4241, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2373 => 1.1078, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -7.22% (1.5373 => 1.4263, std. dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -4.97% (1.9577 => 1.8605, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.22% (8.1563 => 7.8936, std. dev.: 0.0149) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4801, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4197, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0004, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.76% (12.5348 => 12.3146, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6784, std. dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4172, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 05:07:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 07:07:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120728120706.81DB32A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2451?compare_to=2446&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2451, Order: 160914, Start Time: 2012-07-28 09:22:19, End Time: 2012-07-28 12:07:30 To: 2446, Order: 160912, Start Time: 2012-07-28 06:06:44, End Time: 2012-07-28 08:54:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (76 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (807 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 41.93% (0.3792 => 0.5382, std. dev.: 0.0348) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.13% (0.3488 => 0.3981, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-3: 13.79% (0.3460 => 0.3937, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3465 => 0.3942, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 13.75% (0.3469 => 0.3946, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/for-in: 13.73% (0.3496 => 0.3976, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 13.73% (0.3446 => 0.3919, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: 13.71% (0.3442 => 0.3914, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/property: 13.23% (0.3650 => 0.4133, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions: 13.18% (0.3643 => 0.4123, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/parameter-passing: 12.65% (0.3724 => 0.4195, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1620 => 0.1735, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 6.76% (0.5826 => 0.6220, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 6.52% (0.5889 => 0.6273, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 6.47% (1.5932 => 1.6963, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.62% (1.6211 => 1.7122, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.56% (0.5900 => 0.6228, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.54% (3.5627 => 3.7601, std. dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference: 5.42% (0.7171 => 0.7560, std. dev.: 0.0108) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.33% (0.4994 => 0.5260, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.32% (0.3930 => 0.4139, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.28% (1.3152 => 1.3846, std. dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (0.5000 => 0.5250, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 5.00% (1.0781 => 1.1320, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.00% (0.4361 => 0.4579, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.87% (0.5026 => 0.5271, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 4.67% (4.2109 => 4.4075, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.64% (0.2866 => 0.2999, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 4.57% (0.4029 => 0.4213, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.36% (0.2566 => 0.2678, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (2.7292 => 2.8445, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (1.9694 => 2.0491, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.80% (0.2736 => 0.2840, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.73% (1.9966 => 2.0711, std. dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 3.72% (0.2691 => 0.2791, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.63% (5.5417 => 5.7427, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 3.57% (2.1653 => 2.2426, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.57% (0.3362 => 0.3482, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.57% (0.3336 => 0.3455, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.39% (0.3890 => 0.4022, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (0.3195 => 0.3303, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.36% (0.9909 => 1.0242, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 3.31% (4.6177 => 4.7706, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.31% (4.4195 => 4.5658, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.28% (0.3903 => 0.4031, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.24% (0.4658 => 0.4809, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.24% (0.4139 => 0.4273, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.12% (2.0673 => 2.1317, std. dev.: 0.0112) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (1.8794 => 1.9374, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 2.88% (0.7875 => 0.8102, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 2.87% (0.9697 => 0.9975, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 2.85% (0.4146 => 0.4264, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.76% (0.6634 => 0.6817, std. dev.: 0.0048) MultiSource/Applications/lua/lua: 2.74% (1.4269 => 1.4660, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 2.66% (23.5202 => 24.1459, std. dev.: 0.1623) MultiSource/Applications/Burg/burg: 2.58% (0.5546 => 0.5689, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.6435 => 0.6552, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.38% (2.0346 => 2.0627, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.29% (0.2162 => 0.3552, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9636, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 5.26% (1.8057 => 1.9007, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6798, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1685, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6551, std. dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1975, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4584, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5007, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5927, std. dev.: 0.0117) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.50% (3.1722 => 3.2197, std. dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.39% (1.0927 => 1.1079, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.53% (11.9555 => 11.7720, std. dev.: 0.0224) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.04% (25.4195 => 16.5129, std. dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/ary2: -9.45% (0.2402 => 0.2175, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/fldry: -9.21% (17.2379 => 15.6495, std. dev.: 0.3296) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8109, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/moments: -3.88% (0.4438 => 0.4266, std. dev.: 0.0033) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8030, std. dev.: 0.0575) SingleSource/Benchmarks/Dhrystone/dry: -3.58% (14.0481 => 13.5450, std. dev.: 0.0802) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5782, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 11:36:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 13:36:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120728183634.067C22A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2452?compare_to=2449&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2452, Order: 160919, Start Time: 2012-07-28 17:22:40, End Time: 2012-07-28 18:36:58 To: 2449, Order: 160914, Start Time: 2012-07-28 10:22:48, End Time: 2012-07-28 11:37:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (150 on baseline) Performance Improvements: 3 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 949 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.90% (0.0829 => 0.0994, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.25% (3.1550 => 3.1945, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.43% (12.4778 => 12.0494, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.38% (0.8620 => 0.8501, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.0637 => 27.7416, std. dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.53% (2.0176 => 2.3309, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.77% (0.1075 => 0.1180, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3578 => 0.3925, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.61% (0.3601 => 0.3947, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.52% (0.3646 => 0.3993, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.42% (0.3650 => 0.3994, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 9.41% (0.3623 => 0.3964, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.39% (0.3663 => 0.4007, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.34% (0.3789 => 0.4143, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.28% (0.7061 => 0.7716, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.23% (0.5818 => 0.6355, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.22% (0.3914 => 0.4275, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5748 => 0.6270, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.07% (0.4003 => 0.4366, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.04% (0.3940 => 0.4296, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.40% (0.3130 => 0.3393, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.75% (0.1819 => 0.1960, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 7.63% (0.7038 => 0.7575, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.52% (0.7710 => 0.8290, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.33% (3.9660 => 4.2566, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.13% (0.2596 => 0.2781, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 7.10% (1.3693 => 1.4665, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.97% (0.5265 => 0.5632, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.25% (0.4062 => 0.4316, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.22% (0.6959 => 0.7392, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 6.22% (0.2781 => 0.2954, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.05% (0.3899 => 0.4135, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4379 => 0.4644, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.88% (1.2193 => 1.2910, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.86% (0.3022 => 0.3199, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.83% (0.5577 => 0.5902, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.68% (0.2782 => 0.2940, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.57% (13.8202 => 14.5899, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.46% (0.9199 => 0.9701, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.41% (1.4563 => 1.5351, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 5.39% (0.2243 => 0.2364, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 5.31% (16.6129 => 17.4953, std. dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.28% (0.2690 => 0.2832, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.25% (0.2726 => 0.2869, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.18% (0.2914 => 0.3065, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.17% (0.2127 => 0.2237, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.2925 => 0.3076, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.16% (0.2655 => 0.2792, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.14% (0.3580 => 0.3764, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 5.14% (0.2628 => 0.2763, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.14% (0.2765 => 0.2907, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.12% (0.2966 => 0.3118, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.11% (0.3485 => 0.3663, std. dev.: 0.0061) MultiSource/Applications/Burg/burg: 5.08% (1.1061 => 1.1623, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.08% (0.4390 => 0.4613, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 5.07% (0.2937 => 0.3086, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.07% (0.3489 => 0.3666, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.05% (1.9828 => 2.0830, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.03% (0.2761 => 0.2900, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.02% (0.3107 => 0.3263, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.00% (0.5637 => 0.5919, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: 4.96% (0.2760 => 0.2897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.95% (0.3149 => 0.3305, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.92% (1.3819 => 1.4499, std. dev.: 0.0080) MultiSource/Applications/spiff/spiff: 4.92% (0.7506 => 0.7875, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.92% (7.2180 => 7.5728, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.87% (1.1364 => 1.1917, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.84% (0.3246 => 0.3403, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.82% (0.2696 => 0.2826, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2988 => 0.3132, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.78% (13.2842 => 13.9192, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: 4.74% (3.8646 => 4.0477, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 4.71% (1.9270 => 2.0178, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.68% (0.4016 => 0.4204, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.64% (1.3813 => 1.4454, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.64% (1.3245 => 1.3859, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.61% (0.7460 => 0.7804, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 4.61% (0.3192 => 0.3339, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.56% (1.0594 => 1.1077, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.3453 => 0.3610, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.52% (0.8310 => 0.8686, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 4.47% (0.3534 => 0.3692, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.3756 => 0.3923, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.37% (0.3293 => 0.3437, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 4.35% (0.3220 => 0.3360, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.30% (3.6692 => 3.8270, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/moments: 4.21% (0.3868 => 0.4031, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.17% (4.4433 => 4.6286, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.16% (4.3801 => 4.5621, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 3.96% (2.1791 => 2.2655, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 3.86% (1.2292 => 1.2766, std. dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.86% (1.1333 => 1.1770, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.82% (0.4791 => 0.4974, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.82% (4.9865 => 5.1768, std. dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/objinst: 3.80% (0.2945 => 0.3057, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.72% (0.6135 => 0.6363, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 3.40% (0.4113 => 0.4253, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 3.36% (3.1889 => 3.2961, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 3.35% (0.3131 => 0.3236, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (8.4961 => 8.7758, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.26% (0.6283 => 0.6488, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3755 => 0.3873, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 3.14% (6.5754 => 6.7816, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.06% (0.8698 => 0.8964, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.1007 => 2.1631, std. dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 2.85% (14.8535 => 15.2768, std. dev.: 0.0124) MultiSource/Applications/ClamAV/clamscan: 2.85% (14.5298 => 14.9435, std. dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.76% (3.2742 => 3.3646, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.71% (1.5188 => 1.5600, std. dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 2.64% (4.6629 => 4.7858, std. dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: 2.60% (16.2614 => 16.6843, std. dev.: 0.0139) MultiSource/Applications/minisat/minisat: 2.05% (0.6744 => 0.6882, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.75% (1.0313 => 1.0493, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (0.9108 => 0.9264, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 1.65% (3.7467 => 3.8086, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (6.2785 => 6.3675, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.41% (5.7573 => 7.5081, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2527, std. dev.: 0.0332) SingleSource/Benchmarks/Misc/mandel-2: 7.98% (1.2998 => 1.4035, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.10% (0.9996 => 1.0506, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: 4.50% (7.4271 => 7.7614, std. dev.: 0.0139) MultiSource/Benchmarks/nbench/nbench: 4.24% (11.2619 => 11.7390, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.58% (1.7688 => 1.8145, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.38% (1.0310 => 1.0555, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5339, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (1.9290 => 1.9582, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5107, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.31% (4.5928 => 4.6531, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.08% (10.7476 => 10.8642, std. dev.: 0.0100) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.16% (22.5627 => 21.1729, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.73% (1.0460 => 0.8501, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.55% (1.2308 => 1.1010, std. dev.: 0.0205) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.79% (1.3780 => 1.3120, std. dev.: 0.0085) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.72% (0.4867 => 0.4686, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.31% (1.9762 => 1.9108, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5878, std. dev.: 0.0098) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9472, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.52% (0.8342 => 0.8132, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.12% (20.3410 => 19.9091, std. dev.: 0.0800) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5052, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2352, std. dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: -1.70% (28.2225 => 27.7416, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.3305 => 7.2213, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4929, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8679, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2571, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 11:40:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 13:40:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120728184028.68E542A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2453?compare_to=2450&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2453, Order: 160919, Start Time: 2012-07-28 17:22:26, End Time: 2012-07-28 18:40:53 To: 2450, Order: 160914, Start Time: 2012-07-28 10:27:09, End Time: 2012-07-28 11:45:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (80 on baseline) Performance Improvements: 3 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 928 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.06% (10.9444 => 11.0605, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.59% (0.0847 => 0.0996, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.98% (8.4197 => 8.5862, std. dev.: 0.0161) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.36% (13.6419 => 13.4566, std. dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -3.35% (12.4909 => 12.0723, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.44% (0.8614 => 0.8490, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.80% (10.3673 => 13.4566, std. dev.: 0.0152) SingleSource/UnitTests/ObjC/trivial-interface: 13.25% (0.3473 => 0.3933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.96% (0.3543 => 0.4002, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.90% (0.3497 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.75% (0.3561 => 0.4015, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3543 => 0.3994, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.71% (0.3516 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.45% (0.3694 => 0.4154, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.04% (0.3828 => 0.4289, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.81% (0.3886 => 0.4345, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.76% (0.3927 => 0.4389, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.70% (1.1194 => 1.2504, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.29% (2.2022 => 2.3847, std. dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.08% (1.7609 => 1.9032, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1892 => 0.2021, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.98% (10.4361 => 11.0605, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/Hello: 5.76% (0.5925 => 0.6266, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 5.70% (0.6030 => 0.6374, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4615 => 0.4848, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.82% (0.4879 => 0.5114, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 4.70% (0.7326 => 0.7670, std. dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 4.41% (0.7433 => 0.7761, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 4.27% (0.3282 => 0.3422, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.23% (7.0540 => 7.3526, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (9.4845 => 9.8702, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.00% (0.5569 => 0.5792, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.93% (0.8172 => 0.8493, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (4.9449 => 5.1391, std. dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (5.0018 => 5.1956, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.81% (0.5860 => 0.6083, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.67% (5.7591 => 5.9707, std. dev.: 0.0145) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.64% (4.2646 => 4.4199, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3180 => 0.3292, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.51% (0.3109 => 0.3218, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.38% (0.7835 => 0.8100, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.29% (8.1363 => 8.4041, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.20% (1.1861 => 1.2240, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.18% (1.3050 => 1.3465, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.15% (14.3668 => 14.8190, std. dev.: 0.0113) MultiSource/Applications/hbd/hbd: 3.06% (1.5603 => 1.6080, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 3.00% (1.1642 => 1.1991, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 2.95% (3.3354 => 3.4339, std. dev.: 0.0054) MultiSource/Applications/treecc/treecc: 2.86% (2.0273 => 2.0853, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.5415 => 1.5854, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.63% (3.8723 => 3.9743, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.52% (0.8067 => 0.8270, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.49% (0.5105 => 0.5232, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.48% (0.9765 => 1.0007, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (2.2024 => 2.2567, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 2.35% (0.4299 => 0.4400, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (1.5859 => 1.6231, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.26% (0.6450 => 0.6596, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 2.18% (0.6456 => 0.6597, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.16% (0.4636 => 0.4736, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.04% (1.4186 => 1.4476, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5981 => 0.6103, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.99% (0.6675 => 0.6808, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.97% (17.1811 => 17.5194, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/football/football: 1.93% (0.8921 => 0.9093, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.72% (2.2969 => 2.3364, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.61% (2.0665 => 2.0998, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.60% (0.7115 => 0.7229, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.57% (1.1840 => 1.2026, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.28% (1.0722 => 1.0859, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.24% (1.2842 => 1.3001, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9741, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.95% (4.2280 => 4.3951, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7594, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5357, std. dev.: 0.0003) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2033, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2321, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.24% (5.2763 => 3.1529, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.63% (5.3855 => 3.6820, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.99% (5.3526 => 3.6939, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0364, std. dev.: 0.0363) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.16% (2.9384 => 2.5518, std. dev.: 0.0165) MultiSource/Applications/ClamAV/clamscan: -9.97% (22.1758 => 19.9648, std. dev.: 0.0154) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.10% (1.6925 => 1.4200, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2373 => 1.1108, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -6.93% (1.5373 => 1.4307, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -4.58% (1.9577 => 1.8681, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.21% (12.4730 => 12.0723, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4838, std. dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9121, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9995, std. dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.33% (0.4808 => 0.4696, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.71% (12.5348 => 12.3204, std. dev.: 0.0023) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4187, std. dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.44% (0.8614 => 0.8490, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8094, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.08% (8.6802 => 8.5862, std. dev.: 0.0161) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 13:06:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 15:06:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120728200620.B1BC62A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2454?compare_to=2451&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2454, Order: 160919, Start Time: 2012-07-28 17:22:51, End Time: 2012-07-28 20:06:45 To: 2451, Order: 160914, Start Time: 2012-07-28 09:22:19, End Time: 2012-07-28 12:07:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (103 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (780 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.65% (0.7560 => 0.7685, std. dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 23.44% (0.3792 => 0.4681, std. dev.: 0.0344) SingleSource/UnitTests/ObjC/exceptions-2: 14.48% (0.3446 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.46% (0.3465 => 0.3966, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.42% (0.3488 => 0.3991, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 14.38% (0.3442 => 0.3937, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.31% (0.3460 => 0.3955, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/for-in: 14.30% (0.3496 => 0.3996, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.27% (0.3469 => 0.3964, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.81% (0.3643 => 0.4146, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.70% (0.3650 => 0.4150, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.35% (0.3724 => 0.4221, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.31% (0.5826 => 0.6310, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.08% (0.5889 => 0.6365, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.17% (0.7171 => 0.7685, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 6.53% (1.5932 => 1.6972, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.87% (3.5627 => 3.7720, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.75% (1.6211 => 1.7143, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 5.50% (1.0781 => 1.1374, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.45% (1.3152 => 1.3869, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.36% (0.5000 => 0.5268, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.25% (0.5026 => 0.5290, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.5900 => 0.6207, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.18% (0.4361 => 0.4587, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.2014 => 0.2118, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.06% (0.3930 => 0.4129, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.97% (0.4994 => 0.5242, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 4.96% (0.4029 => 0.4229, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (2.7292 => 2.8619, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 4.71% (4.2109 => 4.4092, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 4.35% (0.9909 => 1.0340, std. dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 4.23% (0.3004 => 0.3131, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.06% (1.9694 => 2.0493, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 4.04% (0.2725 => 0.2835, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.02% (0.2738 => 0.2848, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.01% (0.3195 => 0.3323, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.2736 => 0.2845, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.96% (2.0673 => 2.1492, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (1.9966 => 2.0756, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.94% (0.2866 => 0.2979, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.85% (0.2803 => 0.2911, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.85% (0.2729 => 0.2834, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (2.1013 => 2.1820, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.2780 => 0.2886, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2792 => 0.2898, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.78% (2.1653 => 2.2472, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 3.78% (0.2750 => 0.2854, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (0.4658 => 0.4831, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 3.68% (0.3096 => 0.3210, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.66% (4.6177 => 4.7869, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/methcall: 3.66% (0.2813 => 0.2916, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.65% (0.3124 => 0.3238, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 3.61% (5.5417 => 5.7420, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/ary3: 3.55% (0.3267 => 0.3383, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.54% (0.2911 => 0.3014, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.50% (0.3258 => 0.3372, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.50% (0.3890 => 0.4026, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.43% (0.3903 => 0.4037, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.40% (0.3060 => 0.3164, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.38% (0.3317 => 0.3429, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.35% (4.4195 => 4.5677, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists: 3.35% (0.3348 => 0.3460, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 3.34% (0.3678 => 0.3801, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.30% (0.3362 => 0.3473, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.29% (0.3282 => 0.3390, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.29% (0.9697 => 1.0016, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.29% (0.4139 => 0.4275, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 3.23% (0.7875 => 0.8129, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.22% (0.3845 => 0.3969, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists1: 3.22% (0.3477 => 0.3589, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.19% (0.3726 => 0.3845, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 3.15% (23.5202 => 24.2607, std. dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.3625 => 0.3738, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (1.8794 => 1.9374, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 3.06% (0.4146 => 0.4273, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3690 => 0.3803, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.92% (0.6634 => 0.6828, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.92% (0.4251 => 0.4375, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.84% (0.3981 => 0.4094, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.83% (1.4269 => 1.4673, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.61% (0.6435 => 0.6603, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 2.54% (0.5546 => 0.5687, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 2.31% (0.5012 => 0.5128, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.74% (2.0346 => 2.0701, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 14.91% (2.5769 => 2.9611, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.26% (0.2122 => 0.2276, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.25% (12.0509 => 12.6839, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-2: 4.76% (1.8057 => 1.8916, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1675, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6795, std. dev.: 0.0153) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1913, std. dev.: 0.0096) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4932, std. dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5908, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2227, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.12% (1.0927 => 1.1049, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.90% (2.4764 => 2.3799, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5464, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ary2: -9.53% (0.2402 => 0.2173, std. dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/fldry: -8.06% (17.2379 => 15.8483, std. dev.: 0.1652) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8050, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: -4.01% (0.4438 => 0.4260, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7930, std. dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: -3.57% (14.0481 => 13.5461, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5789, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 13:18:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 15:18:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120728201852.AFFAC2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2455?compare_to=2452&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2455, Order: 160920, Start Time: 2012-07-28 19:04:59, End Time: 2012-07-28 20:19:17 To: 2452, Order: 160919, Start Time: 2012-07-28 17:22:40, End Time: 2012-07-28 18:36:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (149 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.45% (78.8483 => 80.7829, std. dev.: 0.3795) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.47% (2.0176 => 2.3297, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 9.78% (0.3578 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.63% (0.3646 => 0.3997, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3601 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.53% (0.3650 => 0.3998, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 9.52% (0.3623 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.50% (0.3663 => 0.4011, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.33% (0.7061 => 0.7720, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.32% (0.3789 => 0.4142, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.30% (0.5818 => 0.6359, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.27% (0.3914 => 0.4277, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.09% (0.4003 => 0.4367, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5748 => 0.6269, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.06% (0.3940 => 0.4297, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3130 => 0.3392, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.31% (0.1986 => 0.2151, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.52% (0.7710 => 0.8290, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.43% (0.5265 => 0.5656, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.31% (3.9660 => 4.2561, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 7.17% (1.3693 => 1.4675, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 7.12% (0.7038 => 0.7539, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2596 => 0.2776, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.47% (0.4328 => 0.4608, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.40% (0.4062 => 0.4322, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.02% (0.6959 => 0.7378, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.4379 => 0.4642, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.97% (0.2781 => 0.2947, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.82% (1.2193 => 1.2903, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.64% (0.3899 => 0.4119, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.56% (13.8202 => 14.5886, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.50% (0.5577 => 0.5884, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.45% (1.4563 => 1.5356, std. dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: 5.39% (0.2243 => 0.2364, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.34% (0.9199 => 0.9690, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.25% (16.6129 => 17.4854, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/random: 5.24% (0.2690 => 0.2831, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.23% (0.3022 => 0.3180, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.19% (0.3485 => 0.3666, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.17% (0.4390 => 0.4617, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.16% (0.2655 => 0.2792, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 5.14% (0.2628 => 0.2763, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.14% (0.2765 => 0.2907, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.12% (0.2966 => 0.3118, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.11% (1.1061 => 1.1626, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.3107 => 0.3265, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.08% (0.2914 => 0.3062, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.04% (0.3489 => 0.3665, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.04% (0.2937 => 0.3085, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.04% (0.2760 => 0.2899, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.02% (0.3149 => 0.3307, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.00% (1.9828 => 2.0820, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.97% (7.2180 => 7.5768, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.97% (0.2696 => 0.2830, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: 4.94% (0.7506 => 0.7877, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 4.93% (0.2761 => 0.2897, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (1.3813 => 1.4487, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.85% (1.3245 => 1.3888, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.84% (13.2842 => 13.9278, std. dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.84% (0.3246 => 0.3403, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.81% (1.3819 => 1.4484, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.76% (3.8646 => 4.0486, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 4.72% (0.2988 => 0.3129, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.72% (0.5637 => 0.5903, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 4.69% (0.3453 => 0.3615, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.1364 => 1.1896, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 4.64% (0.3192 => 0.3340, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.57% (1.0594 => 1.1078, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 4.57% (1.9270 => 2.0150, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 4.56% (0.3534 => 0.3695, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 4.46% (0.3293 => 0.3440, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.3756 => 0.3923, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.38% (0.4016 => 0.4192, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 4.38% (0.8310 => 0.8674, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.36% (0.7460 => 0.7785, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 4.32% (0.3868 => 0.4035, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (3.6692 => 3.8255, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.13% (4.3801 => 4.5610, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 4.07% (0.3220 => 0.3351, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (4.4433 => 4.6220, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 4.02% (2.1791 => 2.2666, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 3.94% (0.2945 => 0.3061, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.84% (4.9865 => 5.1782, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.80% (0.4791 => 0.4973, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.70% (1.1333 => 1.1752, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.64% (1.2292 => 1.2740, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 3.31% (3.1889 => 3.2946, std. dev.: 0.0050) MultiSource/Benchmarks/sim/sim: 3.29% (0.3131 => 0.3234, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.28% (0.6135 => 0.6336, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.22% (0.6283 => 0.6485, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 3.19% (0.4113 => 0.4244, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.17% (0.3755 => 0.3874, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.12% (8.4961 => 8.7615, std. dev.: 0.0116) MultiSource/Applications/JM/ldecod/ldecod: 3.02% (6.5754 => 6.7739, std. dev.: 0.0209) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.97% (0.8698 => 0.8956, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.5298 => 14.9429, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.81% (14.8535 => 15.2703, std. dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.78% (2.1007 => 2.1592, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.78% (3.2742 => 3.3651, std. dev.: 0.0072) MultiSource/Applications/oggenc/oggenc: 2.70% (4.6629 => 4.7887, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 2.53% (16.2614 => 16.6724, std. dev.: 0.0243) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.50% (1.5188 => 1.5567, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.87% (0.6744 => 0.6870, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.9108 => 0.9262, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.68% (1.0313 => 1.0486, std. dev.: 0.0043) MultiSource/Applications/lua/lua: 1.47% (3.7467 => 3.8017, std. dev.: 0.0186) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.33% (6.2785 => 6.3622, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5135, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.59% (1.8175 => 2.2644, std. dev.: 0.0241) SingleSource/Benchmarks/Misc/mandel-2: 7.89% (1.2998 => 1.4024, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.13% (0.9996 => 1.0509, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: 4.32% (7.4271 => 7.7481, std. dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.2619 => 11.7374, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.79% (1.7688 => 1.8181, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.35% (1.0310 => 1.0552, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5089 => 1.5364, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4523, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0494, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1943, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.22% (4.5928 => 4.6489, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1400, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1615, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.73% (1.0460 => 0.8501, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.70% (1.2308 => 1.0991, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.00% (1.3780 => 1.3091, std. dev.: 0.0114) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.66% (0.4867 => 0.4689, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.31% (1.9762 => 1.9107, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9448, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.52% (0.8342 => 0.8132, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6075, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2320, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.92% (20.3410 => 19.9514, std. dev.: 0.0409) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5066, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: -1.71% (28.2225 => 27.7411, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0054, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.39% (7.3305 => 7.2283, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8631, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4932, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2503, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8476, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2383, std. dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 13:26:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 15:26:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120728202653.2A9FF2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2456?compare_to=2453&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2456, Order: 160920, Start Time: 2012-07-28 19:08:47, End Time: 2012-07-28 20:27:16 To: 2453, Order: 160919, Start Time: 2012-07-28 17:22:26, End Time: 2012-07-28 18:40:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (80 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.27% (55.3282 => 56.5852, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/lowercase: 1.09% (7.9703 => 8.0570, std. dev.: 0.0194) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.80% (10.3673 => 13.4569, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/trivial-interface: 13.22% (0.3473 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.95% (0.3497 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3516 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.81% (0.3543 => 0.3997, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.78% (0.3561 => 0.4016, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.76% (0.3543 => 0.3995, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.45% (0.3694 => 0.4154, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.07% (0.3828 => 0.4290, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2530, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3927 => 0.4393, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.81% (0.3886 => 0.4345, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.26% (2.2022 => 2.3840, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.07% (1.7609 => 1.9030, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.77% (0.1892 => 0.2020, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2065 => 0.2200, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.3177 => 0.3370, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 5.98% (10.4361 => 11.0598, std. dev.: 0.0116) SingleSource/UnitTests/ObjC++/Hello: 5.87% (0.5925 => 0.6273, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.77% (0.6030 => 0.6378, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4615 => 0.4852, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.78% (0.7326 => 0.7676, std. dev.: 0.0103) MultiSource/Applications/lambda-0_1_3/lambda: 4.57% (0.7433 => 0.7773, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.46% (7.0540 => 7.3683, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/oourafft: 4.30% (0.3282 => 0.3423, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.09% (0.5569 => 0.5797, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (9.4845 => 9.8724, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.9449 => 5.1384, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.5860 => 0.6087, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.85% (0.8172 => 0.8487, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (5.0018 => 5.1933, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.73% (4.2646 => 4.4238, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.68% (0.3121 => 0.3236, std. dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 3.66% (5.7591 => 5.9699, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3423 => 0.3542, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 3.41% (0.7835 => 0.8102, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.33% (8.1363 => 8.4076, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.31% (1.1861 => 1.2254, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.20% (14.3668 => 14.8270, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.16% (1.3050 => 1.3462, std. dev.: 0.0034) MultiSource/Applications/d/make_dparser: 3.05% (3.3354 => 3.4372, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 3.05% (1.1642 => 1.1997, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 3.02% (2.0273 => 2.0885, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 2.93% (1.5603 => 1.6060, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.88% (1.5415 => 1.5859, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.69% (3.8723 => 3.9765, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.60% (0.8067 => 0.8277, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.57% (0.4636 => 0.4755, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.53% (0.5105 => 0.5234, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (2.2024 => 2.2578, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.42% (0.9765 => 1.0001, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 2.35% (0.4299 => 0.4400, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.28% (0.6456 => 0.6603, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (0.6675 => 0.6821, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.14% (1.4186 => 1.4489, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.07% (17.1811 => 17.5370, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6450 => 0.6582, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 2.02% (2.2969 => 2.3434, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.01% (0.5981 => 0.6101, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.00% (0.8921 => 0.9099, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.71% (0.7115 => 0.7237, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.71% (2.0665 => 2.1018, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.60% (1.1840 => 1.2030, std. dev.: 0.0060) MultiSource/Applications/lemon/lemon: 1.36% (1.0722 => 1.0868, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.30% (1.2842 => 1.3009, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.03% (2.6778 => 2.9732, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.02% (4.2280 => 4.3980, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7543, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5086 => 1.5353, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 1.76% (3.1578 => 3.2133, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2454, std. dev.: 0.0264) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2039, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.17% (1.3045 => 1.3198, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.30% (5.2763 => 3.1499, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.61% (5.3855 => 3.6831, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.98% (5.3526 => 3.6946, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0750, std. dev.: 0.0182) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.15% (2.9384 => 2.5520, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -10.04% (22.1758 => 19.9492, std. dev.: 0.0194) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -10.09% (1.2373 => 1.1124, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: -6.57% (1.5373 => 1.4363, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5535, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: -4.65% (1.9577 => 1.8666, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -3.21% (12.4730 => 12.0723, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4837, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9150, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0025, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.33% (1.3677 => 1.3358, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.80% (12.5348 => 12.3096, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std. dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.44% (0.8614 => 0.8490, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.23% (1.8329 => 1.8104, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.19% (8.6802 => 8.5767, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 15:01:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 17:01:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120728220142.2CBB82A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2457?compare_to=2455&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2457, Order: 160924, Start Time: 2012-07-28 20:47:34, End Time: 2012-07-28 22:02:06 To: 2455, Order: 160920, Start Time: 2012-07-28 19:04:59, End Time: 2012-07-28 20:19:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (148 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.97% (3.7771 => 3.8893, std. dev.: 0.0316) SingleSource/Benchmarks/Misc/fbench: 1.29% (2.2644 => 2.2937, std. dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 1.00% (1.0991 => 1.1101, std. dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.50% (2.0176 => 2.3304, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 9.45% (0.3578 => 0.3916, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1075 => 0.1176, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.21% (0.3650 => 0.3986, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 9.16% (0.3646 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.14% (0.3601 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.01% (0.3663 => 0.3993, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.00% (0.3623 => 0.3949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.94% (0.4003 => 0.4361, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.92% (0.3789 => 0.4127, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.87% (0.3914 => 0.4261, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.85% (0.5818 => 0.6333, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.81% (0.7061 => 0.7683, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: 8.79% (0.5748 => 0.6253, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.68% (0.3940 => 0.4282, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1986 => 0.2154, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 7.19% (0.7038 => 0.7544, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.18% (3.9660 => 4.2509, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.15% (0.7710 => 0.8261, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 6.97% (1.3693 => 1.4647, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.89% (0.5265 => 0.5628, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.19% (0.6959 => 0.7390, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4328 => 0.4593, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.11% (0.4062 => 0.4310, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4379 => 0.4641, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.72% (0.2781 => 0.2940, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.70% (0.5577 => 0.5895, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.64% (1.2193 => 1.2881, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.61% (0.2782 => 0.2938, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.54% (0.3899 => 0.4115, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.44% (1.4563 => 1.5355, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.44% (13.8202 => 14.5716, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.39% (0.9199 => 0.9695, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: 5.31% (0.2243 => 0.2362, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 5.23% (16.6129 => 17.4820, std. dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/random: 5.20% (0.2690 => 0.2830, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.15% (0.4390 => 0.4616, std. dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.2914 => 0.3064, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 5.14% (0.2607 => 0.2741, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3022 => 0.3177, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.12% (0.2966 => 0.3118, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.11% (0.3580 => 0.3763, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2628 => 0.2761, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.2925 => 0.3073, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.01% (0.2655 => 0.2788, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.99% (0.3485 => 0.3659, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.96% (0.2760 => 0.2897, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.96% (0.2761 => 0.2898, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.96% (0.3489 => 0.3662, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2726 => 0.2861, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.94% (0.7506 => 0.7877, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.93% (1.9828 => 2.0805, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wc: 4.83% (0.2937 => 0.3079, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.81% (3.8646 => 4.0504, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 4.77% (1.1061 => 1.1589, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3107 => 0.3255, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.76% (0.3149 => 0.3299, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.76% (13.2842 => 13.9166, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.75% (0.2696 => 0.2824, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.74% (0.3246 => 0.3400, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.1364 => 1.1903, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.73% (7.2180 => 7.5595, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.73% (1.3245 => 1.3871, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.70% (1.9270 => 2.0175, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.68% (0.5637 => 0.5901, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.62% (0.2988 => 0.3126, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.3819 => 1.4457, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 4.61% (0.8310 => 0.8693, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.58% (0.3534 => 0.3696, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.58% (0.3453 => 0.3611, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.52% (1.3813 => 1.4437, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.48% (1.0594 => 1.1069, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 4.45% (0.3192 => 0.3334, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.3756 => 0.3923, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.43% (0.4016 => 0.4194, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.37% (0.3293 => 0.3437, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 4.22% (2.1791 => 2.2711, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.20% (0.7460 => 0.7773, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.3801 => 4.5596, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.06% (3.6692 => 3.8180, std. dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 3.94% (0.3220 => 0.3347, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.94% (4.4433 => 4.6182, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.2945 => 0.3056, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.74% (4.9865 => 5.1731, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.74% (0.4791 => 0.4970, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.66% (1.2292 => 1.2742, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.57% (1.1333 => 1.1738, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.41% (0.6135 => 0.6344, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 3.29% (0.3131 => 0.3234, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.20% (0.6283 => 0.6484, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4113 => 0.4243, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 3.13% (8.4961 => 8.7621, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 3.13% (3.1889 => 3.2887, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.01% (0.3755 => 0.3868, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.99% (6.5754 => 6.7719, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.98% (2.1007 => 2.1634, std. dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.97% (0.8698 => 0.8956, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.77% (3.2742 => 3.3649, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 2.73% (14.5298 => 14.9259, std. dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 2.72% (14.8535 => 15.2577, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.61% (1.5188 => 1.5585, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 2.54% (16.2614 => 16.6746, std. dev.: 0.0166) MultiSource/Applications/oggenc/oggenc: 2.07% (4.6629 => 4.7595, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.60% (0.9108 => 0.9254, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.59% (0.6744 => 0.6851, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 1.44% (3.7467 => 3.8005, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.16% (6.2785 => 6.3511, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.43% (5.7573 => 7.5090, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 26.20% (1.8175 => 2.2937, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: 8.08% (1.2998 => 1.4048, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.08% (0.9996 => 1.0504, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 4.37% (7.4271 => 7.7514, std. dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 4.23% (11.2619 => 11.7380, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0021) MultiSource/Benchmarks/llubenchmark/llu: 3.08% (3.7731 => 3.8893, std. dev.: 0.0316) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8160, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (1.5089 => 1.5368, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (1.9290 => 1.9570, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.27% (4.5928 => 4.6512, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.10% (10.7476 => 10.8661, std. dev.: 0.0300) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1402, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1683, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.19% (22.5627 => 21.1650, std. dev.: 0.0188) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.72% (1.0460 => 0.8502, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1101, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std. dev.: 0.0081) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.66% (0.4867 => 0.4689, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.26% (1.9762 => 1.9117, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9480, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5990, std. dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.53% (0.8342 => 0.8131, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2268, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.92% (20.3410 => 19.9508, std. dev.: 0.0299) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5068, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.71% (28.2225 => 27.7389, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std. dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: -1.38% (7.3305 => 7.2295, std. dev.: 0.0241) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.5254 => 2.4925, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2490, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.18% (3.8887 => 3.8428, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 15:13:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 17:13:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120728221336.146932A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2458?compare_to=2456&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2458, Order: 160924, Start Time: 2012-07-28 20:55:08, End Time: 2012-07-28 22:14:00 To: 2456, Order: 160920, Start Time: 2012-07-28 19:08:47, End Time: 2012-07-28 20:27:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (76 on baseline) Performance Improvements: 2 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (762 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 203.67% (2.9897 => 9.0788, std. dev.: 0.0164) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -7.33% (0.4542 => 0.4209, std. dev.: 0.0071) MultiSource/Applications/JM/ldecod/ldecod: -1.49% (11.0598 => 10.8947, std. dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.66% (10.3673 => 13.3388, std. dev.: 0.0093) SingleSource/UnitTests/ObjC/trivial-interface: 13.16% (0.3473 => 0.3930, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 12.81% (0.3497 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.74% (0.3516 => 0.3964, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3543 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.70% (0.3543 => 0.3993, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 12.55% (0.3561 => 0.4008, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 12.32% (0.3694 => 0.4149, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 11.99% (0.3828 => 0.4287, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3927 => 0.4390, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.63% (0.3886 => 0.4338, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.46% (1.1194 => 1.2477, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.27% (0.3817 => 0.4209, std. dev.: 0.0071) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.91% (2.2022 => 2.3765, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.55% (1.7609 => 1.8939, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.76% (0.3177 => 0.3360, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.70% (0.5925 => 0.6263, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 5.59% (0.6030 => 0.6367, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.85% (0.4615 => 0.4839, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.46% (0.7326 => 0.7653, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 4.39% (10.4361 => 10.8947, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.4879 => 0.5092, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.22% (7.0540 => 7.3519, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.16% (0.7433 => 0.7742, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.02% (0.3282 => 0.3414, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.87% (0.8172 => 0.8488, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.71% (4.9449 => 5.1285, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 3.71% (9.4845 => 9.8362, std. dev.: 0.0128) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.64% (5.0018 => 5.1839, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.44% (4.2646 => 4.4111, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.41% (0.5860 => 0.6060, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.36% (0.3423 => 0.3538, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.33% (0.3121 => 0.3225, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.14% (0.7835 => 0.8081, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.10% (8.1363 => 8.3889, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.01% (1.1861 => 1.2218, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.87% (5.7591 => 5.9244, std. dev.: 0.0160) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.83% (14.3668 => 14.7735, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.82% (1.3050 => 1.3418, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.70% (1.1642 => 1.1956, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.66% (2.0273 => 2.0813, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.56% (1.5415 => 1.5810, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 2.55% (3.3354 => 3.4204, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.46% (0.4636 => 0.4750, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.42% (0.8067 => 0.8262, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 2.39% (1.5603 => 1.5976, std. dev.: 0.0072) MultiSource/Applications/lua/lua: 2.39% (3.8723 => 3.9648, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.19% (0.5105 => 0.5217, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.15% (0.9765 => 0.9975, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.08% (2.2024 => 2.2482, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.01% (1.5859 => 1.6178, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6450 => 0.6573, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.91% (0.5981 => 0.6095, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.87% (0.6456 => 0.6577, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.85% (1.4186 => 1.4448, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.67% (2.2969 => 2.3353, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.67% (17.1811 => 17.4673, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.63% (0.6675 => 0.6784, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.61% (2.0665 => 2.0997, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.26% (1.1840 => 1.1989, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 1.23% (1.2842 => 1.3000, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.98% (4.2280 => 4.3962, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7595, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.68% (3.1578 => 3.2109, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5086 => 1.5327, std. dev.: 0.0012) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2042, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2280, std. dev.: 0.0114) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.39% (5.2763 => 3.1454, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.71% (5.3855 => 3.6775, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.07% (5.3526 => 3.6894, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -14.97% (54.1659 => 46.0578, std. dev.: 0.0330) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.28% (2.9384 => 2.5482, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -10.22% (22.1758 => 19.9089, std. dev.: 0.0377) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.10% (1.6925 => 1.4200, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: -10.63% (1.2373 => 1.1058, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: -7.52% (1.5373 => 1.4217, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5535, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.14% (1.9577 => 1.8571, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5057, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -3.21% (12.4730 => 12.0730, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4858, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (8.1563 => 7.9085, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0007, std. dev.: 0.0069) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.74% (12.5348 => 12.3163, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4172, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.43% (0.8614 => 0.8491, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.36% (8.6802 => 8.5625, std. dev.: 0.0334) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8094, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 16:17:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 18:17:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120728231757.3802D2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2459?compare_to=2454&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2459, Order: 160924, Start Time: 2012-07-28 20:34:53, End Time: 2012-07-28 23:18:22 To: 2454, Order: 160919, Start Time: 2012-07-28 17:22:51, End Time: 2012-07-28 20:06:45 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (81 on baseline) Performance Improvements: 3 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 950 (802 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.94% (2.0727 => 2.1129, std. dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.69% (0.7685 => 0.7555, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -1.66% (0.6310 => 0.6205, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -1.60% (0.6365 => 0.6263, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 21.65% (0.3792 => 0.4613, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-4: 13.28% (0.3465 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.23% (0.3446 => 0.3902, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.21% (0.3460 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.19% (0.3442 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.13% (0.3496 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.12% (0.3469 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.07% (0.3488 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.74% (0.3650 => 0.4115, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.60% (0.3643 => 0.4102, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.24% (0.3724 => 0.4180, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.79% (0.1620 => 0.1730, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.51% (0.5826 => 0.6205, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.35% (0.5889 => 0.6263, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.53% (1.6211 => 1.7107, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 5.49% (1.5932 => 1.6806, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 5.35% (0.7171 => 0.7555, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.18% (3.5627 => 3.7474, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 5.01% (0.4029 => 0.4231, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.86% (0.4361 => 0.4573, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.80% (0.5900 => 0.6183, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.74% (0.5026 => 0.5264, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.65% (1.3152 => 1.3764, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.65% (0.4994 => 0.5226, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.50% (0.3930 => 0.4107, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.42% (0.5000 => 0.5221, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 4.34% (1.0781 => 1.1249, std. dev.: 0.0097) MultiSource/Applications/ClamAV/clamscan: 4.32% (4.2109 => 4.3929, std. dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.03% (2.7292 => 2.8393, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.80% (0.2738 => 0.2842, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.73% (0.2736 => 0.2838, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.70% (0.2866 => 0.2972, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.63% (1.9966 => 2.0690, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 3.60% (2.1013 => 2.1770, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 3.56% (0.3004 => 0.3111, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.54% (1.9694 => 2.0392, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.54% (0.3362 => 0.3481, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.39% (0.9909 => 1.0245, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (0.3195 => 0.3303, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.34% (2.1653 => 2.2377, std. dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 3.34% (5.5417 => 5.7266, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.26% (0.3890 => 0.4017, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 3.24% (0.6634 => 0.6849, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (0.4658 => 0.4808, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.20% (2.0673 => 2.1334, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (0.3625 => 0.3740, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (1.8794 => 1.9359, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 3.00% (4.6177 => 4.7564, std. dev.: 0.0140) MultiSource/Applications/treecc/treecc: 2.98% (0.7875 => 0.8110, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.83% (4.4195 => 4.5445, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.83% (0.4139 => 0.4256, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.76% (23.5202 => 24.1695, std. dev.: 0.0118) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.3845 => 0.3951, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.74% (0.3903 => 0.4010, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.62% (1.4269 => 1.4643, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 2.51% (0.9697 => 0.9940, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 2.45% (0.5546 => 0.5682, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.25% (0.6435 => 0.6580, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.17% (0.5012 => 0.5121, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.39% (0.7426 => 0.7529, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.32% (2.0346 => 2.0615, std. dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.12% (11.6398 => 11.7696, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9638, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.55% (0.2122 => 0.2261, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6764, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8929, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1655, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.12% (105.3826 => 107.6186, std. dev.: 0.0498) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1960, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4584, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4961, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5907, std. dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2228, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.48% (2.0820 => 2.1129, std. dev.: 0.0113) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1063, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.22% (11.9555 => 11.8102, std. dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.07% (25.4195 => 16.5044, std. dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/ary2: -8.53% (0.2402 => 0.2197, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -8.36% (17.2379 => 15.7972, std. dev.: 0.1676) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7880, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/moments: -3.97% (0.4438 => 0.4262, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.70% (14.0481 => 13.5278, std. dev.: 0.0137) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7932, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5694, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 20:06:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 22:06:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120729030645.217DC2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2460?compare_to=2457&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2460, Order: 160925, Start Time: 2012-07-29 01:52:48, End Time: 2012-07-29 03:07:08 To: 2457, Order: 160924, Start Time: 2012-07-28 20:47:34, End Time: 2012-07-28 22:02:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (144 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.23% (2.2937 => 2.3677, std. dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.49% (78.1246 => 80.0694, std. dev.: 0.6639) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.11% (1.3115 => 1.3392, std. dev.: 0.0099) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.47% (2.0176 => 2.3297, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 9.31% (0.3578 => 0.3911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.16% (0.3601 => 0.3931, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.13% (0.3646 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.04% (0.3650 => 0.3980, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.00% (0.3623 => 0.3949, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.98% (0.3663 => 0.3992, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.95% (0.5818 => 0.6339, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3789 => 0.4128, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.94% (0.7061 => 0.7692, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 8.81% (0.3914 => 0.4259, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.72% (0.5748 => 0.6249, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.69% (0.4003 => 0.4351, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.68% (0.3940 => 0.4282, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.16% (0.7710 => 0.8262, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (3.9660 => 4.2480, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 6.92% (0.7038 => 0.7525, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 6.91% (1.3693 => 1.4639, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.5265 => 0.5612, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4328 => 0.4593, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.82% (0.4379 => 0.4634, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.82% (0.6959 => 0.7364, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3899 => 0.4123, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.65% (0.2781 => 0.2938, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.58% (1.2193 => 1.2873, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.54% (0.2782 => 0.2936, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.47% (0.4062 => 0.4284, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.42% (0.2140 => 0.2256, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.34% (0.5577 => 0.5875, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.31% (0.3580 => 0.3770, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.28% (0.9199 => 0.9685, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.26% (0.2966 => 0.3122, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.24% (13.8202 => 14.5445, std. dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/random: 5.20% (0.2690 => 0.2830, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 5.17% (0.2243 => 0.2359, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 5.16% (16.6129 => 17.4704, std. dev.: 0.0122) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.2914 => 0.3064, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.14% (0.2607 => 0.2741, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.06% (0.3022 => 0.3175, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.06% (0.4390 => 0.4612, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.04% (0.3489 => 0.3665, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.01% (0.2655 => 0.2788, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 5.00% (0.2760 => 0.2898, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.99% (0.3485 => 0.3659, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.99% (0.2765 => 0.2903, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.98% (0.2628 => 0.2759, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2726 => 0.2861, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.93% (1.9828 => 2.0806, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 4.93% (0.2761 => 0.2897, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 4.90% (0.2937 => 0.3081, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.90% (0.2696 => 0.2828, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.84% (0.7506 => 0.7869, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.80% (1.1364 => 1.1909, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 4.80% (0.3107 => 0.3256, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.76% (0.3149 => 0.3299, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.74% (1.4563 => 1.5254, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.72% (7.2180 => 7.5590, std. dev.: 0.0044) MultiSource/Applications/Burg/burg: 4.70% (1.1061 => 1.1581, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 4.64% (3.8646 => 4.0440, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 4.64% (0.3534 => 0.3698, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.63% (0.5637 => 0.5898, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3246 => 0.3396, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.60% (1.3813 => 1.4449, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.57% (13.2842 => 13.8919, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 4.52% (0.2988 => 0.3123, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.51% (1.9270 => 2.0140, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 4.46% (0.3453 => 0.3607, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.44% (1.3245 => 1.3833, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.42% (1.3819 => 1.4430, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.42% (0.3756 => 0.3922, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.41% (1.0594 => 1.1061, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 4.40% (0.3293 => 0.3438, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 4.33% (0.8310 => 0.8670, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.4016 => 0.4187, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.25% (0.7460 => 0.7777, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3868 => 0.4027, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.3801 => 4.5558, std. dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.90% (3.6692 => 3.8124, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (4.4433 => 4.6158, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 3.82% (2.1791 => 2.2623, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.2945 => 0.3056, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.69% (0.4791 => 0.4968, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.62% (4.9865 => 5.1670, std. dev.: 0.0114) MultiSource/Applications/hexxagon/hexxagon: 3.59% (1.2292 => 1.2733, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.44% (1.1333 => 1.1723, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.35% (0.3131 => 0.3236, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.28% (0.6135 => 0.6336, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 3.19% (3.1889 => 3.2906, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 3.09% (8.4961 => 8.7583, std. dev.: 0.0179) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4113 => 0.4239, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.01% (0.6283 => 0.6472, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3755 => 0.3867, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.93% (6.5754 => 6.7682, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.89% (2.1007 => 2.1614, std. dev.: 0.0205) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.85% (0.8698 => 0.8946, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.71% (14.8535 => 15.2553, std. dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 2.68% (14.5298 => 14.9196, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.65% (3.2742 => 3.3610, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 2.51% (16.2614 => 16.6702, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.5188 => 1.5553, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 1.98% (4.6629 => 4.7550, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.61% (0.9108 => 0.9255, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.53% (1.0313 => 1.0471, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.32% (3.7467 => 3.7960, std. dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (6.2785 => 6.3418, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 30.27% (1.8175 => 2.3677, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: 7.92% (1.2998 => 1.4028, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.11% (0.9996 => 1.0507, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: 4.31% (7.4271 => 7.7474, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 4.23% (11.2619 => 11.7382, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9885, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8158, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5345, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.26% (1.9290 => 1.9534, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 1.23% (4.5928 => 4.6492, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.5627 => 21.1489, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.72% (1.0460 => 0.8502, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.28% (1.2308 => 1.1043, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.99% (0.3139 => 0.2951, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.13% (0.4867 => 0.4666, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -3.38% (1.9762 => 1.9094, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.82% (1.3780 => 1.3392, std. dev.: 0.0099) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9477, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.52% (0.8342 => 0.8132, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.46% (8.8259 => 8.6091, std. dev.: 0.0158) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2294, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.74% (20.3410 => 19.9870, std. dev.: 0.0568) MultiSource/Benchmarks/mafft/pairlocalalign: -1.71% (28.2225 => 27.7406, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8595, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -1.38% (7.3305 => 7.2294, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.5254 => 2.4926, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2189, std. dev.: 0.0235) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2503, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 20:10:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 22:10:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120729031047.9DFAF2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2461?compare_to=2458&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2461, Order: 160925, Start Time: 2012-07-29 01:52:44, End Time: 2012-07-29 03:11:12 To: 2458, Order: 160924, Start Time: 2012-07-28 20:55:08, End Time: 2012-07-28 22:14:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (72 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.70% (10.3673 => 13.3422, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/trivial-interface: 13.16% (0.3473 => 0.3930, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.73% (0.3543 => 0.3994, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 12.67% (0.3497 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3516 => 0.3959, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.53% (0.3543 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.52% (0.3561 => 0.4007, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.24% (0.3694 => 0.4146, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.86% (0.3828 => 0.4282, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 11.58% (0.3886 => 0.4336, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.54% (0.3927 => 0.4380, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.40% (1.1194 => 1.2470, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.98% (2.2022 => 2.3780, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.51% (1.7609 => 1.8931, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.34% (0.2065 => 0.2196, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.3177 => 0.3358, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 5.57% (0.5925 => 0.6255, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.51% (0.6030 => 0.6362, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.77% (0.4615 => 0.4835, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 4.37% (0.7326 => 0.7646, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 4.33% (10.4361 => 10.8880, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.4879 => 0.5087, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.22% (7.0540 => 7.3519, std. dev.: 0.0196) MultiSource/Applications/lambda-0_1_3/lambda: 4.09% (0.7433 => 0.7737, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 3.99% (0.3282 => 0.3413, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.93% (0.8172 => 0.8493, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 3.63% (9.4845 => 9.8287, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.5569 => 0.5771, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.62% (4.9449 => 5.1237, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.0018 => 5.1814, std. dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.33% (0.3121 => 0.3225, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (4.2646 => 4.4052, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.29% (0.5860 => 0.6053, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.08% (8.1363 => 8.3865, std. dev.: 0.0074) MultiSource/Benchmarks/McCat/18-imp/imp: 3.04% (0.3423 => 0.3527, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 3.01% (0.7835 => 0.8071, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.89% (1.1861 => 1.2204, std. dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 2.81% (5.7591 => 5.9210, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.78% (14.3668 => 14.7661, std. dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.73% (1.3050 => 1.3406, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.55% (1.1642 => 1.1939, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.55% (0.4636 => 0.4754, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.50% (3.3354 => 3.4187, std. dev.: 0.0099) MultiSource/Applications/treecc/treecc: 2.49% (2.0273 => 2.0778, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.43% (1.5415 => 1.5789, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 2.33% (0.4299 => 0.4399, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 2.29% (1.5603 => 1.5960, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.26% (0.8067 => 0.8249, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 2.23% (3.8723 => 3.9587, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.05% (0.9765 => 0.9965, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.97% (2.2024 => 2.2458, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.95% (1.5859 => 1.6169, std. dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 1.92% (17.1811 => 17.5104, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5981 => 0.6092, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.83% (0.6456 => 0.6574, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.77% (0.6450 => 0.6564, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.68% (0.6675 => 0.6787, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.63% (0.8921 => 0.9066, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.61% (2.0665 => 2.0997, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.19% (1.2842 => 1.2995, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.81% (4.2280 => 4.3889, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.22% (3.6395 => 3.7568, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.64% (3.1578 => 3.2096, std. dev.: 0.0031) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2033, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2404, std. dev.: 0.0181) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1259, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.35% (5.2763 => 3.1475, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.71% (5.3855 => 3.6780, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.07% (5.3526 => 3.6893, std. dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.99% (54.1659 => 46.0458, std. dev.: 0.0548) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.26% (2.9384 => 2.5489, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -10.25% (22.1758 => 19.9020, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (3.8922 => 3.8503, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: -10.42% (1.2373 => 1.1084, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel-2: -7.57% (1.5373 => 1.4210, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.03% (1.9577 => 1.8592, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.21% (12.4730 => 12.0725, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4816, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.05% (8.1563 => 7.9076, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0003, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.78% (12.5348 => 12.3119, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4177, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.43% (0.8614 => 0.8491, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.24% (1.8329 => 1.8102, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.13% (8.6802 => 8.5824, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 21:36:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 23:36:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120729043602.B765C2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2462?compare_to=2459&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2462, Order: 160925, Start Time: 2012-07-29 01:52:48, End Time: 2012-07-29 04:36:28 To: 2459, Order: 160924, Start Time: 2012-07-28 20:34:53, End Time: 2012-07-28 23:18:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (81 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (801 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.51% (2.4062 => 2.4425, std. dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.46% (124.3202 => 129.8699, std. dev.: 0.8421) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.16% (54.2535 => 54.8835, std. dev.: 0.0778) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.32% (0.3446 => 0.3905, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.30% (0.3465 => 0.3926, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.24% (0.3496 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.22% (0.3442 => 0.3897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.22% (0.3488 => 0.3949, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 13.18% (0.3460 => 0.3916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.17% (0.3469 => 0.3926, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.87% (0.3643 => 0.4112, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.63% (0.3650 => 0.4111, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.41% (0.3724 => 0.4186, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.56% (0.5826 => 0.6208, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.45% (0.5889 => 0.6269, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.56% (0.7171 => 0.7570, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.48% (1.5932 => 1.6805, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.44% (1.6211 => 1.7093, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.27% (0.5900 => 0.6211, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.25% (3.5627 => 3.7498, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.01% (0.4994 => 0.5244, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.94% (0.4029 => 0.4228, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.79% (0.4361 => 0.4570, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.78% (1.3152 => 1.3781, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.66% (0.5000 => 0.5233, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.50% (0.3930 => 0.4107, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 4.44% (1.0781 => 1.1260, std. dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: 4.36% (4.2109 => 4.3944, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (0.5026 => 0.5241, std. dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (2.7292 => 2.8445, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.80% (0.2866 => 0.2975, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.76% (0.2736 => 0.2839, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.65% (1.9694 => 2.0412, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.59% (0.4658 => 0.4825, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.57% (1.9966 => 2.0678, std. dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 3.53% (0.3004 => 0.3110, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.51% (0.2875 => 0.2976, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (0.3845 => 0.3978, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.39% (2.1653 => 2.2387, std. dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 3.38% (5.5417 => 5.7292, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (0.3195 => 0.3303, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.37% (0.3890 => 0.4021, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.27% (2.0673 => 2.1350, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.20% (0.3124 => 0.3224, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (2.1013 => 2.1684, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.18% (0.9909 => 1.0224, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 3.11% (0.7875 => 0.8120, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 3.01% (4.6177 => 4.7565, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (0.3903 => 0.4016, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.87% (0.3625 => 0.3729, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.86% (0.6634 => 0.6824, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.85% (4.4195 => 4.5453, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sieve: 2.79% (0.3726 => 0.3830, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.75% (1.8794 => 1.9311, std. dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 2.75% (23.5202 => 24.1672, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/hash: 2.51% (0.4146 => 0.4250, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 2.49% (0.4251 => 0.4357, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.49% (0.9697 => 0.9938, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 2.48% (1.4269 => 1.4623, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.42% (0.4139 => 0.4239, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.33% (0.6435 => 0.6585, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 2.33% (0.5546 => 0.5675, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 2.08% (0.5012 => 0.5116, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.40% (0.7426 => 0.7530, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.35% (2.0346 => 2.0620, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 14.99% (2.5769 => 2.9632, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.61% (0.2122 => 0.2241, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6657, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8945, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1657, std. dev.: 0.0518) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.10% (105.3826 => 107.5955, std. dev.: 0.0626) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2048, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4940, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5907, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2219, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.37% (2.4764 => 2.4425, std. dev.: 0.0112) MultiSource/Applications/kimwitu++/kc: -1.13% (11.9555 => 11.8208, std. dev.: 0.0165) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.94% (25.4195 => 16.5369, std. dev.: 0.0110) SingleSource/Benchmarks/Dhrystone/fldry: -9.01% (17.2379 => 15.6844, std. dev.: 0.2003) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7908, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ary2: -6.95% (0.2402 => 0.2235, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: -3.99% (0.4438 => 0.4261, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7961, std. dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: -3.56% (14.0481 => 13.5476, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5765, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 21:48:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 23:48:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120729044833.A2BDE2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2463?compare_to=2460&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2463, Order: 160927, Start Time: 2012-07-29 03:35:03, End Time: 2012-07-29 04:48:57 To: 2460, Order: 160925, Start Time: 2012-07-29 01:52:48, End Time: 2012-07-29 03:07:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 5 (141 on baseline) Performance Improvements: 3 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 946 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 3.54% (12.0500 => 12.4762, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.39% (0.8502 => 0.8620, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.18% (55.7742 => 56.4327, std. dev.: 0.0548) SingleSource/Benchmarks/Misc/lowercase: 1.18% (7.9719 => 8.0658, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 1.17% (27.7406 => 28.0656, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.07% (0.0996 => 0.0826, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.06% (1.3392 => 1.3116, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.18% (3.1938 => 3.1560, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.49% (2.0176 => 2.3301, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/trivial-interface: 9.22% (0.3578 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.14% (0.5818 => 0.6350, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.00% (0.3601 => 0.3925, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.97% (0.3646 => 0.3973, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.94% (0.7061 => 0.7692, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/synchronized: 8.93% (0.3663 => 0.3990, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5748 => 0.6259, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.89% (0.3623 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.88% (0.3650 => 0.3974, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 8.84% (0.3789 => 0.4124, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.74% (0.3914 => 0.4256, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.58% (0.3940 => 0.4278, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 8.54% (0.4003 => 0.4345, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.91% (1.3693 => 1.4639, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.80% (3.9660 => 4.2356, std. dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 6.71% (0.7038 => 0.7510, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.57% (0.5265 => 0.5611, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.50% (0.7710 => 0.8211, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.43% (0.2596 => 0.2763, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.26% (0.4328 => 0.4599, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.25% (0.4062 => 0.4316, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 5.93% (0.2781 => 0.2946, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.86% (0.2782 => 0.2945, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.64% (0.4379 => 0.4626, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2607 => 0.2750, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2690 => 0.2837, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.46% (0.3899 => 0.4112, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.42% (0.2655 => 0.2799, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.42% (1.2193 => 1.2854, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.40% (0.6959 => 0.7335, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.2966 => 0.3126, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.34% (0.3485 => 0.3671, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.31% (0.5577 => 0.5873, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/fibo: 5.29% (0.2628 => 0.2767, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.28% (0.3580 => 0.3769, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.26% (0.3022 => 0.3181, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 5.22% (13.8202 => 14.5415, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.19% (0.3489 => 0.3670, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.18% (0.2760 => 0.2903, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.18% (0.2937 => 0.3089, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.16% (0.9199 => 0.9674, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.12% (1.9828 => 2.0844, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2761 => 0.2902, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.97% (16.6129 => 17.4393, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.97% (0.2696 => 0.2830, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.92% (0.3107 => 0.3260, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.89% (0.3149 => 0.3303, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.2988 => 0.3133, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (1.4563 => 1.5268, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.77% (13.2842 => 13.9172, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: 4.76% (0.3192 => 0.3344, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.68% (0.2925 => 0.3062, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.62% (0.3293 => 0.3445, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.56% (0.7506 => 0.7848, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.56% (0.4390 => 0.4590, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 4.56% (0.3534 => 0.3695, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.3453 => 0.3610, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.53% (1.1364 => 1.1879, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.53% (0.2914 => 0.3046, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.47% (1.3819 => 1.4437, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.47% (7.2180 => 7.5407, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.43% (0.5637 => 0.5887, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.40% (1.3813 => 1.4421, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.37% (0.3246 => 0.3388, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.36% (1.9270 => 2.0110, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.34% (0.3756 => 0.3919, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 4.34% (3.8646 => 4.0322, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 4.29% (1.1061 => 1.1536, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 4.25% (0.8310 => 0.8663, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.22% (1.0594 => 1.1041, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.16% (0.3868 => 0.4029, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.11% (1.3245 => 1.3789, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.03% (0.7460 => 0.7761, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.89% (4.3801 => 4.5506, std. dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: 3.74% (0.2995 => 0.3107, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.71% (3.6692 => 3.8052, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/18-imp/imp: 3.70% (0.3220 => 0.3339, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.70% (4.4433 => 4.6075, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.62% (1.2292 => 1.2737, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 3.55% (2.1791 => 2.2565, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.42% (4.9865 => 5.1572, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.31% (1.1333 => 1.1708, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.20% (0.3755 => 0.3875, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.13% (3.1889 => 3.2888, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.94% (0.8698 => 0.8954, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.86% (0.6283 => 0.6463, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.82% (0.6135 => 0.6308, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (6.5754 => 6.7598, std. dev.: 0.0114) MultiSource/Benchmarks/mafft/pairlocalalign: 2.73% (8.4961 => 8.7282, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: 2.72% (0.4113 => 0.4225, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.70% (14.5298 => 14.9227, std. dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 2.61% (16.2614 => 16.6860, std. dev.: 0.0182) MultiSource/Applications/JM/lencod/lencod: 2.57% (14.8535 => 15.2352, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.56% (2.1007 => 2.1545, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.42% (4.6629 => 4.7758, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.36% (3.2742 => 3.3515, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (1.5188 => 1.5517, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (0.9108 => 0.9243, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.12% (3.7467 => 3.7887, std. dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5182, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2612, std. dev.: 0.0496) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4041, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.13% (0.9996 => 1.0509, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 4.36% (7.4271 => 7.7511, std. dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7061, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4762, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.49% (1.7688 => 1.8128, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (1.5089 => 1.5365, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5928 => 4.6633, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: 1.50% (1.9290 => 1.9579, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1397, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.55% (0.4657 => 0.4119, std. dev.: 0.0112) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.32% (22.5627 => 21.1376, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.27% (0.8818 => 0.8706, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.15% (0.0997 => 0.0826, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.65% (1.2308 => 1.0997, std. dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.82% (1.3780 => 1.3116, std. dev.: 0.0093) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.8259 => 8.5625, std. dev.: 0.0187) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std. dev.: 0.0095) MultiSource/Applications/spiff/spiff: -2.67% (3.0263 => 2.9456, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2291, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9463, std. dev.: 0.0674) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5079, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3305 => 7.2230, std. dev.: 0.0161) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std. dev.: 0.0145) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2481, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4932, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2253, std. dev.: 0.0110) MultiSource/Applications/lua/lua: -1.05% (26.5159 => 26.2363, std. dev.: 0.0303) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jul 28 21:57:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 28 Jul 2012 23:57:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120729045710.318202A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2464?compare_to=2461&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2464, Order: 160927, Start Time: 2012-07-29 03:39:05, End Time: 2012-07-29 04:57:35 To: 2461, Order: 160925, Start Time: 2012-07-29 01:52:44, End Time: 2012-07-29 03:11:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (81 on baseline) Performance Improvements: 2 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 928 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (13.3422 => 13.6360, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 3.48% (12.0725 => 12.4922, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 2.26% (1.4210 => 1.4531, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.44% (0.8491 => 0.8613, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.46% (0.0996 => 0.0852, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.82% (8.5824 => 8.4258, std. dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.53% (10.3673 => 13.6360, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/trivial-interface: 12.35% (0.3473 => 0.3902, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.10% (0.3497 => 0.3920, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.00% (0.3543 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.97% (0.3516 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.97% (0.3543 => 0.3967, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.88% (0.3561 => 0.3984, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.69% (0.3694 => 0.4126, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.44% (1.1194 => 1.2475, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3828 => 0.4261, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.07% (0.3886 => 0.4316, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.03% (0.3927 => 0.4360, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.29% (2.2022 => 2.3848, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.11% (1.7609 => 1.9037, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.92% (0.3177 => 0.3365, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 5.54% (0.6030 => 0.6364, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.47% (0.5925 => 0.6249, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.92% (0.4615 => 0.4842, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 4.70% (10.4361 => 10.9270, std. dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.63% (7.0540 => 7.3803, std. dev.: 0.0295) SingleSource/UnitTests/ObjC++/property-reference: 4.38% (0.7326 => 0.7647, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 4.33% (0.3282 => 0.3424, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.25% (0.7433 => 0.7749, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.01% (9.4845 => 9.8653, std. dev.: 0.0176) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.70% (4.9449 => 5.1279, std. dev.: 0.0099) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.68% (5.0018 => 5.1861, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.56% (0.8172 => 0.8463, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.56% (0.5569 => 0.5767, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.44% (4.2646 => 4.4114, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.34% (0.5860 => 0.6056, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.33% (0.3121 => 0.3225, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3423 => 0.3532, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.11% (0.7835 => 0.8079, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.07% (8.1363 => 8.3863, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.3050 => 1.3437, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.93% (5.7591 => 5.9276, std. dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.89% (1.1861 => 1.2204, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.85% (14.3668 => 14.7757, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 2.54% (2.0273 => 2.0787, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.53% (1.1642 => 1.1937, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.44% (3.3354 => 3.4168, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.43% (0.8067 => 0.8263, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 2.35% (0.4299 => 0.4400, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.33% (0.4636 => 0.4744, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.32% (1.5415 => 1.5772, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.31% (0.5105 => 0.5223, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.27% (1.5603 => 1.5957, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.25% (3.8723 => 3.9594, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.11% (0.9765 => 0.9971, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.10% (1.5859 => 1.6192, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (2.2024 => 2.2485, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.89% (0.6675 => 0.6801, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.88% (0.6450 => 0.6571, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.4186 => 1.4441, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 1.78% (0.6456 => 0.6571, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.76% (0.5981 => 0.6086, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.70% (0.8921 => 0.9073, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.46% (17.1811 => 17.4328, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.32% (2.0665 => 2.0937, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.16% (1.1840 => 1.1977, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.02% (1.0722 => 1.0831, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (4.2280 => 4.3999, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7465, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.74% (3.1578 => 3.2127, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5086 => 1.5340, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8339, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.55% (9.1159 => 9.2571, std. dev.: 0.0268) MultiSource/Applications/aha/aha: 1.37% (3.1595 => 3.2029, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.09% (1.3045 => 1.3187, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.00% (2.8904 => 2.9194, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.06% (5.2763 => 3.1624, std. dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.34% (5.3855 => 3.6975, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.75% (5.3526 => 3.7065, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -15.03% (54.1659 => 46.0269, std. dev.: 0.0280) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.36% (2.9384 => 2.5457, std. dev.: 0.0143) MultiSource/Applications/ClamAV/clamscan: -10.24% (22.1758 => 19.9039, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.01% (3.8922 => 3.8528, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.88% (1.2373 => 1.1151, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -5.48% (1.5373 => 1.4531, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.86% (1.9577 => 1.8625, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4791, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9131, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4258, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9995, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.33% (1.3677 => 1.3358, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.68% (12.5348 => 12.3240, std. dev.: 0.0047) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4189, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.30% (1.8329 => 1.8091, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2497, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 00:50:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 02:50:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120729075028.BDAA42A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/2465?compare_to=2462&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2465, Order: 160927, Start Time: 2012-07-29 05:04:24, End Time: 2012-07-29 07:50:52 To: 2462, Order: 160925, Start Time: 2012-07-29 01:52:48, End Time: 2012-07-29 04:36:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (67 on baseline) Performance Improvements: 1 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (815 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.32% (2.0543 => 2.1020, std. dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.12% (1.6667 => 1.6854, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.34% (2.4425 => 2.3853, std. dev.: 0.0080) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.44% (0.3446 => 0.3909, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 13.16% (0.3442 => 0.3895, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.16% (0.3465 => 0.3921, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.16% (0.3496 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.14% (0.3469 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.13% (0.3488 => 0.3946, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 13.12% (0.3460 => 0.3914, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 12.65% (0.3643 => 0.4104, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.63% (0.3650 => 0.4111, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3724 => 0.4179, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.73% (0.3792 => 0.4161, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.13% (0.5826 => 0.6183, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.91% (0.5889 => 0.6237, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.34% (0.5900 => 0.6215, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.14% (3.5627 => 3.7460, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.10% (1.6211 => 1.7037, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.99% (0.5026 => 0.5277, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 4.93% (1.5932 => 1.6717, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.77% (0.4361 => 0.4569, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.69% (1.3152 => 1.3769, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: 4.64% (0.4029 => 0.4216, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 4.55% (0.7171 => 0.7497, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.49% (0.4994 => 0.5218, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.22% (0.3930 => 0.4096, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.16% (0.5000 => 0.5208, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 4.09% (1.0781 => 1.1222, std. dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 4.06% (4.2109 => 4.3817, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.87% (0.2866 => 0.2977, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.73% (2.7292 => 2.8311, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.66% (1.9694 => 2.0415, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.51% (1.9966 => 2.0667, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.41% (0.4658 => 0.4817, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.23% (0.3903 => 0.4029, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.18% (5.5417 => 5.7181, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 3.14% (0.9909 => 1.0220, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.08% (0.3890 => 0.4010, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.06% (2.1013 => 2.1656, std. dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: 2.99% (2.1653 => 2.2300, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.94% (2.0673 => 2.1280, std. dev.: 0.0124) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (1.8794 => 1.9329, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 2.84% (4.6177 => 4.7489, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.78% (4.4195 => 4.5422, std. dev.: 0.0140) MultiSource/Benchmarks/Bullet/bullet: 2.61% (23.5202 => 24.1339, std. dev.: 0.0297) MultiSource/Applications/treecc/treecc: 2.58% (0.7875 => 0.8078, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.51% (0.4139 => 0.4243, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.33% (1.4269 => 1.4601, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.09% (0.5546 => 0.5662, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 1.99% (0.9697 => 0.9890, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0184) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.12% (0.0734 => 0.0845, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 14.44% (2.5769 => 2.9490, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.14% (0.2122 => 0.2231, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-2: 4.98% (1.8057 => 1.8957, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/objinst: 4.98% (12.0509 => 12.6508, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1640, std. dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6947, std. dev.: 0.0420) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2001, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.4996, std. dev.: 0.0254) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5919, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2244, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.68% (2.4764 => 2.3853, std. dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: -1.70% (11.9555 => 11.7520, std. dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.92% (25.4195 => 16.2899, std. dev.: 0.1052) SingleSource/Benchmarks/Shootout-C++/ary2: -8.41% (0.2402 => 0.2200, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -7.78% (17.2379 => 15.8966, std. dev.: 0.2717) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.55% (35.5013 => 32.8209, std. dev.: 0.1135) SingleSource/Benchmarks/Shootout-C++/moments: -3.97% (0.4438 => 0.4262, std. dev.: 0.0036) SingleSource/UnitTests/Vector/build2: -3.75% (11.2080 => 10.7872, std. dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: -3.62% (14.0481 => 13.5398, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5788, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 06:00:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 08:00:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120729130027.358212A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2466?compare_to=2463&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2466, Order: 160928, Start Time: 2012-07-29 11:46:55, End Time: 2012-07-29 13:00:53 To: 2463, Order: 160927, Start Time: 2012-07-29 03:35:03, End Time: 2012-07-29 04:48:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (145 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.12% (2.0176 => 2.3226, std. dev.: 0.0190) SingleSource/UnitTests/ObjC++/property-reference-object: 9.47% (0.5818 => 0.6369, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.36% (0.5748 => 0.6286, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.20% (0.3578 => 0.3907, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.00% (0.3601 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.93% (0.3650 => 0.3976, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 8.89% (0.3646 => 0.3970, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3663 => 0.3987, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/for-in: 8.79% (0.3789 => 0.4122, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.78% (0.3623 => 0.3941, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 8.62% (0.4003 => 0.4348, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.61% (0.3914 => 0.4251, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 8.54% (0.7061 => 0.7664, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 8.45% (0.3940 => 0.4273, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.97% (1.3693 => 1.4647, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.95% (0.7710 => 0.8246, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (3.9660 => 4.2387, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 6.64% (0.7038 => 0.7505, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (0.4328 => 0.4613, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.58% (0.2782 => 0.2965, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.46% (0.5265 => 0.5605, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.29% (0.2607 => 0.2771, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.18% (0.2781 => 0.2953, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.84% (0.2690 => 0.2847, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.79% (0.4062 => 0.4297, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 5.69% (0.2761 => 0.2918, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.64% (0.4379 => 0.4626, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.54% (0.3899 => 0.4115, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (0.3485 => 0.3678, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.51% (0.2760 => 0.2912, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2765 => 0.2917, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.42% (1.2193 => 1.2854, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.42% (0.5577 => 0.5879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.41% (0.2937 => 0.3096, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3022 => 0.3185, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.38% (1.9828 => 2.0895, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.37% (0.6959 => 0.7333, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.34% (0.3580 => 0.3771, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3489 => 0.3675, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.32% (0.2726 => 0.2871, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.3107 => 0.3268, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.13% (0.9199 => 0.9671, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.02% (13.8202 => 14.5143, std. dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.01% (0.4390 => 0.4610, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.95% (0.3192 => 0.3350, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.93% (16.6129 => 17.4318, std. dev.: 0.0175) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.83% (1.4563 => 1.5266, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.80% (0.3293 => 0.3451, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 4.67% (0.3534 => 0.3699, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.67% (13.2842 => 13.9040, std. dev.: 0.0097) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.61% (0.5637 => 0.5897, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.58% (7.2180 => 7.5487, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/moments: 4.58% (0.3868 => 0.4045, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.53% (1.1364 => 1.1879, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.3756 => 0.3926, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.51% (1.3819 => 1.4442, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.49% (1.1061 => 1.1558, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.42% (0.7506 => 0.7838, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.37% (0.3246 => 0.3388, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.31% (1.3813 => 1.4408, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 4.28% (0.8310 => 0.8666, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.27% (1.3245 => 1.3810, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 4.26% (1.9270 => 2.0091, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.22% (1.0594 => 1.1041, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 4.21% (3.8646 => 4.0272, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.14% (0.7460 => 0.7769, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.95% (4.3801 => 4.5531, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.90% (3.6692 => 3.8122, std. dev.: 0.0144) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.80% (4.4433 => 4.6123, std. dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: 3.79% (1.2292 => 1.2758, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.38% (0.3755 => 0.3882, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.36% (0.4791 => 0.4952, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.35% (2.1791 => 2.2522, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.31% (4.9865 => 5.1517, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.29% (1.1333 => 1.1706, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 3.23% (3.1889 => 3.2919, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.01% (0.8698 => 0.8960, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.87% (0.6135 => 0.6311, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 2.80% (8.4961 => 8.7339, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.77% (0.6283 => 0.6457, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.73% (6.5754 => 6.7551, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 2.68% (14.5298 => 14.9190, std. dev.: 0.0130) MultiSource/Applications/sqlite3/sqlite3: 2.67% (16.2614 => 16.6955, std. dev.: 0.0217) MultiSource/Applications/JM/lencod/lencod: 2.60% (14.8535 => 15.2397, std. dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.57% (2.1007 => 2.1547, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.43% (4.6629 => 4.7763, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (3.2742 => 3.3503, std. dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.22% (1.5188 => 1.5525, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.44% (0.9108 => 0.9239, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.36% (1.0313 => 1.0453, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 1.09% (3.7467 => 3.7874, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5138, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.85% (1.8175 => 2.2692, std. dev.: 0.0501) SingleSource/Benchmarks/Misc/mandel-2: 7.31% (1.2998 => 1.3948, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.82% (0.9996 => 1.0578, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: 4.48% (7.4271 => 7.7597, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7063, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4770, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.75% (1.7688 => 1.8174, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (0.9692 => 0.9911, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5089 => 1.5356, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.46% (4.5928 => 4.6599, std. dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9551, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.21% (10.7476 => 10.8781, std. dev.: 0.0153) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1682, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1398, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.47% (22.5627 => 21.1024, std. dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3511 => 0.3399, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.16% (0.8818 => 0.8716, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.45% (1.2308 => 1.1022, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.24% (1.3780 => 1.3058, std. dev.: 0.0088) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5922, std. dev.: 0.0139) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9474, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2207, std. dev.: 0.0108) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5016, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9605, std. dev.: 0.0424) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2125, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8603, std. dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2482, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2243, std. dev.: 0.0275) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8482, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 06:05:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 08:05:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120729130523.33CF72A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2467?compare_to=2464&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2467, Order: 160928, Start Time: 2012-07-29 11:46:59, End Time: 2012-07-29 13:05:49 To: 2464, Order: 160927, Start Time: 2012-07-29 03:39:05, End Time: 2012-07-29 04:57:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (77 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (761 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.08% (28.2692 => 29.7050, std. dev.: 0.0441) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.41% (10.3673 => 13.7278, std. dev.: 0.0179) SingleSource/UnitTests/ObjC/trivial-interface: 12.73% (0.3473 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.50% (0.3497 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.33% (0.3543 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.32% (0.3516 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.28% (0.3543 => 0.3978, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 12.24% (0.3561 => 0.3997, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.97% (0.3694 => 0.4136, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.68% (0.3828 => 0.4275, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.40% (0.3886 => 0.4329, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.33% (1.1194 => 1.2462, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.24% (2.2022 => 2.3836, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.10% (1.7609 => 1.9036, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 6.89% (0.5925 => 0.6333, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.78% (0.6030 => 0.6439, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2065 => 0.2200, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.3177 => 0.3367, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 5.60% (0.7326 => 0.7736, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.98% (0.4615 => 0.4845, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.73% (0.4879 => 0.5110, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.55% (7.0540 => 7.3753, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.3282 => 0.3429, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 4.41% (10.4361 => 10.8960, std. dev.: 0.0210) MultiSource/Applications/lambda-0_1_3/lambda: 4.33% (0.7433 => 0.7755, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 4.15% (9.4845 => 9.8780, std. dev.: 0.0168) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.94% (0.8172 => 0.8494, std. dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.76% (5.0018 => 5.1901, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.76% (4.9449 => 5.1307, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.72% (0.5569 => 0.5776, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.62% (0.5860 => 0.6072, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (4.2646 => 4.4150, std. dev.: 0.0129) MultiSource/Applications/sgefa/sgefa: 3.41% (0.3109 => 0.3215, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.33% (0.3180 => 0.3286, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.33% (0.3423 => 0.3537, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.27% (8.1363 => 8.4026, std. dev.: 0.0054) MultiSource/Applications/spiff/spiff: 3.18% (0.7835 => 0.8084, std. dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 3.12% (5.7591 => 5.9387, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.07% (1.3050 => 1.3451, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.96% (1.1861 => 1.2212, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.88% (14.3668 => 14.7803, std. dev.: 0.0060) MultiSource/Applications/Burg/burg: 2.76% (1.1642 => 1.1963, std. dev.: 0.0102) MultiSource/Applications/hbd/hbd: 2.63% (1.5603 => 1.6014, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.63% (0.4103 => 0.4211, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.58% (2.0273 => 2.0796, std. dev.: 0.0041) MultiSource/Applications/d/make_dparser: 2.57% (3.3354 => 3.4210, std. dev.: 0.0047) MultiSource/Benchmarks/McCat/05-eks/eks: 2.49% (0.4299 => 0.4406, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 2.39% (3.8723 => 3.9647, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.35% (1.5415 => 1.5777, std. dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.29% (0.4636 => 0.4742, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.6456 => 0.6601, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.23% (2.0665 => 2.1126, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (2.2024 => 2.2513, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.18% (0.9765 => 0.9978, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.04% (1.5859 => 1.6183, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.98% (0.6675 => 0.6807, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.95% (0.6450 => 0.6576, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.89% (0.5981 => 0.6094, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.4186 => 1.4453, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 1.69% (0.8921 => 0.9072, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 1.63% (1.2842 => 1.3051, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.59% (2.2969 => 2.3334, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 1.37% (17.1811 => 17.4157, std. dev.: 0.0102) MultiSource/Benchmarks/nbench/nbench: 1.24% (1.1840 => 1.1987, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.34% (4.2280 => 4.4114, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7478, std. dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.74% (3.1578 => 3.2126, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8338, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5086 => 1.5324, std. dev.: 0.0013) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2036, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.12% (9.1159 => 9.2180, std. dev.: 0.0172) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.01% (5.2763 => 3.1655, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.42% (5.3855 => 3.6936, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.88% (5.3526 => 3.6996, std. dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: -15.05% (54.1659 => 46.0118, std. dev.: 0.0279) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.44% (2.9384 => 2.5435, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -10.32% (22.1758 => 19.8872, std. dev.: 0.0647) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2373 => 1.1100, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -6.66% (1.5373 => 1.4349, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.24% (1.5835 => 1.5005, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -4.83% (1.9577 => 1.8631, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4890, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4139, std. dev.: 0.0196) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.07% (8.1563 => 7.9062, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0042, std. dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.37% (0.4808 => 0.4694, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.33% (1.3677 => 1.3358, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6795, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -1.71% (12.5348 => 12.3204, std. dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4174, std. dev.: 0.0076) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8086, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.19% (1.7254 => 1.7049, std. dev.: 0.0006) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2496, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 07:29:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 09:29:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120729142957.C51932A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2468?compare_to=2465&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2468, Order: 160928, Start Time: 2012-07-29 11:46:58, End Time: 2012-07-29 14:30:24 To: 2465, Order: 160927, Start Time: 2012-07-29 05:04:24, End Time: 2012-07-29 07:50:52 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (82 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (800 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.98% (127.8368 => 131.6437, std. dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/methcall: 1.39% (16.2899 => 16.5160, std. dev.: 0.0203) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.20% (54.1303 => 54.7814, std. dev.: 0.1320) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.12% (0.3446 => 0.3898, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.07% (0.3465 => 0.3918, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.04% (0.3496 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3460 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.83% (0.3469 => 0.3914, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.82% (0.3488 => 0.3935, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 12.81% (0.3442 => 0.3883, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.41% (0.3643 => 0.4095, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.38% (0.3650 => 0.4102, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.92% (0.3724 => 0.4168, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.04% (0.5826 => 0.6236, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.79% (0.5889 => 0.6289, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.1620 => 0.1726, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 5.66% (1.5932 => 1.6834, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.32% (1.6211 => 1.7073, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 5.31% (0.7171 => 0.7552, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.23% (3.5627 => 3.7492, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.82% (0.4361 => 0.4571, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.75% (0.4994 => 0.5231, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.55% (1.3152 => 1.3750, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (0.5000 => 0.5224, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.48% (0.3930 => 0.4106, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.47% (0.5900 => 0.6164, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 4.34% (0.4029 => 0.4204, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (0.5026 => 0.5240, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 4.23% (1.0781 => 1.1237, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 4.07% (4.2109 => 4.3824, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.83% (0.2875 => 0.2985, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.72% (0.3195 => 0.3314, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.70% (2.7292 => 2.8303, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.70% (0.2866 => 0.2972, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 3.70% (0.3004 => 0.3115, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.69% (0.2736 => 0.2837, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.57% (0.9909 => 1.0263, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (2.0673 => 2.1398, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.45% (1.9694 => 2.0373, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.44% (1.9966 => 2.0653, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.37% (0.3890 => 0.4021, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.33% (0.3096 => 0.3199, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.31% (0.3258 => 0.3366, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.24% (0.3267 => 0.3373, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.20% (5.5417 => 5.7190, std. dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 3.16% (2.1013 => 2.1676, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.09% (0.4658 => 0.4802, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.06% (0.3362 => 0.3465, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 3.01% (0.3317 => 0.3417, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 2.99% (2.1653 => 2.2301, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 2.99% (23.5202 => 24.2237, std. dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/moments: 2.94% (0.3678 => 0.3786, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.91% (4.6177 => 4.7521, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.85% (4.4195 => 4.5454, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 2.79% (0.7875 => 0.8095, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.77% (0.3903 => 0.4011, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 2.74% (0.3726 => 0.3828, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (1.8794 => 1.9297, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 2.65% (0.4146 => 0.4256, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 2.52% (0.4251 => 0.4358, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.40% (0.9697 => 0.9930, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.38% (1.4269 => 1.4608, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.29% (0.5546 => 0.5673, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 2.11% (0.6634 => 0.6774, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 2.02% (0.5012 => 0.5113, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.6435 => 0.6557, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.19% (2.0346 => 2.0588, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9638, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.61% (0.2122 => 0.2241, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6680, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8938, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1632, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6827, std. dev.: 0.0637) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1947, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4586, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.4994, std. dev.: 0.0176) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5909, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2231, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (8.4155 => 8.5117, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.72% (2.4764 => 2.3844, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: -1.52% (11.9555 => 11.7743, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.03% (25.4195 => 16.5160, std. dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/ary2: -8.20% (0.2402 => 0.2205, std. dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -8.20% (17.2379 => 15.8246, std. dev.: 0.2471) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7963, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: -3.94% (0.4438 => 0.4263, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7953, std. dev.: 0.0176) SingleSource/Benchmarks/Dhrystone/dry: -3.64% (14.0481 => 13.5373, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5741, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 07:42:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 09:42:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120729144219.5A1832A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2469?compare_to=2466&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2469, Order: 160929, Start Time: 2012-07-29 13:28:50, End Time: 2012-07-29 14:42:45 To: 2466, Order: 160928, Start Time: 2012-07-29 11:46:55, End Time: 2012-07-29 13:00:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (141 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.40% (0.7664 => 0.7771, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.38% (2.0176 => 2.3077, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 10.11% (0.5818 => 0.6406, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.06% (0.7061 => 0.7771, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.90% (0.5748 => 0.6317, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3578 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.53% (0.3601 => 0.3944, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-4: 9.49% (0.3646 => 0.3992, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.48% (0.3650 => 0.3996, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 9.39% (0.3663 => 0.4007, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.30% (0.3623 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.29% (0.3789 => 0.4141, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.10% (0.3914 => 0.4270, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.04% (0.4003 => 0.4365, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.93% (0.3940 => 0.4292, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 7.41% (1.3693 => 1.4707, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.04% (0.7710 => 0.8253, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2781 => 0.2973, std. dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 6.85% (0.7038 => 0.7520, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.81% (3.9660 => 4.2362, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 6.79% (0.4328 => 0.4622, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.69% (0.2782 => 0.2968, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.57% (0.4062 => 0.4329, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.54% (0.2690 => 0.2866, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.48% (0.5265 => 0.5606, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2607 => 0.2774, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.28% (0.2721 => 0.2892, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.26% (0.2765 => 0.2938, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.21% (0.2655 => 0.2820, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.20% (0.2966 => 0.3150, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2628 => 0.2789, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.09% (0.3022 => 0.3206, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.05% (0.2760 => 0.2927, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.01% (0.2696 => 0.2858, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.99% (0.2937 => 0.3113, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2761 => 0.2926, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.95% (0.3899 => 0.4131, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.94% (0.2726 => 0.2888, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.88% (1.9828 => 2.0993, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.77% (0.3485 => 0.3686, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.75% (0.4379 => 0.4631, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 5.73% (0.3107 => 0.3285, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.72% (0.3149 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.70% (0.3580 => 0.3784, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.69% (0.6959 => 0.7355, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.67% (0.3489 => 0.3687, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.67% (0.4390 => 0.4639, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 5.66% (0.2988 => 0.3157, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.47% (0.3453 => 0.3642, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.44% (1.2193 => 1.2856, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/lists: 5.44% (0.3293 => 0.3472, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 5.39% (0.3192 => 0.3364, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.12% (0.3534 => 0.3715, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.12% (0.9199 => 0.9670, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.06% (13.8202 => 14.5197, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.05% (0.4016 => 0.4219, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (1.4563 => 1.5296, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.00% (0.5577 => 0.5856, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.95% (0.3756 => 0.3942, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.86% (16.6129 => 17.4202, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/moments: 4.81% (0.3868 => 0.4054, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.72% (0.2925 => 0.3063, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.62% (7.2180 => 7.5512, std. dev.: 0.0059) MultiSource/Applications/spiff/spiff: 4.54% (0.7506 => 0.7847, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.53% (0.2914 => 0.3046, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.50% (0.2243 => 0.2344, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.48% (1.2292 => 1.2843, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.46% (1.3819 => 1.4436, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (13.2842 => 13.8751, std. dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.41% (0.3246 => 0.3389, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.40% (1.1364 => 1.1864, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.33% (0.5637 => 0.5881, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.22% (1.3813 => 1.4396, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.21% (1.3245 => 1.3803, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 4.19% (3.8646 => 4.0264, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 4.18% (1.1061 => 1.1523, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 4.13% (1.9270 => 2.0065, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.11% (1.0594 => 1.1029, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.09% (0.7460 => 0.7765, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (0.8310 => 0.8647, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (4.3801 => 4.5525, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.78% (4.4433 => 4.6113, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.73% (0.3755 => 0.3895, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.69% (3.6692 => 3.8045, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 3.61% (0.2995 => 0.3103, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 3.47% (2.1791 => 2.2547, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.29% (1.1333 => 1.1706, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.26% (0.3131 => 0.3233, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.15% (0.4791 => 0.4942, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.99% (0.8698 => 0.8958, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.96% (3.1889 => 3.2834, std. dev.: 0.0105) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.95% (4.9865 => 5.1337, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.90% (0.6283 => 0.6465, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.84% (0.6135 => 0.6309, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 2.82% (0.4113 => 0.4229, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 2.79% (8.4961 => 8.7330, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 2.73% (14.5298 => 14.9264, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 2.67% (16.2614 => 16.6949, std. dev.: 0.0150) MultiSource/Applications/JM/ldecod/ldecod: 2.66% (6.5754 => 6.7501, std. dev.: 0.0170) MultiSource/Applications/JM/lencod/lencod: 2.51% (14.8535 => 15.2264, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.31% (2.1007 => 2.1492, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.19% (3.2742 => 3.3460, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 1.96% (4.6629 => 4.7545, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 1.65% (0.6250 => 0.6353, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.30% (0.9108 => 0.9226, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.17% (1.0313 => 1.0434, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.85% (0.4846 => 0.6971, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5125, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/fbench: 24.69% (1.8175 => 2.2663, std. dev.: 0.0491) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 5.78% (1.2998 => 1.3749, std. dev.: 0.0214) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.16% (0.9996 => 1.0512, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 4.46% (7.4271 => 7.7586, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7048, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4772, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.58% (1.7688 => 1.8145, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4522, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5928 => 4.6636, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.19% (1.9290 => 1.9519, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1400, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.5627 => 21.0512, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.47% (0.3511 => 0.3389, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.75% (0.0997 => 0.0820, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.99% (1.2308 => 1.1078, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.08% (1.3780 => 1.3080, std. dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9195, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9478, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5989, std. dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2261, std. dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.88% (20.3410 => 19.9596, std. dev.: 0.0387) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5077, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.58% (7.3305 => 7.2145, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.58% (0.6589 => 0.6485, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.47% (9.3358 => 9.1987, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8608, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4929, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2590, std. dev.: 0.0026) MultiSource/Applications/lua/lua: -1.04% (26.5159 => 26.2412, std. dev.: 0.0258) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 07:51:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 09:51:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120729145147.24DCA2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2470?compare_to=2467&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2470, Order: 160929, Start Time: 2012-07-29 13:33:47, End Time: 2012-07-29 14:52:14 To: 2467, Order: 160928, Start Time: 2012-07-29 11:46:59, End Time: 2012-07-29 13:05:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (84 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (755 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.29% (13.7278 => 13.9045, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.45% (55.7164 => 56.5258, std. dev.: 0.0427) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.12% (10.3673 => 13.9045, std. dev.: 0.0093) SingleSource/UnitTests/ObjC/trivial-interface: 12.76% (0.3473 => 0.3916, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.50% (0.3497 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.37% (0.3516 => 0.3951, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.36% (0.3543 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.36% (0.3561 => 0.4001, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.33% (0.3543 => 0.3980, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 12.02% (0.3694 => 0.4138, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.68% (0.3828 => 0.4275, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.60% (1.1194 => 1.2493, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.48% (0.3886 => 0.4332, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.38% (0.3927 => 0.4374, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.75% (2.2022 => 2.3950, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.47% (1.7609 => 1.9100, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 6.75% (0.6030 => 0.6437, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.67% (0.5925 => 0.6320, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.30% (0.3177 => 0.3377, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.54% (0.7326 => 0.7732, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.51% (0.4879 => 0.5148, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.18% (0.4615 => 0.4854, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.94% (7.0540 => 7.4025, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/oourafft: 4.94% (0.3282 => 0.3444, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.89% (10.4361 => 10.9462, std. dev.: 0.0128) MultiSource/Applications/lambda-0_1_3/lambda: 4.53% (0.7433 => 0.7770, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.46% (9.4845 => 9.9076, std. dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: 4.27% (0.2554 => 0.2663, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (4.9449 => 5.1453, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (5.0018 => 5.2028, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.99% (0.5569 => 0.5791, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.94% (0.8172 => 0.8494, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.81% (4.2646 => 4.4269, std. dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.75% (0.3121 => 0.3238, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.67% (0.3109 => 0.3223, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.62% (0.5860 => 0.6072, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.47% (0.7835 => 0.8107, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.46% (8.1363 => 8.4181, std. dev.: 0.0101) MultiSource/Benchmarks/McCat/09-vor/vor: 3.46% (0.3180 => 0.3290, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.26% (1.3050 => 1.3476, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.24% (1.1861 => 1.2245, std. dev.: 0.0079) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.07% (14.3668 => 14.8078, std. dev.: 0.0175) MultiSource/Applications/oggenc/oggenc: 2.99% (5.7591 => 5.9312, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 2.95% (0.3387 => 0.3487, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.91% (1.1642 => 1.1981, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 2.86% (0.4299 => 0.4422, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.86% (2.0273 => 2.0853, std. dev.: 0.0092) MultiSource/Applications/hbd/hbd: 2.76% (1.5603 => 1.6033, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.74% (0.8067 => 0.8288, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.72% (3.3354 => 3.4262, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.71% (1.5415 => 1.5832, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.61% (0.4103 => 0.4210, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.60% (3.8723 => 3.9731, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.55% (0.5105 => 0.5235, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.42% (2.2024 => 2.2558, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.39% (0.9765 => 0.9998, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.38% (0.4289 => 0.4391, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.33% (1.5859 => 1.6229, std. dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.33% (0.4636 => 0.4744, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6450 => 0.6594, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.19% (2.0665 => 2.1117, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.17% (0.5981 => 0.6111, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.15% (1.4186 => 1.4491, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (0.6675 => 0.6817, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 2.06% (0.8921 => 0.9105, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.94% (2.2969 => 2.3414, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 1.67% (1.1840 => 1.2038, std. dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 1.67% (17.1811 => 17.4679, std. dev.: 0.0109) MultiSource/Applications/hexxagon/hexxagon: 1.65% (1.2842 => 1.3054, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.22% (1.0722 => 1.0853, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.42% (4.2280 => 4.4149, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7590, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2158, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8344, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (1.5086 => 1.5318, std. dev.: 0.0018) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2044, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2326, std. dev.: 0.0207) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.96% (5.2763 => 3.1680, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.21% (5.3855 => 3.7046, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.62% (5.3526 => 3.7137, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -15.04% (54.1659 => 46.0208, std. dev.: 0.0387) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.20% (2.9384 => 2.5505, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -10.08% (22.1758 => 19.9400, std. dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4202, std. dev.: 0.0052) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.83% (0.0998 => 0.0840, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.82% (1.2373 => 1.1034, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: -9.84% (1.5373 => 1.3861, std. dev.: 0.0323) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5039, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.83% (1.9577 => 1.8631, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4826, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.12% (8.6802 => 8.4097, std. dev.: 0.0117) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9121, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0037, std. dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3192, std. dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4189, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.30% (1.8329 => 1.8090, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 10:14:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 12:14:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120729171434.913D92A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2471?compare_to=2469&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2471, Order: 160931, Start Time: 2012-07-29 16:00:52, End Time: 2012-07-29 17:15:01 To: 2469, Order: 160929, Start Time: 2012-07-29 13:28:50, End Time: 2012-07-29 14:42:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (146 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.27% (77.7681 => 81.0893, std. dev.: 0.3315) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.24% (54.6422 => 56.4145, std. dev.: 0.1208) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.47% (2.0176 => 2.3095, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: 9.88% (0.5818 => 0.6393, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 9.70% (0.7061 => 0.7746, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.59% (0.5748 => 0.6299, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3578 => 0.3912, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.30% (0.3646 => 0.3985, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.14% (0.3601 => 0.3930, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.12% (0.3663 => 0.3997, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 9.03% (0.3623 => 0.3950, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.93% (0.3650 => 0.3976, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 8.89% (0.3789 => 0.4126, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.76% (0.3914 => 0.4257, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.67% (0.4003 => 0.4350, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.58% (0.3940 => 0.4278, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.56% (0.1986 => 0.2156, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.99% (0.3130 => 0.3380, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 7.16% (1.3693 => 1.4673, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.03% (0.7710 => 0.8252, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (3.9660 => 4.2401, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.65% (0.4062 => 0.4332, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (0.4328 => 0.4614, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.55% (0.2655 => 0.2829, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.55% (0.5265 => 0.5610, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 6.47% (0.2781 => 0.2961, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2782 => 0.2962, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 6.42% (0.7038 => 0.7490, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.2721 => 0.2891, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4379 => 0.4641, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 5.95% (0.2607 => 0.2762, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.91% (0.2690 => 0.2849, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.91% (0.2760 => 0.2923, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.86% (0.2628 => 0.2782, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.76% (0.3022 => 0.3196, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 5.72% (0.2726 => 0.2882, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.72% (0.2761 => 0.2919, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.65% (0.3485 => 0.3682, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.65% (0.2937 => 0.3103, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.62% (1.9828 => 2.0943, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.60% (0.2696 => 0.2847, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.58% (1.2193 => 1.2873, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3107 => 0.3280, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.54% (0.4390 => 0.4633, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 5.49% (0.3149 => 0.3322, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.47% (0.3580 => 0.3776, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.46% (0.6959 => 0.7339, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.3489 => 0.3679, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.35% (0.2988 => 0.3148, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3756 => 0.3956, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.23% (0.3534 => 0.3719, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.19% (0.9199 => 0.9676, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 5.17% (13.8202 => 14.5347, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.10% (0.3453 => 0.3629, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.07% (0.5577 => 0.5860, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.98% (0.3293 => 0.3457, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 4.98% (16.6129 => 17.4394, std. dev.: 0.0130) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (1.4563 => 1.5268, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.80% (7.2180 => 7.5644, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.78% (0.4016 => 0.4208, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.76% (0.3868 => 0.4052, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.76% (0.7506 => 0.7863, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.70% (0.2914 => 0.3051, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.62% (1.1364 => 1.1889, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (13.2842 => 13.8928, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.5637 => 0.5895, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.48% (0.2945 => 0.3077, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.44% (0.3246 => 0.3390, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.43% (1.1061 => 1.1551, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 4.31% (0.8310 => 0.8668, std. dev.: 0.0045) MultiSource/Applications/treecc/treecc: 4.29% (1.9270 => 2.0097, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.24% (1.3813 => 1.4399, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.24% (3.8646 => 4.0284, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.23% (1.3819 => 1.4403, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 4.21% (1.0594 => 1.1040, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.19% (1.3245 => 1.3800, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 4.17% (1.2292 => 1.2804, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (4.3801 => 4.5607, std. dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.12% (0.7460 => 0.7767, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.92% (3.6692 => 3.8131, std. dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (4.4433 => 4.6149, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3755 => 0.3888, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.49% (0.4791 => 0.4958, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.1333 => 1.1720, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 3.29% (2.1791 => 2.2507, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.21% (4.9865 => 5.1466, std. dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 3.20% (8.4961 => 8.7680, std. dev.: 0.0094) MultiSource/Applications/d/make_dparser: 3.14% (3.1889 => 3.2890, std. dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.09% (0.8698 => 0.8967, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.09% (0.6283 => 0.6477, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.08% (0.6135 => 0.6324, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4113 => 0.4239, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.81% (6.5754 => 6.7600, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 2.81% (14.5298 => 14.9377, std. dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: 2.75% (16.2614 => 16.7088, std. dev.: 0.0231) MultiSource/Applications/JM/lencod/lencod: 2.63% (14.8535 => 15.2443, std. dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.50% (2.1007 => 2.1532, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.48% (3.2742 => 3.3553, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (1.5188 => 1.5518, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.16% (4.6629 => 4.7638, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 1.63% (0.6250 => 0.6352, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.58% (0.9108 => 0.9252, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.39% (1.0313 => 1.0456, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 1.34% (33.2944 => 33.7390, std. dev.: 0.0189) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.24% (6.2785 => 6.3562, std. dev.: 0.0189) MultiSource/Applications/lua/lua: 1.15% (3.7467 => 3.7898, std. dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5135, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 25.46% (1.8175 => 2.2802, std. dev.: 0.0474) SingleSource/Benchmarks/Misc/mandel-2: 7.02% (1.2998 => 1.3911, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.28% (0.9996 => 1.0524, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 4.37% (7.4271 => 7.7516, std. dev.: 0.0113) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7083, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.67% (2.8606 => 2.9657, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4775, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.68% (1.7688 => 1.8162, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.36% (1.0310 => 1.0553, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5349, std. dev.: 0.0028) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.51% (4.5928 => 4.6623, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 1.47% (10.7476 => 10.9058, std. dev.: 0.0389) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/fldry: 1.14% (1.9290 => 1.9509, std. dev.: 0.0050) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1391, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.40% (22.5627 => 21.1192, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.30% (0.3511 => 0.3395, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.45% (0.0997 => 0.0823, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2308 => 1.1046, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.30% (1.3780 => 1.3188, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5817, std. dev.: 0.0282) MultiSource/Applications/spiff/spiff: -2.57% (3.0263 => 2.9486, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4991, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2310, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.68% (20.3410 => 19.9996, std. dev.: 0.0190) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.42% (9.3358 => 9.2034, std. dev.: 0.0114) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2351, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2540, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.12% (3.8887 => 3.8452, std. dev.: 0.0037) MultiSource/Applications/lua/lua: -1.04% (26.5159 => 26.2409, std. dev.: 0.0216) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 10:18:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 12:18:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120729171837.561272A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2472?compare_to=2470&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2472, Order: 160931, Start Time: 2012-07-29 16:00:36, End Time: 2012-07-29 17:19:04 To: 2470, Order: 160929, Start Time: 2012-07-29 13:33:47, End Time: 2012-07-29 14:52:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (82 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 3.95% (1.3861 => 1.4408, std. dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.80% (78.0752 => 79.4777, std. dev.: 0.3686) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.08% (13.9045 => 13.7543, std. dev.: 0.0180) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.67% (10.3673 => 13.7543, std. dev.: 0.0180) SingleSource/UnitTests/ObjC/trivial-interface: 12.09% (0.3473 => 0.3893, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.78% (0.3497 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-3: 11.75% (0.3516 => 0.3929, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.71% (0.3543 => 0.3958, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/synchronized: 11.71% (0.3561 => 0.3978, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.53% (1.1194 => 1.2485, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.37% (0.3694 => 0.4114, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/property: 10.73% (0.3886 => 0.4303, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.79% (2.2022 => 2.3958, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.50% (1.7609 => 1.9105, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.3177 => 0.3376, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.18% (0.5925 => 0.6291, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.12% (0.6030 => 0.6399, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.39% (0.4879 => 0.5142, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 5.10% (10.4361 => 10.9679, std. dev.: 0.0108) SingleSource/UnitTests/ObjC++/property-reference: 5.02% (0.7326 => 0.7694, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.94% (0.3282 => 0.3444, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.93% (7.0540 => 7.4017, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.92% (0.4615 => 0.4842, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 4.30% (9.4845 => 9.8920, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (4.9449 => 5.1488, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (5.0018 => 5.1980, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.85% (0.8172 => 0.8487, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.77% (0.5569 => 0.5779, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.66% (4.2646 => 4.4205, std. dev.: 0.0088) MultiSource/Benchmarks/McCat/18-imp/imp: 3.59% (0.3423 => 0.3546, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.55% (0.7835 => 0.8113, std. dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 3.54% (0.3109 => 0.3219, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.41% (8.1363 => 8.4135, std. dev.: 0.0055) MultiSource/Benchmarks/McCat/09-vor/vor: 3.36% (0.3180 => 0.3287, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.17% (14.3668 => 14.8226, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.3050 => 1.3464, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 3.13% (0.3387 => 0.3493, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.09% (5.7591 => 5.9373, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1861 => 1.2228, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.91% (1.5415 => 1.5864, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 2.91% (1.1642 => 1.1981, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.73% (3.3354 => 3.4263, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.72% (2.0273 => 2.0825, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.71% (0.8067 => 0.8286, std. dev.: 0.0045) MultiSource/Applications/hbd/hbd: 2.65% (1.5603 => 1.6017, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 2.61% (0.4299 => 0.4411, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.52% (3.8723 => 3.9697, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.48% (2.2024 => 2.2571, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5859 => 1.6226, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.31% (0.5105 => 0.5223, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.28% (0.9765 => 0.9988, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/football/football: 2.16% (0.8921 => 0.9114, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.15% (0.6456 => 0.6595, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.13% (1.4186 => 1.4488, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.11% (0.6450 => 0.6586, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.02% (0.5981 => 0.6102, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6675 => 0.6799, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.80% (2.0665 => 2.1038, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.73% (0.7115 => 0.7238, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 1.61% (1.1840 => 1.2031, std. dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 1.57% (17.1811 => 17.4512, std. dev.: 0.0156) MultiSource/Applications/siod/siod: 1.57% (2.2969 => 2.3329, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 1.39% (1.2842 => 1.3021, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.24% (1.0722 => 1.0855, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (4.2280 => 4.4163, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7493, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2151, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.65% (11.6436 => 11.8362, std. dev.: 0.0036) MultiSource/Applications/aha/aha: 1.38% (3.1595 => 3.2032, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2334, std. dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.13% (1.3045 => 1.3193, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.98% (5.2763 => 3.1669, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.18% (5.3855 => 3.7062, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.56% (5.3526 => 3.7167, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -15.05% (54.1659 => 46.0150, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.22% (2.9384 => 2.5499, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -10.10% (22.1758 => 19.9363, std. dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.19% (1.2373 => 1.1112, std. dev.: 0.0238) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -6.28% (1.5373 => 1.4408, std. dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (1.9577 => 1.8573, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5101, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.16% (8.1563 => 7.8988, std. dev.: 0.0146) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4906, std. dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4248, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0001, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.33% (1.3677 => 1.3358, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6825, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3229, std. dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4175, std. dev.: 0.0059) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.34% (1.8329 => 1.8083, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 10:40:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 12:40:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120729174041.CAF062A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2473?compare_to=2468&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2473, Order: 160929, Start Time: 2012-07-29 14:58:05, End Time: 2012-07-29 17:41:08 To: 2468, Order: 160928, Start Time: 2012-07-29 11:46:58, End Time: 2012-07-29 14:30:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (93 on baseline) Performance Improvements: 1 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (789 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.92% (131.6437 => 125.1635, std. dev.: 0.7377) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.56% (0.3465 => 0.3935, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.52% (0.3446 => 0.3912, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.42% (0.3496 => 0.3965, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.38% (0.3469 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.34% (0.3442 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.25% (0.3488 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.85% (0.3643 => 0.4111, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.77% (0.3650 => 0.4116, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3724 => 0.4184, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 7.28% (0.5826 => 0.6250, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.95% (0.5889 => 0.6298, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.55% (1.6211 => 1.7111, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 5.52% (0.7171 => 0.7567, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.50% (3.5627 => 3.7586, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.18% (0.4361 => 0.4587, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.12% (0.5900 => 0.6202, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.75% (1.5932 => 1.6688, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.71% (0.4994 => 0.5229, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.69% (1.3152 => 1.3769, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.61% (0.3930 => 0.4111, std. dev.: 0.0061) MultiSource/Applications/spiff/spiff: 4.57% (0.4029 => 0.4213, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (0.5000 => 0.5224, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.40% (0.5026 => 0.5247, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 4.35% (1.0781 => 1.1250, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 4.34% (4.2109 => 4.3938, std. dev.: 0.0069) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.23% (2.7292 => 2.8447, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.17% (0.3792 => 0.3950, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.05% (0.2866 => 0.2982, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 3.99% (0.3004 => 0.3124, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.2736 => 0.2843, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.86% (0.2875 => 0.2986, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (0.3195 => 0.3317, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.73% (1.9966 => 2.0711, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.67% (1.9694 => 2.0417, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.65% (0.2738 => 0.2838, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.60% (0.9909 => 1.0266, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.57% (0.3890 => 0.4029, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.56% (0.4658 => 0.4824, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 3.54% (0.2823 => 0.2923, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 3.53% (2.1013 => 2.1754, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.50% (2.0673 => 2.1396, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wc: 3.49% (0.3096 => 0.3204, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.41% (5.5417 => 5.7306, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 3.32% (2.1653 => 2.2371, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 3.29% (4.6177 => 4.7698, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.29% (4.4195 => 4.5648, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 3.28% (0.3267 => 0.3374, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3124 => 0.3226, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.24% (0.3271 => 0.3377, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3258 => 0.3363, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.13% (0.3903 => 0.4025, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 3.11% (0.3317 => 0.3420, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.07% (0.3678 => 0.3791, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.03% (0.3362 => 0.3464, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 2.99% (0.3348 => 0.3448, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 2.98% (0.3726 => 0.3837, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 2.93% (0.3477 => 0.3579, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (1.8794 => 1.9329, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 2.83% (0.7875 => 0.8098, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (0.3625 => 0.3726, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.73% (0.4139 => 0.4252, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 2.73% (0.4251 => 0.4367, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.71% (0.3690 => 0.3790, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 2.69% (23.5202 => 24.1521, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.4146 => 0.4257, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 2.65% (0.9697 => 0.9954, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.51% (0.3981 => 0.4081, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.47% (1.4269 => 1.4622, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 2.36% (0.5546 => 0.5677, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 2.28% (0.6634 => 0.6785, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.13% (0.6435 => 0.6572, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.02% (0.5012 => 0.5113, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.30% (2.0346 => 2.0611, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9638, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.54% (0.2122 => 0.2282, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6771, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 5.05% (1.8057 => 1.8969, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.77% (15.4430 => 16.1794, std. dev.: 0.1146) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (105.3826 => 107.6235, std. dev.: 0.0455) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1919, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4937, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5904, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2222, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.40% (2.4764 => 2.3921, std. dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: -1.53% (11.9555 => 11.7731, std. dev.: 0.0138) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.06% (25.4195 => 16.5077, std. dev.: 0.0190) SingleSource/Benchmarks/Dhrystone/fldry: -8.74% (17.2379 => 15.7310, std. dev.: 0.1621) SingleSource/Benchmarks/Shootout-C++/ary2: -7.95% (0.2402 => 0.2211, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7889, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/moments: -3.92% (0.4438 => 0.4264, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.81% (11.2080 => 10.7807, std. dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/dry: -3.61% (14.0481 => 13.5413, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5747, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 13:51:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 15:51:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120729205153.378682A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2474?compare_to=2473&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2474, Order: 160931, Start Time: 2012-07-29 18:09:01, End Time: 2012-07-29 20:52:20 To: 2473, Order: 160929, Start Time: 2012-07-29 14:58:05, End Time: 2012-07-29 17:41:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (97 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (786 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.35% (24.1521 => 24.4793, std. dev.: 0.0120) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.62% (0.3465 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.56% (0.3496 => 0.3970, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.55% (0.3446 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.54% (0.3442 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.53% (0.3460 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.47% (0.3488 => 0.3958, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.46% (0.3469 => 0.3936, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 13.09% (0.3643 => 0.4120, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.01% (0.3650 => 0.4125, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.57% (0.3724 => 0.4192, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5826 => 0.6256, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1620 => 0.1736, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.05% (0.5889 => 0.6304, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.53% (1.5932 => 1.6972, std. dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.72% (3.5627 => 3.7665, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.66% (1.6211 => 1.7129, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 5.47% (0.7171 => 0.7563, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.30% (0.4361 => 0.4592, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.25% (0.4994 => 0.5256, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.14% (1.3152 => 1.3828, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.96% (0.3930 => 0.4125, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.85% (0.5900 => 0.6186, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.84% (0.5000 => 0.5242, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.79% (0.4029 => 0.4222, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 4.73% (1.0781 => 1.1291, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.58% (0.5026 => 0.5256, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 4.50% (4.2109 => 4.4004, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.48% (2.7292 => 2.8514, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.33% (0.2866 => 0.2990, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (1.9694 => 2.0501, std. dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 4.08% (23.5202 => 24.4793, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.03% (0.2875 => 0.2991, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.91% (0.3195 => 0.3320, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.90% (0.2566 => 0.2666, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 3.89% (0.3004 => 0.3121, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.85% (5.5417 => 5.7548, std. dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: 3.78% (2.1013 => 2.1807, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.74% (1.9966 => 2.0713, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.73% (0.9909 => 1.0279, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2750 => 0.2852, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.70% (0.3890 => 0.4034, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.69% (0.2792 => 0.2895, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.65% (0.2738 => 0.2838, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.61% (0.2823 => 0.2925, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.61% (0.4658 => 0.4826, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 3.59% (0.2813 => 0.2914, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.59% (2.0673 => 2.1415, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary3: 3.52% (0.3267 => 0.3382, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.50% (2.1653 => 2.2410, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 3.47% (4.6177 => 4.7778, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.43% (0.3060 => 0.3165, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.42% (0.3096 => 0.3202, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.41% (4.4195 => 4.5701, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 3.41% (0.3258 => 0.3369, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.30% (0.3124 => 0.3227, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.28% (0.3903 => 0.4031, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.26% (0.3317 => 0.3425, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.22% (0.3477 => 0.3589, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.21% (0.3362 => 0.3470, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.18% (0.3678 => 0.3795, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.14% (0.7875 => 0.8122, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3726 => 0.3842, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.11% (0.3282 => 0.3384, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.11% (1.8794 => 1.9378, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (0.3625 => 0.3737, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 2.99% (0.3348 => 0.3448, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.92% (0.4146 => 0.4267, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.85% (0.4251 => 0.4372, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.83% (0.4139 => 0.4256, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.82% (0.6634 => 0.6821, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.80% (1.4269 => 1.4668, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.3981 => 0.4089, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.70% (0.5546 => 0.5696, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.59% (0.9697 => 0.9948, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.6435 => 0.6582, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.5012 => 0.5125, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.60% (2.0346 => 2.0672, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 14.90% (2.5769 => 2.9609, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.22% (0.2122 => 0.2254, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6810, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-2: 4.98% (1.8057 => 1.8956, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1699, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.09% (105.3826 => 107.5847, std. dev.: 0.0638) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2029, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4960, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5924, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2245, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (8.4155 => 8.5115, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.12% (11.9555 => 11.8211, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5398, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: -9.37% (0.2402 => 0.2177, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: -8.32% (17.2379 => 15.8037, std. dev.: 0.0944) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9777, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7963, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/moments: -3.99% (0.4438 => 0.4261, std. dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7952, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -3.58% (14.0481 => 13.5458, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5824, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 17:22:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 19:22:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120730002237.AF1972A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2475?compare_to=2471&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2475, Order: 160937, Start Time: 2012-07-29 23:09:00, End Time: 2012-07-30 00:23:02 To: 2471, Order: 160931, Start Time: 2012-07-29 16:00:52, End Time: 2012-07-29 17:15:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.46% (3.8097 => 3.7542, std. dev.: 0.0124) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.42% (2.0176 => 2.3086, std. dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference-object: 9.78% (0.5818 => 0.6387, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.74% (0.7061 => 0.7749, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.69% (0.5748 => 0.6305, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.31% (0.3578 => 0.3911, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.14% (0.3601 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.08% (0.3623 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.02% (0.3646 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.96% (0.3650 => 0.3977, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.95% (0.3663 => 0.3991, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.92% (0.3789 => 0.4127, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 8.81% (0.3914 => 0.4259, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.59% (0.4003 => 0.4347, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.55% (0.3940 => 0.4277, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.12% (0.7710 => 0.8259, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 6.99% (1.3693 => 1.4650, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 6.87% (0.4062 => 0.4341, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.83% (3.9660 => 4.2370, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.71% (0.7038 => 0.7510, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (0.4328 => 0.4613, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2781 => 0.2962, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.50% (0.5265 => 0.5607, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.29% (0.2782 => 0.2957, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.21% (0.2721 => 0.2890, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.98% (0.2607 => 0.2763, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2655 => 0.2812, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.91% (0.2690 => 0.2849, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.82% (0.4379 => 0.4634, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.82% (0.2628 => 0.2781, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.80% (0.2726 => 0.2884, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.79% (0.2937 => 0.3107, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.79% (0.4390 => 0.4644, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.77% (0.2966 => 0.3137, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3022 => 0.3195, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.72% (0.2760 => 0.2918, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.72% (0.3899 => 0.4122, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 5.65% (0.2761 => 0.2917, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.58% (1.9828 => 2.0935, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.57% (1.2193 => 1.2872, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3107 => 0.3280, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3485 => 0.3679, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.56% (0.3580 => 0.3779, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.55% (0.6959 => 0.7345, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.49% (0.2696 => 0.2844, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.46% (0.3149 => 0.3321, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.42% (0.3489 => 0.3678, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3534 => 0.3723, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 5.29% (0.2988 => 0.3146, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.27% (0.9199 => 0.9684, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.18% (13.8202 => 14.5366, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.18% (0.5577 => 0.5866, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.97% (16.6129 => 17.4378, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (0.3756 => 0.3938, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.80% (7.2180 => 7.5643, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.76% (0.3868 => 0.4052, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.71% (1.4563 => 1.5249, std. dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.63% (0.2914 => 0.3049, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (13.2842 => 13.8995, std. dev.: 0.0119) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.62% (1.1364 => 1.1889, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.60% (0.7506 => 0.7851, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.58% (1.1061 => 1.1568, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.49% (0.5637 => 0.5890, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.47% (0.3246 => 0.3391, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.45% (0.2945 => 0.3076, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.44% (3.8646 => 4.0360, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.39% (1.3245 => 1.3827, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 4.33% (1.9270 => 2.0104, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 4.31% (0.8310 => 0.8668, std. dev.: 0.0116) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1048, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.28% (0.7460 => 0.7779, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.22% (1.3813 => 1.4396, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.19% (1.3819 => 1.4398, std. dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 4.05% (1.2292 => 1.2790, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.3801 => 4.5514, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.88% (3.6692 => 3.8114, std. dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (4.4433 => 4.6143, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.78% (0.3755 => 0.3897, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.63% (2.1791 => 2.2581, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.53% (0.4791 => 0.4960, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.34% (1.1333 => 1.1711, std. dev.: 0.0099) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.20% (8.4961 => 8.7680, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 3.17% (3.1889 => 3.2901, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.15% (0.6135 => 0.6328, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.14% (4.9865 => 5.1432, std. dev.: 0.0278) MultiSource/Benchmarks/McCat/05-eks/eks: 3.14% (0.4113 => 0.4242, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.12% (0.6283 => 0.6479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.09% (0.8698 => 0.8967, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (3.2742 => 3.3681, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 2.86% (14.5298 => 14.9453, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (6.5754 => 6.7598, std. dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: 2.75% (16.2614 => 16.7088, std. dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 2.63% (14.8535 => 15.2447, std. dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.46% (2.1007 => 2.1524, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 2.28% (4.6629 => 4.7690, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5188 => 1.5526, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.57% (0.9108 => 0.9251, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.48% (1.0313 => 1.0466, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.45% (33.2944 => 33.7782, std. dev.: 0.0071) MultiSource/Applications/lua/lua: 1.22% (3.7467 => 3.7923, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.18% (6.2785 => 6.3527, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5195, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2629, std. dev.: 0.0205) SingleSource/Benchmarks/Misc/mandel-2: 7.92% (1.2998 => 1.4028, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.15% (0.9996 => 1.0511, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 4.48% (7.4271 => 7.7595, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7083, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4776, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.69% (1.7688 => 1.8164, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4559, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5352, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5928 => 4.6624, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5940, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1391, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.36% (22.5627 => 21.1272, std. dev.: 0.0142) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.45% (0.3511 => 0.3390, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.95% (0.0997 => 0.0818, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1020, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.71% (1.3780 => 1.3131, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.79% (8.8259 => 8.5800, std. dev.: 0.0136) MultiSource/Benchmarks/Olden/bh/bh: -2.78% (1.9762 => 1.9213, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: -2.64% (3.0263 => 2.9464, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2211, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.02% (6.6320 => 6.4978, std. dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (20.3410 => 19.9617, std. dev.: 0.0256) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.38% (5.3167 => 5.2432, std. dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: -1.38% (7.3305 => 7.2296, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8653, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.12% (26.5159 => 26.2176, std. dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8475, std. dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 17:26:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 19:26:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120730002644.3D92D2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2476?compare_to=2472&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2476, Order: 160937, Start Time: 2012-07-29 23:08:38, End Time: 2012-07-30 00:27:09 To: 2472, Order: 160931, Start Time: 2012-07-29 16:00:36, End Time: 2012-07-29 17:19:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (82 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.62% (10.3673 => 13.7495, std. dev.: 0.0100) SingleSource/UnitTests/ObjC/trivial-interface: 11.98% (0.3473 => 0.3889, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3543 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.64% (0.3497 => 0.3904, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.60% (0.3516 => 0.3924, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.57% (1.1194 => 1.2489, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 11.40% (0.3694 => 0.4115, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.3927 => 0.4346, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.80% (2.2022 => 2.3959, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.49% (1.7609 => 1.9104, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.34% (0.2065 => 0.2196, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.3177 => 0.3376, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5925 => 0.6287, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 5.94% (0.6030 => 0.6388, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.37% (0.4879 => 0.5141, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4615 => 0.4852, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 5.09% (10.4361 => 10.9670, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/oourafft: 4.88% (0.3282 => 0.3442, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.86% (0.7326 => 0.7682, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.82% (7.0540 => 7.3937, std. dev.: 0.0144) MultiSource/Benchmarks/McCat/08-main/main: 4.31% (0.2554 => 0.2664, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.29% (9.4845 => 9.8916, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 4.09% (0.7433 => 0.7737, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.99% (0.2758 => 0.2868, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (4.9449 => 5.1385, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.89% (5.0018 => 5.1963, std. dev.: 0.0072) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.87% (0.8172 => 0.8488, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.81% (0.5569 => 0.5781, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.69% (0.5860 => 0.6076, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (4.2646 => 4.4183, std. dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: 3.54% (0.3109 => 0.3219, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.50% (0.7835 => 0.8109, std. dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.49% (0.3121 => 0.3230, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 3.36% (0.3423 => 0.3538, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.30% (8.1363 => 8.4051, std. dev.: 0.0099) MultiSource/Benchmarks/McCat/09-vor/vor: 3.27% (0.3180 => 0.3284, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.18% (1.3050 => 1.3465, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.14% (1.1861 => 1.2233, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.13% (14.3668 => 14.8159, std. dev.: 0.0099) MultiSource/Applications/oggenc/oggenc: 3.09% (5.7591 => 5.9369, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 2.72% (1.1642 => 1.1959, std. dev.: 0.0095) MultiSource/Applications/treecc/treecc: 2.67% (2.0273 => 2.0815, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 2.63% (0.4299 => 0.4412, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.63% (0.8067 => 0.8279, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.62% (3.3354 => 3.4229, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.61% (1.5603 => 1.6010, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.56% (1.5415 => 1.5809, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 2.37% (3.8723 => 3.9641, std. dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.31% (0.5105 => 0.5223, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.30% (1.5859 => 1.6224, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.26% (0.9765 => 0.9986, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (2.2024 => 2.2512, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.20% (0.6450 => 0.6592, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.05% (1.4186 => 1.4477, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5981 => 0.6099, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 1.95% (0.6456 => 0.6582, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.67% (2.0665 => 2.1010, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.64% (17.1811 => 17.4622, std. dev.: 0.0196) MultiSource/Applications/siod/siod: 1.57% (2.2969 => 2.3329, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.47% (1.1840 => 1.2014, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.43% (0.7115 => 0.7217, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.31% (1.2842 => 1.3010, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.17% (1.0722 => 1.0847, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (4.2280 => 4.3913, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7593, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.69% (3.1578 => 3.2111, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5086 => 1.5336, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.61% (11.6436 => 11.8306, std. dev.: 0.0056) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2036, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.11% (9.1159 => 9.2167, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.98% (5.2763 => 3.1667, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.19% (5.3855 => 3.7059, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.63% (5.3526 => 3.7133, std. dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -15.14% (54.1659 => 45.9659, std. dev.: 0.0627) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.35% (2.9384 => 2.5461, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -10.12% (22.1758 => 19.9322, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.52% (1.2373 => 1.1071, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -5.72% (1.5373 => 1.4493, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -4.76% (1.9577 => 1.8646, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4828, std. dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (8.1563 => 7.9084, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4205, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9994, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6783, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: -1.74% (12.5348 => 12.3164, std. dev.: 0.0059) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4190, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.24% (1.8329 => 1.8102, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2497, std. dev.: 0.0082) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 18:51:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 20:51:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120730015121.E6AFD2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2477?compare_to=2474&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2477, Order: 160937, Start Time: 2012-07-29 23:08:32, End Time: 2012-07-30 01:51:47 To: 2474, Order: 160931, Start Time: 2012-07-29 18:09:01, End Time: 2012-07-29 20:52:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (101 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (781 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (15.8037 => 16.0377, std. dev.: 0.0687) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.37% (128.0145 => 129.7738, std. dev.: 0.4128) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.52% (0.3446 => 0.3912, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.51% (0.3465 => 0.3933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.44% (0.3496 => 0.3966, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.44% (0.3460 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.40% (0.3469 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.39% (0.3442 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.39% (0.3488 => 0.3955, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 13.01% (0.3643 => 0.4117, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.99% (0.3650 => 0.4124, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.54% (0.3724 => 0.4191, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.21% (0.5826 => 0.6246, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.10% (0.5889 => 0.6307, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.1620 => 0.1733, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 6.52% (1.5932 => 1.6970, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.1619 => 0.1719, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.68% (3.5627 => 3.7650, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (1.6211 => 1.7127, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.61% (0.7171 => 0.7573, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.19% (0.5026 => 0.5287, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.18% (0.4361 => 0.4587, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.13% (0.4994 => 0.5250, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.03% (1.3152 => 1.3814, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.02% (0.5000 => 0.5251, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.96% (0.3930 => 0.4125, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 4.75% (1.0781 => 1.1293, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.74% (0.4029 => 0.4220, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.61% (0.5900 => 0.6172, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.59% (4.2109 => 4.4040, std. dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.51% (2.7292 => 2.8522, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.2866 => 0.2985, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 4.14% (23.5202 => 24.4942, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.02% (0.2736 => 0.2846, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.00% (0.2875 => 0.2990, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3195 => 0.3321, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.88% (1.9694 => 2.0459, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.86% (0.3890 => 0.4040, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 3.82% (0.2725 => 0.2829, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.81% (0.9909 => 1.0287, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 3.80% (0.2714 => 0.2817, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.3004 => 0.3118, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (2.1013 => 2.1806, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.77% (5.5417 => 5.7505, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.76% (0.2738 => 0.2841, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.73% (0.2813 => 0.2918, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.72% (0.2792 => 0.2896, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.71% (1.9966 => 2.0707, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/objinst: 3.68% (0.2823 => 0.2927, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2750 => 0.2851, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 3.66% (0.2811 => 0.2914, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.64% (0.2803 => 0.2905, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.63% (0.2780 => 0.2881, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.61% (2.0673 => 2.1419, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 3.59% (0.3096 => 0.3207, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.55% (0.3267 => 0.3383, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.50% (0.4658 => 0.4821, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 3.50% (0.3258 => 0.3372, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.46% (4.4195 => 4.5722, std. dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 3.45% (4.6177 => 4.7768, std. dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 3.42% (2.1653 => 2.2394, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.42% (0.3362 => 0.3477, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.37% (0.3060 => 0.3163, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.36% (0.3124 => 0.3229, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.26% (0.3678 => 0.3798, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.24% (0.4139 => 0.4273, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3317 => 0.3424, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.20% (0.3903 => 0.4028, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.20% (0.3348 => 0.3455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.14% (0.3726 => 0.3843, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.14% (0.3282 => 0.3385, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.3625 => 0.3738, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.05% (1.8794 => 1.9367, std. dev.: 0.0056) MultiSource/Applications/treecc/treecc: 2.98% (0.7875 => 0.8110, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.89% (0.4146 => 0.4266, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.87% (0.4251 => 0.4373, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3690 => 0.3794, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.74% (0.3981 => 0.4090, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.73% (0.6634 => 0.6815, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.70% (1.4269 => 1.4654, std. dev.: 0.0055) MultiSource/Applications/hbd/hbd: 2.68% (0.9697 => 0.9957, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.65% (0.5546 => 0.5693, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.36% (0.6435 => 0.6587, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.33% (0.5012 => 0.5129, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.69% (2.0346 => 2.0689, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9639, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.13% (0.2122 => 0.2252, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-2: 5.12% (1.8057 => 1.8981, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (12.0509 => 12.6612, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1622, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.10% (105.3826 => 107.5966, std. dev.: 0.0588) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1996, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4938, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.50% (3.1722 => 3.2198, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.81% (2.4764 => 2.3821, std. dev.: 0.0233) MultiSource/Applications/kimwitu++/kc: -1.08% (11.9555 => 11.8258, std. dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.08% (25.4195 => 16.5018, std. dev.: 0.0264) SingleSource/Benchmarks/Shootout-C++/ary2: -8.03% (0.2402 => 0.2209, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8105, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -6.96% (17.2379 => 16.0377, std. dev.: 0.0687) SingleSource/Benchmarks/Shootout-C++/moments: -3.92% (0.4438 => 0.4264, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8006, std. dev.: 0.0103) SingleSource/Benchmarks/Dhrystone/dry: -3.60% (14.0481 => 13.5422, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5816, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 19:04:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 21:04:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120730020439.3FCCE2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2478?compare_to=2475&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2478, Order: 160938, Start Time: 2012-07-30 00:51:00, End Time: 2012-07-30 02:05:05 To: 2475, Order: 160937, Start Time: 2012-07-29 23:09:00, End Time: 2012-07-30 00:23:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (148 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.74% (2.0176 => 2.3150, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.80% (0.5818 => 0.6388, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.60% (0.5748 => 0.6300, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.60% (0.7061 => 0.7739, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 9.22% (0.3578 => 0.3908, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.05% (0.3601 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.97% (0.3646 => 0.3973, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.96% (0.3650 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3789 => 0.4128, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.92% (0.3623 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.90% (0.3663 => 0.3989, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.74% (0.3914 => 0.4256, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.52% (0.4003 => 0.4344, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.50% (0.3940 => 0.4275, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.20% (1.3693 => 1.4679, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.04% (0.7710 => 0.8253, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.96% (3.9660 => 4.2422, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.63% (0.5265 => 0.5614, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 6.61% (0.7038 => 0.7503, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 6.58% (0.2781 => 0.2964, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.43% (0.2782 => 0.2961, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.21% (0.2721 => 0.2890, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.08% (0.4062 => 0.4309, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 5.99% (0.2690 => 0.2851, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.98% (0.2607 => 0.2763, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4379 => 0.4637, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.88% (0.2655 => 0.2811, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 5.87% (0.2760 => 0.2922, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.82% (0.2628 => 0.2781, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3022 => 0.3197, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.75% (0.2765 => 0.2924, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.72% (0.3899 => 0.4122, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.69% (0.2761 => 0.2918, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.65% (0.2726 => 0.2880, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.6959 => 0.7352, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.63% (1.9828 => 2.0944, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.62% (0.3485 => 0.3681, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.59% (1.2193 => 1.2874, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.58% (0.4390 => 0.4635, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2696 => 0.2846, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.50% (0.3107 => 0.3278, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.50% (0.3580 => 0.3777, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.47% (0.3489 => 0.3680, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.43% (0.3149 => 0.3320, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.32% (0.3534 => 0.3722, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.28% (0.9199 => 0.9685, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.28% (0.2140 => 0.2253, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.26% (13.8202 => 14.5474, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.15% (0.3453 => 0.3631, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.15% (0.5577 => 0.5864, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.07% (16.6129 => 17.4548, std. dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/lists: 4.95% (0.3293 => 0.3456, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.87% (7.2180 => 7.5693, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.83% (0.4016 => 0.4210, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.76% (0.7506 => 0.7863, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.73% (1.4563 => 1.5252, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: 4.73% (0.3868 => 0.4051, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.72% (0.2925 => 0.3063, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.64% (13.2842 => 13.9010, std. dev.: 0.0085) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.62% (1.1364 => 1.1889, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.61% (0.5637 => 0.5897, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.54% (1.1061 => 1.1563, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.47% (1.9270 => 2.0132, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.46% (1.3819 => 1.4435, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.36% (1.3245 => 1.3823, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 4.33% (0.8310 => 0.8670, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.32% (3.8646 => 4.0316, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1049, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.29% (1.3813 => 1.4406, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (0.7460 => 0.7772, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.99% (1.2292 => 1.2783, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.93% (3.6692 => 3.8135, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (4.4433 => 4.6155, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.3801 => 4.5493, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.72% (0.4791 => 0.4969, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.70% (0.3755 => 0.3894, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.67% (2.1791 => 2.2591, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.44% (1.1333 => 1.1723, std. dev.: 0.0062) MultiSource/Benchmarks/sim/sim: 3.39% (0.3131 => 0.3237, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.19% (4.9865 => 5.1456, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.16% (0.8698 => 0.8973, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.15% (3.1889 => 3.2892, std. dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 3.14% (8.4961 => 8.7631, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 3.14% (0.4113 => 0.4242, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.10% (0.6283 => 0.6478, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.10% (0.6135 => 0.6325, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.85% (6.5754 => 6.7628, std. dev.: 0.0126) MultiSource/Applications/ClamAV/clamscan: 2.79% (14.5298 => 14.9352, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 2.79% (16.2614 => 16.7146, std. dev.: 0.0150) MultiSource/Applications/JM/lencod/lencod: 2.76% (14.8535 => 15.2628, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.51% (2.1007 => 2.1534, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (3.2742 => 3.3549, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.21% (1.5188 => 1.5523, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 2.12% (4.6629 => 4.7617, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 1.70% (0.6250 => 0.6356, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.47% (1.0313 => 1.0465, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.36% (33.2944 => 33.7459, std. dev.: 0.0065) MultiSource/Applications/lua/lua: 1.21% (3.7467 => 3.7921, std. dev.: 0.0091) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.16% (6.2785 => 6.3516, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5190, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2605, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/mandel-2: 7.92% (1.2998 => 1.4028, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.17% (0.9996 => 1.0513, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 4.39% (7.4271 => 7.7530, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7034, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4781, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.69% (1.7688 => 1.8163, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0310 => 1.0556, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5355, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.50% (4.5928 => 4.6615, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0407, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.21% (1.9290 => 1.9524, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9659, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 1.08% (10.7476 => 10.8639, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1683, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1397, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.5627 => 21.1291, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.28% (0.3511 => 0.3396, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.05% (0.0997 => 0.0827, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1100, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.92% (1.3780 => 1.3240, std. dev.: 0.0159) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9187, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5833, std. dev.: 0.0097) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9480, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2283, std. dev.: 0.0091) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5072, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.68% (20.3410 => 19.9991, std. dev.: 0.0518) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3305 => 7.2178, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8663, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2259, std. dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2565, std. dev.: 0.0044) MultiSource/Applications/lua/lua: -1.04% (26.5159 => 26.2398, std. dev.: 0.0383) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 19:13:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 21:13:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120730021305.BBC512A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2479?compare_to=2476&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2479, Order: 160938, Start Time: 2012-07-30 00:55:01, End Time: 2012-07-30 02:13:32 To: 2476, Order: 160937, Start Time: 2012-07-29 23:08:38, End Time: 2012-07-30 00:27:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (81 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.96% (54.8481 => 56.4728, std. dev.: 0.0606) MultiSource/Benchmarks/llubenchmark/llu: 2.76% (3.7758 => 3.8800, std. dev.: 0.0039) SingleSource/Regression/C/uint64_to_float: 1.87% (0.5353 => 0.5453, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.38% (13.7495 => 13.5602, std. dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.80% (10.3673 => 13.5602, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.33% (0.3543 => 0.3980, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.01% (0.3473 => 0.3890, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.75% (0.3516 => 0.3929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.70% (0.3497 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.63% (0.3543 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.63% (0.3561 => 0.3975, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.46% (1.1194 => 1.2477, std. dev.: 0.0068) SingleSource/UnitTests/ObjC/for-in: 11.32% (0.3694 => 0.4112, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 11.02% (0.3828 => 0.4250, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.70% (0.3927 => 0.4347, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.71% (2.2022 => 2.3941, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.44% (1.7609 => 1.9096, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.23% (0.3177 => 0.3375, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.15% (0.2065 => 0.2192, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.04% (0.5925 => 0.6283, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.00% (0.6030 => 0.6392, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.21% (0.4879 => 0.5133, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.04% (10.4361 => 10.9618, std. dev.: 0.0169) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.92% (0.4615 => 0.4842, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.90% (0.7326 => 0.7685, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.78% (0.3282 => 0.3439, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.74% (7.0540 => 7.3881, std. dev.: 0.0135) MultiSource/Benchmarks/mafft/pairlocalalign: 4.25% (9.4845 => 9.8873, std. dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: 4.21% (0.7433 => 0.7746, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.2554 => 0.2660, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.89% (4.9449 => 5.1374, std. dev.: 0.0095) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.84% (5.0018 => 5.1937, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.81% (0.8172 => 0.8483, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.67% (4.2646 => 4.4212, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.66% (0.5569 => 0.5773, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 3.51% (0.3109 => 0.3218, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.50% (0.5860 => 0.6065, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.33% (0.3121 => 0.3225, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.33% (0.3423 => 0.3537, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.29% (8.1363 => 8.4038, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.12% (1.3050 => 1.3457, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.09% (14.3668 => 14.8107, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1861 => 1.2227, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.06% (0.7835 => 0.8075, std. dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 3.06% (5.7591 => 5.9353, std. dev.: 0.0143) MultiSource/Applications/Burg/burg: 2.83% (1.1642 => 1.1971, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.68% (2.0273 => 2.0817, std. dev.: 0.0056) MultiSource/Applications/d/make_dparser: 2.58% (3.3354 => 3.4215, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 2.54% (0.4299 => 0.4408, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.50% (0.8067 => 0.8269, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 2.49% (1.5603 => 1.5991, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.43% (1.5415 => 1.5790, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.39% (0.5105 => 0.5227, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.36% (3.8723 => 3.9638, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.27% (1.5859 => 1.6219, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.2024 => 2.2521, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.25% (0.9765 => 0.9985, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.05% (1.4186 => 1.4477, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 2.04% (0.6456 => 0.6588, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.04% (0.6675 => 0.6811, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.02% (0.6450 => 0.6580, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 2.01% (0.8921 => 0.9100, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.91% (0.5981 => 0.6095, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.70% (2.0665 => 2.1017, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.61% (17.1811 => 17.4580, std. dev.: 0.0111) MultiSource/Applications/siod/siod: 1.55% (2.2969 => 2.3325, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 1.55% (1.1840 => 1.2023, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: 1.46% (0.7115 => 0.7219, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.21% (1.2842 => 1.2998, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.12% (1.0722 => 1.0842, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.74% (4.2280 => 4.3860, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7591, std. dev.: 0.0006) MultiSource/Benchmarks/llubenchmark/llu: 2.70% (3.7781 => 3.8800, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.67% (3.1578 => 3.2106, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.61% (11.6436 => 11.8312, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5086 => 1.5327, std. dev.: 0.0021) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2045, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3373, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.00% (2.8904 => 2.9194, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.06% (5.2763 => 3.1628, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.28% (5.3855 => 3.7010, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.71% (5.3526 => 3.7086, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -15.09% (54.1659 => 45.9897, std. dev.: 0.0367) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.32% (2.9384 => 2.5471, std. dev.: 0.0140) MultiSource/Applications/ClamAV/clamscan: -10.06% (22.1758 => 19.9446, std. dev.: 0.0142) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.11% (1.2373 => 1.1122, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -7.65% (1.5373 => 1.4197, std. dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -4.58% (1.9577 => 1.8680, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4812, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.16% (8.1563 => 7.8985, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/salsa20: -2.77% (10.2830 => 9.9984, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.6802 => 8.4415, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6786, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.68% (12.5348 => 12.3248, std. dev.: 0.0030) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4182, std. dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8095, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2496, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 20:46:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 22:46:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120730034644.B8F962A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2480?compare_to=2478&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2480, Order: 160939, Start Time: 2012-07-30 02:33:05, End Time: 2012-07-30 03:47:09 To: 2478, Order: 160938, Start Time: 2012-07-30 00:51:00, End Time: 2012-07-30 02:05:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (148 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.73% (2.0176 => 2.3147, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 9.94% (0.7061 => 0.7763, std. dev.: 0.0082) SingleSource/UnitTests/ObjC++/property-reference-object: 9.87% (0.5818 => 0.6392, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.69% (0.5748 => 0.6305, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.28% (0.3578 => 0.3910, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.16% (0.3601 => 0.3931, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.08% (0.3646 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.95% (0.3663 => 0.3991, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.94% (0.3623 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.93% (0.3650 => 0.3976, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 8.89% (0.3789 => 0.4126, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.79% (0.3914 => 0.4258, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.57% (0.4003 => 0.4346, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.50% (0.3940 => 0.4275, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.14% (1.3693 => 1.4671, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.00% (3.9660 => 4.2436, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.98% (0.7710 => 0.8248, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 6.76% (0.7038 => 0.7514, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.72% (0.4328 => 0.4619, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5265 => 0.5619, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 6.65% (0.2781 => 0.2966, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.65% (0.4062 => 0.4332, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.32% (0.2721 => 0.2893, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.10% (0.3899 => 0.4137, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 6.06% (0.2690 => 0.2853, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.04% (0.2966 => 0.3145, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.02% (0.2607 => 0.2764, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.01% (0.5577 => 0.5912, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.96% (0.3022 => 0.3202, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2655 => 0.2813, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.90% (0.2765 => 0.2928, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.88% (0.4390 => 0.4648, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.87% (1.9828 => 2.0992, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.87% (0.3580 => 0.3790, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/except: 5.83% (0.2760 => 0.2921, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.82% (0.3485 => 0.3688, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.80% (0.2726 => 0.2884, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.79% (0.2937 => 0.3107, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.79% (0.2696 => 0.2852, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.76% (0.2761 => 0.2920, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.72% (0.6959 => 0.7357, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.63% (1.2193 => 1.2879, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.56% (0.3149 => 0.3324, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.49% (0.2988 => 0.3152, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.32% (13.8202 => 14.5549, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.32% (0.9199 => 0.9688, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.29% (0.3192 => 0.3361, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.15% (0.3453 => 0.3631, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.15% (0.3534 => 0.3716, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.07% (16.6129 => 17.4558, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/lists: 5.01% (0.3293 => 0.3458, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.95% (0.3756 => 0.3942, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.93% (0.4016 => 0.4214, std. dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.86% (7.2180 => 7.5690, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.85% (1.4563 => 1.5270, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 4.81% (0.3868 => 0.4054, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.78% (0.7506 => 0.7865, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 4.72% (0.2925 => 0.3063, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.69% (13.2842 => 13.9073, std. dev.: 0.0187) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.56% (1.1364 => 1.1882, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.54% (0.5637 => 0.5893, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.51% (3.8646 => 4.0390, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3246 => 0.3392, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.49% (1.1061 => 1.1558, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 4.48% (0.2945 => 0.3077, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.45% (1.9270 => 2.0127, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 4.45% (1.0594 => 1.1065, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.39% (1.3245 => 1.3826, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 4.37% (0.8310 => 0.8673, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.3819 => 1.4420, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.30% (0.7460 => 0.7781, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.21% (1.3813 => 1.4395, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.16% (1.2292 => 1.2803, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.3801 => 4.5537, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.91% (3.6692 => 3.8126, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (4.4433 => 4.6148, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 3.73% (2.1791 => 2.2603, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.69% (0.4791 => 0.4968, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3755 => 0.3890, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.46% (1.1333 => 1.1725, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.29% (0.6283 => 0.6490, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.26% (4.9865 => 5.1493, std. dev.: 0.0187) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4113 => 0.4247, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.24% (0.6135 => 0.6334, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 3.19% (3.1889 => 3.2905, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.16% (0.8698 => 0.8973, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (8.4961 => 8.7640, std. dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.88% (3.2742 => 3.3685, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 2.84% (6.5754 => 6.7623, std. dev.: 0.0090) MultiSource/Applications/ClamAV/clamscan: 2.78% (14.5298 => 14.9340, std. dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: 2.75% (16.2614 => 16.7091, std. dev.: 0.0226) MultiSource/Applications/JM/lencod/lencod: 2.71% (14.8535 => 15.2561, std. dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.51% (2.1007 => 2.1535, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 2.40% (4.6629 => 4.7748, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 1.63% (0.6250 => 0.6352, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.59% (0.9108 => 0.9253, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.57% (0.6744 => 0.6850, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.44% (1.0313 => 1.0462, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.39% (33.2944 => 33.7569, std. dev.: 0.0236) MultiSource/Applications/lua/lua: 1.28% (3.7467 => 3.7946, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.18% (6.2785 => 6.3523, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5132, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2690, std. dev.: 0.0470) SingleSource/Benchmarks/Misc/mandel-2: 7.69% (1.2998 => 1.3998, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.54% (0.9996 => 1.0550, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: 4.44% (7.4271 => 7.7565, std. dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 3.97% (11.2619 => 11.7087, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9658, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4787, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8154, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4562, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 1.55% (1.9290 => 1.9589, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5928 => 4.6631, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5943, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1965, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1403, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.5627 => 21.1408, std. dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.22% (0.3511 => 0.3398, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.35% (0.0997 => 0.0834, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.20% (1.2308 => 1.1052, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3154, std. dev.: 0.0095) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5931, std. dev.: 0.0093) MultiSource/Applications/spiff/spiff: -2.57% (3.0263 => 2.9485, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.26% (6.3560 => 6.2121, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (20.3410 => 19.9636, std. dev.: 0.0578) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5099, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0040, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3305 => 7.2242, std. dev.: 0.0146) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8618, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4929, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2531, std. dev.: 0.0045) MultiSource/Applications/lua/lua: -1.13% (26.5159 => 26.2154, std. dev.: 0.0140) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 20:59:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 29 Jul 2012 22:59:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120730035926.B93822A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2481?compare_to=2479&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2481, Order: 160939, Start Time: 2012-07-30 02:41:27, End Time: 2012-07-30 03:59:53 To: 2479, Order: 160938, Start Time: 2012-07-30 00:55:01, End Time: 2012-07-30 02:13:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (80 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.79% (10.3673 => 13.5599, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/trivial-interface: 11.92% (0.3473 => 0.3887, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.77% (0.3516 => 0.3930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.71% (0.3543 => 0.3958, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 11.67% (0.3497 => 0.3905, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: 11.60% (0.3561 => 0.3974, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.56% (1.1194 => 1.2488, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.40% (0.3694 => 0.4115, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.18% (0.3828 => 0.4256, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.89% (0.3886 => 0.4309, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.59% (0.3817 => 0.4183, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.67% (2.2022 => 2.3932, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.42% (1.7609 => 1.9092, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.17% (0.3177 => 0.3373, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.04% (0.5925 => 0.6283, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.97% (0.6030 => 0.6390, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.25% (0.4879 => 0.5135, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.04% (10.4361 => 10.9620, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (0.4615 => 0.4843, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.85% (0.7326 => 0.7681, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.72% (7.0540 => 7.3873, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (9.4845 => 9.8855, std. dev.: 0.0128) MultiSource/Applications/lambda-0_1_3/lambda: 4.17% (0.7433 => 0.7743, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.97% (4.9449 => 5.1412, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.78% (0.8172 => 0.8481, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.77% (5.0018 => 5.1904, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.70% (0.5569 => 0.5775, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (4.2646 => 4.4173, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.48% (0.5860 => 0.6064, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3121 => 0.3227, std. dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.28% (8.1363 => 8.4034, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.15% (1.3050 => 1.3461, std. dev.: 0.0051) MultiSource/Applications/spiff/spiff: 3.11% (0.7835 => 0.8079, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.11% (14.3668 => 14.8137, std. dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 3.07% (5.7591 => 5.9359, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.99% (1.1861 => 1.2216, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.79% (1.1642 => 1.1967, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.62% (2.0273 => 2.0804, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 2.60% (3.3354 => 3.4222, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 2.50% (1.5603 => 1.5993, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.49% (0.8067 => 0.8268, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 2.42% (0.4299 => 0.4403, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.37% (1.5415 => 1.5781, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 2.31% (3.8723 => 3.9619, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.31% (0.5105 => 0.5223, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.29% (1.5859 => 1.6222, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.22% (0.9765 => 0.9982, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.20% (2.2024 => 2.2509, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.12% (0.6450 => 0.6587, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.6456 => 0.6585, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.95% (0.8921 => 0.9095, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.95% (0.6675 => 0.6805, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.4186 => 1.4455, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.89% (0.5981 => 0.6094, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.60% (2.0665 => 2.0996, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.60% (17.1811 => 17.4553, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 1.58% (2.2969 => 2.3333, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.55% (1.1840 => 1.2023, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.09% (1.0722 => 1.0839, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (4.2280 => 4.4099, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7590, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2137, std. dev.: 0.0087) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5086 => 1.5349, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8339, std. dev.: 0.0015) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2040, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2212, std. dev.: 0.0160) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.00% (2.8904 => 2.9194, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.02% (5.2763 => 3.1646, std. dev.: 0.0153) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.30% (5.3855 => 3.6997, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.72% (5.3526 => 3.7082, std. dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -15.03% (54.1659 => 46.0263, std. dev.: 0.0179) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.29% (2.9384 => 2.5479, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -10.13% (22.1758 => 19.9298, std. dev.: 0.0204) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2373 => 1.1159, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -6.84% (1.5373 => 1.4322, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.10% (1.5835 => 1.5027, std. dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/fldry: -4.94% (1.9577 => 1.8609, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4810, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.13% (8.1563 => 7.9010, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4199, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9992, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.73% (12.5348 => 12.3179, std. dev.: 0.0039) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4188, std. dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.23% (1.8329 => 1.8103, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 22:02:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 00:02:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120730050235.AD3082A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2482?compare_to=2477&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2482, Order: 160939, Start Time: 2012-07-30 02:19:34, End Time: 2012-07-30 05:03:01 To: 2477, Order: 160937, Start Time: 2012-07-29 23:08:32, End Time: 2012-07-30 01:51:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (98 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (784 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.09% (2.7859 => 2.8162, std. dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.85% (0.3465 => 0.3945, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 13.72% (0.3469 => 0.3945, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.64% (0.3446 => 0.3916, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.63% (0.3442 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.56% (0.3496 => 0.3970, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.50% (0.3488 => 0.3959, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 13.50% (0.3460 => 0.3927, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 13.07% (0.3643 => 0.4119, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.01% (0.3650 => 0.4125, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.62% (0.3724 => 0.4194, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.24% (0.5826 => 0.6248, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.96% (0.5889 => 0.6299, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.60% (1.5932 => 1.6984, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.09% (0.3792 => 0.4023, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.71% (3.5627 => 3.7662, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.68% (1.6211 => 1.7131, std. dev.: 0.0063) SingleSource/UnitTests/ObjC++/property-reference: 5.54% (0.7171 => 0.7568, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (0.4361 => 0.4599, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.38% (0.5000 => 0.5269, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.17% (0.4994 => 0.5252, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.14% (1.3152 => 1.3828, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.2014 => 0.2115, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.96% (0.3930 => 0.4125, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 4.84% (1.0781 => 1.1303, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.83% (0.5026 => 0.5269, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 4.77% (0.4029 => 0.4221, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.73% (0.5900 => 0.6179, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.65% (4.2109 => 4.4067, std. dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.46% (2.7292 => 2.8509, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.28% (0.2736 => 0.2853, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.16% (0.3004 => 0.3129, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.13% (0.3195 => 0.3327, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.2866 => 0.2984, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 4.10% (23.5202 => 24.4846, std. dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (1.9694 => 2.0478, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.97% (0.2875 => 0.2989, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.94% (5.5417 => 5.7599, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.83% (0.2738 => 0.2843, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.83% (0.9909 => 1.0289, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (1.9966 => 2.0722, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: 3.78% (0.2750 => 0.2854, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.78% (0.3890 => 0.4037, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (2.1013 => 2.1805, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.76% (0.2792 => 0.2897, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.74% (0.2780 => 0.2884, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.67% (0.4658 => 0.4829, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.67% (2.0673 => 2.1431, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/except: 3.59% (0.2811 => 0.2912, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.59% (0.3096 => 0.3207, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.58% (0.2823 => 0.2924, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.57% (0.2803 => 0.2903, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.54% (4.6177 => 4.7813, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 3.52% (0.3267 => 0.3382, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.51% (2.1653 => 2.2413, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (4.4195 => 4.5699, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.36% (0.3124 => 0.3229, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.35% (0.3258 => 0.3367, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.33% (0.3362 => 0.3474, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.30% (0.3060 => 0.3161, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.20% (0.3282 => 0.3387, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (1.8794 => 1.9394, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 3.19% (0.5546 => 0.5723, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.3903 => 0.4026, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.14% (0.3726 => 0.3843, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.14% (0.3348 => 0.3453, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.13% (0.3678 => 0.3793, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.11% (0.7875 => 0.8120, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.03% (0.3625 => 0.3735, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 2.99% (0.3477 => 0.3581, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3690 => 0.3797, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 2.86% (0.9697 => 0.9974, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.80% (0.4139 => 0.4255, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.78% (1.4269 => 1.4666, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 2.78% (0.4251 => 0.4369, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.77% (0.6634 => 0.6818, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.3981 => 0.4089, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.33% (0.5012 => 0.5129, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.27% (0.6435 => 0.6581, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.73% (2.0346 => 2.0698, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9636, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6669, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-2: 5.05% (1.8057 => 1.8968, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1664, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.11% (105.3826 => 107.6104, std. dev.: 0.0643) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2044, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4584, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.93% (2.0820 => 2.1222, std. dev.: 0.0066) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4961, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5908, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2213, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.90% (2.4764 => 2.3799, std. dev.: 0.0288) MultiSource/Applications/kimwitu++/kc: -1.14% (11.9555 => 11.8193, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.97% (25.4195 => 16.5315, std. dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9754, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7894, std. dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/ary2: -7.45% (0.2402 => 0.2223, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -7.24% (17.2379 => 15.9897, std. dev.: 0.1448) SingleSource/Benchmarks/Shootout-C++/moments: -3.97% (0.4438 => 0.4262, std. dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7950, std. dev.: 0.0129) SingleSource/Benchmarks/Dhrystone/dry: -3.62% (14.0481 => 13.5394, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5821, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 22:28:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 00:28:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120730052853.6ED9B2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2483?compare_to=2480&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2483, Order: 160942, Start Time: 2012-07-30 04:15:07, End Time: 2012-07-30 05:29:19 To: 2480, Order: 160939, Start Time: 2012-07-30 02:33:05, End Time: 2012-07-30 03:47:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (150 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.05% (78.1416 => 80.5225, std. dev.: 0.3644) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.47% (54.7495 => 56.1023, std. dev.: 0.2309) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.75% (2.0176 => 2.3152, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.80% (0.5818 => 0.6388, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.77% (0.7061 => 0.7751, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.64% (0.5748 => 0.6302, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.22% (0.3578 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.08% (0.3601 => 0.3928, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.08% (0.3646 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.97% (0.3623 => 0.3948, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.90% (0.3650 => 0.3975, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.90% (0.3663 => 0.3989, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.89% (0.3789 => 0.4126, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.84% (0.3914 => 0.4260, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.69% (0.4003 => 0.4351, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/property: 8.48% (0.3940 => 0.4274, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.34% (1.3693 => 1.4698, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.09% (0.7710 => 0.8257, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.99% (0.5265 => 0.5633, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.2596 => 0.2777, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.96% (3.9660 => 4.2422, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.89% (0.4062 => 0.4342, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.71% (0.7038 => 0.7510, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 6.62% (0.2781 => 0.2965, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.36% (0.2782 => 0.2959, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.36% (0.2721 => 0.2894, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.10% (0.4390 => 0.4658, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.02% (0.2607 => 0.2764, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.99% (0.2690 => 0.2851, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4379 => 0.4641, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.90% (0.2761 => 0.2924, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.82% (0.2628 => 0.2781, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.79% (0.2937 => 0.3107, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.77% (0.2966 => 0.3137, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2726 => 0.2883, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.76% (0.3022 => 0.3196, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.75% (0.6959 => 0.7359, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3899 => 0.4123, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 5.71% (0.3293 => 0.3481, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.65% (0.3485 => 0.3682, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.65% (1.9828 => 2.0948, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 5.60% (0.3107 => 0.3281, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.57% (1.2193 => 1.2872, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.54% (0.5577 => 0.5886, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3489 => 0.3682, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2696 => 0.2845, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.49% (0.3149 => 0.3322, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.32% (13.8202 => 14.5560, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.26% (0.3192 => 0.3360, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.25% (0.9199 => 0.9682, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists1: 5.12% (0.3534 => 0.3715, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.11% (0.3756 => 0.3948, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 5.03% (16.6129 => 17.4479, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.91% (1.4563 => 1.5278, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.90% (7.2180 => 7.5715, std. dev.: 0.0065) MultiSource/Applications/spiff/spiff: 4.86% (0.7506 => 0.7871, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.71% (0.3868 => 0.4050, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.69% (13.2842 => 13.9071, std. dev.: 0.0094) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.55% (1.1364 => 1.1881, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.51% (0.5637 => 0.5891, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3246 => 0.3392, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.49% (1.1061 => 1.1558, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.44% (1.3245 => 1.3833, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.44% (1.9270 => 2.0125, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.40% (0.8310 => 0.8676, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 4.39% (3.8646 => 4.0344, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.34% (1.3813 => 1.4413, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (1.3819 => 1.4418, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.21% (0.7460 => 0.7774, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.20% (1.0594 => 1.1039, std. dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 4.04% (0.2995 => 0.3116, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.02% (1.2292 => 1.2786, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.96% (3.6692 => 3.8146, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.94% (0.3755 => 0.3903, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (4.3801 => 4.5525, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (4.4433 => 4.6147, std. dev.: 0.0088) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.80% (0.4791 => 0.4973, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.65% (2.1791 => 2.2587, std. dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.40% (1.1333 => 1.1718, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 3.35% (0.3131 => 0.3236, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.29% (0.6283 => 0.6490, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (8.4961 => 8.7735, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.23% (4.9865 => 5.1477, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.21% (0.8698 => 0.8977, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 3.20% (3.1889 => 3.2909, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4113 => 0.4243, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.11% (0.6135 => 0.6326, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.91% (6.5754 => 6.7670, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 2.81% (16.2614 => 16.7176, std. dev.: 0.0134) MultiSource/Applications/ClamAV/clamscan: 2.78% (14.5298 => 14.9341, std. dev.: 0.0120) MultiSource/Applications/JM/lencod/lencod: 2.74% (14.8535 => 15.2600, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (3.2742 => 3.3557, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.36% (1.5188 => 1.5547, std. dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 2.12% (4.6629 => 4.7618, std. dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/bigfib: 1.71% (0.6250 => 0.6357, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.64% (0.9108 => 0.9257, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.50% (0.6744 => 0.6845, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.43% (1.0313 => 1.0460, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.34% (3.7467 => 3.7969, std. dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: 1.34% (33.2944 => 33.7390, std. dev.: 0.0148) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.24% (6.2785 => 6.3565, std. dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5174, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.69% (1.8175 => 2.2663, std. dev.: 0.0431) SingleSource/Benchmarks/Misc/mandel-2: 7.44% (1.2998 => 1.3965, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.07% (0.9996 => 1.0503, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/salsa20: 4.36% (7.4271 => 7.7509, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7056, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4772, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.59% (1.7688 => 1.8146, std. dev.: 0.0175) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.24% (0.9692 => 0.9909, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5337, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4522, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (1.9290 => 1.9581, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.5928 => 4.6610, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5939, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.12% (1.9433 => 1.9650, std. dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 1.08% (10.7476 => 10.8633, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (3.1071 => 3.1387, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.34% (22.5627 => 21.1316, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.22% (0.3511 => 0.3398, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.35% (0.0997 => 0.0844, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.42% (1.2308 => 1.1026, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.22% (1.3780 => 1.3060, std. dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.12% (0.4867 => 0.4715, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.8259 => 8.5761, std. dev.: 0.0234) MultiSource/Applications/spiff/spiff: -2.67% (3.0263 => 2.9454, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.18% (20.3410 => 19.8970, std. dev.: 0.0587) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.3560 => 6.2201, std. dev.: 0.0108) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.03% (6.6320 => 6.4971, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.61% (0.6589 => 0.6483, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3305 => 7.2167, std. dev.: 0.0270) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2469, std. dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2210, std. dev.: 0.0308) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.13% (3.8887 => 3.8446, std. dev.: 0.0056) MultiSource/Applications/lua/lua: -1.07% (26.5159 => 26.2320, std. dev.: 0.0377) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jul 29 22:46:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 00:46:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120730054612.ED0A52A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2484?compare_to=2481&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2484, Order: 160942, Start Time: 2012-07-30 04:27:46, End Time: 2012-07-30 05:46:38 To: 2481, Order: 160939, Start Time: 2012-07-30 02:41:27, End Time: 2012-07-30 03:59:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (79 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (760 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.17% (53.6070 => 55.3039, std. dev.: 0.6062) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.80% (10.3673 => 13.5608, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3473 => 0.3892, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.78% (0.3497 => 0.3909, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.77% (0.3516 => 0.3930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.69% (0.3543 => 0.3957, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.69% (0.3543 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.60% (0.3561 => 0.3974, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.55% (1.1194 => 1.2487, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 11.40% (0.3694 => 0.4115, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.75% (0.3927 => 0.4349, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.69% (2.2022 => 2.3935, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.44% (1.7609 => 1.9096, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.3177 => 0.3376, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 6.10% (0.6030 => 0.6398, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 6.06% (0.5925 => 0.6284, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1892 => 0.1997, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.21% (0.4879 => 0.5133, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.03% (0.4615 => 0.4847, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.98% (10.4361 => 10.9561, std. dev.: 0.0066) SingleSource/UnitTests/ObjC++/property-reference: 4.86% (0.7326 => 0.7682, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.72% (7.0540 => 7.3866, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.28% (9.4845 => 9.8905, std. dev.: 0.0109) MultiSource/Applications/lambda-0_1_3/lambda: 4.22% (0.7433 => 0.7747, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (4.9449 => 5.1349, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.82% (5.0018 => 5.1928, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.77% (0.5569 => 0.5779, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.59% (0.8172 => 0.8465, std. dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.56% (0.3121 => 0.3232, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (4.2646 => 4.4151, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.41% (0.5860 => 0.6060, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.37% (8.1363 => 8.4104, std. dev.: 0.0062) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: 3.18% (0.7835 => 0.8084, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.16% (1.3050 => 1.3462, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (14.3668 => 14.8010, std. dev.: 0.0321) MultiSource/Applications/oggenc/oggenc: 3.02% (5.7591 => 5.9330, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.00% (1.1861 => 1.2217, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.88% (3.3354 => 3.4313, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.83% (1.1642 => 1.1972, std. dev.: 0.0066) MultiSource/Applications/treecc/treecc: 2.65% (2.0273 => 2.0811, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.57% (0.8067 => 0.8274, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 2.50% (1.5603 => 1.5993, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.41% (1.5415 => 1.5786, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 2.40% (3.8723 => 3.9653, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 2.40% (0.4299 => 0.4402, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.29% (0.5105 => 0.5222, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.24% (1.5859 => 1.6214, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.22% (0.9765 => 0.9982, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.08% (0.6450 => 0.6584, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.4186 => 1.4469, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 1.97% (0.6456 => 0.6583, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.93% (0.6675 => 0.6804, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5981 => 0.6096, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 1.89% (0.8921 => 0.9090, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.72% (2.0665 => 2.1020, std. dev.: 0.0050) MultiSource/Applications/siod/siod: 1.61% (2.2969 => 2.3338, std. dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 1.56% (17.1811 => 17.4489, std. dev.: 0.0191) MultiSource/Benchmarks/nbench/nbench: 1.49% (1.1840 => 1.2017, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.32% (1.2842 => 1.3011, std. dev.: 0.0029) MultiSource/Applications/lemon/lemon: 1.14% (1.0722 => 1.0844, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.95% (4.2280 => 4.3951, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.16% (3.6395 => 3.7545, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2162, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8318, std. dev.: 0.0011) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2034, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2266, std. dev.: 0.0268) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9196, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.01% (5.2763 => 3.1652, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.28% (5.3855 => 3.7007, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7091, std. dev.: 0.0067) SingleSource/UnitTests/Vector/constpool: -15.08% (54.1659 => 45.9994, std. dev.: 0.0991) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.19% (2.9384 => 2.5509, std. dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: -10.06% (22.1758 => 19.9454, std. dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4216, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.12% (1.2373 => 1.0997, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -6.02% (1.5373 => 1.4448, std. dev.: 0.0072) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.70% (1.9577 => 1.8656, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-5: -4.55% (1.5835 => 1.5115, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5961, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4744, std. dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.00% (8.1563 => 7.9120, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.82% (8.6802 => 8.4354, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0002, std. dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.35% (0.4808 => 0.4695, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -1.73% (12.5348 => 12.3179, std. dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4189, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.30% (1.8329 => 1.8090, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2496, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 00:13:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 02:13:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120730071356.F2BF32A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2485?compare_to=2483&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2485, Order: 160948, Start Time: 2012-07-30 05:57:21, End Time: 2012-07-30 07:14:21 To: 2483, Order: 160942, Start Time: 2012-07-30 04:15:07, End Time: 2012-07-30 05:29:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (97 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.73% (2.0176 => 2.3148, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.92% (0.5818 => 0.6395, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.84% (0.7061 => 0.7756, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.71% (0.5748 => 0.6306, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.28% (0.3578 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.05% (0.3601 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.02% (0.3646 => 0.3975, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 8.94% (0.3623 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.93% (0.3663 => 0.3990, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.89% (0.3789 => 0.4126, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.88% (0.3650 => 0.3974, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.79% (0.3914 => 0.4258, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.57% (0.4003 => 0.4346, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.53% (0.3940 => 0.4276, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0088) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.60% (0.7710 => 0.8296, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (0.4328 => 0.4616, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 6.54% (0.2781 => 0.2963, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.43% (0.2782 => 0.2961, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.32% (0.2721 => 0.2893, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.29% (0.2655 => 0.2822, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 6.28% (0.4062 => 0.4317, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.08% (0.3899 => 0.4136, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 6.06% (0.2690 => 0.2853, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.98% (0.2607 => 0.2763, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4379 => 0.4639, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.93% (0.2966 => 0.3142, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.90% (0.2765 => 0.2928, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.86% (0.3022 => 0.3199, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.83% (0.2760 => 0.2921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.82% (0.2628 => 0.2781, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.72% (0.2726 => 0.2882, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.69% (1.9828 => 2.0956, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.65% (0.2761 => 0.2917, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.64% (0.3580 => 0.3782, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.62% (0.3485 => 0.3681, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.60% (0.2696 => 0.2847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 5.46% (0.3149 => 0.3321, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.26% (0.3192 => 0.3360, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.25% (13.8202 => 14.5451, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sieve: 5.10% (0.3453 => 0.3629, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.03% (0.4390 => 0.4611, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 4.95% (0.3293 => 0.3456, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.89% (0.7506 => 0.7873, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.86% (0.4016 => 0.4211, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.82% (0.3756 => 0.3937, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.77% (1.4563 => 1.5258, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/moments: 4.73% (0.3868 => 0.4051, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.62% (13.2842 => 13.8975, std. dev.: 0.1205) MultiSource/Applications/Burg/burg: 4.50% (1.1061 => 1.1559, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.48% (0.2945 => 0.3077, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.43% (1.9270 => 2.0123, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.34% (1.3819 => 1.4419, std. dev.: 0.0071) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.74% (0.4791 => 0.4970, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.72% (2.1791 => 2.2602, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.26% (4.9865 => 5.1491, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.23% (0.6283 => 0.6486, std. dev.: 0.0043) MultiSource/Applications/d/make_dparser: 3.21% (3.1889 => 3.2914, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.18% (0.8698 => 0.8975, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.18% (8.4961 => 8.7659, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.60% (2.1007 => 2.1554, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.44% (3.2742 => 3.3542, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5188 => 1.5526, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.60% (0.6250 => 0.6350, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.36% (33.2944 => 33.7487, std. dev.: 0.0195) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5181, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/fbench: 24.28% (1.8175 => 2.2588, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/mandel-2: 8.34% (1.2998 => 1.4082, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.28% (0.9996 => 1.0524, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: 4.35% (7.4271 => 7.7503, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7029, std. dev.: 0.0269) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9663, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4779, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0310 => 1.0567, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (0.9692 => 0.9911, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5940, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1963, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1395, std. dev.: 0.0089) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1229, std. dev.: 0.0283) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.28% (0.3511 => 0.3396, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0078) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.65% (0.0997 => 0.0831, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2308 => 1.1015, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.18% (0.3139 => 0.2945, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3092, std. dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.95% (1.9762 => 1.9180, std. dev.: 0.0176) MultiSource/Applications/spiff/spiff: -2.67% (3.0263 => 2.9455, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.6003, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2324, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5078, std. dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.84% (20.3410 => 19.9660, std. dev.: 0.0483) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3305 => 7.2169, std. dev.: 0.0263) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8644, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.5254 => 2.4918, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.3167 => 5.2462, std. dev.: 0.0094) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 00:35:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 02:35:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120730073509.B27E92A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/2486?compare_to=2484&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2486, Order: 160948, Start Time: 2012-07-30 06:14:37, End Time: 2012-07-30 07:35:36 To: 2484, Order: 160942, Start Time: 2012-07-30 04:27:46, End Time: 2012-07-30 05:46:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (68 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (770 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.05% (0.5357 => 0.5467, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.25% (80.8517 => 79.0335, std. dev.: 0.3220) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.86% (10.3673 => 13.5665, std. dev.: 0.1660) SingleSource/UnitTests/ObjC/trivial-interface: 11.92% (0.3473 => 0.3887, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.69% (0.3543 => 0.3957, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 11.66% (0.3516 => 0.3926, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.63% (1.1194 => 1.2496, std. dev.: 0.0098) SingleSource/UnitTests/ObjC/exceptions-2: 11.61% (0.3497 => 0.3903, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.60% (0.3561 => 0.3974, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.29% (0.3694 => 0.4111, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.08% (0.3828 => 0.4252, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.3927 => 0.4346, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.71% (2.2022 => 2.3941, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.50% (1.7609 => 1.9105, std. dev.: 0.0267) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.30% (0.3177 => 0.3377, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/Hello: 5.96% (0.5925 => 0.6278, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 5.94% (0.6030 => 0.6388, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.00% (10.4361 => 10.9575, std. dev.: 0.0223) SingleSource/UnitTests/ObjC++/property-reference: 4.86% (0.7326 => 0.7682, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/oourafft: 4.72% (0.3282 => 0.3437, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.25% (0.7433 => 0.7749, std. dev.: 0.0102) MultiSource/Benchmarks/mafft/pairlocalalign: 4.22% (9.4845 => 9.8850, std. dev.: 0.0808) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.82% (5.0018 => 5.1931, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.72% (0.5569 => 0.5776, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.56% (4.2646 => 4.4166, std. dev.: 0.0178) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3423 => 0.3540, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3180 => 0.3288, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.38% (0.5860 => 0.6058, std. dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.27% (8.1363 => 8.4024, std. dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.08% (1.1861 => 1.2226, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.07% (1.3050 => 1.3450, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 3.06% (0.7835 => 0.8075, std. dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 3.01% (5.7591 => 5.9326, std. dev.: 0.0052) MultiSource/Applications/d/make_dparser: 2.62% (3.3354 => 3.4227, std. dev.: 0.0039) MultiSource/Applications/treecc/treecc: 2.59% (2.0273 => 2.0799, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 2.54% (0.4299 => 0.4408, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 2.48% (1.5603 => 1.5990, std. dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.33% (0.5105 => 0.5224, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 2.31% (3.8723 => 3.9618, std. dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.29% (1.5859 => 1.6222, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.25% (0.9765 => 0.9985, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.20% (2.2024 => 2.2509, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6450 => 0.6585, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.02% (1.4186 => 1.4472, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.01% (0.5981 => 0.6101, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.96% (0.6675 => 0.6806, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.94% (0.6456 => 0.6581, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 1.89% (0.8921 => 0.9090, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.59% (17.1811 => 17.4543, std. dev.: 0.0087) MultiSource/Applications/minisat/minisat: 1.48% (0.7115 => 0.7220, std. dev.: 0.0038) MultiSource/Applications/siod/siod: 1.44% (2.2969 => 2.3299, std. dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 1.24% (1.2842 => 1.3001, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.12% (1.0722 => 1.0842, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.39% (4.2280 => 4.4138, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7515, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.76% (3.1578 => 3.2134, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8336, std. dev.: 0.0089) MultiSource/Applications/aha/aha: 1.38% (3.1595 => 3.2030, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2258, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.09% (1.3045 => 1.3187, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.98% (5.2763 => 3.1668, std. dev.: 0.0506) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.28% (5.3855 => 3.7008, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7096, std. dev.: 0.0577) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0049, std. dev.: 0.0221) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.34% (2.9384 => 2.5464, std. dev.: 0.0395) MultiSource/Applications/ClamAV/clamscan: -10.12% (22.1758 => 19.9319, std. dev.: 0.0491) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.13% (0.0998 => 0.0837, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1073, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -5.56% (1.5373 => 1.4518, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0256) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5960, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (1.9577 => 1.8698, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-5: -4.47% (1.5835 => 1.5127, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4843, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.97% (8.1563 => 7.9143, std. dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.6802 => 8.4337, std. dev.: 0.0783) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0019, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.78% (12.5348 => 12.3118, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6795, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4177, std. dev.: 0.0323) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8094, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -1.02% (3.2827 => 3.2491, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 01:17:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 03:17:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120730081751.CB2CE2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2487?compare_to=2482&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2487, Order: 160946, Start Time: 2012-07-30 05:30:45, End Time: 2012-07-30 08:18:17 To: 2482, Order: 160939, Start Time: 2012-07-30 02:19:34, End Time: 2012-07-30 05:03:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (78 on baseline) Performance Improvements: 0 (10 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (806 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3446 => 0.3917, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.57% (0.3442 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.56% (0.3465 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.47% (0.3496 => 0.3967, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.47% (0.3460 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.42% (0.3488 => 0.3956, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 13.35% (0.3469 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.01% (0.3643 => 0.4117, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.93% (0.3650 => 0.4122, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.65% (0.3724 => 0.4195, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.19% (0.5826 => 0.6245, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.1620 => 0.1733, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 6.86% (0.5889 => 0.6293, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 6.44% (1.5932 => 1.6958, std. dev.: 0.0287) SingleSource/UnitTests/ObjC++/property-reference: 5.51% (0.7171 => 0.7566, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.26% (0.5000 => 0.5263, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.21% (0.4994 => 0.5254, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.2014 => 0.2118, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.03% (1.3152 => 1.3814, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: 4.79% (0.4029 => 0.4222, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 4.73% (1.0781 => 1.1291, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.64% (0.5900 => 0.6174, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.62% (0.5026 => 0.5258, std. dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.55% (2.7292 => 2.8535, std. dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 4.01% (23.5202 => 24.4645, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/hello: 3.87% (0.2714 => 0.2819, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.83% (0.2875 => 0.2985, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (0.3195 => 0.3317, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.80% (1.9694 => 2.0442, std. dev.: 0.0073) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.3004 => 0.3118, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 3.78% (2.1013 => 2.1807, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.77% (1.9966 => 2.0719, std. dev.: 0.0131) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.70% (0.3890 => 0.4034, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 3.68% (5.5417 => 5.7459, std. dev.: 0.0340) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2750 => 0.2851, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.67% (0.2780 => 0.2882, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.65% (0.2738 => 0.2838, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.58% (0.2792 => 0.2892, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.56% (2.0673 => 2.1409, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.47% (4.4195 => 4.5728, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: 3.46% (0.3096 => 0.3203, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3362 => 0.3475, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 3.34% (0.3267 => 0.3376, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.31% (0.3258 => 0.3366, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.30% (0.3060 => 0.3161, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.22% (0.3726 => 0.3846, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.14% (0.3282 => 0.3385, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.10% (0.7875 => 0.8119, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 3.08% (0.3317 => 0.3419, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.04% (0.4146 => 0.4272, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 2.99% (0.3348 => 0.3448, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 2.93% (0.3477 => 0.3579, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (0.3625 => 0.3731, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.76% (0.3690 => 0.3792, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.66% (0.3981 => 0.4087, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.66% (0.4251 => 0.4364, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.51% (0.5546 => 0.5685, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.43% (0.6634 => 0.6795, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.5012 => 0.5131, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.27% (0.6435 => 0.6581, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (2.5769 => 2.9635, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6765, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-2: 4.97% (1.8057 => 1.8955, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1640, std. dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6766, std. dev.: 0.0435) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1996, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4586, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4969, std. dev.: 0.0155) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2265, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.53% (2.0820 => 2.1138, std. dev.: 0.0084) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1063, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.95% (25.4195 => 16.5346, std. dev.: 0.0156) SingleSource/Benchmarks/Dhrystone/fldry: -8.40% (17.2379 => 15.7905, std. dev.: 0.0851) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std. dev.: 0.0410) SingleSource/Benchmarks/Shootout-C++/ary2: -7.66% (0.2402 => 0.2218, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7999, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/moments: -4.01% (0.4438 => 0.4260, std. dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8002, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: -3.59% (14.0481 => 13.5436, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5747, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 01:56:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 03:56:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120730085620.E99CC2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2488?compare_to=2485&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2488, Order: 160951, Start Time: 2012-07-30 07:42:37, End Time: 2012-07-30 08:56:47 To: 2485, Order: 160948, Start Time: 2012-07-30 05:57:21, End Time: 2012-07-30 07:14:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (145 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.87% (54.4472 => 56.5518, std. dev.: 0.1229) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.52% (79.3303 => 81.3279, std. dev.: 0.1823) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.68% (2.0176 => 2.3138, std. dev.: 0.0069) SingleSource/UnitTests/ObjC++/property-reference-object: 9.85% (0.5818 => 0.6391, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.67% (0.5748 => 0.6304, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.52% (0.7061 => 0.7733, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 9.25% (0.3578 => 0.3909, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.24% (0.3646 => 0.3983, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.22% (0.3601 => 0.3933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.04% (0.3663 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.99% (0.3650 => 0.3978, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 8.94% (0.3623 => 0.3947, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.92% (0.3789 => 0.4127, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.89% (0.3914 => 0.4262, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.72% (0.4003 => 0.4352, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.58% (0.3940 => 0.4278, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 7.34% (1.3693 => 1.4698, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.15% (0.7710 => 0.8261, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.03% (3.9660 => 4.2447, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2596 => 0.2776, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.82% (0.5265 => 0.5624, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (0.4328 => 0.4616, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.64% (0.7038 => 0.7505, std. dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 6.58% (0.2781 => 0.2964, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2782 => 0.2962, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.28% (0.2721 => 0.2892, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.11% (0.4062 => 0.4310, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 6.06% (0.2607 => 0.2765, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.06% (0.2690 => 0.2853, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.99% (0.6959 => 0.7376, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4379 => 0.4641, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.98% (0.2726 => 0.2889, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.97% (0.4390 => 0.4652, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2655 => 0.2812, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.90% (0.2966 => 0.3141, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.90% (0.3899 => 0.4129, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.90% (0.2765 => 0.2928, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.89% (0.2937 => 0.3110, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.86% (0.2628 => 0.2782, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.86% (0.3022 => 0.3199, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.80% (0.2761 => 0.2921, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.75% (1.2193 => 1.2894, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 5.72% (0.2760 => 0.2918, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.70% (1.9828 => 2.0958, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.68% (0.3485 => 0.3683, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.63% (0.3107 => 0.3282, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2696 => 0.2846, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3489 => 0.3682, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.49% (0.3149 => 0.3322, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.39% (0.2988 => 0.3149, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.36% (0.3192 => 0.3363, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.35% (13.8202 => 14.5602, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.34% (0.9199 => 0.9690, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.31% (0.5577 => 0.5873, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 5.18% (0.3453 => 0.3632, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.15% (0.3534 => 0.3716, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.13% (0.3293 => 0.3462, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 5.09% (16.6129 => 17.4588, std. dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.95% (0.3756 => 0.3942, std. dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: 4.95% (0.2243 => 0.2354, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.91% (0.4016 => 0.4213, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.88% (7.2180 => 7.5701, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.86% (1.4563 => 1.5271, std. dev.: 0.0031) MultiSource/Applications/spiff/spiff: 4.80% (0.7506 => 0.7866, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.77% (0.2914 => 0.3053, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 4.76% (0.3868 => 0.4052, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.66% (13.2842 => 13.9039, std. dev.: 0.0225) MultiSource/Benchmarks/MallocBench/gs/gs: 4.66% (3.8646 => 4.0446, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5637 => 0.5899, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3246 => 0.3395, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.57% (1.1364 => 1.1883, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 4.57% (1.1061 => 1.1566, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.52% (0.2945 => 0.3078, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.49% (0.8310 => 0.8683, std. dev.: 0.0136) MultiSource/Applications/treecc/treecc: 4.46% (1.9270 => 2.0130, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.43% (1.3245 => 1.3832, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.40% (1.3813 => 1.4421, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.36% (1.3819 => 1.4422, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.26% (0.7460 => 0.7778, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.23% (1.0594 => 1.1042, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 4.17% (1.2292 => 1.2805, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 4.10% (0.3220 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.01% (3.6692 => 3.8164, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (4.3801 => 4.5524, std. dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.89% (4.4433 => 4.6160, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 3.79% (2.1791 => 2.2616, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.75% (0.3755 => 0.3896, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.74% (0.4791 => 0.4970, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.51% (1.1333 => 1.1731, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.37% (4.9865 => 5.1543, std. dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 3.35% (0.3131 => 0.3236, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.6283 => 0.6491, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.25% (8.4961 => 8.7722, std. dev.: 0.0077) MultiSource/Applications/d/make_dparser: 3.21% (3.1889 => 3.2913, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.19% (0.6135 => 0.6331, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 3.19% (0.4113 => 0.4244, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.16% (0.8698 => 0.8973, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (6.5754 => 6.7664, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: 2.77% (14.5298 => 14.9318, std. dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: 2.76% (16.2614 => 16.7096, std. dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 2.72% (14.8535 => 15.2569, std. dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (2.1007 => 2.1557, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.47% (3.2742 => 3.3551, std. dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: 2.20% (4.6629 => 4.7657, std. dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.65% (0.9108 => 0.9258, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.55% (1.0313 => 1.0473, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 1.37% (33.2944 => 33.7492, std. dev.: 0.0169) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.28% (6.2785 => 6.3587, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 1.26% (3.7467 => 3.7940, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5157, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/fbench: 25.02% (1.8175 => 2.2722, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: 8.59% (1.2998 => 1.4114, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.46% (0.9996 => 1.0542, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 4.43% (7.4271 => 7.7561, std. dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7071, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4775, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.64% (1.7688 => 1.8155, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (0.9692 => 0.9911, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0052) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std. dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5928 => 4.6627, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.5089 => 1.5318, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5945, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1398, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.25% (22.5627 => 21.1522, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.3511 => 0.3397, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.15% (0.0997 => 0.0826, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -10.34% (1.2308 => 1.1035, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3107, std. dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.66% (3.0263 => 2.9458, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6056, std. dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9419, std. dev.: 0.0631) SingleSource/Benchmarks/Shootout/lists: -1.93% (6.3560 => 6.2333, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5087, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3305 => 7.2175, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8613, std. dev.: 0.0119) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2524, std. dev.: 0.0024) MultiSource/Applications/lua/lua: -1.16% (26.5159 => 26.2095, std. dev.: 0.0135) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2362, std. dev.: 0.0327) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 02:22:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 04:22:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120730092213.1572D2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2489?compare_to=2486&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2489, Order: 160954, Start Time: 2012-07-30 08:03:49, End Time: 2012-07-30 09:22:38 To: 2486, Order: 160948, Start Time: 2012-07-30 06:14:37, End Time: 2012-07-30 07:35:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (76 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (763 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.18% (13.5665 => 13.7269, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.94% (79.0335 => 80.5664, std. dev.: 0.2728) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.41% (10.3673 => 13.7269, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3473 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3497 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 11.63% (0.3516 => 0.3925, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.54% (0.3561 => 0.3972, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.38% (1.1194 => 1.2468, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: 11.34% (0.3694 => 0.4113, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.62% (0.3927 => 0.4344, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.34% (2.2022 => 2.3859, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.18% (1.7609 => 1.9049, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.34% (0.2065 => 0.2196, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 6.06% (0.5925 => 0.6284, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.3177 => 0.3367, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.97% (0.1892 => 0.2005, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 5.94% (0.6030 => 0.6388, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.19% (0.3121 => 0.3283, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.98% (0.4879 => 0.5122, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 4.90% (0.7326 => 0.7685, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 4.84% (10.4361 => 10.9409, std. dev.: 0.0152) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.68% (0.4615 => 0.4831, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.67% (7.0540 => 7.3831, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 4.03% (9.4845 => 9.8663, std. dev.: 0.0118) MultiSource/Applications/lambda-0_1_3/lambda: 4.02% (0.7433 => 0.7732, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.84% (0.5860 => 0.6085, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.81% (0.8172 => 0.8483, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (5.0018 => 5.1893, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.72% (4.9449 => 5.1287, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.61% (0.5569 => 0.5770, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.39% (4.2646 => 4.4091, std. dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 3.16% (5.7591 => 5.9410, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.09% (8.1363 => 8.3879, std. dev.: 0.0117) MultiSource/Applications/spiff/spiff: 2.97% (0.7835 => 0.8068, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.85% (14.3668 => 14.7768, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.81% (1.3050 => 1.3417, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.77% (1.1861 => 1.2190, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.64% (0.8067 => 0.8280, std. dev.: 0.0075) MultiSource/Applications/hbd/hbd: 2.49% (1.5603 => 1.5992, std. dev.: 0.0070) MultiSource/Applications/Burg/burg: 2.49% (1.1642 => 1.1932, std. dev.: 0.0083) MultiSource/Applications/d/make_dparser: 2.46% (3.3354 => 3.4175, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.37% (1.5415 => 1.5781, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.27% (2.0273 => 2.0733, std. dev.: 0.0038) MultiSource/Applications/lua/lua: 2.14% (3.8723 => 3.9552, std. dev.: 0.0228) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.10% (0.5105 => 0.5212, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 2.03% (0.6456 => 0.6587, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.03% (0.9765 => 0.9963, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.02% (2.0665 => 2.1083, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.96% (1.5859 => 1.6170, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6450 => 0.6574, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.87% (2.2024 => 2.2436, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6675 => 0.6792, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.75% (1.4186 => 1.4434, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.72% (0.5981 => 0.6084, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 1.69% (0.8921 => 0.9072, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.40% (17.1811 => 17.4215, std. dev.: 0.0220) MultiSource/Applications/hexxagon/hexxagon: 1.37% (1.2842 => 1.3018, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.30% (1.1840 => 1.1994, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.25% (2.2969 => 2.3255, std. dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9734, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.19% (4.2280 => 4.4052, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7527, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0313 => 1.0566, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.83% (3.1578 => 3.2155, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5086 => 1.5333, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8317, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.46% (9.1159 => 9.2489, std. dev.: 0.0027) MultiSource/Applications/aha/aha: 1.37% (3.1595 => 3.2028, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 1.04% (2.2771 => 2.3007, std. dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9196, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1287, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.92% (5.2763 => 3.1698, std. dev.: 0.0080) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.29% (5.3855 => 3.7006, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.72% (5.3526 => 3.7082, std. dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -15.08% (54.1659 => 45.9975, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.51% (2.9384 => 2.5415, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -10.30% (22.1758 => 19.8923, std. dev.: 0.0342) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.05% (3.8922 => 3.8512, std. dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4241, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.54% (1.2373 => 1.1069, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel-2: -6.50% (1.5373 => 1.4374, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5538, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -4.63% (1.9577 => 1.8671, std. dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5961, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4799, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.15% (8.1563 => 7.8991, std. dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.15% (8.6802 => 8.4067, std. dev.: 0.0198) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0005, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3197, std. dev.: 0.0062) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.54% (9.5636 => 9.4165, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8088, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 03:38:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 05:38:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120730103831.1E4952A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2490?compare_to=2488&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2490, Order: 160954, Start Time: 2012-07-30 09:25:01, End Time: 2012-07-30 10:38:57 To: 2488, Order: 160951, Start Time: 2012-07-30 07:42:37, End Time: 2012-07-30 08:56:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (150 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.07% (2.0176 => 2.3216, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.83% (0.5818 => 0.6390, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.59% (0.5748 => 0.6299, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.50% (0.3578 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.43% (0.3646 => 0.3990, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.33% (0.3601 => 0.3937, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.19% (0.3623 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.15% (0.3650 => 0.3984, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/synchronized: 9.15% (0.3663 => 0.3998, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.11% (0.7061 => 0.7704, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: 9.08% (0.3789 => 0.4133, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.99% (0.3914 => 0.4266, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.82% (0.4003 => 0.4356, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.73% (0.3940 => 0.4284, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.26% (0.1986 => 0.2150, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.41% (1.3693 => 1.4708, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.21% (0.7710 => 0.8266, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.07% (3.9660 => 4.2463, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.99% (0.5265 => 0.5633, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.79% (0.4328 => 0.4622, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.64% (0.7038 => 0.7505, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.47% (0.4062 => 0.4325, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2781 => 0.2960, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.36% (0.2782 => 0.2959, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4379 => 0.4644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.02% (0.2607 => 0.2764, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.88% (1.2193 => 1.2910, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.87% (0.2690 => 0.2848, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.83% (0.6959 => 0.7365, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3022 => 0.3197, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.76% (0.2760 => 0.2919, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.75% (0.2628 => 0.2779, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.72% (0.2937 => 0.3105, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.72% (0.3899 => 0.4122, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.70% (1.9828 => 2.0959, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 5.65% (0.2761 => 0.2917, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/strcat: 5.65% (0.2726 => 0.2880, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.62% (0.3485 => 0.3681, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.59% (0.3580 => 0.3780, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3107 => 0.3280, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2696 => 0.2846, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (0.9199 => 0.9703, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.46% (0.3149 => 0.3321, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.43% (13.8202 => 14.5709, std. dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.42% (0.5577 => 0.5879, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.26% (0.3192 => 0.3360, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.18% (0.3453 => 0.3632, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.15% (0.3534 => 0.3716, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.12% (0.2127 => 0.2236, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.10% (0.4390 => 0.4614, std. dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 5.08% (16.6129 => 17.4563, std. dev.: 0.0190) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.03% (7.2180 => 7.5814, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.01% (1.4563 => 1.5293, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.99% (0.2243 => 0.2355, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.92% (0.3293 => 0.3455, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.91% (0.4016 => 0.4213, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.88% (0.7506 => 0.7872, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.86% (0.3868 => 0.4056, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.85% (13.2842 => 13.9284, std. dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (0.3756 => 0.3938, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.83% (0.5637 => 0.5909, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.1364 => 1.1903, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.65% (0.3246 => 0.3397, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.64% (1.3245 => 1.3859, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.62% (1.1061 => 1.1572, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 4.61% (0.8310 => 0.8693, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.52% (1.3813 => 1.4438, std. dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 4.50% (1.0594 => 1.1071, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.47% (1.9270 => 2.0131, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.46% (1.3819 => 1.4435, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.37% (0.7460 => 0.7786, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 4.36% (3.8646 => 4.0332, std. dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 4.31% (0.2995 => 0.3124, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (4.4433 => 4.6281, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.15% (3.6692 => 3.8215, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.11% (4.3801 => 4.5600, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 4.08% (1.2292 => 1.2794, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 4.07% (0.3220 => 0.3351, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.84% (0.4791 => 0.4975, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.70% (2.1791 => 2.2597, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/05-eks/eks: 3.57% (0.4113 => 0.4260, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.57% (1.1333 => 1.1738, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3755 => 0.3888, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.28% (0.6283 => 0.6489, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.27% (0.8698 => 0.8982, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.24% (0.6135 => 0.6334, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.24% (8.4961 => 8.7710, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.20% (4.9865 => 5.1462, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 3.20% (3.1889 => 3.2910, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 2.98% (6.5754 => 6.7714, std. dev.: 0.0140) MultiSource/Applications/sqlite3/sqlite3: 2.87% (16.2614 => 16.7273, std. dev.: 0.0107) MultiSource/Applications/JM/lencod/lencod: 2.84% (14.8535 => 15.2753, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 2.82% (14.5298 => 14.9396, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.72% (3.2742 => 3.3633, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.69% (2.1007 => 2.1573, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.5188 => 1.5553, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.19% (4.6629 => 4.7648, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.86% (0.9108 => 0.9277, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 1.66% (0.6250 => 0.6354, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.51% (0.6744 => 0.6846, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.34% (6.2785 => 6.3629, std. dev.: 0.0041) MultiSource/Applications/lua/lua: 1.29% (3.7467 => 3.7949, std. dev.: 0.0106) MultiSource/Benchmarks/Bullet/bullet: 1.28% (33.2944 => 33.7200, std. dev.: 0.0264) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5193, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.60% (1.8175 => 2.2646, std. dev.: 0.0174) SingleSource/Benchmarks/Misc/mandel-2: 8.66% (1.2998 => 1.4124, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.27% (0.9996 => 1.0523, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 4.39% (7.4271 => 7.7535, std. dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7047, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4770, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.59% (1.7688 => 1.8147, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.49% (4.5928 => 4.6611, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5941, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (3.1071 => 3.1387, std. dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.39% (22.5627 => 21.1214, std. dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.02% (0.2670 => 0.2536, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.76% (0.0997 => 0.0810, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.14% (1.2308 => 1.1060, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.63% (1.3780 => 1.3142, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5852, std. dev.: 0.0132) MultiSource/Applications/spiff/spiff: -2.56% (3.0263 => 2.9488, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2244, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.07% (20.3410 => 19.9199, std. dev.: 0.0607) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5068, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3305 => 7.2154, std. dev.: 0.0371) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2220, std. dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2565, std. dev.: 0.0017) MultiSource/Applications/lua/lua: -1.03% (26.5159 => 26.2421, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8495, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 04:30:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 06:30:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120730113000.9FF4C2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2491?compare_to=2487&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2491, Order: 160954, Start Time: 2012-07-30 08:46:28, End Time: 2012-07-30 11:30:27 To: 2487, Order: 160946, Start Time: 2012-07-30 05:30:45, End Time: 2012-07-30 08:18:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (83 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (799 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 13.62% (0.3496 => 0.3972, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.58% (0.3446 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.56% (0.3465 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.52% (0.3469 => 0.3938, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.48% (0.3442 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.41% (0.3460 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.30% (0.3488 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.93% (0.3650 => 0.4122, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.93% (0.3643 => 0.4114, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.54% (0.3724 => 0.4191, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.21% (0.5826 => 0.6246, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1620 => 0.1735, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 6.93% (0.5889 => 0.6297, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.60% (1.5932 => 1.6984, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 5.79% (0.7171 => 0.7586, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.54% (3.5627 => 3.7599, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.53% (1.6211 => 1.7108, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.13% (0.5026 => 0.5284, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.11% (0.4994 => 0.5249, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.10% (0.5900 => 0.6201, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 5.02% (1.0781 => 1.1322, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.98% (0.4361 => 0.4578, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.81% (0.3930 => 0.4119, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.80% (1.3152 => 1.3783, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.78% (0.5000 => 0.5239, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.67% (0.4029 => 0.4217, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 4.48% (4.2109 => 4.3994, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.41% (2.7292 => 2.8495, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 4.25% (0.2566 => 0.2675, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.09% (0.2738 => 0.2850, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.94% (0.2866 => 0.2979, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.2736 => 0.2843, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 3.87% (23.5202 => 24.4305, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (1.9694 => 2.0454, std. dev.: 0.0066) MultiSource/Applications/SPASS/SPASS: 3.80% (5.5417 => 5.7522, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.66% (0.3195 => 0.3312, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.65% (0.2875 => 0.2980, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (2.1013 => 2.1780, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.63% (1.9966 => 2.0690, std. dev.: 0.0032) SingleSource/Regression/C++/ofstream_ctor: 3.60% (0.3004 => 0.3112, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.48% (2.1653 => 2.2407, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.48% (0.9909 => 1.0254, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.44% (4.6177 => 4.7767, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.37% (0.3890 => 0.4021, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.37% (0.3625 => 0.3747, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.33% (0.4658 => 0.4813, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.32% (2.0673 => 2.1359, std. dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.30% (4.4195 => 4.5655, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.27% (0.3060 => 0.3160, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.24% (0.3362 => 0.3471, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3258 => 0.3361, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.08% (1.8794 => 1.9373, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.05% (0.3903 => 0.4022, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 3.02% (0.3678 => 0.3789, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.97% (0.4139 => 0.4262, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.97% (1.4269 => 1.4693, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.93% (0.7875 => 0.8106, std. dev.: 0.0051) MultiSource/Applications/siod/siod: 2.89% (0.6634 => 0.6826, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 2.87% (0.3726 => 0.3833, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.4146 => 0.4257, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 2.52% (0.4251 => 0.4358, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.52% (0.9697 => 0.9941, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.16% (0.6435 => 0.6574, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 2.09% (0.5012 => 0.5117, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.39% (2.0346 => 2.0629, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.25% (0.2162 => 0.3551, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 8.72% (0.2122 => 0.2307, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6649, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8944, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1694, std. dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6369, std. dev.: 0.0654) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2107, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4952, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5926, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2213, std. dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.53% (2.4764 => 2.3891, std. dev.: 0.0210) MultiSource/Applications/kimwitu++/kc: -1.29% (11.9555 => 11.8008, std. dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.94% (25.4195 => 16.5386, std. dev.: 0.0127) SingleSource/Benchmarks/Dhrystone/fldry: -8.78% (17.2379 => 15.7242, std. dev.: 0.2081) SingleSource/Benchmarks/Shootout-C++/ary2: -8.12% (0.2402 => 0.2207, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9742, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7900, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/moments: -4.08% (0.4438 => 0.4257, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7993, std. dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/dry: -3.57% (14.0481 => 13.5472, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5192, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5724, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 05:54:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 07:54:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120730125402.9ADE83524034@llvm.org> http://llvm.org/perf/db_default/v4/nts/2492?compare_to=2490&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2492, Order: 160958, Start Time: 2012-07-30 11:40:35, End Time: 2012-07-30 12:54:29 To: 2490, Order: 160954, Start Time: 2012-07-30 09:25:01, End Time: 2012-07-30 10:38:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (151 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.52% (78.7629 => 80.7474, std. dev.: 0.1474) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.20% (2.0176 => 2.3242, std. dev.: 0.0164) SingleSource/UnitTests/ObjC++/property-reference-object: 9.71% (0.5818 => 0.6383, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 9.59% (0.3578 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.45% (0.5748 => 0.6291, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.44% (0.3601 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.35% (0.3646 => 0.3987, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.32% (0.3650 => 0.3990, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 9.25% (0.3663 => 0.4002, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.25% (0.3623 => 0.3958, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.21% (0.3789 => 0.4138, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.07% (0.3914 => 0.4269, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.05% (0.7061 => 0.7700, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 8.92% (0.4003 => 0.4360, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.83% (0.3940 => 0.4288, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.33% (1.3693 => 1.4697, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.20% (3.9660 => 4.2515, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.05% (0.5265 => 0.5636, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.84% (0.4328 => 0.4624, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.80% (0.7710 => 0.8234, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.72% (0.7038 => 0.7511, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 6.47% (0.2781 => 0.2961, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.25% (0.2782 => 0.2956, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.20% (0.4062 => 0.4314, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.19% (0.4379 => 0.4650, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.16% (0.6959 => 0.7388, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.87% (0.2690 => 0.2848, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.85% (1.2193 => 1.2906, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3580 => 0.3788, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.80% (0.2655 => 0.2809, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.75% (0.2765 => 0.2924, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3022 => 0.3194, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 5.69% (0.2760 => 0.2917, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.67% (0.2628 => 0.2777, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.66% (0.2966 => 0.3134, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.64% (0.3899 => 0.4119, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.62% (0.3485 => 0.3681, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.61% (0.2761 => 0.2916, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.59% (0.1789 => 0.1889, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.53% (1.9828 => 2.0924, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 5.50% (13.8202 => 14.5800, std. dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.3107 => 0.3277, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.45% (0.2696 => 0.2843, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.43% (0.5577 => 0.5880, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.3149 => 0.3318, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.31% (0.2127 => 0.2240, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.30% (0.9199 => 0.9687, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 5.20% (0.3192 => 0.3358, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3453 => 0.3630, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.12% (1.4563 => 1.5308, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/lists1: 5.09% (0.3534 => 0.3714, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (0.3756 => 0.3947, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.07% (7.2180 => 7.5837, std. dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 5.05% (16.6129 => 17.4511, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.04% (0.2914 => 0.3061, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.96% (0.4016 => 0.4215, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: 4.95% (0.3293 => 0.3456, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.92% (0.4390 => 0.4606, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.90% (13.2842 => 13.9347, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 4.78% (0.3868 => 0.4053, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.1364 => 1.1903, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 4.74% (0.8310 => 0.8704, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.2140 => 0.2241, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5637 => 0.5902, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.70% (1.3245 => 1.3867, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.69% (0.7506 => 0.7858, std. dev.: 0.0070) MultiSource/Applications/Burg/burg: 4.64% (1.1061 => 1.1574, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3246 => 0.3396, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.61% (1.0594 => 1.1082, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (0.7460 => 0.7800, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.50% (1.9270 => 2.0137, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 4.47% (3.8646 => 4.0372, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.44% (1.3813 => 1.4426, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.41% (1.3819 => 1.4428, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.2945 => 0.3072, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.25% (3.6692 => 3.8252, std. dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 4.21% (0.2995 => 0.3121, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.19% (1.2292 => 1.2807, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.16% (4.3801 => 4.5621, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 4.13% (0.3220 => 0.3353, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.13% (4.4433 => 4.6267, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.88% (0.4791 => 0.4977, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.74% (1.1333 => 1.1757, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.74% (2.1791 => 2.2606, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 3.60% (0.4113 => 0.4261, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.50% (0.2859 => 0.2959, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.44% (0.6283 => 0.6499, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.42% (0.6135 => 0.6345, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.33% (8.4961 => 8.7794, std. dev.: 0.0150) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.30% (4.9865 => 5.1510, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 3.29% (3.1889 => 3.2938, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.28% (0.8698 => 0.8983, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.09% (6.5754 => 6.7784, std. dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 2.97% (14.5298 => 14.9618, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 2.85% (14.8535 => 15.2773, std. dev.: 0.0201) MultiSource/Applications/sqlite3/sqlite3: 2.84% (16.2614 => 16.7233, std. dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.81% (2.1007 => 2.1597, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (3.2742 => 3.3654, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.65% (1.5188 => 1.5591, std. dev.: 0.0065) MultiSource/Applications/oggenc/oggenc: 2.37% (4.6629 => 4.7736, std. dev.: 0.0132) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.93% (0.9108 => 0.9284, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.82% (0.6250 => 0.6364, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.75% (0.6744 => 0.6862, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.72% (1.0313 => 1.0490, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.46% (3.7467 => 3.8014, std. dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.33% (6.2785 => 6.3619, std. dev.: 0.0155) MultiSource/Benchmarks/Bullet/bullet: 1.33% (33.2944 => 33.7357, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5152, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2618, std. dev.: 0.0480) SingleSource/Benchmarks/Misc/mandel-2: 9.11% (1.2998 => 1.4182, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.17% (0.9996 => 1.0513, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/salsa20: 4.47% (7.4271 => 7.7589, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7058, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4782, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8153, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5349, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5950, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.47% (4.5928 => 4.6602, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.5627 => 21.1471, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.15% (0.0997 => 0.0816, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.75% (1.2308 => 1.1108, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.38% (1.3780 => 1.3039, std. dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std. dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9445, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.45% (8.8259 => 8.6095, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2295, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5055, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.74% (20.3410 => 19.9878, std. dev.: 0.0347) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3305 => 7.2132, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2471, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8664, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2237, std. dev.: 0.0323) MultiSource/Applications/lua/lua: -1.12% (26.5159 => 26.2196, std. dev.: 0.0431) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 05:58:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 07:58:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120730125835.144523524034@llvm.org> http://llvm.org/perf/db_default/v4/nts/2493?compare_to=2489&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2493, Order: 160958, Start Time: 2012-07-30 11:40:34, End Time: 2012-07-30 12:59:01 To: 2489, Order: 160954, Start Time: 2012-07-30 08:03:49, End Time: 2012-07-30 09:22:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (74 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.45% (10.3673 => 13.7319, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 12.32% (0.3473 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.03% (0.3516 => 0.3939, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 11.93% (0.3561 => 0.3986, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.92% (0.3497 => 0.3914, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.91% (0.3543 => 0.3965, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.85% (0.3543 => 0.3963, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.78% (0.3694 => 0.4129, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.36% (1.1194 => 1.2466, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3828 => 0.4258, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.99% (0.3886 => 0.4313, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 10.87% (0.3927 => 0.4354, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.36% (2.2022 => 2.3862, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.09% (1.7609 => 1.9033, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.10% (0.3817 => 0.4088, std. dev.: 0.0058) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5925 => 0.6290, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 6.07% (0.6030 => 0.6396, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.19% (0.4879 => 0.5132, std. dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference: 5.04% (0.7326 => 0.7695, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 4.85% (10.4361 => 10.9422, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.64% (0.4615 => 0.4829, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 4.63% (0.3282 => 0.3434, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.52% (7.0540 => 7.3730, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 4.03% (9.4845 => 9.8663, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.93% (0.7433 => 0.7725, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.66% (4.9449 => 5.1261, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.58% (5.0018 => 5.1807, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.57% (0.5569 => 0.5768, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.54% (0.8172 => 0.8461, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.42% (4.2646 => 4.4106, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 3.31% (0.3109 => 0.3212, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.31% (0.5860 => 0.6054, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 3.16% (0.3423 => 0.3531, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.08% (8.1363 => 8.3870, std. dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 3.03% (5.7591 => 5.9334, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.96% (0.7835 => 0.8067, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.92% (14.3668 => 14.7870, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.88% (1.3050 => 1.3426, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.8067 => 0.8272, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.54% (3.3354 => 3.4201, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 2.47% (1.5603 => 1.5989, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.41% (1.1642 => 1.1922, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.38% (2.0273 => 2.0755, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.24% (1.5415 => 1.5760, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 2.21% (3.8723 => 3.9577, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.07% (1.5859 => 1.6187, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.2024 => 2.2471, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.00% (0.5105 => 0.5207, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 1.92% (0.6456 => 0.6580, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.91% (2.0665 => 2.1060, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (0.6675 => 0.6791, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.74% (0.6450 => 0.6562, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 1.72% (0.8921 => 0.9074, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.69% (0.5981 => 0.6082, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.48% (17.1811 => 17.4347, std. dev.: 0.0158) MultiSource/Applications/hexxagon/hexxagon: 1.38% (1.2842 => 1.3019, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.28% (2.2969 => 2.3263, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (4.2280 => 4.4001, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7465, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.68% (3.1578 => 3.2110, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5086 => 1.5333, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.61% (11.6436 => 11.8316, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 1.59% (2.2771 => 2.3133, std. dev.: 0.0079) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2036, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2192, std. dev.: 0.0139) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.06% (5.2763 => 3.1627, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.34% (5.3855 => 3.6979, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.75% (5.3526 => 3.7065, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0048, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.45% (2.9384 => 2.5433, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -10.31% (22.1758 => 19.8889, std. dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.73% (0.0998 => 0.0841, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2373 => 1.1109, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -6.81% (1.5373 => 1.4326, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5538, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.03% (1.9577 => 1.8593, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4743, std. dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (8.1563 => 7.9002, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4154, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0008, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6795, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.71% (12.5348 => 12.3210, std. dev.: 0.0044) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4199, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.25% (1.8329 => 1.8099, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0006) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2497, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 07:41:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 09:41:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120730144115.35E143524034@llvm.org> http://llvm.org/perf/db_default/v4/nts/2494?compare_to=2491&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2494, Order: 160958, Start Time: 2012-07-30 11:58:26, End Time: 2012-07-30 14:41:43 To: 2491, Order: 160954, Start Time: 2012-07-30 08:46:28, End Time: 2012-07-30 11:30:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (93 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (789 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.33% (54.1528 => 54.8736, std. dev.: 0.0212) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.18% (2.2781 => 2.3049, std. dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.38% (0.3446 => 0.3907, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.33% (0.3465 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.25% (0.3442 => 0.3898, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.24% (0.3496 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.24% (0.3460 => 0.3918, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.20% (0.3469 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.16% (0.3488 => 0.3947, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.71% (0.3643 => 0.4106, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.38% (0.3724 => 0.4185, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.25% (0.3792 => 0.4105, std. dev.: 0.0084) SingleSource/UnitTests/ObjC++/Hello: 6.99% (0.5826 => 0.6233, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.79% (0.5889 => 0.6289, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.1620 => 0.1728, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 5.98% (1.5932 => 1.6884, std. dev.: 0.0089) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.50% (1.6211 => 1.7103, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.43% (3.5627 => 3.7562, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference: 5.26% (0.7171 => 0.7548, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.06% (1.3152 => 1.3817, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.97% (0.5026 => 0.5276, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.96% (0.5000 => 0.5248, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.84% (0.4361 => 0.4572, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.83% (0.5900 => 0.6185, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.71% (0.4994 => 0.5229, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.68% (0.3930 => 0.4114, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.57% (0.2866 => 0.2997, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.44% (0.4029 => 0.4208, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 4.42% (1.0781 => 1.1258, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.27% (4.2109 => 4.3906, std. dev.: 0.0077) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.15% (2.7292 => 2.8424, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 4.12% (23.5202 => 24.4902, std. dev.: 0.0134) MultiSource/Benchmarks/nbench/nbench: 4.01% (0.2566 => 0.2669, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.97% (0.2875 => 0.2989, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.94% (0.9909 => 1.0299, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.2736 => 0.2843, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.85% (0.3195 => 0.3318, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.82% (0.2750 => 0.2855, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.74% (1.9694 => 2.0431, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 3.65% (0.3258 => 0.3377, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.62% (1.9966 => 2.0688, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.61% (5.5417 => 5.7420, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.60% (2.0673 => 2.1417, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/methcall: 3.59% (0.2813 => 0.2914, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 3.55% (0.3267 => 0.3383, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 3.54% (0.2823 => 0.2923, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.49% (0.3096 => 0.3204, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.47% (2.1013 => 2.1742, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.42% (0.3362 => 0.3477, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.24% (0.3890 => 0.4016, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.24% (4.4195 => 4.5625, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.20% (0.3124 => 0.3224, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.20% (0.4658 => 0.4807, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 3.17% (0.3317 => 0.3422, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.12% (0.3271 => 0.3373, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3726 => 0.3842, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.10% (2.1653 => 2.2324, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (0.3625 => 0.3737, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 3.08% (4.6177 => 4.7597, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.05% (0.3282 => 0.3382, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 2.99% (0.3477 => 0.3581, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 2.99% (0.3678 => 0.3788, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 2.99% (0.3348 => 0.3448, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.97% (0.7875 => 0.8109, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.90% (0.9697 => 0.9978, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.87% (0.3903 => 0.4015, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.80% (0.4139 => 0.4255, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 2.78% (1.8794 => 1.9316, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.4146 => 0.4259, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.70% (0.5546 => 0.5696, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.64% (1.4269 => 1.4645, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.56% (0.3981 => 0.4083, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.46% (0.6634 => 0.6797, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.5012 => 0.5123, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.13% (0.6435 => 0.6572, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.30% (2.0346 => 2.0611, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 14.91% (2.5769 => 2.9610, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.2122 => 0.2279, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.07% (12.0509 => 12.6617, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-2: 4.80% (1.8057 => 1.8924, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1649, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (105.3826 => 107.6699, std. dev.: 0.0306) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1973, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4967, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5908, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2231, std. dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.99% (2.4764 => 2.3776, std. dev.: 0.0315) MultiSource/Applications/kimwitu++/kc: -1.36% (11.9555 => 11.7926, std. dev.: 0.0147) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.17% (25.4195 => 16.4791, std. dev.: 0.0301) SingleSource/Benchmarks/Dhrystone/fldry: -8.67% (17.2379 => 15.7437, std. dev.: 0.1436) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9746, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7969, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary2: -6.62% (0.2402 => 0.2243, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -3.99% (0.4438 => 0.4261, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -3.65% (14.0481 => 13.5352, std. dev.: 0.0076) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7994, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5714, std. dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 10:40:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 12:40:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120730174002.17C923524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2495?compare_to=2492&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2495, Order: 160961, Start Time: 2012-07-30 16:26:40, End Time: 2012-07-30 17:40:27 To: 2492, Order: 160958, Start Time: 2012-07-30 11:40:35, End Time: 2012-07-30 12:54:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (155 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (704 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.65% (56.5501 => 54.4849, std. dev.: 0.7885) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.22% (2.0176 => 2.3247, std. dev.: 0.0113) SingleSource/UnitTests/ObjC/trivial-interface: 10.15% (0.3578 => 0.3941, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.01% (0.3646 => 0.4011, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.97% (0.3601 => 0.3960, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.93% (0.5818 => 0.6396, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.88% (0.3663 => 0.4025, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 9.76% (0.5748 => 0.6309, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.74% (0.3789 => 0.4158, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.72% (0.3623 => 0.3975, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.70% (0.3650 => 0.4004, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.48% (0.3914 => 0.4285, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.46% (0.7061 => 0.7729, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 9.31% (0.3940 => 0.4307, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.27% (0.4003 => 0.4374, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.31% (0.1986 => 0.2151, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.12% (0.3130 => 0.3384, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.40% (1.3693 => 1.4706, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.23% (3.9660 => 4.2528, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.07% (0.7710 => 0.8255, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.2596 => 0.2777, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.97% (0.5265 => 0.5632, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.83% (0.7038 => 0.7519, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.72% (0.4328 => 0.4619, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.65% (0.2721 => 0.2902, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.60% (0.1819 => 0.1939, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.36% (0.2781 => 0.2958, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.29% (0.2782 => 0.2957, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.17% (0.4379 => 0.4649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.01% (0.4062 => 0.4306, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.98% (0.2607 => 0.2763, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.91% (1.2193 => 1.2913, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.85% (0.6959 => 0.7366, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.77% (0.3899 => 0.4124, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.77% (0.2966 => 0.3137, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.76% (0.2690 => 0.2845, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.72% (0.2761 => 0.2919, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3022 => 0.3194, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.67% (0.2628 => 0.2777, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.65% (0.3485 => 0.3682, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.65% (0.2760 => 0.2916, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.59% (0.3580 => 0.3780, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.58% (0.2937 => 0.3101, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.54% (0.9199 => 0.9709, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.54% (0.2726 => 0.2877, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.51% (1.9828 => 2.0920, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.44% (0.3107 => 0.3276, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.42% (0.3489 => 0.3678, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.41% (13.8202 => 14.5675, std. dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.38% (0.5577 => 0.5877, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.38% (0.2696 => 0.2841, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.3149 => 0.3318, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.17% (0.2127 => 0.2237, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3453 => 0.3630, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.11% (16.6129 => 17.4619, std. dev.: 0.0232) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.08% (7.2180 => 7.5850, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.07% (0.3534 => 0.3713, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.04% (0.2914 => 0.3061, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.97% (0.7506 => 0.7879, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.92% (1.4563 => 1.5280, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.92% (0.4390 => 0.4606, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 4.92% (0.3293 => 0.3455, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.91% (0.4016 => 0.4213, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.86% (13.2842 => 13.9293, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.81% (0.2140 => 0.2243, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.81% (0.3868 => 0.4054, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.81% (0.5637 => 0.5908, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (0.3756 => 0.3934, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.73% (1.1364 => 1.1902, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 4.70% (1.1061 => 1.1581, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 4.69% (0.8310 => 0.8700, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.65% (0.3246 => 0.3397, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 4.62% (1.9270 => 2.0160, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.60% (1.3245 => 1.3854, std. dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: 4.58% (3.8646 => 4.0416, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 4.50% (1.0594 => 1.1071, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.48% (1.3819 => 1.4438, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.45% (1.3813 => 1.4428, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.38% (0.7460 => 0.7787, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 4.34% (0.2995 => 0.3125, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.16% (3.6692 => 3.8219, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.15% (4.4433 => 4.6278, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.13% (4.3801 => 4.5610, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 4.07% (0.3220 => 0.3351, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.07% (1.2292 => 1.2792, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 3.82% (2.1791 => 2.2624, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.82% (0.4791 => 0.4974, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.72% (0.4113 => 0.4266, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.64% (1.1333 => 1.1746, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.55% (0.3131 => 0.3242, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.54% (0.6135 => 0.6352, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3755 => 0.3885, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.44% (8.4961 => 8.7880, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.36% (0.6283 => 0.6494, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.36% (4.9865 => 5.1538, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 3.27% (3.1889 => 3.2931, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.21% (0.8698 => 0.8977, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 3.06% (6.5754 => 6.7767, std. dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 2.93% (14.8535 => 15.2894, std. dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 2.85% (16.2614 => 16.7254, std. dev.: 0.0183) MultiSource/Applications/ClamAV/clamscan: 2.83% (14.5298 => 14.9413, std. dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.82% (3.2742 => 3.3664, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.81% (2.1007 => 2.1597, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.57% (1.5188 => 1.5578, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.31% (4.6629 => 4.7704, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.00% (0.9108 => 0.9290, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.75% (1.0313 => 1.0493, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 1.70% (0.6250 => 0.6356, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.62% (0.6744 => 0.6853, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.47% (6.2785 => 6.3709, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 1.37% (3.7467 => 3.7979, std. dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 1.30% (33.2944 => 33.7259, std. dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5167, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 25.40% (1.8175 => 2.2791, std. dev.: 0.0441) SingleSource/Benchmarks/Misc/mandel-2: 6.95% (1.2998 => 1.3901, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.14% (0.9996 => 1.0510, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 4.35% (7.4271 => 7.7504, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.98% (11.2619 => 11.7106, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4765, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.58% (1.7688 => 1.8145, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0310 => 1.0558, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.34% (0.9692 => 0.9919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.74% (3.7731 => 3.8389, std. dev.: 0.0233) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5336, std. dev.: 0.0033) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.5928 => 4.6607, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5072, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.34% (1.9290 => 1.9548, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 1.11% (10.7476 => 10.8667, std. dev.: 0.0323) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1682, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1391, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.31% (22.5627 => 21.1384, std. dev.: 0.0206) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.25% (0.0997 => 0.0825, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.12% (1.2308 => 1.1063, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.60% (1.3780 => 1.3146, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.12% (0.4867 => 0.4715, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9187, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9449, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.44% (8.8259 => 8.6104, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2234, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (20.3410 => 19.9630, std. dev.: 0.0285) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.76% (6.6320 => 6.5152, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3305 => 7.2185, std. dev.: 0.0210) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8595, std. dev.: 0.0170) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2496, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2273, std. dev.: 0.0322) MultiSource/Applications/lua/lua: -1.02% (26.5159 => 26.2459, std. dev.: 0.0106) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 10:44:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 12:44:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120730174440.1CE6E3524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2496?compare_to=2493&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2496, Order: 160961, Start Time: 2012-07-30 16:26:38, End Time: 2012-07-30 17:45:07 To: 2493, Order: 160958, Start Time: 2012-07-30 11:40:34, End Time: 2012-07-30 12:59:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (77 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (762 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.75% (55.5770 => 56.5516, std. dev.: 0.0976) SingleSource/Benchmarks/Misc/mandel-2: 1.38% (1.4326 => 1.4524, std. dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.30% (10.3673 => 13.7161, std. dev.: 0.0164) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3473 => 0.3913, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.44% (0.3497 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.33% (0.3543 => 0.3980, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.31% (0.3543 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.29% (0.3516 => 0.3948, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.22% (0.3561 => 0.3996, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.57% (0.3828 => 0.4271, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.32% (0.3886 => 0.4326, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.28% (1.1194 => 1.2457, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std. dev.: 0.0084) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.96% (2.2022 => 2.3775, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.61% (1.7609 => 1.8949, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.65% (0.3817 => 0.4071, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.34% (0.2065 => 0.2196, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5925 => 0.6293, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.19% (0.6030 => 0.6403, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.3177 => 0.3367, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.98% (0.7326 => 0.7691, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.88% (0.4615 => 0.4840, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.79% (10.4361 => 10.9364, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/oourafft: 4.39% (0.3282 => 0.3426, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.36% (7.0540 => 7.3613, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 4.15% (9.4845 => 9.8781, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 4.01% (0.7433 => 0.7731, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.73% (0.8172 => 0.8477, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.64% (4.9449 => 5.1251, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.61% (0.5569 => 0.5770, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.60% (5.0018 => 5.1818, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (4.2646 => 4.4138, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.43% (0.5860 => 0.6061, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3121 => 0.3227, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.14% (8.1363 => 8.3915, std. dev.: 0.0077) MultiSource/Benchmarks/McCat/18-imp/imp: 3.10% (0.3423 => 0.3529, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.04% (14.3668 => 14.8034, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.03% (1.1861 => 1.2220, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 3.00% (5.7591 => 5.9318, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.00% (1.3050 => 1.3441, std. dev.: 0.0067) MultiSource/Applications/spiff/spiff: 2.99% (0.7835 => 0.8069, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.8067 => 0.8285, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.67% (1.1642 => 1.1953, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.53% (1.5603 => 1.5998, std. dev.: 0.0047) MultiSource/Applications/d/make_dparser: 2.52% (3.3354 => 3.4196, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.50% (1.5415 => 1.5800, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.49% (0.4103 => 0.4205, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.47% (2.0273 => 2.0773, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 2.36% (3.8723 => 3.9637, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.13% (0.9765 => 0.9973, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.2024 => 2.2471, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.97% (1.5859 => 1.6172, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 1.92% (0.6456 => 0.6580, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.88% (0.6450 => 0.6571, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.87% (2.0665 => 2.1052, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.80% (0.6675 => 0.6795, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.79% (0.5981 => 0.6088, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.69% (1.4186 => 1.4426, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 1.67% (0.8921 => 0.9070, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.48% (17.1811 => 17.4355, std. dev.: 0.0179) MultiSource/Applications/siod/siod: 1.47% (2.2969 => 2.3306, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 1.35% (1.2842 => 1.3016, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.28% (1.1840 => 1.1992, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.19% (4.2280 => 4.4051, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7520, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.72% (3.1578 => 3.2122, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8343, std. dev.: 0.0033) MultiSource/Applications/aha/aha: 1.38% (3.1595 => 3.2031, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2364, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9196, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.50% (0.8651 => 0.1687, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.97% (5.2763 => 3.1674, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.62% (5.3855 => 3.6826, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.03% (5.3526 => 3.6919, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -15.04% (54.1659 => 46.0215, std. dev.: 0.0231) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.17% (2.9384 => 2.5513, std. dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: -10.45% (22.1758 => 19.8585, std. dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (3.8922 => 3.8484, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.35% (1.2373 => 1.1093, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -5.52% (1.5373 => 1.4524, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.90% (1.9577 => 1.8618, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4972, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (8.1563 => 7.9110, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4225, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0016, std. dev.: 0.0113) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.39% (0.4808 => 0.4693, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.79% (12.5348 => 12.3101, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4192, std. dev.: 0.0079) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8095, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 12:10:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 14:10:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120730191001.35FC13524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2497?compare_to=2494&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2497, Order: 160961, Start Time: 2012-07-30 16:26:47, End Time: 2012-07-30 19:10:28 To: 2494, Order: 160958, Start Time: 2012-07-30 11:58:26, End Time: 2012-07-30 14:41:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (91 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (791 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.28% (125.4731 => 130.8493, std. dev.: 0.4108) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.97% (0.3465 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3446 => 0.3925, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.84% (0.3460 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.79% (0.3496 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.77% (0.3442 => 0.3916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.73% (0.3488 => 0.3967, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 13.66% (0.3469 => 0.3943, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.40% (0.3643 => 0.4131, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.23% (0.3650 => 0.4133, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.89% (0.3724 => 0.4204, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.23% (0.5826 => 0.6247, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.00% (0.5889 => 0.6301, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.13% (1.5932 => 1.6909, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.61% (3.5627 => 3.7626, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.57% (1.6211 => 1.7114, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 5.51% (0.7171 => 0.7566, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.47% (0.5026 => 0.5301, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.25% (0.4994 => 0.5256, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.2014 => 0.2115, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.98% (0.4361 => 0.4578, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (1.3152 => 1.3799, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.3930 => 0.4116, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.69% (0.4029 => 0.4218, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.64% (0.5900 => 0.6174, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.64% (0.2736 => 0.2863, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.56% (0.5000 => 0.5228, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 4.47% (1.0781 => 1.1263, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 4.35% (4.2109 => 4.3941, std. dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.31% (2.7292 => 2.8469, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 4.11% (23.5202 => 24.4873, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.2866 => 0.2983, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.88% (0.3195 => 0.3319, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.88% (1.9694 => 2.0458, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 3.85% (0.2725 => 0.2830, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.80% (2.0673 => 2.1459, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.80% (0.4658 => 0.4835, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.79% (0.2875 => 0.2984, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.77% (5.5417 => 5.7506, std. dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (2.1013 => 2.1796, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.73% (0.2738 => 0.2840, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 3.68% (0.2714 => 0.2814, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.68% (0.9909 => 1.0274, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.64% (1.9966 => 2.0692, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.62% (0.3890 => 0.4031, std. dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 3.60% (0.3004 => 0.3112, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.44% (0.3258 => 0.3370, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.43% (0.3267 => 0.3379, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.35% (4.6177 => 4.7724, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.33% (4.4195 => 4.5668, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 3.33% (0.3096 => 0.3199, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.31% (0.4139 => 0.4276, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.30% (2.1653 => 2.2367, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3124 => 0.3226, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.26% (1.8794 => 1.9406, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.18% (0.3362 => 0.3469, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 3.11% (0.3317 => 0.3420, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (0.3625 => 0.3737, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 2.97% (0.4146 => 0.4269, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 2.96% (0.3678 => 0.3787, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3477 => 0.3580, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 2.95% (0.3726 => 0.3836, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.94% (0.6634 => 0.6829, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.93% (0.7875 => 0.8106, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.87% (0.3903 => 0.4015, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 2.77% (0.9697 => 0.9966, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.75% (1.4269 => 1.4661, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 2.73% (0.4251 => 0.4367, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.60% (0.3845 => 0.3945, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.54% (0.5546 => 0.5687, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.5012 => 0.5123, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.10% (0.6435 => 0.6570, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.40% (2.0346 => 2.0630, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 15.03% (2.5769 => 2.9642, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.83% (0.2122 => 0.2267, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6667, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-2: 4.94% (1.8057 => 1.8949, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1673, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6618, std. dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1963, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4972, std. dev.: 0.0266) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5926, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2219, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.03% (2.4764 => 2.3765, std. dev.: 0.0220) MultiSource/Applications/kimwitu++/kc: -1.23% (11.9555 => 11.8085, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5460, std. dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/fldry: -8.64% (17.2379 => 15.7480, std. dev.: 0.0693) SingleSource/Benchmarks/Shootout-C++/ary2: -8.45% (0.2402 => 0.2199, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8042, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/moments: -3.92% (0.4438 => 0.4264, std. dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7922, std. dev.: 0.0114) SingleSource/Benchmarks/Dhrystone/dry: -3.60% (14.0481 => 13.5418, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5753, std. dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 12:21:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 14:21:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120730192143.C65863524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2498?compare_to=2495&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2498, Order: 160966, Start Time: 2012-07-30 18:08:17, End Time: 2012-07-30 19:22:10 To: 2495, Order: 160961, Start Time: 2012-07-30 16:26:40, End Time: 2012-07-30 17:40:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (153 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (706 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.23% (54.4849 => 56.2432, std. dev.: 0.1520) SingleSource/Benchmarks/Shootout/ary3: 1.92% (3.6855 => 3.7564, std. dev.: 0.0246) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -1.86% (0.5437 => 0.5336, std. dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.15% (2.0176 => 2.3233, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.06% (0.3578 => 0.3938, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.92% (0.5818 => 0.6395, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.86% (0.5748 => 0.6315, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.86% (0.3601 => 0.3956, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.82% (0.3646 => 0.4004, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.80% (0.3623 => 0.3978, std. dev.: 0.0072) SingleSource/UnitTests/ObjC/synchronized: 9.77% (0.3663 => 0.4021, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.75% (0.3650 => 0.4006, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 9.63% (0.3789 => 0.4154, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.63% (0.3914 => 0.4291, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.53% (0.7061 => 0.7734, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 9.39% (0.4003 => 0.4379, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 9.34% (0.3940 => 0.4308, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.28% (1.3693 => 1.4690, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.23% (3.9660 => 4.2527, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.01% (0.2596 => 0.2778, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.89% (0.7710 => 0.8241, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 6.85% (0.7038 => 0.7520, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.82% (0.4328 => 0.4623, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.76% (0.5265 => 0.5621, std. dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: 6.54% (0.2781 => 0.2963, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.43% (0.2782 => 0.2961, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.19% (0.4379 => 0.4650, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.13% (0.4062 => 0.4311, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.10% (0.2607 => 0.2766, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.08% (0.6959 => 0.7382, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.96% (0.3022 => 0.3202, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2655 => 0.2812, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.91% (0.2690 => 0.2849, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.90% (1.2193 => 1.2912, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.90% (0.2765 => 0.2928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.82% (0.2937 => 0.3108, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.82% (0.3899 => 0.4126, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.82% (0.2628 => 0.2781, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.80% (0.2966 => 0.3138, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.80% (0.2761 => 0.2921, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.76% (0.2760 => 0.2919, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2726 => 0.2883, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.71% (1.9828 => 2.0960, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.70% (0.3580 => 0.3784, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.68% (0.3485 => 0.3683, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.68% (0.2696 => 0.2849, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3107 => 0.3283, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.59% (0.3489 => 0.3684, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.52% (0.2988 => 0.3153, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.50% (13.8202 => 14.5798, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary3: 5.49% (0.3149 => 0.3322, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (0.9199 => 0.9703, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.5577 => 0.5881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.33% (0.3453 => 0.3637, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3192 => 0.3362, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.22% (16.6129 => 17.4808, std. dev.: 0.0232) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.2925 => 0.3076, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 5.15% (0.3534 => 0.3716, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 5.10% (0.7506 => 0.7889, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.10% (0.4390 => 0.4614, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.08% (0.2127 => 0.2235, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.06% (7.2180 => 7.5829, std. dev.: 0.0100) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 5.04% (0.3293 => 0.3459, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.04% (0.2243 => 0.2356, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.01% (0.2914 => 0.3060, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.98% (1.4563 => 1.5288, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.93% (0.4016 => 0.4214, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.90% (0.5637 => 0.5913, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (0.3756 => 0.3939, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 4.86% (0.3868 => 0.4056, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.86% (13.2842 => 13.9298, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.78% (1.1364 => 1.1907, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.2140 => 0.2241, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.68% (0.8310 => 0.8699, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.67% (1.1061 => 1.1577, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.66% (1.9270 => 2.0168, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3246 => 0.3396, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.61% (3.8646 => 4.0427, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.60% (1.0594 => 1.1081, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.49% (1.3245 => 1.3840, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.37% (1.3813 => 1.4417, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.37% (1.3819 => 1.4423, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.34% (4.3801 => 4.5703, std. dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 4.27% (0.2995 => 0.3123, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.24% (0.7460 => 0.7776, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 4.19% (1.2292 => 1.2807, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.15% (3.6692 => 3.8216, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 4.13% (0.3220 => 0.3353, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.12% (4.4433 => 4.6263, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.86% (0.4791 => 0.4976, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.83% (2.1791 => 2.2625, std. dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.68% (1.1333 => 1.1750, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.65% (0.3755 => 0.3892, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.58% (0.3131 => 0.3243, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 3.55% (0.4113 => 0.4259, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.41% (0.6283 => 0.6497, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.40% (3.1889 => 3.2972, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.39% (4.9865 => 5.1553, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.36% (8.4961 => 8.7814, std. dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.33% (0.6135 => 0.6339, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.29% (0.8698 => 0.8984, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (6.5754 => 6.7800, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.97% (14.8535 => 15.2947, std. dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: 2.91% (16.2614 => 16.7350, std. dev.: 0.0153) MultiSource/Applications/ClamAV/clamscan: 2.91% (14.5298 => 14.9523, std. dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.89% (3.2742 => 3.3688, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (2.1007 => 2.1612, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.63% (1.5188 => 1.5588, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.18% (4.6629 => 4.7644, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 1.90% (0.6250 => 0.6369, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.90% (0.9108 => 0.9281, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.74% (1.0313 => 1.0492, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.69% (0.6744 => 0.6858, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 1.62% (33.2944 => 33.8344, std. dev.: 0.0077) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.41% (6.2785 => 6.3672, std. dev.: 0.0082) MultiSource/Applications/lua/lua: 1.36% (3.7467 => 3.7975, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5169, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 25.53% (1.8175 => 2.2815, std. dev.: 0.0416) SingleSource/Benchmarks/Misc/mandel-2: 7.82% (1.2998 => 1.4015, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.02% (0.9996 => 1.0598, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.39% (7.4271 => 7.7531, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7049, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.20% (12.0921 => 12.4788, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8153, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5343, std. dev.: 0.0086) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.51% (4.5928 => 4.6620, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5951, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0494, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 1.27% (9.0760 => 9.1914, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1405, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 1.07% (1.1560 => 1.1684, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.39% (22.5627 => 21.1220, std. dev.: 0.0196) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.05% (0.0997 => 0.0827, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -11.07% (1.2308 => 1.0945, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.42% (1.3780 => 1.3171, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5872, std. dev.: 0.0240) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9474, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.07% (0.5449 => 0.5336, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2248, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.93% (20.3410 => 19.9493, std. dev.: 0.0449) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5104, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3305 => 7.2172, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8680, std. dev.: 0.0135) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2209, std. dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2554, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 12:31:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 14:31:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120730193123.3AABA3524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2499?compare_to=2496&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2499, Order: 160970, Start Time: 2012-07-30 18:13:16, End Time: 2012-07-30 19:31:50 To: 2496, Order: 160961, Start Time: 2012-07-30 16:26:38, End Time: 2012-07-30 17:45:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (78 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (761 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.99% (13.7161 => 13.4438, std. dev.: 0.0191) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.68% (10.3673 => 13.4438, std. dev.: 0.0191) SingleSource/UnitTests/ObjC/trivial-interface: 12.64% (0.3473 => 0.3912, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.47% (0.3497 => 0.3933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.26% (0.3516 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.25% (0.3543 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.22% (0.3543 => 0.3976, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.22% (0.3561 => 0.3996, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.97% (0.3694 => 0.4136, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.52% (0.3828 => 0.4269, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.35% (1.1194 => 1.2465, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 11.26% (0.3927 => 0.4369, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.22% (0.3886 => 0.4322, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.05% (2.2022 => 2.3795, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.50% (1.7609 => 1.8929, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1892 => 0.2019, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 6.51% (0.5925 => 0.6311, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.42% (0.6030 => 0.6417, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.33% (0.3177 => 0.3378, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 5.86% (0.7326 => 0.7755, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.90% (0.4615 => 0.4841, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.59% (10.4361 => 10.9152, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/oourafft: 4.42% (0.3282 => 0.3427, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.29% (7.0540 => 7.3567, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 4.03% (9.4845 => 9.8665, std. dev.: 0.0142) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.95% (0.8172 => 0.8495, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.80% (4.9449 => 5.1327, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 3.78% (0.7433 => 0.7714, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (5.0018 => 5.1896, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.66% (0.5569 => 0.5773, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.36% (4.2646 => 4.4079, std. dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 3.31% (0.3109 => 0.3212, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.28% (0.5860 => 0.6052, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.25% (8.1363 => 8.4005, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: 3.18% (0.3180 => 0.3281, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.13% (0.3423 => 0.3530, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.05% (0.7835 => 0.8074, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.91% (14.3668 => 14.7853, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.84% (1.3050 => 1.3420, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (1.1861 => 1.2195, std. dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 2.64% (5.7591 => 5.9114, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.60% (0.8067 => 0.8277, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.60% (1.1642 => 1.1945, std. dev.: 0.0082) MultiSource/Applications/d/make_dparser: 2.50% (3.3354 => 3.4189, std. dev.: 0.0060) MultiSource/Benchmarks/McCat/05-eks/eks: 2.49% (0.4299 => 0.4406, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.45% (1.5603 => 1.5986, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.37% (1.5415 => 1.5781, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.35% (2.0273 => 2.0749, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.31% (2.0665 => 2.1142, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.20% (0.4636 => 0.4738, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.20% (0.6456 => 0.6598, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.14% (0.5105 => 0.5214, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.10% (0.9765 => 0.9970, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.08% (3.8723 => 3.9529, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5981 => 0.6096, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.84% (1.5859 => 1.6151, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.79% (2.2024 => 2.2418, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.78% (0.6675 => 0.6794, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.76% (1.4186 => 1.4436, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.69% (1.2842 => 1.3059, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 1.51% (0.8921 => 0.9056, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.29% (17.1811 => 17.4031, std. dev.: 0.0072) MultiSource/Applications/siod/siod: 1.14% (2.2969 => 2.3231, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.11% (1.1840 => 1.1972, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (4.2280 => 4.4027, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7552, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2158, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5086 => 1.5338, std. dev.: 0.0097) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8347, std. dev.: 0.0031) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2036, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2234, std. dev.: 0.0080) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1286, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.92% (5.2763 => 3.1700, std. dev.: 0.0135) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.53% (5.3855 => 3.6877, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.97% (5.3526 => 3.6947, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -15.05% (54.1659 => 46.0116, std. dev.: 0.0537) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.16% (2.9384 => 2.5517, std. dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: -10.39% (22.1758 => 19.8713, std. dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (3.8922 => 3.8466, std. dev.: 0.0176) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2373 => 1.1108, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: -9.24% (1.5373 => 1.3952, std. dev.: 0.0278) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.98% (1.9577 => 1.8603, std. dev.: 0.0171) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5107, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5959, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.20% (8.6802 => 8.4027, std. dev.: 0.0263) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4837, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (8.1563 => 7.9088, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0006, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -1.68% (12.5348 => 12.3243, std. dev.: 0.0030) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4179, std. dev.: 0.0061) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.8329 => 1.8080, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 14:03:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 16:03:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120730210328.197173524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2500?compare_to=2498&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2500, Order: 160978, Start Time: 2012-07-30 19:50:02, End Time: 2012-07-30 21:03:55 To: 2498, Order: 160966, Start Time: 2012-07-30 18:08:17, End Time: 2012-07-30 19:22:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (144 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.77% (2.0176 => 2.3156, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.73% (0.5818 => 0.6384, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3578 => 0.3925, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.60% (0.5748 => 0.6300, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.53% (0.7061 => 0.7734, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 9.47% (0.3601 => 0.3942, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.43% (0.3646 => 0.3990, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: 9.42% (0.3663 => 0.4008, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.37% (0.3789 => 0.4144, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.34% (0.3650 => 0.3991, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 9.30% (0.3623 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.12% (0.3914 => 0.4271, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.96% (0.3940 => 0.4293, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.94% (0.4003 => 0.4361, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.44% (1.3693 => 1.4712, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.37% (0.1819 => 0.1953, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.98% (0.7710 => 0.8248, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.80% (3.9660 => 4.2356, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (0.4328 => 0.4616, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.55% (0.5265 => 0.5610, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2781 => 0.2962, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.48% (0.7038 => 0.7494, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.36% (0.2782 => 0.2959, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.08% (0.4062 => 0.4309, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.06% (0.3022 => 0.3205, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.05% (0.3899 => 0.4135, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.02% (0.2607 => 0.2764, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.87% (0.2690 => 0.2848, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.86% (0.2937 => 0.3109, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.83% (0.2966 => 0.3139, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2726 => 0.2883, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.3107 => 0.3284, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.69% (0.2761 => 0.2918, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.68% (1.9828 => 2.0954, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.60% (0.3485 => 0.3680, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2696 => 0.2846, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.53% (0.3149 => 0.3323, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.49% (0.6959 => 0.7341, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.3489 => 0.3679, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.40% (1.2193 => 1.2851, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 5.35% (0.2988 => 0.3148, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3192 => 0.3362, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.29% (0.9199 => 0.9686, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.15% (16.6129 => 17.4688, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3453 => 0.3630, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.11% (0.5577 => 0.5862, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists1: 5.04% (0.3534 => 0.3712, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.99% (13.8202 => 14.5104, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists: 4.98% (0.3293 => 0.3457, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.92% (0.4390 => 0.4606, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.74% (7.2180 => 7.5603, std. dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (0.3756 => 0.3934, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 4.68% (0.3868 => 0.4049, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.59% (0.5637 => 0.5896, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (13.2842 => 13.8926, std. dev.: 0.0288) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.51% (1.4563 => 1.5220, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.51% (1.1364 => 1.1876, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 4.46% (0.7506 => 0.7841, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.44% (0.3246 => 0.3390, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.43% (1.1061 => 1.1551, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (0.8310 => 0.8672, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.35% (3.8646 => 4.0328, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.35% (0.2945 => 0.3073, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.31% (1.3813 => 1.4408, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.28% (1.3245 => 1.3812, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.26% (1.3819 => 1.4408, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.20% (1.0594 => 1.1039, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.14% (0.7460 => 0.7769, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.12% (1.9270 => 2.0064, std. dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: 4.05% (1.2292 => 1.2790, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.97% (4.3801 => 4.5540, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.94% (3.6692 => 3.8136, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (4.4433 => 4.6174, std. dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.62% (0.3755 => 0.3891, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.55% (0.4791 => 0.4961, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 3.47% (2.1791 => 2.2548, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.43% (1.1333 => 1.1722, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (4.9865 => 5.1508, std. dev.: 0.0051) MultiSource/Applications/d/make_dparser: 3.16% (3.1889 => 3.2897, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 3.09% (0.4113 => 0.4240, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.07% (0.8698 => 0.8965, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.06% (0.6283 => 0.6475, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.91% (8.4961 => 8.7434, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.90% (0.6135 => 0.6313, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.81% (6.5754 => 6.7604, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.69% (2.1007 => 2.1572, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.68% (14.8535 => 15.2510, std. dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: 2.51% (16.2614 => 16.6702, std. dev.: 0.0087) MultiSource/Applications/ClamAV/clamscan: 2.46% (14.5298 => 14.8872, std. dev.: 0.0162) MultiSource/Applications/oggenc/oggenc: 2.43% (4.6629 => 4.7764, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.42% (3.2742 => 3.3534, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.22% (1.5188 => 1.5525, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.50% (0.9108 => 0.9245, std. dev.: 0.0045) MultiSource/Applications/lemon/lemon: 1.41% (1.0313 => 1.0458, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.24% (33.2944 => 33.7068, std. dev.: 0.0137) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (6.2785 => 6.3421, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2689, std. dev.: 0.0228) SingleSource/Benchmarks/Misc/mandel-2: 7.31% (1.2998 => 1.3948, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.13% (0.9996 => 1.0509, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: 4.58% (7.4271 => 7.7674, std. dev.: 0.0119) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7068, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4775, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.51% (4.5928 => 4.6622, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5951, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1965, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.04% (1.9290 => 1.9490, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1393, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.5627 => 21.1294, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.15% (0.0997 => 0.0836, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.35% (1.2308 => 1.1034, std. dev.: 0.0164) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2638, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3082, std. dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.82% (1.9762 => 1.9204, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5804, std. dev.: 0.0147) MultiSource/Applications/spiff/spiff: -2.57% (3.0263 => 2.9486, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2311, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5046, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (20.3410 => 19.9619, std. dev.: 0.0542) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2123, std. dev.: 0.0228) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0177) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2494, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2285, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8485, std. dev.: 0.0066) MultiSource/Applications/lua/lua: -1.00% (26.5159 => 26.2496, std. dev.: 0.0232) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 14:17:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 16:17:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120730211743.0430E3524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2501?compare_to=2499&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2501, Order: 160978, Start Time: 2012-07-30 19:59:48, End Time: 2012-07-30 21:18:10 To: 2499, Order: 160970, Start Time: 2012-07-30 18:13:16, End Time: 2012-07-30 19:31:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (75 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (763 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 3.02% (0.5325 => 0.5486, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.60% (55.1119 => 56.5426, std. dev.: 0.0540) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.48% (78.7990 => 80.7531, std. dev.: 0.2112) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.40% (13.4438 => 13.2561, std. dev.: 0.0072) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.86% (10.3673 => 13.2561, std. dev.: 0.0072) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3473 => 0.3911, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: 12.38% (0.3497 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.33% (0.3543 => 0.3980, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.32% (0.3516 => 0.3949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.28% (0.3543 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.19% (0.3561 => 0.3995, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.49% (0.3828 => 0.4268, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.25% (0.3886 => 0.4323, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.23% (0.3927 => 0.4368, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.09% (1.1194 => 1.2435, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.20% (0.3817 => 0.4130, std. dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.81% (2.2022 => 2.3743, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.30% (1.7609 => 1.8895, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.23% (0.5925 => 0.6294, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: 6.14% (0.6030 => 0.6400, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.82% (0.3177 => 0.3362, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.76% (0.1892 => 0.2001, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.06% (0.7326 => 0.7697, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 4.72% (10.4361 => 10.9290, std. dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.70% (0.4615 => 0.4832, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.39% (0.4879 => 0.5093, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.15% (0.8172 => 0.8511, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 4.05% (0.3282 => 0.3415, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.86% (7.0540 => 7.3266, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 3.75% (0.7433 => 0.7712, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.65% (0.5569 => 0.5772, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (4.9449 => 5.1217, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.58% (9.4845 => 9.8236, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.48% (5.0018 => 5.1758, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.23% (8.1363 => 8.3992, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.23% (0.5860 => 0.6049, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.20% (4.2646 => 4.4012, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.99% (0.7835 => 0.8069, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 2.95% (0.3423 => 0.3524, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.79% (14.3668 => 14.7680, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.73% (1.3050 => 1.3406, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.71% (1.1861 => 1.2183, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.61% (5.7591 => 5.9096, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.61% (0.4636 => 0.4757, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.45% (1.1642 => 1.1927, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.43% (3.3354 => 3.4165, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.41% (1.5415 => 1.5787, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.32% (2.0273 => 2.0744, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 2.31% (1.5603 => 1.5963, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.19% (0.8067 => 0.8244, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.08% (0.9765 => 0.9968, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.06% (3.8723 => 3.9519, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.98% (2.0665 => 2.1074, std. dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/bigfib: 1.91% (0.6456 => 0.6579, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.78% (1.5859 => 1.6142, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.75% (2.2024 => 2.2410, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.72% (0.5981 => 0.6084, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.71% (0.6450 => 0.6560, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.63% (1.4186 => 1.4417, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.60% (0.6675 => 0.6782, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 1.51% (0.8921 => 0.9056, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.49% (17.1811 => 17.4368, std. dev.: 0.0155) MultiSource/Applications/hexxagon/hexxagon: 1.41% (1.2842 => 1.3023, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.16% (1.1840 => 1.1977, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.08% (2.2969 => 2.3216, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.99% (4.2280 => 4.3968, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7473, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.76% (3.1578 => 3.2133, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8337, std. dev.: 0.0009) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2042, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 1.38% (2.2771 => 2.3085, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2244, std. dev.: 0.0397) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.00% (2.8904 => 2.9194, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.30% (5.2763 => 3.1499, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.89% (5.3855 => 3.6681, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.30% (5.3526 => 3.6772, std. dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -15.03% (54.1659 => 46.0236, std. dev.: 0.0293) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.56% (2.9384 => 2.5400, std. dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: -10.44% (22.1758 => 19.8602, std. dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.40% (3.8922 => 3.8377, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2373 => 1.1095, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -8.51% (1.5373 => 1.4064, std. dev.: 0.0243) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: -5.07% (1.5835 => 1.5032, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.63% (1.9577 => 1.8671, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5963, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4745, std. dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (8.1563 => 7.9166, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.6802 => 8.4334, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0010, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.33% (1.3677 => 1.3358, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3192, std. dev.: 0.0060) SingleSource/UnitTests/Vector/multiplies: -1.55% (2.5528 => 2.5132, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4171, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.22% (1.8329 => 1.8105, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 15:21:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 17:21:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120730222138.E57E73524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2502?compare_to=2497&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2502, Order: 160978, Start Time: 2012-07-30 19:38:25, End Time: 2012-07-30 22:22:06 To: 2497, Order: 160961, Start Time: 2012-07-30 16:26:47, End Time: 2012-07-30 19:10:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (104 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (778 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 13.95% (0.3442 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.90% (0.3488 => 0.3973, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3446 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.85% (0.3465 => 0.3945, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.79% (0.3496 => 0.3978, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.79% (0.3460 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.72% (0.3469 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.29% (0.3643 => 0.4127, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.12% (0.3650 => 0.4129, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.97% (0.3724 => 0.4207, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 12.39% (0.3792 => 0.4262, std. dev.: 0.0059) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5826 => 0.6256, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 7.08% (0.5889 => 0.6306, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.85% (3.5627 => 3.7712, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.85% (1.6211 => 1.7159, std. dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference: 5.58% (0.7171 => 0.7571, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 5.28% (1.5932 => 1.6773, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.27% (0.5900 => 0.6211, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.2014 => 0.2118, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.11% (0.4994 => 0.5249, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.09% (0.2866 => 0.3012, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.09% (0.4029 => 0.4234, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.98% (0.4361 => 0.4578, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.93% (1.3152 => 1.3801, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 4.82% (1.0781 => 1.1301, std. dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.78% (0.3930 => 0.4118, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (0.5000 => 0.5237, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.70% (2.7292 => 2.8576, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.52% (0.5026 => 0.5253, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 4.46% (4.2109 => 4.3986, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.14% (0.2875 => 0.2994, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.01% (0.4658 => 0.4845, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.95% (1.9966 => 2.0755, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.95% (0.2736 => 0.2844, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.95% (2.1013 => 2.1842, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.88% (0.3195 => 0.3319, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.87% (0.2738 => 0.2844, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.85% (1.9694 => 2.0453, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.82% (0.9909 => 1.0288, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.81% (0.3362 => 0.3490, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 3.80% (0.2813 => 0.2920, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.3004 => 0.3118, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.79% (0.2823 => 0.2930, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.79% (5.5417 => 5.7516, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.76% (0.2792 => 0.2897, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 3.71% (0.2725 => 0.2826, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.70% (0.2729 => 0.2830, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 3.68% (0.2714 => 0.2814, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.67% (4.6177 => 4.7871, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 3.63% (0.2780 => 0.2881, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.60% (2.0673 => 2.1418, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 3.60% (23.5202 => 24.3658, std. dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/except: 3.59% (0.2811 => 0.2912, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.57% (0.2803 => 0.2903, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.52% (4.4195 => 4.5750, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.50% (0.3890 => 0.4026, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.46% (2.1653 => 2.2403, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 3.45% (0.4146 => 0.4289, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.42% (0.3096 => 0.3202, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.40% (0.3267 => 0.3378, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.37% (0.3060 => 0.3163, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.33% (0.3124 => 0.3228, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.30% (0.3271 => 0.3379, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.28% (0.7875 => 0.8133, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.25% (0.3726 => 0.3847, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.24% (0.3678 => 0.3797, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3317 => 0.3423, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.3903 => 0.4026, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 3.13% (0.3477 => 0.3586, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.11% (0.3282 => 0.3384, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.06% (0.3625 => 0.3736, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 3.05% (0.3348 => 0.3450, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.04% (0.3690 => 0.3802, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.97% (1.8794 => 1.9353, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 2.78% (0.5546 => 0.5700, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.74% (1.4269 => 1.4660, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.3981 => 0.4088, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.63% (0.4139 => 0.4248, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 2.59% (0.4251 => 0.4361, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.56% (0.9697 => 0.9945, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 2.50% (0.6634 => 0.6800, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.5012 => 0.5123, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.18% (0.6435 => 0.6575, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.31% (2.0346 => 2.0613, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.12% (0.0734 => 0.0845, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.2122 => 0.2279, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6779, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-2: 4.73% (1.8057 => 1.8911, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1696, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6588, std. dev.: 0.0287) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2131, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4929, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5905, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2267, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0019) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.04% (2.0820 => 2.1037, std. dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.05% (2.4764 => 2.3760, std. dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: -1.14% (11.9555 => 11.8194, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.96% (25.4195 => 16.5329, std. dev.: 0.0242) SingleSource/Benchmarks/Dhrystone/fldry: -9.53% (17.2379 => 15.5945, std. dev.: 0.0672) SingleSource/Benchmarks/Shootout-C++/ary2: -7.83% (0.2402 => 0.2214, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8041, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/moments: -3.94% (0.4438 => 0.4263, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7938, std. dev.: 0.0118) SingleSource/Benchmarks/Dhrystone/dry: -3.65% (14.0481 => 13.5358, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5784, std. dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 15:46:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 17:46:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120730224623.6CFCD3524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2503?compare_to=2500&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2503, Order: 160994, Start Time: 2012-07-30 21:32:54, End Time: 2012-07-30 22:46:50 To: 2500, Order: 160978, Start Time: 2012-07-30 19:50:02, End Time: 2012-07-30 21:03:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.56% (55.1785 => 56.5911, std. dev.: 0.1087) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.74% (2.0176 => 2.2948, std. dev.: 0.0149) SingleSource/UnitTests/ObjC++/property-reference-object: 10.07% (0.5818 => 0.6404, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.95% (0.5748 => 0.6320, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 9.60% (0.7061 => 0.7739, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.86% (0.3578 => 0.3895, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.69% (0.3646 => 0.3963, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.66% (0.3650 => 0.3966, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 8.64% (0.3601 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.57% (0.3663 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.50% (0.3789 => 0.4111, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-3: 8.45% (0.3623 => 0.3929, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.41% (0.3914 => 0.4243, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 8.22% (0.4003 => 0.4332, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.12% (0.3940 => 0.4260, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.37% (0.2781 => 0.2986, std. dev.: 0.0059) MultiSource/Applications/hbd/hbd: 7.30% (1.3693 => 1.4693, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: 7.00% (0.4328 => 0.4631, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.00% (0.1986 => 0.2125, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.94% (0.2782 => 0.2975, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2607 => 0.2779, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.52% (0.7038 => 0.7497, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.50% (0.7710 => 0.8211, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 6.49% (0.2760 => 0.2939, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.48% (3.9660 => 4.2228, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: 6.47% (0.2690 => 0.2864, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.45% (0.4062 => 0.4324, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.45% (0.2761 => 0.2939, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.43% (0.2628 => 0.2797, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.40% (0.2655 => 0.2825, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.37% (0.2966 => 0.3155, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.37% (0.2765 => 0.2941, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.32% (0.2596 => 0.2760, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.31% (0.5265 => 0.5597, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.30% (0.2937 => 0.3122, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.21% (0.2721 => 0.2890, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.21% (0.3899 => 0.4141, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 6.16% (0.2726 => 0.2894, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.15% (0.3022 => 0.3208, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.12% (0.3107 => 0.3297, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.08% (1.9828 => 2.1034, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2696 => 0.2859, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.00% (0.3485 => 0.3694, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.98% (0.3580 => 0.3794, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.97% (0.3149 => 0.3337, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.96% (0.2988 => 0.3166, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.82% (0.3489 => 0.3692, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.3192 => 0.3377, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.71% (0.3453 => 0.3650, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.44% (0.4379 => 0.4617, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.36% (1.2193 => 1.2846, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3534 => 0.3723, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.31% (0.3293 => 0.3468, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.30% (0.4016 => 0.4229, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.28% (0.4390 => 0.4622, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.20% (0.6959 => 0.7321, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.14% (0.3756 => 0.3949, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.11% (0.9199 => 0.9669, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.04% (0.3868 => 0.4063, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.99% (13.8202 => 14.5097, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.90% (0.5577 => 0.5850, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2945 => 0.3089, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.88% (16.6129 => 17.4235, std. dev.: 0.0159) MultiSource/Benchmarks/McCat/09-vor/vor: 4.72% (0.2925 => 0.3063, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.64% (13.2842 => 13.9000, std. dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: 4.60% (1.2292 => 1.2858, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.43% (1.1061 => 1.1551, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.2914 => 0.3043, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.41% (1.4563 => 1.5205, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.5637 => 0.5884, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.37% (7.2180 => 7.5335, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.34% (0.3246 => 0.3387, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.27% (1.1364 => 1.1849, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 4.26% (0.8310 => 0.8664, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.21% (0.7506 => 0.7822, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 4.17% (3.8646 => 4.0257, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.11% (1.3245 => 1.3790, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.05% (1.0594 => 1.1023, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.02% (0.7460 => 0.7760, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 4.00% (1.9270 => 2.0041, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.89% (0.3755 => 0.3901, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.89% (1.3819 => 1.4356, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.83% (1.3813 => 1.4342, std. dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 3.81% (0.2995 => 0.3109, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.74% (4.4433 => 4.6095, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.61% (4.3801 => 4.5383, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 3.51% (2.1791 => 2.2556, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.45% (3.6692 => 3.7957, std. dev.: 0.0123) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3220 => 0.3331, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.36% (0.4791 => 0.4952, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.29% (0.8698 => 0.8984, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.26% (4.9865 => 5.1490, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.26% (0.3131 => 0.3233, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.14% (1.1333 => 1.1689, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.94% (0.6283 => 0.6468, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 2.80% (0.4113 => 0.4228, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.75% (3.1889 => 3.2765, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.67% (0.6135 => 0.6299, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.64% (8.4961 => 8.7202, std. dev.: 0.0108) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (6.5754 => 6.7389, std. dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: 2.46% (16.2614 => 16.6611, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.43% (2.1007 => 2.1518, std. dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.42% (3.2742 => 3.3535, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 2.36% (14.8535 => 15.2042, std. dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: 2.36% (14.5298 => 14.8720, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.29% (1.5188 => 1.5536, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.93% (4.6629 => 4.7527, std. dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/bigfib: 1.87% (0.6250 => 0.6367, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (0.9108 => 0.9247, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.22% (1.0313 => 1.0439, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.16% (33.2944 => 33.6815, std. dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5183, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 25.67% (1.8175 => 2.2840, std. dev.: 0.0350) SingleSource/Benchmarks/Misc/mandel-2: 8.59% (1.2998 => 1.4115, std. dev.: 0.0164) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.11% (0.9996 => 1.0507, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: 4.43% (7.4271 => 7.7561, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7028, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4777, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8166, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (1.5089 => 1.5344, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5928 => 4.6637, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9576, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5941, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.45% (2.0200 => 2.0492, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1398, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.04% (3.6469 => 3.6847, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.36% (22.5627 => 21.1273, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.28% (0.3511 => 0.3396, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.0460 => 0.8619, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.85% (0.0997 => 0.0829, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -9.75% (1.2308 => 1.1108, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.29% (2.4152 => 2.2634, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.15% (0.3139 => 0.2946, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.08% (1.3780 => 1.3080, std. dev.: 0.0046) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5815, std. dev.: 0.0220) MultiSource/Applications/spiff/spiff: -2.67% (3.0263 => 2.9455, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.97% (20.3410 => 19.9412, std. dev.: 0.0633) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5088, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2455, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.63% (7.3305 => 7.2112, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2145, std. dev.: 0.0349) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8665, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4929, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2537, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.10% (3.8887 => 3.8459, std. dev.: 0.0041) MultiSource/Applications/lua/lua: -1.09% (26.5159 => 26.2266, std. dev.: 0.0130) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 16:06:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 18:06:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120730230641.7753A3524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2504?compare_to=2501&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2504, Order: 160996, Start Time: 2012-07-30 21:48:36, End Time: 2012-07-30 23:07:08 To: 2501, Order: 160978, Start Time: 2012-07-30 19:59:48, End Time: 2012-07-30 21:18:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (84 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (756 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.52% (13.2561 => 13.7226, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.04% (3.6772 => 3.7153, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.03% (3.6681 => 3.7058, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.97% (1.4064 => 1.4482, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -2.42% (0.5486 => 0.5353, std. dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.36% (10.3673 => 13.7226, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/trivial-interface: 12.35% (0.3473 => 0.3902, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.04% (0.3497 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.91% (0.3543 => 0.3965, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.91% (0.3543 => 0.3965, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.80% (0.3516 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.79% (0.3561 => 0.3981, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.67% (1.1194 => 1.2500, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3694 => 0.4121, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.15% (0.3828 => 0.4255, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.98% (0.3927 => 0.4358, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.96% (0.3886 => 0.4312, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.99% (0.3817 => 0.4160, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.27% (2.2022 => 2.3843, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.83% (1.7609 => 1.8988, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.28% (0.5925 => 0.6297, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.22% (0.6030 => 0.6405, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.02% (0.7326 => 0.7767, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.3177 => 0.3367, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.83% (0.4615 => 0.4838, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.78% (7.0540 => 7.3914, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.4879 => 0.5112, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.49% (10.4361 => 10.9047, std. dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 4.48% (0.7433 => 0.7766, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 4.39% (0.3282 => 0.3426, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.14% (0.8172 => 0.8510, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (9.4845 => 9.8702, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (5.0018 => 5.1943, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (4.9449 => 5.1345, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.61% (0.5569 => 0.5770, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (4.2646 => 4.4182, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.50% (0.5860 => 0.6065, std. dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3121 => 0.3227, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 3.36% (0.3180 => 0.3287, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.34% (8.1363 => 8.4080, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.25% (14.3668 => 14.8337, std. dev.: 0.0099) MultiSource/Benchmarks/McCat/18-imp/imp: 3.24% (0.3423 => 0.3534, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.16% (0.3387 => 0.3494, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.10% (0.7835 => 0.8078, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.01% (1.3050 => 1.3443, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.99% (1.1861 => 1.2216, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.94% (5.7591 => 5.9287, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.87% (0.4636 => 0.4769, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.80% (3.3354 => 3.4288, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.70% (1.1642 => 1.1956, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.66% (0.4103 => 0.4212, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.5415 => 1.5824, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.65% (0.8067 => 0.8281, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.65% (3.8723 => 3.9750, std. dev.: 0.0102) MultiSource/Applications/hbd/hbd: 2.64% (1.5603 => 1.6015, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 2.58% (2.0273 => 2.0796, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.50% (2.0665 => 2.1181, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.27% (0.5105 => 0.5221, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.23% (0.9765 => 0.9983, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.22% (1.5859 => 1.6211, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.19% (2.2024 => 2.2507, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 2.14% (0.6456 => 0.6594, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5981 => 0.6103, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.97% (0.6450 => 0.6577, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.97% (1.4186 => 1.4465, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6675 => 0.6799, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 1.82% (0.8921 => 0.9083, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.77% (17.1811 => 17.4845, std. dev.: 0.0135) MultiSource/Applications/minisat/minisat: 1.64% (0.7115 => 0.7232, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.58% (1.2842 => 1.3045, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.50% (2.2969 => 2.3314, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.44% (1.1840 => 1.2010, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.19% (1.0722 => 1.0850, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.35% (4.2280 => 4.4121, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7472, std. dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2162, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5086 => 1.5342, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8327, std. dev.: 0.0018) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2037, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.14% (9.1159 => 9.2196, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.03% (5.2763 => 3.1641, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.19% (5.3855 => 3.7058, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.59% (5.3526 => 3.7153, std. dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -15.02% (54.1659 => 46.0290, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.07% (2.9384 => 2.5544, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.14% (22.1758 => 19.9268, std. dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2373 => 1.1108, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5537, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -5.80% (1.5373 => 1.4482, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -4.97% (1.9577 => 1.8605, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5099, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4814, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.06% (8.1563 => 7.9064, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.6802 => 8.4345, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0006, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.81% (12.5348 => 12.3079, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4177, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8094, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 17:28:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 19:28:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120731002812.3750A3524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2505?compare_to=2503&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2505, Order: 161001, Start Time: 2012-07-30 23:14:43, End Time: 2012-07-31 00:28:38 To: 2503, Order: 160994, Start Time: 2012-07-30 21:32:54, End Time: 2012-07-30 22:46:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (145 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.22% (2.0176 => 2.3046, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.71% (0.5818 => 0.6383, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.59% (0.5748 => 0.6299, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.05% (0.7061 => 0.7700, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 8.52% (0.3578 => 0.3883, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.36% (0.3601 => 0.3902, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.31% (0.3646 => 0.3949, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3623 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.27% (0.3663 => 0.3966, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.22% (0.3650 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3914 => 0.4230, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.99% (0.4003 => 0.4323, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.94% (0.3940 => 0.4253, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.43% (1.3693 => 1.4710, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.7710 => 0.8238, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.75% (3.9660 => 4.2339, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5265 => 0.5619, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.68% (0.7038 => 0.7508, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (0.4328 => 0.4617, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.4062 => 0.4320, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 6.29% (0.2781 => 0.2956, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.22% (0.2782 => 0.2955, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.98% (0.3899 => 0.4132, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.68% (0.2607 => 0.2755, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.61% (1.2193 => 1.2877, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2765 => 0.2919, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.56% (0.3022 => 0.3190, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2760 => 0.2913, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (0.3485 => 0.3678, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.48% (0.2628 => 0.2772, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.46% (0.6959 => 0.7339, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.45% (0.3580 => 0.3775, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.35% (1.9828 => 2.0889, std. dev.: 0.0109) MultiSource/Applications/kimwitu++/kc: 5.35% (16.6129 => 17.5009, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.29% (0.9199 => 0.9686, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.3107 => 0.3271, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.27% (0.3149 => 0.3315, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.24% (0.5577 => 0.5869, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.21% (13.8202 => 14.5397, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.01% (0.4390 => 0.4610, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 4.98% (0.3192 => 0.3351, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.95% (0.3453 => 0.3624, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.81% (0.3534 => 0.3704, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.79% (1.4563 => 1.5261, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.78% (0.4016 => 0.4208, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.77% (0.3293 => 0.3450, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.71% (7.2180 => 7.5580, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.68% (13.2842 => 13.9061, std. dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.67% (0.5637 => 0.5900, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.3868 => 0.4044, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.51% (3.8646 => 4.0388, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 4.49% (1.1061 => 1.1558, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.1364 => 1.1872, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.47% (0.3246 => 0.3391, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.42% (0.7506 => 0.7838, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.30% (0.7460 => 0.7781, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 4.28% (0.8310 => 0.8666, std. dev.: 0.0084) MultiSource/Applications/treecc/treecc: 4.28% (1.9270 => 2.0094, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.27% (1.3245 => 1.3810, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.20% (1.0594 => 1.1039, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.15% (1.3813 => 1.4386, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.07% (1.3819 => 1.4381, std. dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 4.02% (1.2292 => 1.2786, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.3801 => 4.5534, std. dev.: 0.0077) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.90% (4.4433 => 4.6165, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.77% (3.6692 => 3.8076, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.74% (0.4791 => 0.4970, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.73% (0.3220 => 0.3340, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.62% (2.1791 => 2.2580, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.46% (4.9865 => 5.1591, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3755 => 0.3883, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (1.1333 => 1.1716, std. dev.: 0.0142) MultiSource/Benchmarks/McCat/05-eks/eks: 3.28% (0.4113 => 0.4248, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.17% (0.8698 => 0.8974, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.09% (0.6283 => 0.6477, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.00% (3.1889 => 3.2846, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.97% (0.6135 => 0.6317, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 2.95% (8.4961 => 8.7470, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (6.5754 => 6.7562, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.72% (2.1007 => 2.1578, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.57% (3.2742 => 3.3585, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 2.53% (16.2614 => 16.6735, std. dev.: 0.0244) MultiSource/Applications/ClamAV/clamscan: 2.52% (14.5298 => 14.8962, std. dev.: 0.0141) MultiSource/Applications/JM/lencod/lencod: 2.52% (14.8535 => 15.2274, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.43% (1.5188 => 1.5557, std. dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 2.13% (4.6629 => 4.7622, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 1.63% (0.6250 => 0.6352, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.59% (0.9108 => 0.9253, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.19% (3.7467 => 3.7914, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 1.16% (33.2944 => 33.6804, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5182, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/fbench: 24.87% (1.8175 => 2.2695, std. dev.: 0.0307) SingleSource/Benchmarks/Misc/mandel-2: 8.48% (1.2998 => 1.4100, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.84% (1.5824 => 1.6748, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.65% (0.9996 => 1.0561, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: 4.44% (7.4271 => 7.7567, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7025, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4770, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8149, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5089 => 1.5360, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0057) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.49% (4.5928 => 4.6612, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1401, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.5627 => 21.1487, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -19.26% (0.0997 => 0.0805, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1020, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.62% (1.3780 => 1.3143, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std. dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5807, std. dev.: 0.0192) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9479, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.33% (20.3410 => 19.8667, std. dev.: 0.0724) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.27% (6.3560 => 6.2115, std. dev.: 0.0258) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5115, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.61% (0.6589 => 0.6483, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3305 => 7.2151, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.34% (5.3167 => 5.2455, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8649, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2338, std. dev.: 0.0051) MultiSource/Applications/lua/lua: -1.06% (26.5159 => 26.2350, std. dev.: 0.0215) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 17:53:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 19:53:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120731005334.5C2033524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2506?compare_to=2504&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2506, Order: 161002, Start Time: 2012-07-30 23:35:02, End Time: 2012-07-31 00:54:00 To: 2504, Order: 160996, Start Time: 2012-07-30 21:48:36, End Time: 2012-07-30 23:07:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (83 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (755 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.99% (10.3673 => 13.6841, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.53% (1.1194 => 1.2485, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 11.32% (0.3473 => 0.3866, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.15% (0.3516 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.04% (0.3497 => 0.3883, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.98% (0.3543 => 0.3932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.98% (0.3543 => 0.3932, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 10.92% (0.3561 => 0.3950, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.75% (0.3694 => 0.4091, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.40% (0.3828 => 0.4226, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.34% (0.3886 => 0.4288, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.11% (0.3927 => 0.4324, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.70% (2.2022 => 2.3938, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.35% (1.7609 => 1.8903, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.21% (0.1622 => 0.1739, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.36% (0.5925 => 0.6302, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.25% (0.6030 => 0.6407, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.91% (0.2065 => 0.2187, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.00% (0.7326 => 0.7692, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.90% (0.4879 => 0.5118, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 4.78% (10.4361 => 10.9354, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 4.72% (0.3282 => 0.3437, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.66% (7.0540 => 7.3828, std. dev.: 0.0141) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.66% (0.4615 => 0.4830, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 4.22% (0.7433 => 0.7747, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (9.4845 => 9.8709, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.84% (0.5569 => 0.5783, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (4.9449 => 5.1333, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.74% (0.5860 => 0.6079, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.69% (5.0018 => 5.1866, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.61% (0.8172 => 0.8467, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (4.2646 => 4.4122, std. dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.27% (0.3121 => 0.3223, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.21% (8.1363 => 8.3973, std. dev.: 0.0087) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3423 => 0.3532, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.18% (0.7835 => 0.8084, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.04% (14.3668 => 14.8032, std. dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.01% (1.1861 => 1.2218, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 2.99% (5.7591 => 5.9313, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.3050 => 1.3434, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.73% (0.8067 => 0.8287, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.4636 => 0.4761, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.69% (3.3354 => 3.4250, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.65% (1.5603 => 1.6017, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 2.65% (1.1642 => 1.1950, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.59% (0.5020 => 0.5150, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 2.57% (2.0273 => 2.0794, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.39% (0.5105 => 0.5227, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.39% (1.5415 => 1.5783, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.29% (3.8723 => 3.9611, std. dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.19% (2.2024 => 2.2506, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.15% (0.9765 => 0.9975, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.12% (1.5859 => 1.6196, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.95% (1.4186 => 1.4462, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6450 => 0.6574, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.91% (0.5981 => 0.6095, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 1.91% (0.6456 => 0.6579, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.76% (17.1811 => 17.4836, std. dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6675 => 0.6792, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.70% (2.0665 => 2.1016, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 1.64% (0.8921 => 0.9067, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.42% (0.7115 => 0.7216, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.39% (1.1840 => 1.2004, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.34% (1.2842 => 1.3014, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.32% (2.2969 => 2.3272, std. dev.: 0.0071) MultiSource/Applications/lemon/lemon: 1.08% (1.0722 => 1.0838, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.28% (4.2280 => 4.4089, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7542, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2159, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5086 => 1.5343, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8332, std. dev.: 0.0023) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2037, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2257, std. dev.: 0.0161) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9195, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.12% (5.2763 => 3.1592, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.11% (5.3855 => 3.7103, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.57% (5.3526 => 3.7162, std. dev.: 0.0091) SingleSource/UnitTests/Vector/constpool: -15.03% (54.1659 => 46.0274, std. dev.: 0.0337) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.13% (2.9384 => 2.5525, std. dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: -10.25% (22.1758 => 19.9038, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.07% (1.6925 => 1.4205, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.45% (1.2373 => 1.1080, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -5.80% (1.5373 => 1.4482, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -4.68% (1.9577 => 1.8661, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5961, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4806, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.10% (8.6802 => 8.4113, std. dev.: 0.0227) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9135, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9995, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.33% (1.3677 => 1.3358, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3230, std. dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4181, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8096, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2494, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 18:37:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 20:37:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120731013715.E07B13524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2507?compare_to=2502&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2507, Order: 161001, Start Time: 2012-07-30 22:53:57, End Time: 2012-07-31 01:37:43 To: 2502, Order: 160978, Start Time: 2012-07-30 19:38:25, End Time: 2012-07-30 22:22:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (105 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (777 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.16% (15.5945 => 15.9313, std. dev.: 0.1072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.91% (0.3446 => 0.3891, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.90% (0.3465 => 0.3912, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.84% (0.3496 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.81% (0.3442 => 0.3883, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.77% (0.3460 => 0.3902, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3488 => 0.3932, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 12.71% (0.3469 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.38% (0.3650 => 0.4102, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.35% (0.3643 => 0.4093, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.92% (0.3724 => 0.4168, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.34% (0.3792 => 0.4184, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/Hello: 7.81% (0.5826 => 0.6281, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.64% (0.5889 => 0.6339, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.04% (0.1620 => 0.1734, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.93% (0.7171 => 0.7596, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.50% (3.5627 => 3.7585, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.45% (1.6211 => 1.7094, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 5.28% (1.5932 => 1.6774, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.24% (0.4029 => 0.4240, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.2014 => 0.2116, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.02% (0.4361 => 0.4580, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.97% (1.3152 => 1.3805, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.93% (0.5900 => 0.6191, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (0.4994 => 0.5237, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.61% (0.3930 => 0.4111, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.60% (0.5000 => 0.5230, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.54% (0.3195 => 0.3340, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 4.47% (1.0781 => 1.1263, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 4.41% (4.2109 => 4.3967, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.30% (0.5026 => 0.5242, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2875 => 0.2998, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.16% (2.7292 => 2.8426, std. dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 4.13% (0.3004 => 0.3128, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 4.05% (0.2714 => 0.2824, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.02% (0.2738 => 0.2848, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.98% (0.2866 => 0.2980, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.95% (0.2736 => 0.2844, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 3.93% (0.2725 => 0.2832, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.92% (0.2729 => 0.2836, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.92% (0.3267 => 0.3395, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.90% (0.9909 => 1.0295, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.89% (2.0673 => 2.1478, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.87% (0.2792 => 0.2900, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.85% (0.2803 => 0.2911, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.84% (0.2811 => 0.2919, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.84% (1.9966 => 2.0732, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 3.82% (0.2750 => 0.2855, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.81% (0.2911 => 0.3022, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.78% (0.3625 => 0.3762, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 3.78% (0.2780 => 0.2885, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 3.77% (0.2813 => 0.2919, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.71% (1.9694 => 2.0424, std. dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/objinst: 3.68% (0.2823 => 0.2927, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.68% (0.3096 => 0.3210, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.64% (23.5202 => 24.3762, std. dev.: 0.0087) MultiSource/Applications/SPASS/SPASS: 3.59% (5.5417 => 5.7404, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary: 3.56% (0.3258 => 0.3374, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.53% (0.3060 => 0.3168, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (2.1013 => 2.1748, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.49% (0.3124 => 0.3233, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.44% (0.3317 => 0.3431, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.42% (0.9697 => 1.0029, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 3.40% (0.3678 => 0.3803, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.39% (0.3477 => 0.3595, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.3362 => 0.3476, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.38% (0.3282 => 0.3393, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.33% (4.4195 => 4.5668, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/sieve: 3.33% (0.3726 => 0.3850, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.28% (0.3845 => 0.3971, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.26% (0.3890 => 0.4017, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.26% (0.4658 => 0.4810, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.26% (0.3348 => 0.3457, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 3.21% (1.8794 => 1.9398, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 3.13% (4.6177 => 4.7623, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 3.06% (0.4251 => 0.4381, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.06% (2.1653 => 2.2315, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 3.01% (0.4146 => 0.4271, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.01% (0.3690 => 0.3801, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.00% (0.3903 => 0.4020, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.97% (0.4139 => 0.4262, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.96% (0.7875 => 0.8108, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.84% (0.3981 => 0.4094, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.72% (1.4269 => 1.4657, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 2.58% (0.6634 => 0.6805, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 2.52% (0.5546 => 0.5686, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.47% (0.6435 => 0.6594, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.5012 => 0.5131, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.17% (2.0346 => 2.0584, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 14.96% (2.5769 => 2.9624, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6762, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 5.16% (1.8057 => 1.8989, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1689, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.15% (105.3826 => 107.6494, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1928, std. dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4586, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4965, std. dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.75% (3.1722 => 3.2278, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5916, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5119, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.44% (2.4764 => 2.4159, std. dev.: 0.0174) MultiSource/Applications/kimwitu++/kc: -1.01% (11.9555 => 11.8344, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.97% (25.4195 => 16.5310, std. dev.: 0.0193) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8033, std. dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: -7.58% (17.2379 => 15.9313, std. dev.: 0.1072) SingleSource/Benchmarks/Shootout-C++/ary2: -7.33% (0.2402 => 0.2226, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -4.01% (0.4438 => 0.4260, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8007, std. dev.: 0.0135) SingleSource/Benchmarks/Dhrystone/dry: -3.57% (14.0481 => 13.5472, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5688, std. dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 19:10:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 21:10:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120731021009.A37943524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2508?compare_to=2505&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2508, Order: 161012, Start Time: 2012-07-31 00:56:37, End Time: 2012-07-31 02:10:35 To: 2505, Order: 161001, Start Time: 2012-07-30 23:14:43, End Time: 2012-07-31 00:28:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (146 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.06% (2.3046 => 2.3291, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.86% (41.6875 => 42.4639, std. dev.: 0.0194) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.44% (2.0176 => 2.3291, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 10.00% (0.5818 => 0.6400, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.97% (0.5748 => 0.6321, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 9.59% (0.7061 => 0.7738, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.14% (0.3578 => 0.3905, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 8.86% (0.3601 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.80% (0.3646 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.74% (0.3650 => 0.3969, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.74% (0.3663 => 0.3983, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: 8.67% (0.3623 => 0.3937, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.66% (0.3789 => 0.4117, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.58% (0.3914 => 0.4250, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.49% (0.4003 => 0.4343, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.43% (0.3130 => 0.3394, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.32% (0.3940 => 0.4268, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.09% (0.2721 => 0.2941, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 7.32% (1.3693 => 1.4695, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.26% (0.1819 => 0.1951, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (3.9660 => 4.2427, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (0.4328 => 0.4618, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.70% (0.4062 => 0.4334, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.65% (0.5265 => 0.5615, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.60% (0.7710 => 0.8219, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 6.58% (0.7038 => 0.7501, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2782 => 0.2962, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2781 => 0.2960, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.95% (0.3899 => 0.4131, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 5.95% (0.2607 => 0.2762, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.86% (0.2937 => 0.3109, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.77% (0.2966 => 0.3137, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.75% (0.4379 => 0.4631, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.75% (0.2628 => 0.2779, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3022 => 0.3195, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 5.72% (0.2760 => 0.2918, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.66% (0.6959 => 0.7353, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.64% (1.9828 => 2.0947, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.62% (0.3485 => 0.3681, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.59% (0.3489 => 0.3684, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.56% (0.3580 => 0.3779, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.47% (1.2193 => 1.2860, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 5.46% (0.3149 => 0.3321, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.46% (16.6129 => 17.5203, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/ary: 5.44% (0.3107 => 0.3276, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.42% (0.2140 => 0.2256, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.33% (0.5577 => 0.5874, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 5.25% (0.2988 => 0.3145, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.25% (13.8202 => 14.5459, std. dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.9199 => 0.9680, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.15% (0.3453 => 0.3631, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.03% (0.4390 => 0.4611, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.00% (0.4016 => 0.4217, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.98% (0.3293 => 0.3457, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.98% (0.3534 => 0.3710, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.88% (1.4563 => 1.5273, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (0.3756 => 0.3938, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.74% (0.2914 => 0.3052, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.71% (1.1364 => 1.1899, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.64% (7.2180 => 7.5527, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.3868 => 0.4047, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.57% (13.2842 => 13.8907, std. dev.: 0.0163) MultiSource/Applications/spiff/spiff: 4.52% (0.7506 => 0.7845, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.51% (0.5637 => 0.5891, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 4.48% (1.1061 => 1.1556, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 4.46% (3.8646 => 4.0370, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 4.41% (1.9270 => 2.0119, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 4.38% (0.8310 => 0.8674, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.36% (0.7460 => 0.7785, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.3819 => 1.4420, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/objinst: 4.35% (0.2945 => 0.3073, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.34% (0.3246 => 0.3387, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.34% (1.3813 => 1.4412, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.28% (1.0594 => 1.1047, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.21% (3.6692 => 3.8237, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.19% (1.3245 => 1.3800, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 4.12% (1.2292 => 1.2799, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.04% (4.3801 => 4.5571, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (4.4433 => 4.6219, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.93% (4.9865 => 5.1826, std. dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: 3.84% (0.2995 => 0.3110, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3220 => 0.3341, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.68% (0.3755 => 0.3893, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (0.4791 => 0.4966, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.65% (2.1791 => 2.2586, std. dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.52% (1.1333 => 1.1732, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.28% (0.8698 => 0.8983, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.21% (0.4113 => 0.4245, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.16% (3.1889 => 3.2896, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.07% (0.6283 => 0.6476, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.93% (0.6135 => 0.6315, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 2.87% (8.4961 => 8.7402, std. dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (6.5754 => 6.7596, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 2.80% (14.8535 => 15.2690, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.73% (2.1007 => 2.1581, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.70% (14.5298 => 14.9219, std. dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: 2.49% (16.2614 => 16.6666, std. dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.48% (3.2742 => 3.3555, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.43% (1.5188 => 1.5557, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 2.39% (4.6629 => 4.7745, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 1.92% (0.6250 => 0.6370, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.35% (0.9108 => 0.9231, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.35% (1.0313 => 1.0452, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 1.25% (3.7467 => 3.7934, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.16% (33.2944 => 33.6806, std. dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.95% (1.8175 => 2.2710, std. dev.: 0.0453) SingleSource/Benchmarks/Misc/mandel-2: 7.33% (1.2998 => 1.3951, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.29% (0.9996 => 1.0525, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7552, std. dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 3.97% (11.2619 => 11.7092, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4772, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8159, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5354, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9593, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.55% (4.5928 => 4.6638, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5951, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0407, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1682, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1392, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.82% (22.5627 => 21.2489, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.02% (0.2670 => 0.2536, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.59% (1.0460 => 0.8620, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.05% (0.0997 => 0.0837, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.66% (1.2308 => 1.0996, std. dev.: 0.0053) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.65% (1.3780 => 1.3139, std. dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9185, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.8259 => 8.5738, std. dev.: 0.0211) MultiSource/Applications/spiff/spiff: -2.63% (3.0263 => 2.9467, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.03% (20.3410 => 19.9272, std. dev.: 0.0234) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2278, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5111, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3305 => 7.2170, std. dev.: 0.0253) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0176) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.32% (2.5254 => 2.4920, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2149, std. dev.: 0.0232) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2501, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8478, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 19:39:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 21:39:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120731023955.C88F03524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2509?compare_to=2506&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2509, Order: 161014, Start Time: 2012-07-31 01:21:58, End Time: 2012-07-31 02:40:21 To: 2506, Order: 161002, Start Time: 2012-07-30 23:35:02, End Time: 2012-07-31 00:54:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (82 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.88% (55.0484 => 56.0819, std. dev.: 0.3202) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.28% (10.3673 => 13.7138, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 12.58% (0.3473 => 0.3910, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.21% (0.3497 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3543 => 0.3974, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.14% (0.3516 => 0.3943, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.11% (0.3543 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.10% (0.3561 => 0.3992, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.88% (0.3694 => 0.4133, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.68% (0.3828 => 0.4275, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.32% (0.3886 => 0.4326, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (1.1194 => 1.2441, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.20% (2.2022 => 2.3828, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.23% (1.7609 => 1.8882, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.68% (0.5925 => 0.6321, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.57% (0.6030 => 0.6426, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.50% (0.1892 => 0.2015, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.76% (0.3177 => 0.3360, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.36% (0.7326 => 0.7719, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.68% (0.4615 => 0.4831, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.60% (10.4361 => 10.9157, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.4879 => 0.5103, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.54% (7.0540 => 7.3741, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/oourafft: 4.27% (0.3282 => 0.3422, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.16% (0.7433 => 0.7742, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.90% (0.8172 => 0.8491, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (9.4845 => 9.8491, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (4.9449 => 5.1324, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.73% (0.5569 => 0.5777, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.73% (5.0018 => 5.1882, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.40% (0.5860 => 0.6059, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.37% (4.2646 => 4.4084, std. dev.: 0.0091) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.33% (0.3121 => 0.3225, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.15% (8.1363 => 8.3923, std. dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 3.14% (5.7591 => 5.9398, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.13% (0.3423 => 0.3530, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 3.11% (0.7835 => 0.8079, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.3050 => 1.3428, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.87% (0.4636 => 0.4769, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.87% (1.1861 => 1.2201, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.78% (14.3668 => 14.7667, std. dev.: 0.0052) MultiSource/Applications/d/make_dparser: 2.71% (3.3354 => 3.4258, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.70% (1.1642 => 1.1956, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.68% (0.4103 => 0.4213, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 2.52% (0.4289 => 0.4397, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.50% (2.0273 => 2.0779, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 2.49% (0.4299 => 0.4406, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.47% (1.5603 => 1.5988, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.39% (0.5105 => 0.5227, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.37% (1.5415 => 1.5781, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.29% (0.8067 => 0.8252, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.28% (3.8723 => 3.9605, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.15% (0.5020 => 0.5128, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (2.0665 => 2.1105, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.2024 => 2.2492, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 2.12% (0.6456 => 0.6593, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.05% (0.6675 => 0.6812, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.02% (1.5859 => 1.6179, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.98% (0.9765 => 0.9958, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6450 => 0.6574, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.89% (0.5981 => 0.6094, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.75% (1.4186 => 1.4434, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 1.60% (0.8921 => 0.9064, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.56% (17.1811 => 17.4495, std. dev.: 0.0114) MultiSource/Applications/hexxagon/hexxagon: 1.53% (1.2842 => 1.3038, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.45% (0.7115 => 0.7218, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.34% (2.2969 => 2.3276, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.32% (1.1840 => 1.1996, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9733, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.46% (4.2280 => 4.4167, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7504, std. dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.66% (3.1578 => 3.2102, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8337, std. dev.: 0.0021) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2329, std. dev.: 0.0313) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9196, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1261, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.51% (0.8651 => 0.1686, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.37% (5.2763 => 3.1465, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.45% (5.3855 => 3.6920, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.90% (5.3526 => 3.6987, std. dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0369, std. dev.: 0.0382) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.23% (2.9384 => 2.5496, std. dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: -10.37% (22.1758 => 19.8768, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.01% (3.8922 => 3.8528, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.74% (1.2373 => 1.1168, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.44% (2.7294 => 2.5536, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -5.93% (1.5373 => 1.4462, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: -4.67% (1.9577 => 1.8662, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.53% (4.8142 => 4.5962, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4835, std. dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.07% (8.1563 => 7.9055, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4204, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0031, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.75% (12.5348 => 12.3151, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4175, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8092, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 20:52:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 22:52:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120731035207.6E5293524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2510?compare_to=2508&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2510, Order: 161020, Start Time: 2012-07-31 02:38:30, End Time: 2012-07-31 03:52:33 To: 2508, Order: 161012, Start Time: 2012-07-31 00:56:37, End Time: 2012-07-31 02:10:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (145 on baseline) Performance Improvements: 1 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.08% (54.3263 => 56.5420, std. dev.: 0.0276) SingleSource/Benchmarks/Misc/fbench: 2.92% (2.2710 => 2.3373, std. dev.: 0.0142) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: -1.26% (28.0646 => 27.7107, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.54% (2.0176 => 2.3110, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.69% (0.5818 => 0.6382, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 9.53% (0.5748 => 0.6296, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.12% (0.7061 => 0.7705, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 8.81% (0.3789 => 0.4123, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 8.80% (0.3578 => 0.3893, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.69% (0.3646 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.66% (0.3601 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.57% (0.3663 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.55% (0.3650 => 0.3962, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 8.50% (0.3623 => 0.3931, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.41% (0.3914 => 0.4243, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.27% (0.3940 => 0.4266, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.27% (0.4003 => 0.4334, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.25% (0.1819 => 0.1969, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.36% (1.3693 => 1.4701, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash: 7.09% (0.4062 => 0.4350, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (0.4328 => 0.4633, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (3.9660 => 4.2387, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.74% (0.7710 => 0.8230, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.72% (0.2782 => 0.2969, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.69% (0.5265 => 0.5617, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 6.59% (0.7038 => 0.7502, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.51% (0.3899 => 0.4153, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2607 => 0.2774, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2690 => 0.2862, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.33% (0.2655 => 0.2823, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.25% (0.3022 => 0.3211, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.20% (0.2966 => 0.3150, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2760 => 0.2931, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.18% (0.2765 => 0.2936, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.17% (0.3580 => 0.3801, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/fibo: 6.16% (0.2628 => 0.2790, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.16% (0.2937 => 0.3118, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.06% (1.9828 => 2.1029, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2696 => 0.2859, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.02% (0.2726 => 0.2890, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2761 => 0.2927, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.00% (0.3485 => 0.3694, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.3107 => 0.3290, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.86% (0.2988 => 0.3163, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.85% (0.3489 => 0.3693, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.84% (0.3149 => 0.3333, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.67% (0.3192 => 0.3373, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.56% (0.6959 => 0.7346, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.56% (0.5577 => 0.5887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.47% (0.3293 => 0.3473, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.44% (0.3453 => 0.3641, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.41% (16.6129 => 17.5124, std. dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.41% (1.2193 => 1.2853, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.32% (0.3534 => 0.3722, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.28% (13.8202 => 14.5497, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.22% (0.9199 => 0.9679, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.14% (0.3868 => 0.4067, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.14% (0.3756 => 0.3949, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.10% (0.4016 => 0.4221, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.08% (0.4390 => 0.4613, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.95% (0.2243 => 0.2354, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.74% (0.2914 => 0.3052, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.72% (0.5637 => 0.5903, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.65% (1.4563 => 1.5240, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.62% (0.7506 => 0.7853, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.62% (7.2180 => 7.5512, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.51% (1.1364 => 1.1877, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.51% (13.2842 => 13.8834, std. dev.: 0.0156) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.50% (0.7460 => 0.7796, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.47% (0.3246 => 0.3391, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.47% (1.1061 => 1.1555, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.34% (1.9270 => 2.0106, std. dev.: 0.0100) MultiSource/Benchmarks/MallocBench/gs/gs: 4.33% (3.8646 => 4.0319, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 4.32% (1.2292 => 1.2823, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.31% (0.8310 => 0.8668, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 4.26% (1.0594 => 1.1045, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.25% (1.3813 => 1.4400, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.25% (1.3819 => 1.4406, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.23% (1.3245 => 1.3805, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.13% (0.3755 => 0.3910, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (4.3801 => 4.5525, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.88% (3.6692 => 3.8116, std. dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (4.4433 => 4.6144, std. dev.: 0.0067) MultiSource/Applications/siod/siod: 3.73% (2.1791 => 2.2603, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.70% (0.3220 => 0.3339, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.55% (0.4791 => 0.4961, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.48% (1.1333 => 1.1727, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.45% (4.9865 => 5.1586, std. dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.40% (0.8698 => 0.8994, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.23% (0.3131 => 0.3232, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.18% (0.6283 => 0.6483, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.13% (3.1889 => 3.2887, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 3.11% (4.6629 => 4.8078, std. dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.06% (0.6135 => 0.6323, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 2.97% (0.4113 => 0.4235, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.81% (8.4961 => 8.7346, std. dev.: 0.0157) MultiSource/Applications/JM/ldecod/ldecod: 2.68% (6.5754 => 6.7516, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.61% (2.1007 => 2.1556, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 2.58% (14.8535 => 15.2371, std. dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 2.55% (14.5298 => 14.8999, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.53% (3.2742 => 3.3571, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.41% (16.2614 => 16.6530, std. dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/bigfib: 1.82% (0.6250 => 0.6364, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.52% (0.9108 => 0.9246, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.51% (1.0313 => 1.0469, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.07% (33.2944 => 33.6518, std. dev.: 0.0078) MultiSource/Applications/lua/lua: 1.02% (3.7467 => 3.7848, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.39% (5.7573 => 7.5067, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/fbench: 28.60% (1.8175 => 2.3373, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/mandel-2: 7.70% (1.2998 => 1.3999, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.67% (0.9996 => 1.0563, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: 4.35% (7.4271 => 7.7499, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 3.97% (11.2619 => 11.7092, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4773, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8153, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0310 => 1.0566, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (1.5089 => 1.5344, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: 1.31% (4.5928 => 4.6529, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1940, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.23% (1.9290 => 1.9527, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1683, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (3.1071 => 3.1388, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.19% (22.5627 => 21.1652, std. dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.75% (0.0997 => 0.0830, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.03% (1.2308 => 1.1074, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3082, std. dev.: 0.0023) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.12% (0.4867 => 0.4715, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.79% (8.8259 => 8.5794, std. dev.: 0.0153) MultiSource/Applications/spiff/spiff: -2.66% (3.0263 => 2.9457, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2215, std. dev.: 0.0133) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5040, std. dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: -1.81% (28.2225 => 27.7107, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.70% (20.3410 => 19.9962, std. dev.: 0.0180) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.67% (7.3305 => 7.2084, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2482, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 21:26:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 23:26:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120731042618.4AFD63524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2511?compare_to=2509&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2511, Order: 161021, Start Time: 2012-07-31 03:08:17, End Time: 2012-07-31 04:26:45 To: 2509, Order: 161014, Start Time: 2012-07-31 01:21:58, End Time: 2012-07-31 02:40:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 7 (96 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 927 (743 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.69% (2.3828 => 2.4470, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.07% (3.6920 => 3.7686, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.07% (3.6987 => 3.7753, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.75% (7.3741 => 7.5028, std. dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: 1.32% (10.9157 => 11.0603, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.22% (1.8882 => 1.9113, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.08% (5.9398 => 6.0037, std. dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.45% (10.3673 => 13.7315, std. dev.: 0.0080) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3473 => 0.3928, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.81% (0.3497 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.81% (0.3561 => 0.4017, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.79% (0.3543 => 0.3996, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 12.74% (0.3516 => 0.3964, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.64% (0.3543 => 0.3991, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 12.56% (0.3694 => 0.4158, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3828 => 0.4288, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.94% (1.1194 => 1.2531, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.76% (0.3886 => 0.4343, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.74% (0.3927 => 0.4388, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.12% (2.2022 => 2.4470, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.54% (1.7609 => 1.9113, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 8.10% (0.1432 => 0.1548, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2065 => 0.2210, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.95% (0.5925 => 0.6337, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.95% (0.6030 => 0.6449, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (0.1622 => 0.1731, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.61% (0.1892 => 0.2017, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.55% (0.3177 => 0.3385, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.36% (7.0540 => 7.5028, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/oourafft: 6.22% (0.3282 => 0.3486, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.98% (10.4361 => 11.0603, std. dev.: 0.0091) SingleSource/UnitTests/ObjC++/property-reference: 5.75% (0.7326 => 0.7747, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.72% (0.4879 => 0.5158, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.4615 => 0.4853, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 4.51% (9.4845 => 9.9119, std. dev.: 0.0143) MultiSource/Applications/lambda-0_1_3/lambda: 4.44% (0.7433 => 0.7763, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: 4.42% (0.2554 => 0.2667, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.32% (4.9449 => 5.1585, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.29% (5.0018 => 5.2162, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.28% (0.8172 => 0.8522, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.25% (5.7591 => 6.0037, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.00% (0.5569 => 0.5792, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.82% (4.2646 => 4.4274, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.81% (0.5860 => 0.6083, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.73% (8.1363 => 8.4398, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.72% (0.3121 => 0.3237, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 3.62% (0.3423 => 0.3547, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 3.55% (0.3180 => 0.3293, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 3.47% (0.3109 => 0.3217, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.40% (0.7835 => 0.8101, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (1.3050 => 1.3484, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.33% (14.3668 => 14.8445, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.31% (1.1861 => 1.2254, std. dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 3.31% (0.3387 => 0.3499, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.29% (1.5603 => 1.6116, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 3.27% (0.3092 => 0.3193, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.18% (0.3650 => 0.3766, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.16% (1.1642 => 1.2010, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 3.05% (0.4289 => 0.4420, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.98% (0.3826 => 0.3940, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.92% (0.4103 => 0.4223, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.90% (3.3354 => 3.4322, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.88% (2.0665 => 2.1260, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.81% (0.8067 => 0.8294, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.78% (0.4636 => 0.4765, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4299 => 0.4418, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.73% (2.0273 => 2.0826, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.4203 => 0.4317, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.71% (1.5415 => 1.5832, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (0.4064 => 0.4173, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.64% (0.3935 => 0.4039, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.60% (0.6456 => 0.6624, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.56% (3.8723 => 3.9716, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.55% (0.5105 => 0.5235, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.53% (0.4620 => 0.4737, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.52% (0.4048 => 0.4150, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.38% (0.9765 => 0.9997, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.28% (0.6450 => 0.6597, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.28% (1.5859 => 1.6220, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.23% (0.6675 => 0.6824, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.18% (2.2024 => 2.2505, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.17% (0.5981 => 0.6111, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.15% (1.4186 => 1.4491, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.09% (1.2842 => 1.3111, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.78% (0.8921 => 0.9080, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.71% (0.7115 => 0.7237, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.69% (17.1811 => 17.4715, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 1.66% (2.2969 => 2.3350, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.61% (1.1840 => 1.2031, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.23% (1.0722 => 1.0854, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.84% (4.2280 => 4.3904, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7549, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2138, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5086 => 1.5336, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8323, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 1.50% (2.2771 => 2.3112, std. dev.: 0.0110) MultiSource/Applications/minisat/minisat: 1.49% (9.1159 => 9.2516, std. dev.: 0.0060) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2036, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1276, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.94% (5.2763 => 3.1688, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.02% (5.3855 => 3.7686, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.47% (5.3526 => 3.7753, std. dev.: 0.0078) SingleSource/UnitTests/Vector/constpool: -15.04% (54.1659 => 46.0196, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.95% (2.9384 => 2.5580, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -10.04% (22.1758 => 19.9497, std. dev.: 0.0218) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0998 => 0.0844, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -9.73% (1.2373 => 1.1169, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -8.07% (1.5373 => 1.4133, std. dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -4.71% (1.9577 => 1.8654, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5104, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.28% (8.6802 => 8.3958, std. dev.: 0.0172) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4854, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9121, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0006, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3229, std. dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4176, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.25% (1.8329 => 1.8100, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2494, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 21:48:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 30 Jul 2012 23:48:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120731044837.75EAE3524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2512?compare_to=2507&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2512, Order: 161019, Start Time: 2012-07-31 02:05:42, End Time: 2012-07-31 04:49:04 To: 2507, Order: 161001, Start Time: 2012-07-30 22:53:57, End Time: 2012-07-31 01:37:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (77 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (805 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.87% (1.6774 => 1.7087, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.23% (2.7838 => 2.8181, std. dev.: 0.0114) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.09% (0.3465 => 0.3884, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.08% (0.3469 => 0.3888, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 12.07% (0.3446 => 0.3862, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3442 => 0.3857, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.01% (0.3488 => 0.3907, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.96% (0.3496 => 0.3914, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.94% (0.3460 => 0.3873, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.59% (0.3650 => 0.4073, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.58% (0.3643 => 0.4065, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.28% (0.3724 => 0.4144, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.25% (1.5932 => 1.7087, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.92% (0.5826 => 0.6229, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.83% (0.5889 => 0.6291, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.1620 => 0.1726, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.50% (1.6211 => 1.7102, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.26% (3.5627 => 3.7500, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.14% (0.4361 => 0.4585, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (0.4994 => 0.5247, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: 5.05% (0.7171 => 0.7533, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 4.82% (0.4029 => 0.4223, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.68% (0.5900 => 0.6176, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.68% (1.3152 => 1.3767, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.62% (0.5000 => 0.5231, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.58% (0.3930 => 0.4110, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 4.50% (1.0781 => 1.1266, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.28% (4.2109 => 4.3913, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (0.5026 => 0.5241, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.94% (0.2866 => 0.2979, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2750 => 0.2857, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.83% (2.7292 => 2.8338, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.78% (5.5417 => 5.7510, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (1.9966 => 2.0655, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.43% (1.9694 => 2.0369, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.34% (0.3890 => 0.4020, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.26% (0.3317 => 0.3425, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.26% (2.1013 => 2.1697, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.26% (0.3195 => 0.3299, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.25% (0.9909 => 1.0231, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.24% (0.4658 => 0.4809, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.19% (4.4195 => 4.5605, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.18% (0.3271 => 0.3375, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (0.3625 => 0.3737, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.08% (2.0673 => 2.1310, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 3.08% (1.8794 => 1.9372, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.07% (0.3903 => 0.4023, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.97% (0.6634 => 0.6831, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 2.96% (23.5202 => 24.2163, std. dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (2.1653 => 2.2281, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.85% (4.6177 => 4.7492, std. dev.: 0.0113) MultiSource/Applications/hbd/hbd: 2.84% (0.9697 => 0.9972, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.83% (0.4139 => 0.4256, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 2.71% (0.3726 => 0.3827, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.67% (0.7875 => 0.8085, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.62% (1.4269 => 1.4643, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 2.53% (0.4146 => 0.4251, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.40% (0.5546 => 0.5679, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.5012 => 0.5112, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.94% (0.6435 => 0.6560, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.39% (2.0346 => 2.0629, std. dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (2.5769 => 2.9634, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6689, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 4.80% (1.8057 => 1.8924, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1686, std. dev.: 0.0566) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (105.3826 => 107.6741, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2108, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4955, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5921, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2228, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.92% (2.4764 => 2.4288, std. dev.: 0.0164) MultiSource/Applications/kimwitu++/kc: -1.47% (11.9555 => 11.7800, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5508, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: -9.16% (17.2379 => 15.6586, std. dev.: 0.2472) SingleSource/Benchmarks/Shootout-C++/ary2: -9.12% (0.2402 => 0.2183, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7953, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/moments: -3.94% (0.4438 => 0.4263, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7992, std. dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/dry: -3.56% (14.0481 => 13.5480, std. dev.: 0.0185) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5807, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 22:33:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 00:33:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120731053353.3C1723524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2513?compare_to=2510&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2513, Order: 161024, Start Time: 2012-07-31 04:20:28, End Time: 2012-07-31 05:34:20 To: 2510, Order: 161020, Start Time: 2012-07-31 02:38:30, End Time: 2012-07-31 03:52:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (143 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.22% (0.5361 => 0.5480, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -3.71% (2.3373 => 2.2506, std. dev.: 0.0117) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.34% (2.0176 => 2.3069, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5818 => 0.6360, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.13% (0.7061 => 0.7706, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5748 => 0.6270, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.86% (0.3578 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.86% (0.3646 => 0.3969, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.75% (0.3601 => 0.3916, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.63% (0.3650 => 0.3965, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.61% (0.3623 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.57% (0.3663 => 0.3977, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.50% (0.3789 => 0.4111, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.38% (0.3914 => 0.4242, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.19% (0.4003 => 0.4331, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.10% (0.3940 => 0.4259, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.26% (0.1819 => 0.1951, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 6.83% (1.3693 => 1.4628, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.76% (0.7710 => 0.8231, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.62% (3.9660 => 4.2286, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 6.54% (0.2781 => 0.2963, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.51% (0.2596 => 0.2765, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.48% (0.5265 => 0.5606, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.40% (0.4328 => 0.4605, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.29% (0.2782 => 0.2957, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.28% (0.7038 => 0.7480, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.80% (0.2690 => 0.2846, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hello: 5.79% (0.2607 => 0.2758, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.74% (0.4062 => 0.4295, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 5.69% (0.2760 => 0.2917, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.67% (0.3899 => 0.4120, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.66% (0.3022 => 0.3193, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.64% (0.4379 => 0.4626, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.63% (0.2966 => 0.3133, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.2655 => 0.2804, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2761 => 0.2912, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (0.3485 => 0.3675, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.40% (0.6959 => 0.7335, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.39% (0.2726 => 0.2873, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.38% (0.2696 => 0.2841, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.30% (1.9828 => 2.0879, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.30% (1.2193 => 1.2839, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.22% (0.3489 => 0.3671, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.3107 => 0.3268, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.12% (16.6129 => 17.4639, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.11% (0.9199 => 0.9669, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.98% (0.5577 => 0.5855, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 4.89% (0.3192 => 0.3348, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.86% (13.8202 => 14.4923, std. dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/sieve: 4.84% (0.3453 => 0.3620, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.73% (0.3534 => 0.3701, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.65% (0.4390 => 0.4594, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3293 => 0.3446, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.61% (1.4563 => 1.5234, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.53% (7.2180 => 7.5449, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.3756 => 0.3926, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.52% (0.5637 => 0.5892, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.51% (0.4016 => 0.4197, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.50% (0.2914 => 0.3045, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.44% (13.2842 => 13.8743, std. dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/moments: 4.42% (0.3868 => 0.4039, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.38% (1.1364 => 1.1862, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.37% (0.3246 => 0.3388, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.32% (0.7506 => 0.7830, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 4.14% (0.8310 => 0.8654, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.11% (3.8646 => 4.0236, std. dev.: 0.0056) MultiSource/Applications/Burg/burg: 4.11% (1.1061 => 1.1516, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.10% (1.3819 => 1.4385, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.08% (1.3813 => 1.4377, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.08% (0.7460 => 0.7764, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2945 => 0.3065, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.05% (1.9270 => 2.0050, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.04% (1.0594 => 1.1022, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.02% (1.3245 => 1.3777, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.2292 => 1.2763, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.69% (4.3801 => 4.5417, std. dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 3.67% (0.2995 => 0.3105, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.62% (3.6692 => 3.8022, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.56% (4.4433 => 4.6013, std. dev.: 0.0036) MultiSource/Applications/siod/siod: 3.49% (2.1791 => 2.2551, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3755 => 0.3885, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.35% (4.9865 => 5.1537, std. dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.32% (0.4791 => 0.4950, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.20% (1.1333 => 1.1696, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.96% (3.1889 => 3.2834, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.84% (0.6135 => 0.6309, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.83% (0.8698 => 0.8944, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4113 => 0.4227, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.77% (0.6283 => 0.6457, std. dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (8.4961 => 8.7266, std. dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (6.5754 => 6.7431, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 2.52% (4.6629 => 4.7804, std. dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 2.49% (16.2614 => 16.6656, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 2.45% (14.8535 => 15.2180, std. dev.: 0.0188) MultiSource/Applications/ClamAV/clamscan: 2.45% (14.5298 => 14.8861, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.37% (2.1007 => 2.1504, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (3.2742 => 3.3457, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.15% (1.5188 => 1.5515, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.22% (1.0313 => 1.0439, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.21% (0.9108 => 0.9218, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.08% (33.2944 => 33.6541, std. dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5172, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/fbench: 23.83% (1.8175 => 2.2506, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/mandel-2: 8.55% (1.2998 => 1.4109, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.37% (0.9996 => 1.0533, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: 4.28% (7.4271 => 7.7452, std. dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 3.97% (11.2619 => 11.7091, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9658, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4768, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.55% (1.7688 => 1.8139, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0310 => 1.0558, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9550, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 1.16% (4.5928 => 4.6461, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1683, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1401, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.54% (22.5627 => 21.0873, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.76% (0.0997 => 0.0810, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.74% (1.2308 => 1.1109, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3082, std. dev.: 0.0125) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5135, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.62% (3.0263 => 2.9469, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.43% (8.8259 => 8.6115, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2235, std. dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.85% (20.3410 => 19.9651, std. dev.: 0.0201) MultiSource/Benchmarks/mafft/pairlocalalign: -1.81% (28.2225 => 27.7109, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.78% (6.6320 => 6.5141, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8606, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2366, std. dev.: 0.0199) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2523, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2253, std. dev.: 0.0247) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jul 30 23:12:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 01:12:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120731061250.0B3343524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2514?compare_to=2511&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2514, Order: 161025, Start Time: 2012-07-31 04:54:43, End Time: 2012-07-31 06:13:15 To: 2511, Order: 161021, Start Time: 2012-07-31 03:08:17, End Time: 2012-07-31 04:26:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (81 on baseline) Performance Improvements: 7 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 927 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.02% (2.4470 => 2.3976, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.64% (3.7686 => 3.7069, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.55% (3.7753 => 3.7167, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -1.38% (11.0603 => 10.9074, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.30% (7.5028 => 7.4052, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.06% (2.1260 => 2.1035, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.12% (3.8229 => 3.7800, std. dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.36% (10.3673 => 13.8261, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: 12.12% (0.3473 => 0.3894, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.01% (0.3497 => 0.3917, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.85% (0.3543 => 0.3963, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-4: 11.83% (0.3543 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.82% (0.3561 => 0.3982, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.80% (0.3516 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.51% (0.3694 => 0.4119, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.40% (1.1194 => 1.2470, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.21% (0.3828 => 0.4257, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.94% (0.3886 => 0.4311, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.75% (0.3927 => 0.4349, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.87% (2.2022 => 2.3976, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.26% (0.1622 => 0.1756, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.59% (1.7609 => 1.8946, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1892 => 0.2022, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.3177 => 0.3367, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.70% (0.6030 => 0.6374, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.70% (0.5925 => 0.6263, std. dev.: 0.0086) SingleSource/UnitTests/ObjC++/property-reference: 5.05% (0.7326 => 0.7696, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.98% (7.0540 => 7.4052, std. dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.85% (0.4615 => 0.4839, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.52% (10.4361 => 10.9074, std. dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: 4.08% (0.7433 => 0.7736, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.95% (9.4845 => 9.8596, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.93% (0.8172 => 0.8493, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 3.92% (5.7591 => 5.9851, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (4.9449 => 5.1346, std. dev.: 0.0099) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.82% (5.0018 => 5.1927, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.62% (4.2646 => 4.4190, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.36% (0.3423 => 0.3538, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.31% (8.1363 => 8.4055, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.24% (0.7835 => 0.8089, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.1861 => 1.2239, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.03% (14.3668 => 14.8025, std. dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.01% (1.3050 => 1.3443, std. dev.: 0.0135) MultiSource/Applications/Burg/burg: 2.86% (1.1642 => 1.1975, std. dev.: 0.0064) MultiSource/Applications/d/make_dparser: 2.85% (3.3354 => 3.4305, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.62% (2.0273 => 2.0804, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.58% (0.8067 => 0.8275, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.52% (1.5415 => 1.5804, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.50% (0.4636 => 0.4752, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.46% (1.5603 => 1.5987, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 2.40% (0.4299 => 0.4402, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.36% (3.8723 => 3.9637, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.33% (0.5105 => 0.5224, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.16% (2.2024 => 2.2500, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.14% (0.9765 => 0.9974, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.06% (1.5859 => 1.6185, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.03% (0.6456 => 0.6587, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.98% (0.6450 => 0.6578, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.91% (0.5981 => 0.6095, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.83% (1.4186 => 1.4446, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.79% (2.0665 => 2.1035, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 1.70% (0.8921 => 0.9073, std. dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.62% (17.1811 => 17.4599, std. dev.: 0.0298) MultiSource/Applications/siod/siod: 1.46% (2.2969 => 2.3305, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 1.40% (1.1840 => 1.2006, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 1.15% (1.2842 => 1.2990, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.04% (1.0722 => 1.0833, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.56% (4.2280 => 4.4206, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7570, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.66% (11.6436 => 11.8369, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5086 => 1.5329, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 1.58% (3.1578 => 3.2078, std. dev.: 0.0026) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2039, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2192, std. dev.: 0.0291) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9195, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.46% (5.2763 => 3.1417, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.17% (5.3855 => 3.7069, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.56% (5.3526 => 3.7167, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -15.09% (54.1659 => 45.9931, std. dev.: 0.0259) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.61% (2.9384 => 2.5386, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: -10.17% (22.1758 => 19.9206, std. dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.23% (0.0998 => 0.0836, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: -10.35% (1.2373 => 1.1093, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -8.99% (1.5373 => 1.3991, std. dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.20% (1.5835 => 1.5012, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.66% (1.9577 => 1.8665, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5956, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4786, std. dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4128, std. dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.07% (8.1563 => 7.9061, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0006, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.76% (12.5348 => 12.3148, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0053) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4185, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.35% (1.8329 => 1.8082, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2497, std. dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 00:18:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 02:18:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120731071838.4A3003524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2515?compare_to=2513&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2515, Order: 161031, Start Time: 2012-07-31 06:02:35, End Time: 2012-07-31 07:19:03 To: 2513, Order: 161024, Start Time: 2012-07-31 04:20:28, End Time: 2012-07-31 05:34:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (124 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (732 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.23% (2.0176 => 2.3047, std. dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference-object: 8.87% (0.5818 => 0.6334, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.73% (0.5748 => 0.6250, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.36% (0.3578 => 0.3877, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.30% (0.3601 => 0.3900, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.26% (0.3646 => 0.3947, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.22% (0.3663 => 0.3964, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.21% (0.3789 => 0.4100, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.14% (0.3623 => 0.3918, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3650 => 0.3947, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 7.95% (0.3914 => 0.4225, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 7.90% (0.7061 => 0.7619, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 7.82% (0.3940 => 0.4248, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.72% (0.4003 => 0.4312, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.64% (0.3130 => 0.3369, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.40% (0.1986 => 0.2133, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.15% (1.3693 => 1.4672, std. dev.: 0.0085) SingleSource/Regression/C++/ofstream_ctor: 6.76% (0.2781 => 0.2969, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4328 => 0.4620, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.58% (0.2782 => 0.2965, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.55% (0.7038 => 0.7499, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.54% (0.7710 => 0.8214, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (3.9660 => 4.2192, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.32% (0.5265 => 0.5598, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.32% (0.2596 => 0.2760, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 6.18% (0.2607 => 0.2768, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.17% (0.2721 => 0.2889, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.13% (0.2690 => 0.2855, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4062 => 0.4307, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.03% (0.2655 => 0.2815, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.90% (0.2966 => 0.3141, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wc: 5.89% (0.2937 => 0.3110, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.87% (0.2760 => 0.2922, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.86% (0.3022 => 0.3199, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.74% (0.3485 => 0.3685, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.72% (0.3899 => 0.4122, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 5.69% (0.2761 => 0.2918, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.64% (0.2696 => 0.2848, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.62% (1.9828 => 2.0943, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.49% (0.3149 => 0.3322, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.47% (0.3580 => 0.3776, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.3489 => 0.3679, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.35% (0.2988 => 0.3148, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.4379 => 0.4607, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.13% (0.6959 => 0.7316, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 5.10% (0.3453 => 0.3629, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.99% (1.2193 => 1.2801, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.93% (0.5577 => 0.5852, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.92% (0.9199 => 0.9652, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.92% (0.3534 => 0.3708, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.91% (16.6129 => 17.4285, std. dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/lists: 4.89% (0.3293 => 0.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.86% (0.4016 => 0.4211, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.78% (0.4390 => 0.4600, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.71% (0.3756 => 0.3933, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.68% (0.3868 => 0.4049, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.42% (0.5637 => 0.5886, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.2945 => 0.3075, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.29% (0.2914 => 0.3039, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.23% (7.2180 => 7.5236, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/09-vor/vor: 4.21% (0.2925 => 0.3048, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.19% (1.4563 => 1.5173, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.13% (1.1364 => 1.1833, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.07% (1.2292 => 1.2792, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.06% (13.2842 => 13.8229, std. dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.04% (0.3246 => 0.3377, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.01% (3.8646 => 4.0196, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.91% (0.7460 => 0.7752, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 3.87% (0.8310 => 0.8632, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.86% (1.3819 => 1.4353, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.84% (1.3813 => 1.4344, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (1.3245 => 1.3754, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.0594 => 1.1001, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.62% (0.3755 => 0.3891, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3220 => 0.3330, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.42% (4.3801 => 4.5297, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.39% (4.4433 => 4.5938, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.37% (3.6692 => 3.7929, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.21% (4.9865 => 5.1467, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.17% (0.4791 => 0.4943, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1333 => 1.1678, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.90% (0.8698 => 0.8950, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.61% (0.6135 => 0.6295, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 2.48% (0.4113 => 0.4215, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.47% (0.6283 => 0.6438, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 2.45% (8.4961 => 8.7042, std. dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.25% (2.1007 => 2.1479, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (3.2742 => 3.3396, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5136, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/fbench: 24.66% (1.8175 => 2.2657, std. dev.: 0.0229) SingleSource/Benchmarks/Misc/mandel-2: 7.85% (1.2998 => 1.4018, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.16% (0.9996 => 1.0512, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7547, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7041, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4778, std. dev.: 0.0230) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8149, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5345, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0407, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.18% (1.9290 => 1.9517, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (3.1071 => 3.1389, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.52% (22.5627 => 21.0909, std. dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.88% (0.3511 => 0.3410, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.18% (0.8818 => 0.8714, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.05% (0.0997 => 0.0827, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.99% (1.2308 => 1.1079, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3133, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.95% (1.9762 => 1.9179, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5801, std. dev.: 0.0165) MultiSource/Applications/spiff/spiff: -2.57% (3.0263 => 2.9486, std. dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.3560 => 6.2198, std. dev.: 0.0076) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.06% (6.6320 => 6.4955, std. dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: -1.81% (28.2225 => 27.7105, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.74% (20.3410 => 19.9865, std. dev.: 0.0288) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.61% (0.6589 => 0.6483, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4927, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2371, std. dev.: 0.0068) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2537, std. dev.: 0.0033) MultiSource/Applications/lua/lua: -1.14% (26.5159 => 26.2140, std. dev.: 0.0543) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8497, std. dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 01:01:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 03:01:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120731080147.792A83524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2516?compare_to=2514&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2516, Order: 161033, Start Time: 2012-07-31 06:41:14, End Time: 2012-07-31 08:02:13 To: 2514, Order: 161025, Start Time: 2012-07-31 04:54:43, End Time: 2012-07-31 06:13:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (65 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (774 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.32% (1.3991 => 1.4315, std. dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.02% (13.8261 => 13.2696, std. dev.: 0.1364) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.99% (10.3673 => 13.2696, std. dev.: 0.1364) SingleSource/UnitTests/ObjC/trivial-interface: 12.99% (0.3473 => 0.3924, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.62% (0.3543 => 0.3990, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 12.58% (0.3497 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.45% (0.3543 => 0.3984, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.40% (0.3516 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.38% (0.3561 => 0.4002, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.07% (0.3694 => 0.4140, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.68% (0.3828 => 0.4275, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.39% (1.1194 => 1.2469, std. dev.: 0.0299) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.46% (2.2022 => 2.3885, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.18% (1.7609 => 1.8874, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.24% (0.1906 => 0.2025, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 6.22% (0.6030 => 0.6405, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5925 => 0.6290, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 6.03% (0.7326 => 0.7768, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 4.44% (10.4361 => 10.8999, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/oourafft: 4.36% (0.3282 => 0.3425, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 4.26% (0.7433 => 0.7750, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 3.93% (9.4845 => 9.8574, std. dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: 3.92% (0.2554 => 0.2654, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.72% (0.5569 => 0.5776, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0046) MultiSource/Applications/spiff/spiff: 3.47% (0.7835 => 0.8107, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.37% (4.2646 => 4.4084, std. dev.: 0.0100) MultiSource/Benchmarks/McCat/09-vor/vor: 3.33% (0.3180 => 0.3286, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.26% (0.4636 => 0.4787, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.16% (8.1363 => 8.3937, std. dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: 3.08% (5.7591 => 5.9367, std. dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.08% (1.1861 => 1.2226, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 3.06% (1.5603 => 1.6080, std. dev.: 0.0093) MultiSource/Applications/Burg/burg: 3.04% (1.1642 => 1.1996, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.02% (1.3050 => 1.3444, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 2.82% (3.3354 => 3.4296, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 2.72% (2.0273 => 2.0825, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.59% (0.3865 => 0.3965, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.46% (3.8723 => 3.9676, std. dev.: 0.0102) MultiSource/Benchmarks/McCat/05-eks/eks: 2.37% (0.4299 => 0.4401, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.28% (0.6456 => 0.6603, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.05% (0.9765 => 0.9965, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.04% (0.5105 => 0.5209, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.2024 => 2.2459, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 1.78% (17.1811 => 17.4871, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.76% (1.4186 => 1.4436, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.75% (1.5859 => 1.6136, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 1.67% (2.2969 => 2.3353, std. dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.66% (0.6675 => 0.6786, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.60% (1.2842 => 1.3048, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 1.48% (0.8921 => 0.9053, std. dev.: 0.0033) MultiSource/Applications/lemon/lemon: 1.07% (1.0722 => 1.0837, std. dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9743, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.85% (4.2280 => 4.3908, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.25% (3.6395 => 3.7577, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2161, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 1.65% (11.6436 => 11.8352, std. dev.: 0.0224) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2267, std. dev.: 0.0406) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1288, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -80.50% (0.8651 => 0.1687, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.29% (5.2763 => 3.1504, std. dev.: 0.0595) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.50% (5.3855 => 3.6889, std. dev.: 0.0527) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.87% (5.3526 => 3.7002, std. dev.: 0.0543) SingleSource/UnitTests/Vector/constpool: -15.05% (54.1659 => 46.0123, std. dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.09% (2.9384 => 2.5538, std. dev.: 0.0751) MultiSource/Applications/ClamAV/clamscan: -10.21% (22.1758 => 19.9123, std. dev.: 0.0369) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.34% (3.8922 => 3.8401, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.29% (1.6925 => 1.4168, std. dev.: 0.0066) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.67% (1.2373 => 1.1053, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: -6.88% (1.5373 => 1.4315, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.48% (1.9577 => 1.8700, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4893, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9122, std. dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.6802 => 8.4326, std. dev.: 0.0916) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9996, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3231, std. dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std. dev.: 0.0367) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.25% (1.8329 => 1.8100, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -1.00% (3.2827 => 3.2498, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 01:03:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 03:03:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120731080351.D8A8A3524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2517?compare_to=2512&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2517, Order: 161026, Start Time: 2012-07-31 05:17:01, End Time: 2012-07-31 08:04:19 To: 2512, Order: 161019, Start Time: 2012-07-31 02:05:42, End Time: 2012-07-31 04:49:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (823 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.79% (0.3496 => 0.3943, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-4: 12.70% (0.3465 => 0.3905, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3442 => 0.3878, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-2: 12.65% (0.3446 => 0.3882, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.64% (0.3488 => 0.3929, std. dev.: 0.0087) SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3460 => 0.3896, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/synchronized: 12.51% (0.3469 => 0.3903, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions: 12.16% (0.3643 => 0.4086, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/property: 12.08% (0.3650 => 0.4091, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3724 => 0.4166, std. dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 7.16% (1.5932 => 1.7072, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference-object: 6.89% (0.5889 => 0.6295, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.25% (1.6211 => 1.7062, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.15% (3.5627 => 3.7461, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.93% (0.4994 => 0.5240, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.78% (0.5000 => 0.5239, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (0.5026 => 0.5261, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.66% (0.5900 => 0.6175, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.52% (1.3152 => 1.3746, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.48% (0.3930 => 0.4106, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.38% (0.4361 => 0.4552, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: 4.32% (0.4029 => 0.4203, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 4.31% (1.0781 => 1.1246, std. dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 3.86% (4.2109 => 4.3736, std. dev.: 0.0108) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.74% (2.7292 => 2.8313, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.70% (0.2866 => 0.2972, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.23% (1.9694 => 2.0331, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.20% (5.5417 => 5.7192, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.09% (1.9966 => 2.0582, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.03% (0.3890 => 0.4008, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.01% (0.9909 => 1.0207, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.96% (0.4658 => 0.4796, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.95% (0.4139 => 0.4261, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.84% (2.0673 => 2.1260, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.69% (4.4195 => 4.5386, std. dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (2.1653 => 2.2223, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 2.54% (1.8794 => 1.9272, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 2.51% (4.6177 => 4.7337, std. dev.: 0.0188) MultiSource/Applications/treecc/treecc: 2.49% (0.7875 => 0.8071, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.09% (0.9697 => 0.9900, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 2.00% (0.5546 => 0.5657, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.65% (0.6435 => 0.6541, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.53% (0.0734 => 0.0870, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9639, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6814, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8937, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1674, std. dev.: 0.0466) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6568, std. dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2129, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4957, std. dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.77% (3.1722 => 3.2285, std. dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5912, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.79% (11.9555 => 11.7415, std. dev.: 0.0170) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.98% (25.4195 => 16.5266, std. dev.: 0.0149) SingleSource/Benchmarks/Dhrystone/fldry: -7.85% (17.2379 => 15.8843, std. dev.: 0.1455) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9778, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7906, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary2: -6.12% (0.2402 => 0.2255, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: -3.92% (0.4438 => 0.4264, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8061, std. dev.: 0.1429) SingleSource/Benchmarks/Dhrystone/dry: -3.58% (14.0481 => 13.5456, std. dev.: 0.1403) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5709, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 02:00:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 04:00:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120731090050.E536B3524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2518?compare_to=2515&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2518, Order: 161037, Start Time: 2012-07-31 07:47:27, End Time: 2012-07-31 09:01:15 To: 2515, Order: 161031, Start Time: 2012-07-31 06:02:35, End Time: 2012-07-31 07:19:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (136 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (723 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.95% (54.4999 => 56.1095, std. dev.: 0.2700) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.22% (2.0176 => 2.3046, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.85% (0.5818 => 0.6333, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.73% (0.5748 => 0.6250, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.53% (0.3601 => 0.3908, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.45% (0.3646 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.38% (0.3578 => 0.3878, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.17% (0.3623 => 0.3919, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.16% (0.3650 => 0.3948, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 8.14% (0.3663 => 0.3961, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.13% (0.3789 => 0.4097, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.99% (0.7061 => 0.7625, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.99% (0.3130 => 0.3380, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.89% (0.3914 => 0.4223, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.77% (0.3940 => 0.4246, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.4003 => 0.4313, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.16% (1.3693 => 1.4674, std. dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 6.72% (0.2781 => 0.2968, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.65% (0.2782 => 0.2967, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (0.4328 => 0.4611, std. dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 6.35% (0.7038 => 0.7485, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.34% (0.5265 => 0.5599, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.32% (0.2596 => 0.2760, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.31% (3.9660 => 4.2164, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.28% (0.2721 => 0.2892, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.24% (0.7710 => 0.8191, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 6.18% (0.2607 => 0.2768, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2690 => 0.2856, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.01% (0.2628 => 0.2786, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2655 => 0.2814, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.4062 => 0.4303, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 5.86% (0.2937 => 0.3109, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.83% (0.2966 => 0.3139, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.82% (0.3022 => 0.3198, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.75% (0.2765 => 0.2924, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.71% (0.2696 => 0.2850, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.69% (0.2761 => 0.2918, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.68% (1.9828 => 2.0954, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.67% (0.3489 => 0.3687, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.65% (0.3485 => 0.3682, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3899 => 0.4118, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.53% (0.3149 => 0.3323, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.47% (0.3580 => 0.3776, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.39% (0.2988 => 0.3149, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.27% (0.6959 => 0.7326, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 5.20% (0.3192 => 0.3358, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4379 => 0.4604, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.04% (0.3293 => 0.3459, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.04% (0.3534 => 0.3712, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.00% (1.2193 => 1.2803, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.94% (0.9199 => 0.9653, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.81% (0.4390 => 0.4601, std. dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 4.81% (16.6129 => 17.4113, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.73% (0.5577 => 0.5841, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 4.73% (13.8202 => 14.4734, std. dev.: 0.0179) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.71% (0.3756 => 0.3933, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.60% (0.3868 => 0.4046, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.55% (0.2925 => 0.3058, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.2945 => 0.3075, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.40% (0.5637 => 0.5885, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.22% (7.2180 => 7.5227, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.22% (0.2914 => 0.3037, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.21% (1.4563 => 1.5176, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.13% (1.1364 => 1.1833, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 4.08% (1.2292 => 1.2793, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.04% (0.3246 => 0.3377, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.03% (1.1061 => 1.1507, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.03% (13.2842 => 13.8189, std. dev.: 0.0149) MultiSource/Benchmarks/MallocBench/gs/gs: 3.99% (3.8646 => 4.0189, std. dev.: 0.0046) MultiSource/Applications/spiff/spiff: 3.98% (0.7506 => 0.7805, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.94% (0.7460 => 0.7754, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.89% (1.3813 => 1.4351, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.81% (1.3245 => 1.3749, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.78% (1.0594 => 1.0994, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.76% (1.3819 => 1.4338, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (0.8310 => 0.8622, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 3.75% (1.9270 => 1.9993, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 3.35% (0.3220 => 0.3328, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.34% (4.3801 => 4.5265, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.32% (4.4433 => 4.5909, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.30% (3.6692 => 3.7902, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.15% (4.9865 => 5.1437, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.14% (2.1791 => 2.2475, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.96% (0.4791 => 0.4933, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.94% (1.1333 => 1.1666, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.83% (0.8698 => 0.8944, std. dev.: 0.0062) MultiSource/Applications/d/make_dparser: 2.72% (3.1889 => 3.2756, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.64% (0.6283 => 0.6449, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.58% (0.6135 => 0.6293, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 2.43% (8.4961 => 8.7026, std. dev.: 0.0147) MultiSource/Applications/sqlite3/sqlite3: 2.26% (16.2614 => 16.6290, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 2.26% (6.5754 => 6.7238, std. dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: 2.18% (14.5298 => 14.8472, std. dev.: 0.0155) MultiSource/Applications/JM/lencod/lencod: 2.09% (14.8535 => 15.1641, std. dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 2.07% (4.6629 => 4.7593, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.96% (3.2742 => 3.3383, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.86% (1.5188 => 1.5470, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5116, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 25.13% (1.8175 => 2.2742, std. dev.: 0.0514) SingleSource/Benchmarks/Misc/mandel-2: 8.31% (1.2998 => 1.4078, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.16% (0.9996 => 1.0512, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: 4.39% (7.4271 => 7.7529, std. dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7031, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4771, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.00% (1.9199 => 1.9775, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8149, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.77% (3.7731 => 3.8399, std. dev.: 0.0220) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5339, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (1.9290 => 1.9581, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5943, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.15% (4.5928 => 4.6454, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6861, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1401, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.56% (22.5627 => 21.0823, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.85% (0.0997 => 0.0839, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -9.83% (1.2308 => 1.1098, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.35% (1.3780 => 1.3043, std. dev.: 0.0077) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.8259 => 8.5627, std. dev.: 0.0178) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.58% (3.0263 => 2.9483, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5006, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2392, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -1.81% (28.2225 => 27.7106, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.66% (20.3410 => 20.0031, std. dev.: 0.0397) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.61% (0.6589 => 0.6483, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8650, std. dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2350, std. dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4928, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2533, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2247, std. dev.: 0.0406) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 02:48:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 04:48:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120731094851.A8AE23524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2519?compare_to=2516&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2519, Order: 161037, Start Time: 2012-07-31 08:30:35, End Time: 2012-07-31 09:49:18 To: 2516, Order: 161033, Start Time: 2012-07-31 06:41:14, End Time: 2012-07-31 08:02:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (80 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.86% (78.4837 => 80.7264, std. dev.: 0.1500) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.91% (10.3673 => 13.2613, std. dev.: 0.0076) SingleSource/UnitTests/ObjC/trivial-interface: 13.04% (0.3473 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.75% (0.3497 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.59% (0.3543 => 0.3989, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.57% (0.3516 => 0.3958, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.50% (0.3561 => 0.4006, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.48% (0.3543 => 0.3985, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 12.21% (0.3694 => 0.4145, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.81% (0.3828 => 0.4280, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.50% (0.3886 => 0.4333, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 11.38% (0.3927 => 0.4374, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.33% (1.1194 => 1.2462, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.43% (2.2022 => 2.3879, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.17% (1.7609 => 1.8872, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.35% (0.5925 => 0.6301, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.34% (0.2065 => 0.2196, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.24% (0.1892 => 0.2010, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 6.17% (0.6030 => 0.6402, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.3177 => 0.3370, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 5.19% (0.7326 => 0.7706, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.66% (0.4615 => 0.4830, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.4879 => 0.5105, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.46% (7.0540 => 7.3684, std. dev.: 0.0140) MultiSource/Applications/JM/ldecod/ldecod: 4.40% (10.4361 => 10.8958, std. dev.: 0.0162) MultiSource/Applications/lambda-0_1_3/lambda: 4.33% (0.7433 => 0.7755, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 4.27% (0.3282 => 0.3422, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.94% (0.5860 => 0.6091, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 3.92% (0.2554 => 0.2654, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.87% (0.8172 => 0.8488, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (5.0018 => 5.1933, std. dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 3.83% (9.4845 => 9.8475, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (4.9449 => 5.1338, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/09-vor/vor: 3.58% (0.3180 => 0.3294, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.36% (4.2646 => 4.4080, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.28% (14.3668 => 14.8386, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.16% (8.1363 => 8.3932, std. dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 3.09% (5.7591 => 5.9372, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.08% (1.3050 => 1.3452, std. dev.: 0.0047) MultiSource/Applications/spiff/spiff: 3.05% (0.7835 => 0.8074, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.01% (1.1861 => 1.2218, std. dev.: 0.0127) MultiSource/Applications/hbd/hbd: 2.80% (1.5603 => 1.6040, std. dev.: 0.0088) MultiSource/Applications/d/make_dparser: 2.76% (3.3354 => 3.4276, std. dev.: 0.0043) MultiSource/Applications/Burg/burg: 2.75% (1.1642 => 1.1962, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.71% (0.4103 => 0.4214, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.64% (3.8723 => 3.9744, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.59% (1.5415 => 1.5814, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 2.54% (2.0273 => 2.0787, std. dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.46% (0.4636 => 0.4750, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 2.40% (0.4289 => 0.4392, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.36% (2.0665 => 2.1153, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.33% (0.8067 => 0.8255, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 2.18% (0.6456 => 0.6597, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.15% (0.9765 => 0.9975, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.2024 => 2.2459, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.94% (0.5981 => 0.6097, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.90% (17.1811 => 17.5082, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.86% (0.6450 => 0.6570, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.4186 => 1.4441, std. dev.: 0.0083) MultiSource/Applications/hexxagon/hexxagon: 1.71% (1.2842 => 1.3061, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 1.64% (0.8921 => 0.9067, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 1.17% (1.1840 => 1.1978, std. dev.: 0.0046) MultiSource/Applications/lemon/lemon: 1.10% (1.0722 => 1.0840, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.11% (4.2280 => 4.4017, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7570, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2161, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5086 => 1.5332, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8328, std. dev.: 0.0011) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2044, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.39% (1.3045 => 1.3226, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2260, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.31% (5.2763 => 3.1492, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.48% (5.3855 => 3.6903, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.84% (5.3526 => 3.7020, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -15.00% (54.1659 => 46.0411, std. dev.: 0.0311) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.13% (2.9384 => 2.5526, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.28% (22.1758 => 19.8960, std. dev.: 0.0389) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.26% (3.8922 => 3.8432, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.13% (1.2373 => 1.1119, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -6.04% (1.5373 => 1.4445, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.72% (1.9577 => 1.8653, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-5: -4.61% (1.5835 => 1.5105, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5952, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4766, std. dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.16% (8.1563 => 7.8988, std. dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4241, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9992, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.33% (1.3677 => 1.3358, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6790, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -1.66% (12.5348 => 12.3267, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4173, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -1.03% (3.2827 => 3.2489, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 03:42:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 05:42:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120731104218.01EF83524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2520?compare_to=2518&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2520, Order: 161038, Start Time: 2012-07-31 09:29:04, End Time: 2012-07-31 10:42:45 To: 2518, Order: 161037, Start Time: 2012-07-31 07:47:27, End Time: 2012-07-31 09:01:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (145 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.28% (2.0176 => 2.3057, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.69% (0.5818 => 0.6382, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.53% (0.5748 => 0.6296, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: 9.53% (0.3578 => 0.3919, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.44% (0.3601 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.43% (0.3646 => 0.3990, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.36% (0.3623 => 0.3962, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.32% (0.3650 => 0.3990, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.25% (0.3663 => 0.4002, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.24% (0.3789 => 0.4139, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.10% (0.3914 => 0.4270, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.78% (0.3940 => 0.4286, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.77% (0.4003 => 0.4354, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.74% (0.7061 => 0.7678, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.30% (1.3693 => 1.4692, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.98% (0.2781 => 0.2975, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.96% (0.7710 => 0.8247, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.90% (0.2782 => 0.2974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.89% (0.4328 => 0.4626, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.69% (3.9660 => 4.2314, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.65% (0.5265 => 0.5615, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2607 => 0.2777, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 6.47% (0.2690 => 0.2864, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.44% (0.7038 => 0.7491, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.44% (0.2937 => 0.3126, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.37% (0.2655 => 0.2824, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.25% (0.4062 => 0.4316, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2628 => 0.2792, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2760 => 0.2931, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.16% (0.2726 => 0.2894, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.15% (0.3022 => 0.3208, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.10% (0.2966 => 0.3147, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.08% (0.3899 => 0.4136, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.04% (0.2765 => 0.2932, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.99% (1.9828 => 2.1016, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 5.99% (0.3107 => 0.3293, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2761 => 0.2926, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.97% (0.2696 => 0.2857, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.94% (0.3149 => 0.3336, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.80% (0.3485 => 0.3687, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.76% (0.3192 => 0.3376, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.76% (0.3489 => 0.3690, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.75% (0.3580 => 0.3786, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.62% (0.2988 => 0.3156, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4379 => 0.4622, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.36% (0.3453 => 0.3638, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3534 => 0.3723, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.34% (0.3293 => 0.3469, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.30% (1.2193 => 1.2839, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.29% (0.6959 => 0.7327, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.22% (0.4390 => 0.4619, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.12% (16.6129 => 17.4628, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.09% (0.5577 => 0.5861, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.05% (0.4016 => 0.4219, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.01% (0.9199 => 0.9660, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.01% (0.3756 => 0.3944, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.90% (13.8202 => 14.4978, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/moments: 4.86% (0.3868 => 0.4056, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.59% (7.2180 => 7.5493, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.54% (0.5637 => 0.5893, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.50% (0.2914 => 0.3045, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.4563 => 1.5216, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.37% (0.7506 => 0.7834, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.36% (1.1364 => 1.1859, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.34% (13.2842 => 13.8606, std. dev.: 0.0196) MultiSource/Applications/Burg/burg: 4.32% (1.1061 => 1.1539, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.28% (0.3246 => 0.3385, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.25% (1.3813 => 1.4400, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 4.21% (1.2292 => 1.2810, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.20% (0.7460 => 0.7773, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.16% (1.3819 => 1.4394, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 4.06% (1.9270 => 2.0053, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 4.05% (3.8646 => 4.0211, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 4.01% (0.8310 => 0.8643, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.00% (1.3245 => 1.3775, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.99% (0.3755 => 0.3905, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.97% (1.0594 => 1.1015, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.76% (4.3801 => 4.5449, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (4.4433 => 4.6085, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 3.60% (0.3220 => 0.3336, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.56% (3.6692 => 3.8000, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.44% (0.2995 => 0.3098, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.39% (4.9865 => 5.1557, std. dev.: 0.0049) MultiSource/Applications/siod/siod: 3.25% (2.1791 => 2.2499, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.21% (1.1333 => 1.1697, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.15% (0.4791 => 0.4942, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.10% (0.8698 => 0.8968, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.93% (3.1889 => 3.2824, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.85% (0.6283 => 0.6462, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.80% (0.6135 => 0.6307, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 2.75% (0.4113 => 0.4226, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.62% (8.4961 => 8.7188, std. dev.: 0.0109) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (6.5754 => 6.7432, std. dev.: 0.0171) MultiSource/Applications/ClamAV/clamscan: 2.43% (14.5298 => 14.8834, std. dev.: 0.0121) MultiSource/Applications/JM/lencod/lencod: 2.42% (14.8535 => 15.2135, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 2.42% (16.2614 => 16.6555, std. dev.: 0.0164) MultiSource/Applications/oggenc/oggenc: 2.29% (4.6629 => 4.7698, std. dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.21% (2.1007 => 2.1471, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.07% (3.2742 => 3.3421, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.99% (1.5188 => 1.5490, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 1.81% (0.6250 => 0.6363, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.15% (1.0313 => 1.0432, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.11% (0.9108 => 0.9209, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 1.11% (33.2944 => 33.6634, std. dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5184, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/fbench: 25.44% (1.8175 => 2.2798, std. dev.: 0.0481) SingleSource/Benchmarks/Misc/mandel-2: 8.73% (1.2998 => 1.4133, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.27% (0.9996 => 1.0523, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: 4.34% (7.4271 => 7.7494, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7064, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4774, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.00% (1.9199 => 1.9775, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8150, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.24% (0.9692 => 0.9909, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5348, std. dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0112) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (1.9290 => 1.9560, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1966, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 1.22% (4.5928 => 4.6489, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.07% (1.1560 => 1.1684, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1392, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.00% (0.4657 => 0.4005, std. dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.44% (22.5627 => 21.1086, std. dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.86% (0.0997 => 0.0809, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.67% (1.2308 => 1.0995, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.82% (1.3780 => 1.3116, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.58% (3.0263 => 2.9481, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6013, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.06% (20.3410 => 19.9214, std. dev.: 0.0749) SingleSource/Benchmarks/Shootout/lists: -1.96% (6.3560 => 6.2313, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5107, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.81% (28.2225 => 27.7106, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2368, std. dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2493, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2217, std. dev.: 0.0397) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 04:15:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 06:15:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120731111535.EF5683524035@llvm.org> http://llvm.org/perf/db_default/v4/nts/2521?compare_to=2517&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2521, Order: 161037, Start Time: 2012-07-31 08:32:40, End Time: 2012-07-31 11:16:05 To: 2517, Order: 161026, Start Time: 2012-07-31 05:17:01, End Time: 2012-07-31 08:04:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (85 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (797 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.23% (0.3446 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.16% (0.3465 => 0.3921, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.09% (0.3460 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.07% (0.3442 => 0.3892, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.07% (0.3488 => 0.3944, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 13.06% (0.3469 => 0.3922, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.04% (0.3496 => 0.3952, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 12.63% (0.3643 => 0.4103, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.47% (0.3650 => 0.4105, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3724 => 0.4179, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.04% (0.1620 => 0.1734, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.81% (0.5826 => 0.6223, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.58% (1.5932 => 1.6981, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 6.57% (0.5889 => 0.6276, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.34% (3.5627 => 3.7529, std. dev.: 0.0089) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.32% (1.6211 => 1.7073, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 5.10% (0.7171 => 0.7537, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (0.4994 => 0.5247, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.79% (0.4361 => 0.4570, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (0.5000 => 0.5237, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.71% (1.3152 => 1.3771, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.66% (0.3930 => 0.4113, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.63% (0.5900 => 0.6173, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 4.42% (1.0781 => 1.1258, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 4.42% (0.4029 => 0.4207, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.24% (0.5026 => 0.5239, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 4.05% (4.2109 => 4.3813, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.02% (0.2736 => 0.2846, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.98% (0.2866 => 0.2980, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.97% (0.2875 => 0.2989, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.88% (0.3195 => 0.3319, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.80% (2.7292 => 2.8330, std. dev.: 0.0038) SingleSource/Regression/C++/ofstream_ctor: 3.66% (0.3004 => 0.3114, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.58% (0.9909 => 1.0264, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.58% (0.2792 => 0.2892, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.49% (2.0673 => 2.1395, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.45% (1.9694 => 2.0373, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 3.36% (0.3096 => 0.3200, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.28% (1.9966 => 2.0620, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.26% (0.3890 => 0.4017, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.26% (5.5417 => 5.7226, std. dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 3.24% (23.5202 => 24.2824, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.23% (0.3124 => 0.3225, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3258 => 0.3363, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (0.4658 => 0.4808, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 3.21% (0.3267 => 0.3372, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.08% (2.1013 => 2.1660, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.08% (4.4195 => 4.5555, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/moments: 3.05% (0.3678 => 0.3790, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 2.98% (0.3726 => 0.3837, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 2.93% (0.3477 => 0.3579, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.88% (0.4139 => 0.4258, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.3903 => 0.4013, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.81% (2.1653 => 2.2261, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 2.80% (0.9697 => 0.9969, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 2.80% (0.4146 => 0.4262, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 2.75% (4.6177 => 4.7447, std. dev.: 0.0082) MultiSource/Benchmarks/MallocBench/gs/gs: 2.72% (1.8794 => 1.9306, std. dev.: 0.0059) MultiSource/Applications/treecc/treecc: 2.59% (0.7875 => 0.8079, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.56% (0.3981 => 0.4083, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.52% (0.4251 => 0.4358, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.23% (0.6634 => 0.6782, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 2.22% (0.5546 => 0.5669, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.21% (1.4269 => 1.4584, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 2.08% (0.5012 => 0.5116, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.93% (0.6435 => 0.6559, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.06% (2.0346 => 2.0561, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 14.91% (2.5769 => 2.9610, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.2122 => 0.2242, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6747, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-2: 4.85% (1.8057 => 1.8933, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1658, std. dev.: 0.0263) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.12% (105.3826 => 107.6177, std. dev.: 0.0396) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2011, std. dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4971, std. dev.: 0.0242) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2266, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.63% (11.9555 => 11.7611, std. dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5224, std. dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/ary2: -10.03% (0.2402 => 0.2161, std. dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: -9.96% (17.2379 => 15.5210, std. dev.: 0.1569) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7944, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/moments: -3.99% (0.4438 => 0.4261, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7933, std. dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: -3.55% (14.0481 => 13.5491, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5698, std. dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.10% (41.7953 => 41.3346, std. dev.: 0.1485) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 04:36:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 06:36:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120731113646.14E1B2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2522?compare_to=2519&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2522, Order: 161041, Start Time: 2012-07-31 10:18:37, End Time: 2012-07-31 11:37:14 To: 2519, Order: 161037, Start Time: 2012-07-31 08:30:35, End Time: 2012-07-31 09:49:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (87 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (752 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.11% (13.2613 => 13.5416, std. dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.62% (10.3673 => 13.5416, std. dev.: 0.0087) SingleSource/UnitTests/ObjC/trivial-interface: 12.53% (0.3473 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.21% (0.3497 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3516 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.14% (0.3543 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.11% (0.3543 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.08% (0.3561 => 0.3991, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 11.91% (0.3694 => 0.4134, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.74% (1.1194 => 1.2508, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 11.52% (0.3828 => 0.4269, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.13% (0.3927 => 0.4364, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.48% (2.2022 => 2.4110, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 9.12% (0.1622 => 0.1770, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.42% (1.7609 => 1.8915, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.39% (0.3177 => 0.3380, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 6.14% (0.5925 => 0.6289, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.10% (0.6030 => 0.6398, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 5.55% (0.3282 => 0.3464, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.42% (7.0540 => 7.4364, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.35% (0.4879 => 0.5140, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 5.00% (10.4361 => 10.9580, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 4.97% (0.7326 => 0.7690, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.83% (0.4615 => 0.4838, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 4.47% (9.4845 => 9.9080, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 4.37% (0.7433 => 0.7758, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.03% (4.9449 => 5.1444, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (5.0018 => 5.2035, std. dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.74% (0.8172 => 0.8478, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.72% (0.5569 => 0.5776, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 3.60% (5.7591 => 5.9665, std. dev.: 0.0085) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (4.2646 => 4.4156, std. dev.: 0.0050) MultiSource/Applications/sgefa/sgefa: 3.54% (0.3109 => 0.3219, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.51% (1.5603 => 1.6150, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.48% (0.5860 => 0.6064, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.36% (8.1363 => 8.4095, std. dev.: 0.0047) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.24% (0.3121 => 0.3222, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.20% (14.3668 => 14.8272, std. dev.: 0.0115) MultiSource/Applications/spiff/spiff: 3.20% (0.7835 => 0.8086, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.05% (1.1861 => 1.2223, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 2.98% (0.3422 => 0.3524, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.3050 => 1.3438, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 2.95% (0.3387 => 0.3487, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.85% (0.4636 => 0.4768, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 2.80% (3.3354 => 3.4289, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.80% (0.4103 => 0.4218, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.79% (0.3650 => 0.3752, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.72% (1.1642 => 1.1959, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.69% (1.5415 => 1.5830, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.69% (2.0665 => 2.1221, std. dev.: 0.0093) MultiSource/Applications/treecc/treecc: 2.61% (2.0273 => 2.0803, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 2.61% (0.4289 => 0.4401, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.53% (0.8067 => 0.8271, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.41% (3.8723 => 3.9656, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (0.4620 => 0.4723, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.16% (2.2024 => 2.2499, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.15% (0.9765 => 0.9975, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.14% (1.5859 => 1.6198, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (0.6675 => 0.6817, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.11% (0.6450 => 0.6586, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5981 => 0.6099, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.95% (1.2842 => 1.3092, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.4186 => 1.4459, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.91% (17.1811 => 17.5100, std. dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/football/football: 1.89% (0.8921 => 0.9090, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.52% (1.1840 => 1.2020, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.52% (0.7115 => 0.7223, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.47% (2.2969 => 2.3306, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.17% (1.0722 => 1.0847, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.94% (4.2280 => 4.3946, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7520, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 1.79% (3.1578 => 3.2144, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5086 => 1.5339, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8350, std. dev.: 0.0013) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2039, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2276, std. dev.: 0.0339) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.46% (0.8651 => 0.1690, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.09% (5.2763 => 3.1608, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.96% (5.3855 => 3.7180, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.37% (5.3526 => 3.7269, std. dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -15.05% (54.1659 => 46.0160, std. dev.: 0.0225) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.00% (2.9384 => 2.5563, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -10.15% (22.1758 => 19.9256, std. dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.71% (1.2373 => 1.1171, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -6.66% (1.5373 => 1.4349, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5543, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.70% (1.9577 => 1.8656, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4708, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9046, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4201, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 9.9999, std. dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.43% (0.4808 => 0.4691, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6817, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.71% (12.5348 => 12.3199, std. dev.: 0.0040) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4169, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.25% (1.8329 => 1.8099, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2495, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 05:23:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 07:23:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120731122353.3EF662A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2523?compare_to=2520&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2523, Order: 161042, Start Time: 2012-07-31 11:10:41, End Time: 2012-07-31 12:24:22 To: 2520, Order: 161038, Start Time: 2012-07-31 09:29:04, End Time: 2012-07-31 10:42:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (139 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.46% (79.9193 => 81.0888, std. dev.: 0.1220) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.67% (2.0176 => 2.2935, std. dev.: 0.0158) SingleSource/UnitTests/ObjC++/property-reference-object: 9.38% (0.5818 => 0.6364, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.17% (0.5748 => 0.6275, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.47% (0.3578 => 0.3881, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.39% (0.3601 => 0.3903, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.37% (0.3646 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.33% (0.3663 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3789 => 0.4104, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3623 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.27% (0.7061 => 0.7645, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.19% (0.3650 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.10% (0.3914 => 0.4231, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 7.94% (0.3940 => 0.4253, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.83% (0.3130 => 0.3375, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.79% (0.4003 => 0.4315, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.91% (1.3693 => 1.4639, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.49% (0.7710 => 0.8210, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.39% (0.7038 => 0.7488, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (3.9660 => 4.2191, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 6.38% (0.4328 => 0.4604, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.36% (0.2596 => 0.2761, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.28% (0.2721 => 0.2892, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.25% (0.2782 => 0.2956, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.21% (0.5265 => 0.5592, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.18% (0.2781 => 0.2953, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.96% (0.4062 => 0.4304, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.84% (0.2690 => 0.2847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.72% (0.2607 => 0.2756, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3899 => 0.4118, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.2655 => 0.2804, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 5.59% (0.2628 => 0.2775, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.59% (0.3022 => 0.3191, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.58% (0.2760 => 0.2914, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.47% (0.3580 => 0.3776, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2761 => 0.2912, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.47% (0.2726 => 0.2875, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.40% (1.9828 => 2.0898, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.37% (0.3485 => 0.3672, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.32% (0.4379 => 0.4612, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.3107 => 0.3271, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.25% (0.6959 => 0.7324, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3149 => 0.3314, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.12% (0.2988 => 0.3141, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.09% (0.5577 => 0.5861, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.08% (1.2193 => 1.2812, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.01% (0.3453 => 0.3626, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.98% (0.3192 => 0.3351, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.91% (0.9199 => 0.9651, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 4.82% (13.8202 => 14.4862, std. dev.: 0.0194) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.74% (0.4390 => 0.4598, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.73% (0.4016 => 0.4206, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.70% (16.6129 => 17.3940, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3293 => 0.3446, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.64% (0.3534 => 0.3698, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.3756 => 0.3925, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.50% (0.2914 => 0.3045, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.45% (0.5637 => 0.5888, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 4.45% (0.3868 => 0.4040, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.41% (0.3246 => 0.3389, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.38% (0.7506 => 0.7835, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 4.38% (0.2925 => 0.3053, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.31% (1.4563 => 1.5191, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 4.23% (1.1061 => 1.1529, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.22% (7.2180 => 7.5224, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.20% (13.2842 => 13.8418, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.15% (1.1364 => 1.1836, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 4.10% (3.8646 => 4.0232, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.10% (0.8310 => 0.8651, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 3.98% (1.9270 => 2.0036, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.95% (0.7460 => 0.7755, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.87% (1.2292 => 1.2768, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.86% (1.0594 => 1.1003, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (1.3245 => 1.3753, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.82% (1.3813 => 1.4340, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.79% (1.3819 => 1.4343, std. dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 3.61% (0.2995 => 0.3103, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.49% (4.3801 => 4.5328, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.47% (4.4433 => 4.5975, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.45% (3.6692 => 3.7959, std. dev.: 0.0082) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3220 => 0.3329, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.33% (0.3755 => 0.3880, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 3.28% (2.1791 => 2.2506, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.09% (0.4791 => 0.4939, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.1333 => 1.1680, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.99% (4.9865 => 5.1358, std. dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.79% (0.8698 => 0.8941, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.71% (3.1889 => 3.2754, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.71% (0.6283 => 0.6453, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 2.67% (0.4113 => 0.4223, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.61% (8.4961 => 8.7177, std. dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 2.41% (6.5754 => 6.7339, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 2.35% (16.2614 => 16.6432, std. dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: 2.27% (14.5298 => 14.8593, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.25% (2.1007 => 2.1480, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 2.19% (14.8535 => 15.1783, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.13% (3.2742 => 3.3441, std. dev.: 0.0228) MultiSource/Applications/oggenc/oggenc: 2.04% (4.6629 => 4.7578, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.02% (1.5188 => 1.5495, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.19% (0.9108 => 0.9216, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5124, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/fbench: 25.55% (1.8175 => 2.2818, std. dev.: 0.0186) SingleSource/Benchmarks/Misc/mandel-2: 7.97% (1.2998 => 1.4034, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.09% (0.9996 => 1.0505, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 4.46% (7.4271 => 7.7582, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7078, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4769, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8154, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0310 => 1.0564, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5089 => 1.5328, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.26% (2.0152 => 2.0406, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.16% (4.5928 => 4.6460, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (3.1071 => 3.1388, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.10% (0.4657 => 0.4047, std. dev.: 0.0115) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.62% (22.5627 => 21.0684, std. dev.: 0.0202) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.95% (0.0997 => 0.0818, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.36% (1.2308 => 1.1033, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3107, std. dev.: 0.0071) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5825, std. dev.: 0.0113) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9447, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2220, std. dev.: 0.0088) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5049, std. dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: -1.81% (28.2225 => 27.7104, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9831, std. dev.: 0.0319) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8634, std. dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2365, std. dev.: 0.0126) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2486, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 06:23:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 08:23:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120731132321.67CFE2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2524?compare_to=2522&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2524, Order: 161043, Start Time: 2012-07-31 12:05:11, End Time: 2012-07-31 13:23:48 To: 2522, Order: 161041, Start Time: 2012-07-31 10:18:37, End Time: 2012-07-31 11:37:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (93 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (747 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.61% (10.3673 => 13.5410, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/trivial-interface: 12.47% (0.3473 => 0.3906, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3543 => 0.3981, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3497 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.22% (0.3543 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.14% (0.3516 => 0.3943, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.08% (0.3561 => 0.3991, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.73% (1.1194 => 1.2507, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.55% (0.3828 => 0.4270, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.17% (0.3886 => 0.4320, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.55% (2.2022 => 2.4124, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.12% (0.1622 => 0.1770, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.34% (1.7609 => 1.8902, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.18% (0.1892 => 0.2009, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.18% (0.5925 => 0.6291, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.15% (0.2065 => 0.2192, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 6.12% (0.6030 => 0.6399, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.59% (7.0540 => 7.4481, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 5.51% (0.3282 => 0.3463, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.31% (0.4879 => 0.5138, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.29% (0.4615 => 0.4859, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 5.01% (10.4361 => 10.9588, std. dev.: 0.0191) SingleSource/UnitTests/ObjC++/property-reference: 4.93% (0.7326 => 0.7687, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.62% (9.4845 => 9.9231, std. dev.: 0.0098) MultiSource/Applications/lambda-0_1_3/lambda: 4.39% (0.7433 => 0.7759, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.29% (0.3121 => 0.3255, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.14% (0.8172 => 0.8510, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.07% (4.9449 => 5.1464, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.01% (5.0018 => 5.2023, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.68% (5.7591 => 5.9711, std. dev.: 0.0089) MultiSource/Applications/hbd/hbd: 3.62% (1.5603 => 1.6168, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.62% (0.5860 => 0.6072, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.61% (0.5569 => 0.5770, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.55% (4.2646 => 4.4160, std. dev.: 0.0131) MultiSource/Applications/sgefa/sgefa: 3.47% (0.3109 => 0.3217, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.40% (8.1363 => 8.4127, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.28% (0.4636 => 0.4788, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.19% (0.7835 => 0.8085, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.11% (14.3668 => 14.8131, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 3.07% (0.3387 => 0.3491, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.07% (1.1861 => 1.2225, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 2.98% (0.3422 => 0.3524, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.3050 => 1.3434, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 2.85% (0.3684 => 0.3789, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.80% (3.3354 => 3.4289, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 2.80% (0.4289 => 0.4409, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.78% (1.5415 => 1.5844, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.74% (0.3650 => 0.3750, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.74% (2.0273 => 2.0828, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.73% (0.4103 => 0.4215, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 2.70% (0.4299 => 0.4415, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.69% (1.1642 => 1.1955, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.65% (0.8067 => 0.8281, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.64% (0.3865 => 0.3967, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.63% (2.0665 => 2.1209, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.53% (0.5105 => 0.5234, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.48% (0.6456 => 0.6616, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.43% (0.4203 => 0.4305, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.36% (3.8723 => 3.9638, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.36% (0.9765 => 0.9995, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.35% (2.2024 => 2.2542, std. dev.: 0.0183) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6450 => 0.6594, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (0.6675 => 0.6820, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.16% (1.5859 => 1.6202, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.06% (1.2842 => 1.3107, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.05% (2.2969 => 2.3439, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.97% (1.4186 => 1.4466, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 1.91% (0.8921 => 0.9091, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5981 => 0.6092, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.84% (17.1811 => 17.4972, std. dev.: 0.0055) MultiSource/Applications/minisat/minisat: 1.69% (0.7115 => 0.7235, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.55% (1.1840 => 1.2024, std. dev.: 0.0060) MultiSource/Applications/lemon/lemon: 1.18% (1.0722 => 1.0849, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.81% (4.2280 => 4.3889, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7493, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.74% (3.1578 => 3.2126, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8323, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5086 => 1.5329, std. dev.: 0.0018) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2039, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2271, std. dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.07% (1.3045 => 1.3184, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.10% (5.2763 => 3.1607, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.90% (5.3855 => 3.7216, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.35% (5.3526 => 3.7282, std. dev.: 0.0070) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0045, std. dev.: 0.0193) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.96% (2.9384 => 2.5576, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -10.16% (22.1758 => 19.9236, std. dev.: 0.0380) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2373 => 1.1062, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: -9.64% (1.5373 => 1.3891, std. dev.: 0.0311) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5539, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5952, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.54% (1.9577 => 1.8688, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4811, std. dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9045, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4275, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0009, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.80% (12.5348 => 12.3092, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4180, std. dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.8329 => 1.8079, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 07:05:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 09:05:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120731140535.BCCD32A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2525?compare_to=2523&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2525, Order: 161044, Start Time: 2012-07-31 12:52:14, End Time: 2012-07-31 14:06:03 To: 2523, Order: 161042, Start Time: 2012-07-31 11:10:41, End Time: 2012-07-31 12:24:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (142 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.5264 => 56.4865, std. dev.: 0.1363) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.43% (81.0888 => 79.9331, std. dev.: 0.3421) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.86% (2.0176 => 2.2972, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.14% (0.5818 => 0.6350, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.91% (0.5748 => 0.6260, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3578 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.58% (0.3646 => 0.3959, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3601 => 0.3904, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.41% (0.3663 => 0.3971, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/for-in: 8.34% (0.3789 => 0.4105, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.34% (0.3623 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.27% (0.3650 => 0.3952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.12% (0.3914 => 0.4232, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.06% (0.7061 => 0.7630, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.99% (0.3130 => 0.3380, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 7.97% (0.4003 => 0.4322, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.87% (0.3940 => 0.4250, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 7.23% (1.3693 => 1.4683, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.60% (0.1819 => 0.1939, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.59% (3.9660 => 4.2272, std. dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.57% (0.5265 => 0.5611, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash2: 6.49% (0.4328 => 0.4609, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.47% (0.7710 => 0.8209, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 6.45% (0.7038 => 0.7492, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.43% (0.2596 => 0.2763, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.40% (0.2781 => 0.2959, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2782 => 0.2958, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.00% (0.2966 => 0.3144, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 5.95% (0.2607 => 0.2762, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.87% (0.2690 => 0.2848, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.87% (0.3899 => 0.4128, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.86% (0.4062 => 0.4300, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.78% (0.2628 => 0.2780, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.76% (0.2655 => 0.2808, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3022 => 0.3195, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.59% (0.3580 => 0.3780, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.58% (0.2937 => 0.3101, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.58% (0.2726 => 0.2878, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.54% (0.2761 => 0.2914, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2696 => 0.2845, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.52% (1.9828 => 2.0923, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.51% (0.3485 => 0.3677, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (0.4379 => 0.4620, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.46% (0.6959 => 0.7339, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.44% (0.3107 => 0.3276, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.42% (0.3489 => 0.3678, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.3149 => 0.3318, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.25% (0.2988 => 0.3145, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.19% (1.2193 => 1.2826, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.10% (0.3453 => 0.3629, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.08% (0.3192 => 0.3354, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.04% (0.9199 => 0.9663, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.99% (0.4390 => 0.4609, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.98% (0.3534 => 0.3710, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.97% (13.8202 => 14.5064, std. dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/lists: 4.89% (0.3293 => 0.3454, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.88% (0.5577 => 0.5849, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.78% (0.4016 => 0.4208, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.70% (16.6129 => 17.3938, std. dev.: 0.0222) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.55% (1.4563 => 1.5225, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/moments: 4.52% (0.3868 => 0.4043, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.47% (7.2180 => 7.5409, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.47% (0.5637 => 0.5889, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.46% (0.2914 => 0.3044, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.45% (1.1061 => 1.1553, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.41% (0.3246 => 0.3389, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.39% (1.1364 => 1.1863, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 4.36% (0.7506 => 0.7833, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.34% (13.2842 => 13.8607, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 4.15% (0.8310 => 0.8655, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.14% (0.7460 => 0.7769, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.13% (1.3245 => 1.3792, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.09% (3.8646 => 4.0227, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 4.07% (1.9270 => 2.0054, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.06% (1.3813 => 1.4374, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.99% (1.0594 => 1.1017, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.99% (1.2292 => 1.2782, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.89% (1.3819 => 1.4357, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 3.71% (0.2995 => 0.3106, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (4.3801 => 4.5393, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.62% (4.4433 => 4.6042, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.56% (3.6692 => 3.7999, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3755 => 0.3888, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.54% (0.3220 => 0.3334, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.42% (2.1791 => 2.2537, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.32% (0.4791 => 0.4950, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1333 => 1.1683, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.06% (4.9865 => 5.1392, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.93% (0.8698 => 0.8953, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.91% (3.1889 => 3.2817, std. dev.: 0.0104) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.79% (0.6135 => 0.6306, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.77% (0.6283 => 0.6457, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.74% (8.4961 => 8.7293, std. dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (6.5754 => 6.7482, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.44% (16.2614 => 16.6577, std. dev.: 0.0214) MultiSource/Applications/JM/lencod/lencod: 2.39% (14.8535 => 15.2081, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.37% (2.1007 => 2.1505, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 2.34% (14.5298 => 14.8701, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (3.2742 => 3.3490, std. dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.13% (1.5188 => 1.5512, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.05% (4.6629 => 4.7586, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.33% (0.9108 => 0.9229, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.25% (1.0313 => 1.0442, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.02% (33.2944 => 33.6326, std. dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 24.63% (1.8175 => 2.2652, std. dev.: 0.0449) SingleSource/Benchmarks/Misc/mandel-2: 7.72% (1.2998 => 1.4002, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.10% (0.9996 => 1.0506, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 4.46% (7.4271 => 7.7580, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7081, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4766, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8154, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0310 => 1.0557, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5349, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9577, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5944, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1930, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.19% (4.5928 => 4.6475, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.54% (0.4657 => 0.4073, std. dev.: 0.0124) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.48% (22.5627 => 21.0996, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.05% (0.0997 => 0.0827, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1101, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.25% (1.3780 => 1.3057, std. dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.93% (1.9762 => 1.9183, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -2.58% (3.0263 => 2.9483, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6032, std. dev.: 0.0174) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2245, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.89% (20.3410 => 19.9563, std. dev.: 0.0394) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: -1.81% (28.2225 => 27.7113, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.32% (7.3305 => 7.2335, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2500, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8696, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2243, std. dev.: 0.0140) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 07:26:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 09:26:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120731142640.AFB8A2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2526?compare_to=2521&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2526, Order: 161043, Start Time: 2012-07-31 11:43:50, End Time: 2012-07-31 14:27:09 To: 2521, Order: 161037, Start Time: 2012-07-31 08:32:40, End Time: 2012-07-31 11:16:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (102 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (780 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.41% (124.7293 => 128.9884, std. dev.: 1.2200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.30% (54.1929 => 54.8969, std. dev.: 0.0927) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.80% (0.3446 => 0.3887, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.73% (0.3465 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.65% (0.3469 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.59% (0.3488 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.55% (0.3442 => 0.3874, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.53% (0.3496 => 0.3934, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 12.51% (0.3460 => 0.3893, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.16% (0.3643 => 0.4086, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.92% (0.3650 => 0.4085, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.68% (0.3724 => 0.4159, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1620 => 0.1735, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 6.42% (0.5826 => 0.6200, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.37% (0.5889 => 0.6264, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 5.88% (1.5932 => 1.6869, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.40% (1.6211 => 1.7086, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.23% (3.5627 => 3.7492, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.09% (0.4361 => 0.4583, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.86% (0.5000 => 0.5243, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 4.82% (0.7171 => 0.7517, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.73% (0.4994 => 0.5230, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.71% (0.5900 => 0.6178, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.55% (1.3152 => 1.3751, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.48% (0.3930 => 0.4106, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.32% (0.4029 => 0.4203, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2875 => 0.2998, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 4.28% (1.0781 => 1.1242, std. dev.: 0.0036) SingleSource/Regression/C++/ofstream_ctor: 4.16% (0.3004 => 0.3129, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.11% (0.3792 => 0.3948, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.06% (0.5026 => 0.5230, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.96% (0.2729 => 0.2837, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.95% (4.2109 => 4.3772, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 3.95% (0.9909 => 1.0300, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.94% (0.2738 => 0.2846, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3195 => 0.3321, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.94% (0.2792 => 0.2902, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.93% (0.2750 => 0.2858, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.89% (2.7292 => 2.8353, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2780 => 0.2888, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.88% (2.0673 => 2.1475, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 3.84% (0.2811 => 0.2919, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.79% (0.2823 => 0.2930, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.77% (0.2866 => 0.2974, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 3.77% (0.2813 => 0.2919, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2803 => 0.2908, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.71% (0.3096 => 0.3211, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.71% (0.2911 => 0.3019, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.70% (0.3267 => 0.3388, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.62% (0.3258 => 0.3376, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.59% (0.9697 => 1.0045, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.59% (0.3124 => 0.3236, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.53% (0.3060 => 0.3168, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.44% (0.3317 => 0.3431, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.44% (0.3726 => 0.3854, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.40% (1.9694 => 2.0363, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.3362 => 0.3476, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.38% (0.3282 => 0.3393, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.34% (0.3477 => 0.3593, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: 3.32% (0.3678 => 0.3800, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.32% (0.3890 => 0.4019, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (2.1013 => 2.1704, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.27% (4.4195 => 4.5639, std. dev.: 0.0062) MultiSource/Benchmarks/Bullet/bullet: 3.26% (23.5202 => 24.2869, std. dev.: 0.0136) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.25% (1.9966 => 2.0614, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (0.3348 => 0.3456, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.22% (5.5417 => 5.7200, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (0.3625 => 0.3741, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.13% (0.4658 => 0.4804, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 2.99% (0.4146 => 0.4270, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.95% (0.3903 => 0.4018, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.94% (0.4251 => 0.4376, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (2.1653 => 2.2281, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.85% (0.4139 => 0.4257, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3690 => 0.3794, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 2.80% (4.6177 => 4.7471, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.79% (0.3981 => 0.4092, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.64% (1.8794 => 1.9290, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.63% (0.7875 => 0.8082, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.3845 => 0.3946, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.34% (0.5546 => 0.5676, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.30% (0.6435 => 0.6583, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.28% (1.4269 => 1.4594, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.11% (0.6634 => 0.6774, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.11% (2.0346 => 2.0572, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.84% (0.2122 => 0.2246, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-2: 5.17% (1.8057 => 1.8991, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6741, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1654, std. dev.: 0.0884) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6378, std. dev.: 0.0247) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4584, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1895, std. dev.: 0.0095) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4960, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5907, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2215, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.59% (2.4764 => 2.4123, std. dev.: 0.0114) MultiSource/Applications/kimwitu++/kc: -1.48% (11.9555 => 11.7780, std. dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.02% (25.4195 => 16.5173, std. dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/fldry: -8.72% (17.2379 => 15.7355, std. dev.: 0.1286) SingleSource/Benchmarks/Shootout-C++/ary2: -7.79% (0.2402 => 0.2215, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8015, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/moments: -3.90% (0.4438 => 0.4265, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.73% (11.2080 => 10.7895, std. dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: -3.70% (14.0481 => 13.5282, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5723, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 08:09:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 10:09:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120731150941.A2ADF2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2527?compare_to=2524&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2527, Order: 161044, Start Time: 2012-07-31 13:51:44, End Time: 2012-07-31 15:10:09 To: 2524, Order: 161043, Start Time: 2012-07-31 12:05:11, End Time: 2012-07-31 13:23:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (742 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.55% (10.3673 => 13.5341, std. dev.: 0.0109) SingleSource/UnitTests/ObjC/trivial-interface: 12.47% (0.3473 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.21% (0.3497 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3516 => 0.3944, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.14% (0.3543 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.13% (0.3561 => 0.3993, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.02% (0.3543 => 0.3969, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 11.75% (0.3694 => 0.4128, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.62% (1.1194 => 1.2495, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 11.49% (0.3828 => 0.4268, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.05% (0.3927 => 0.4361, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.62% (2.2022 => 2.4140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.19% (0.1622 => 0.1771, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.93% (0.3817 => 0.4158, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/flops: 8.03% (0.1432 => 0.1547, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.33% (1.7609 => 1.8900, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.18% (0.1892 => 0.2009, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 6.13% (0.5925 => 0.6288, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 6.09% (0.6030 => 0.6397, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 5.55% (0.3282 => 0.3464, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.33% (7.0540 => 7.4303, std. dev.: 0.0253) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.33% (0.4615 => 0.4861, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.4879 => 0.5137, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 5.03% (10.4361 => 10.9606, std. dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference: 5.01% (0.7326 => 0.7693, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 4.51% (9.4845 => 9.9124, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.7433 => 0.7756, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.13% (0.2758 => 0.2872, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.07% (0.3121 => 0.3248, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (5.0018 => 5.2029, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.97% (4.9449 => 5.1414, std. dev.: 0.0069) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.94% (0.8172 => 0.8494, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.86% (0.5860 => 0.6086, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.70% (0.5569 => 0.5775, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 3.69% (5.7591 => 5.9718, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 3.57% (1.5603 => 1.6160, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (4.2646 => 4.4149, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.47% (8.1363 => 8.4188, std. dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: 3.41% (0.3109 => 0.3215, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (0.4636 => 0.4794, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.33% (0.3423 => 0.3537, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.21% (14.3668 => 14.8282, std. dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.13% (1.1861 => 1.2232, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.13% (0.7835 => 0.8080, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/lists: 3.07% (0.3422 => 0.3527, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.05% (0.3865 => 0.3983, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.00% (1.3050 => 1.3442, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.95% (1.1642 => 1.1986, std. dev.: 0.0060) MultiSource/Benchmarks/sim/sim: 2.95% (0.3387 => 0.3487, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.90% (0.3650 => 0.3756, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.90% (0.4103 => 0.4222, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.87% (3.3354 => 3.4310, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 2.82% (0.3684 => 0.3788, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.78% (2.0665 => 2.1240, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.4289 => 0.4404, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.67% (0.3826 => 0.3928, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.66% (0.5105 => 0.5241, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.65% (2.0273 => 2.0810, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.63% (0.8067 => 0.8279, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 2.56% (0.4299 => 0.4409, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6456 => 0.6621, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.55% (0.4203 => 0.4310, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.53% (0.4064 => 0.4167, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.52% (1.5415 => 1.5803, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4620 => 0.4734, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.39% (3.8723 => 3.9650, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.36% (0.9765 => 0.9995, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 2.21% (1.2842 => 1.3126, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.17% (2.2024 => 2.2502, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (0.6675 => 0.6818, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.14% (1.5859 => 1.6198, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.11% (0.6450 => 0.6586, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 2.04% (0.8921 => 0.9103, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.97% (1.4186 => 1.4466, std. dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 1.95% (17.1811 => 17.5154, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5981 => 0.6096, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.60% (0.7115 => 0.7229, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.18% (1.0722 => 1.0849, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.08% (4.2280 => 4.4007, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.25% (3.6395 => 3.7577, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.72% (3.1578 => 3.2120, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8346, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5086 => 1.5332, std. dev.: 0.0026) MultiSource/Applications/aha/aha: 1.37% (3.1595 => 3.2028, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2315, std. dev.: 0.0129) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.00% (2.8904 => 2.9194, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.07% (5.2763 => 3.1620, std. dev.: 0.0086) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.96% (5.3855 => 3.7182, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.39% (5.3526 => 3.7260, std. dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -15.11% (54.1659 => 45.9836, std. dev.: 0.0392) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.97% (2.9384 => 2.5574, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -10.18% (22.1758 => 19.9183, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4258, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.37% (1.2373 => 1.1090, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -9.41% (1.5373 => 1.3926, std. dev.: 0.0241) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.69% (1.9577 => 1.8659, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5110, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4867, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4171, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.02% (8.1563 => 7.9103, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0002, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6820, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.66% (12.5348 => 12.3268, std. dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4184, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.32% (1.8329 => 1.8087, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.07% (1.7254 => 1.7069, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -1.02% (3.2827 => 3.2492, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 08:47:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 10:47:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120731154738.C63722A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2528?compare_to=2525&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2528, Order: 161047, Start Time: 2012-07-31 14:34:18, End Time: 2012-07-31 15:48:07 To: 2525, Order: 161044, Start Time: 2012-07-31 12:52:14, End Time: 2012-07-31 14:06:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (141 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.64% (2.0176 => 2.2929, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.06% (0.5818 => 0.6345, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.92% (0.5748 => 0.6261, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3578 => 0.3889, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.55% (0.7061 => 0.7665, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 8.48% (0.3646 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3601 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.38% (0.3663 => 0.3970, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3623 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.33% (0.3650 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.29% (0.3789 => 0.4103, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.10% (0.3914 => 0.4231, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.92% (0.4003 => 0.4320, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.12% (1.3693 => 1.4668, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.58% (0.7710 => 0.8217, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.48% (0.5265 => 0.5606, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.47% (0.4328 => 0.4608, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.47% (3.9660 => 4.2225, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 6.44% (0.7038 => 0.7491, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.36% (0.2596 => 0.2761, std. dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 6.29% (0.2781 => 0.2956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.25% (0.2782 => 0.2956, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.99% (0.2690 => 0.2851, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 5.81% (0.4062 => 0.4298, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.76% (0.2655 => 0.2808, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 5.71% (0.2628 => 0.2778, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3022 => 0.3194, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.68% (0.2765 => 0.2922, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.65% (0.2937 => 0.3103, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.64% (0.3899 => 0.4119, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.58% (0.2726 => 0.2878, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.47% (0.3489 => 0.3680, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.45% (1.9828 => 2.0908, std. dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.39% (0.3485 => 0.3673, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.37% (0.4379 => 0.4614, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.36% (0.3580 => 0.3772, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.29% (0.6959 => 0.7327, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.25% (0.2988 => 0.3145, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3149 => 0.3314, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.23% (1.2193 => 1.2831, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.98% (0.3453 => 0.3625, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.96% (0.9199 => 0.9655, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.87% (13.8202 => 14.4929, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.86% (0.5577 => 0.5848, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.83% (0.3293 => 0.3452, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.76% (0.4390 => 0.4599, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.68% (0.4016 => 0.4204, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.67% (16.6129 => 17.3891, std. dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3756 => 0.3929, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.53% (0.7506 => 0.7846, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 4.50% (0.2243 => 0.2344, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3246 => 0.3392, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 4.47% (0.3868 => 0.4041, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.44% (0.2925 => 0.3055, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.40% (0.5637 => 0.5885, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.36% (0.2914 => 0.3041, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.35% (0.2945 => 0.3073, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.34% (7.2180 => 7.5314, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.33% (1.4563 => 1.5194, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.31% (1.1364 => 1.1854, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 4.25% (1.1061 => 1.1531, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.25% (13.2842 => 13.8482, std. dev.: 0.0110) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.24% (0.7460 => 0.7776, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 4.13% (0.8310 => 0.8653, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 3.95% (3.8646 => 4.0174, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 3.94% (1.0594 => 1.1011, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.93% (1.3813 => 1.4356, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.93% (1.3245 => 1.3765, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.2292 => 1.2773, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.91% (1.9270 => 2.0024, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.84% (1.3819 => 1.4349, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 3.64% (0.2995 => 0.3104, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.60% (4.3801 => 4.5379, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.58% (4.4433 => 4.6022, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3220 => 0.3333, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.47% (3.6692 => 3.7966, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3755 => 0.3885, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.35% (2.1791 => 2.2522, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.15% (0.4791 => 0.4942, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.11% (1.1333 => 1.1685, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.09% (4.9865 => 5.1408, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 2.82% (0.4113 => 0.4229, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.82% (0.6135 => 0.6308, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 2.81% (3.1889 => 3.2785, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.79% (0.8698 => 0.8941, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.72% (0.6283 => 0.6454, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 2.63% (8.4961 => 8.7196, std. dev.: 0.0145) MultiSource/Applications/JM/ldecod/ldecod: 2.42% (6.5754 => 6.7347, std. dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 2.34% (14.8535 => 15.2007, std. dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 2.32% (16.2614 => 16.6382, std. dev.: 0.0430) MultiSource/Applications/ClamAV/clamscan: 2.31% (14.5298 => 14.8648, std. dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.29% (2.1007 => 2.1489, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (3.2742 => 3.3457, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.08% (1.5188 => 1.5504, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 1.98% (4.6629 => 4.7553, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.31% (0.9108 => 0.9227, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.08% (1.0313 => 1.0424, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5130, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2623, std. dev.: 0.0335) SingleSource/Benchmarks/Misc/mandel-2: 8.05% (1.2998 => 1.4044, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.20% (0.9996 => 1.0516, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 4.38% (7.4271 => 7.7527, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7027, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4772, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.7688 => 1.8141, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5349, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.45% (2.0200 => 2.0493, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.16% (4.5928 => 4.6462, std. dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 1.11% (10.7476 => 10.8674, std. dev.: 0.0331) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1396, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.61% (22.5627 => 21.0724, std. dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.15% (0.8818 => 0.8717, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.95% (0.0997 => 0.0828, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.99% (1.2308 => 1.1078, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.41% (1.3780 => 1.3035, std. dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.65% (3.0263 => 2.9460, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5934, std. dev.: 0.0223) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.21% (20.3410 => 19.8922, std. dev.: 0.0565) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2195, std. dev.: 0.0140) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5062, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7101, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4928, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std. dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2384, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.21% (3.8887 => 3.8418, std. dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2533, std. dev.: 0.0042) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2281, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 09:56:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 11:56:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120731165602.964CC2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2529?compare_to=2527&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2529, Order: 161048, Start Time: 2012-07-31 15:38:00, End Time: 2012-07-31 16:56:31 To: 2527, Order: 161044, Start Time: 2012-07-31 13:51:44, End Time: 2012-07-31 15:10:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (96 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (743 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 3.63% (1.3926 => 1.4432, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.07% (54.7676 => 56.4500, std. dev.: 0.1320) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.70% (10.3673 => 13.5502, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 12.53% (0.3473 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.27% (0.3497 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3516 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.22% (0.3543 => 0.3976, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 12.19% (0.3543 => 0.3975, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.13% (0.3561 => 0.3993, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.86% (0.3694 => 0.4132, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.83% (1.1194 => 1.2518, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 11.55% (0.3828 => 0.4270, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.25% (0.3886 => 0.4323, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.18% (0.3927 => 0.4366, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.08% (2.2022 => 2.4241, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/richards_benchmark: 9.31% (0.1622 => 0.1773, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.41% (0.3817 => 0.4138, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 8.24% (0.1432 => 0.1550, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.10% (1.7609 => 1.9036, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.48% (0.3177 => 0.3383, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.09% (0.5925 => 0.6286, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.04% (0.6030 => 0.6394, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/oourafft: 5.91% (0.3282 => 0.3476, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.86% (7.0540 => 7.4674, std. dev.: 0.0161) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.60% (0.4879 => 0.5152, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.4615 => 0.4867, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 5.15% (10.4361 => 10.9731, std. dev.: 0.0093) SingleSource/UnitTests/ObjC++/property-reference: 4.93% (0.7326 => 0.7687, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.53% (9.4845 => 9.9144, std. dev.: 0.0200) MultiSource/Benchmarks/McCat/08-main/main: 4.35% (0.2554 => 0.2665, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 4.22% (0.7433 => 0.7747, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.14% (4.9449 => 5.1494, std. dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.12% (5.0018 => 5.2078, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.00% (0.8172 => 0.8499, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 3.81% (5.7591 => 5.9783, std. dev.: 0.0134) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.78% (0.2700 => 0.2802, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.75% (0.5569 => 0.5778, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.67% (0.5860 => 0.6075, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.61% (1.5603 => 1.6166, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (4.2646 => 4.4180, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.52% (8.1363 => 8.4225, std. dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: 3.47% (0.3109 => 0.3217, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3121 => 0.3227, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 3.27% (0.3180 => 0.3284, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.23% (14.3668 => 14.8314, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.19% (0.3422 => 0.3531, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.18% (0.7835 => 0.8084, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.10% (0.4103 => 0.4230, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.08% (1.1861 => 1.2226, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.04% (0.8067 => 0.8312, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.3050 => 1.3437, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.96% (3.3354 => 3.4341, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.93% (2.0665 => 2.1270, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.90% (0.3650 => 0.3756, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 2.88% (0.3684 => 0.3790, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.87% (1.1642 => 1.1976, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.82% (0.3826 => 0.3934, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.80% (0.4636 => 0.4766, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 2.80% (0.4289 => 0.4409, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3865 => 0.3971, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.69% (0.3935 => 0.4041, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.67% (2.0273 => 2.0815, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 2.61% (0.4299 => 0.4411, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.59% (1.5415 => 1.5814, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.58% (0.4064 => 0.4169, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6456 => 0.6621, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.55% (0.4203 => 0.4310, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.53% (0.5105 => 0.5234, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.45% (2.2024 => 2.2563, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.38% (1.5859 => 1.6236, std. dev.: 0.0049) MultiSource/Applications/lua/lua: 2.34% (3.8723 => 3.9631, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.28% (0.9765 => 0.9988, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (0.4620 => 0.4725, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.20% (0.6450 => 0.6592, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.15% (1.2842 => 1.3118, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.11% (0.6675 => 0.6816, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.01% (0.5981 => 0.6101, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.4186 => 1.4459, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 1.92% (0.8921 => 0.9092, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.80% (17.1811 => 17.4906, std. dev.: 0.0058) MultiSource/Applications/minisat/minisat: 1.69% (0.7115 => 0.7235, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 1.60% (1.1840 => 1.2030, std. dev.: 0.0060) MultiSource/Applications/siod/siod: 1.58% (2.2969 => 2.3333, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.31% (4.2280 => 4.4103, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7537, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5086 => 1.5345, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 1.61% (11.6436 => 11.8312, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.52% (9.1159 => 9.2547, std. dev.: 0.0276) MultiSource/Applications/aha/aha: 1.43% (3.1595 => 3.2046, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.15% (5.2763 => 3.1577, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.58% (5.3855 => 3.7384, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.01% (5.3526 => 3.7463, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -15.00% (54.1659 => 46.0437, std. dev.: 0.0224) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.31% (2.9384 => 2.5473, std. dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: -9.93% (22.1758 => 19.9736, std. dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.11% (1.6925 => 1.4198, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2373 => 1.1164, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -6.12% (1.5373 => 1.4432, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -4.62% (1.9577 => 1.8673, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5951, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4892, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4170, std. dev.: 0.0204) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9134, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0042, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.34% (1.3677 => 1.3357, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -1.66% (12.5348 => 12.3262, std. dev.: 0.0056) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4174, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.40% (1.8329 => 1.8073, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2494, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 10:29:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 12:29:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120731172922.141572A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2530?compare_to=2528&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2530, Order: 161049, Start Time: 2012-07-31 16:16:00, End Time: 2012-07-31 17:29:48 To: 2528, Order: 161047, Start Time: 2012-07-31 14:34:18, End Time: 2012-07-31 15:48:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (144 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.49% (78.9498 => 80.1279, std. dev.: 0.2281) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.64% (2.0176 => 2.2929, std. dev.: 0.0137) SingleSource/UnitTests/ObjC++/property-reference-object: 10.09% (0.5818 => 0.6405, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.97% (0.5748 => 0.6321, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.50% (0.7061 => 0.7732, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 9.20% (0.3578 => 0.3907, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 9.11% (0.3601 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.03% (0.3623 => 0.3950, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.02% (0.3646 => 0.3975, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.98% (0.3663 => 0.3992, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.90% (0.3650 => 0.3975, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 8.89% (0.3914 => 0.4262, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.87% (0.3789 => 0.4125, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.53% (0.3940 => 0.4276, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.49% (0.4003 => 0.4343, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.20% (0.1819 => 0.1950, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.05% (1.3693 => 1.4659, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.91% (0.7710 => 0.8243, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.61% (3.9660 => 4.2281, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (0.4328 => 0.4613, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.58% (0.2781 => 0.2964, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.54% (0.2782 => 0.2964, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.53% (0.5265 => 0.5609, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 6.31% (0.7038 => 0.7482, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.2721 => 0.2891, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.02% (0.2690 => 0.2852, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.02% (0.2607 => 0.2764, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.91% (0.4062 => 0.4302, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.86% (0.2765 => 0.2927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.82% (0.3022 => 0.3198, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.77% (0.3899 => 0.4124, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2726 => 0.2883, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 5.76% (0.2761 => 0.2920, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.65% (1.9828 => 2.0948, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.63% (0.4390 => 0.4637, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.60% (0.3485 => 0.3680, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.57% (0.4379 => 0.4623, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2696 => 0.2846, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3489 => 0.3682, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.53% (0.3580 => 0.3778, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.3107 => 0.3277, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.46% (0.3149 => 0.3321, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.39% (0.6959 => 0.7334, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/matrix: 5.39% (0.2988 => 0.3149, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.2914 => 0.3070, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.18% (1.2193 => 1.2825, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.13% (0.5577 => 0.5863, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3453 => 0.3630, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.01% (13.8202 => 14.5128, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.96% (0.9199 => 0.9655, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.83% (0.4016 => 0.4210, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 4.78% (16.6129 => 17.4066, std. dev.: 0.0102) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.75% (0.2127 => 0.2228, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3756 => 0.3932, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.3868 => 0.4047, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3246 => 0.3395, std. dev.: 0.0054) MultiSource/Benchmarks/McCat/09-vor/vor: 4.58% (0.2925 => 0.3059, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.5637 => 0.5895, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.54% (7.2180 => 7.5457, std. dev.: 0.0081) MultiSource/Applications/spiff/spiff: 4.48% (0.7506 => 0.7842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.43% (1.4563 => 1.5208, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 4.36% (1.1061 => 1.1543, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.36% (0.7460 => 0.7785, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.35% (0.2945 => 0.3073, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.34% (13.2842 => 13.8606, std. dev.: 0.0200) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.30% (1.1364 => 1.1853, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.20% (1.3819 => 1.4400, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (0.8310 => 0.8652, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.08% (1.2292 => 1.2793, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.08% (3.8646 => 4.0221, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.06% (1.3245 => 1.3783, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 3.96% (1.9270 => 2.0034, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.96% (1.0594 => 1.1014, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.96% (1.3813 => 1.4360, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (4.3801 => 4.5461, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (4.4433 => 4.6098, std. dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 3.64% (0.2995 => 0.3104, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.61% (3.6692 => 3.8015, std. dev.: 0.0090) MultiSource/Benchmarks/McCat/18-imp/imp: 3.57% (0.3220 => 0.3335, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 3.50% (2.1791 => 2.2554, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3755 => 0.3886, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.34% (0.4791 => 0.4951, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.28% (1.1333 => 1.1705, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.18% (4.9865 => 5.1452, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 3.04% (0.4113 => 0.4238, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.00% (0.8698 => 0.8959, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.92% (0.6135 => 0.6314, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 2.87% (3.1889 => 3.2804, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.74% (0.6283 => 0.6455, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.73% (8.4961 => 8.7282, std. dev.: 0.0114) MultiSource/Applications/JM/ldecod/ldecod: 2.54% (6.5754 => 6.7422, std. dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: 2.41% (14.5298 => 14.8798, std. dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: 2.35% (14.8535 => 15.2028, std. dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 2.35% (16.2614 => 16.6428, std. dev.: 0.0118) MultiSource/Applications/oggenc/oggenc: 2.31% (4.6629 => 4.7708, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.28% (2.1007 => 2.1487, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.21% (3.2742 => 3.3466, std. dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.98% (1.5188 => 1.5488, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.25% (0.9108 => 0.9222, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.12% (1.0313 => 1.0428, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.06% (33.2944 => 33.6460, std. dev.: 0.0181) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5197, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2623, std. dev.: 0.0178) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3802, std. dev.: 0.0173) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.40% (0.9996 => 1.0536, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7551, std. dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7045, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.18% (12.0921 => 12.4766, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9739, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8149, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5349, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4523, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.11% (4.5928 => 4.6437, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1402, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 1.06% (10.7476 => 10.8616, std. dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -9.04% (0.4657 => 0.4236, std. dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.52% (22.5627 => 21.0925, std. dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.25% (0.0997 => 0.0835, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -9.80% (1.2308 => 1.1102, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.97% (1.3780 => 1.3095, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9189, std. dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5892, std. dev.: 0.0153) MultiSource/Applications/spiff/spiff: -2.65% (3.0263 => 2.9461, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2285, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.84% (20.3410 => 19.9660, std. dev.: 0.0466) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5102, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.81% (28.2225 => 27.7118, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.76% (0.6589 => 0.6473, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8597, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.31% (2.5254 => 2.4922, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2391, std. dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2558, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8484, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 10:37:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 12:37:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120731173743.DFB632A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2531?compare_to=2526&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2531, Order: 161047, Start Time: 2012-07-31 14:54:55, End Time: 2012-07-31 17:38:12 To: 2526, Order: 161043, Start Time: 2012-07-31 11:43:50, End Time: 2012-07-31 14:27:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (104 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (778 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.55% (15.7355 => 15.9795, std. dev.: 0.0493) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.45% (0.3465 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.41% (0.3446 => 0.3908, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.35% (0.3460 => 0.3922, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.34% (0.3442 => 0.3901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.33% (0.3496 => 0.3962, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.27% (0.3488 => 0.3951, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 13.23% (0.3469 => 0.3928, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.93% (0.3643 => 0.4114, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.77% (0.3650 => 0.4116, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.41% (0.3724 => 0.4186, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.11% (0.5826 => 0.6240, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.00% (0.5889 => 0.6301, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.1620 => 0.1733, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.81% (1.5932 => 1.6857, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.47% (0.7171 => 0.7563, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.39% (3.5627 => 3.7549, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.33% (1.6211 => 1.7075, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.25% (0.4994 => 0.5256, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.03% (0.5900 => 0.6197, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.00% (0.4361 => 0.4579, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.90% (0.5000 => 0.5245, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.67% (1.3152 => 1.3766, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.63% (0.2875 => 0.3008, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.62% (0.5026 => 0.5258, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.59% (0.4029 => 0.4214, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.48% (0.3930 => 0.4106, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.31% (0.2738 => 0.2856, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.29% (0.2725 => 0.2842, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.26% (0.9909 => 1.0331, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.24% (0.2714 => 0.2829, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.23% (2.7292 => 2.8446, std. dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: 4.19% (0.3004 => 0.3130, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 4.18% (0.2750 => 0.2865, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.18% (0.2729 => 0.2843, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 4.17% (1.0781 => 1.1231, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.16% (0.3195 => 0.3328, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (2.0673 => 2.1532, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.2866 => 0.2985, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 4.14% (0.2780 => 0.2895, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.12% (0.2792 => 0.2907, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.10% (4.2109 => 4.3837, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.09% (0.2811 => 0.2926, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 4.09% (0.2813 => 0.2928, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2823 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.01% (0.3096 => 0.3220, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.00% (0.2803 => 0.2915, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.95% (0.2911 => 0.3026, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.86% (0.3267 => 0.3393, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.86% (0.3060 => 0.3178, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.84% (0.3258 => 0.3383, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.81% (0.3124 => 0.3243, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.80% (0.3317 => 0.3443, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (0.3348 => 0.3473, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.69% (0.2736 => 0.2837, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.68% (1.9694 => 2.0418, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.63% (0.3282 => 0.3401, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.60% (0.3362 => 0.3483, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 3.60% (0.3726 => 0.3860, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.53% (0.3678 => 0.3808, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.53% (1.9966 => 2.0671, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 3.46% (0.9697 => 1.0033, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3477 => 0.3596, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.34% (0.3890 => 0.4020, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.34% (0.3625 => 0.3746, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.30% (2.1013 => 2.1707, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.28% (5.5417 => 5.7236, std. dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: 3.25% (23.5202 => 24.2842, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.24% (0.4658 => 0.4809, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.22% (0.3690 => 0.3809, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 3.11% (0.4146 => 0.4275, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.06% (0.3981 => 0.4103, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.04% (2.1653 => 2.2312, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash2: 3.03% (0.4251 => 0.4380, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.97% (0.3903 => 0.4019, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.94% (4.4195 => 4.5495, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.89% (0.3845 => 0.3956, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.85% (4.6177 => 4.7491, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.78% (0.4139 => 0.4254, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.77% (1.8794 => 1.9315, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.58% (0.7875 => 0.8078, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 2.51% (0.5012 => 0.5138, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.51% (1.4269 => 1.4627, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.47% (0.6435 => 0.6594, std. dev.: 0.0048) MultiSource/Applications/Burg/burg: 2.31% (0.5546 => 0.5674, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.13% (0.6634 => 0.6775, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.05% (2.0346 => 2.0560, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 14.93% (2.5769 => 2.9617, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.78% (0.2122 => 0.2287, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6784, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8938, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1682, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.15% (105.3826 => 107.6525, std. dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1982, std. dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4897, std. dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.80% (3.1722 => 3.2292, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5907, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5123, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.02% (2.4764 => 2.4016, std. dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: -1.37% (11.9555 => 11.7919, std. dev.: 0.0203) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.95% (25.4195 => 16.5344, std. dev.: 0.0125) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9741, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7805, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/ary2: -7.37% (0.2402 => 0.2225, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: -7.30% (17.2379 => 15.9795, std. dev.: 0.0493) SingleSource/Benchmarks/Shootout-C++/moments: -4.03% (0.4438 => 0.4259, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.67% (14.0481 => 13.5324, std. dev.: 0.0134) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8009, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 11:42:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 13:42:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120731184226.08CE92A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2532?compare_to=2529&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2532, Order: 161053, Start Time: 2012-07-31 17:24:25, End Time: 2012-07-31 18:42:54 To: 2529, Order: 161048, Start Time: 2012-07-31 15:38:00, End Time: 2012-07-31 16:56:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (80 on baseline) Performance Improvements: 2 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 4.72% (2.2931 => 2.4014, std. dev.: 0.0114) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.59% (13.5502 => 13.1987, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.06% (2.1270 => 2.1044, std. dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.31% (10.3673 => 13.1987, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3473 => 0.3903, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 12.32% (0.3497 => 0.3928, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.31% (0.3543 => 0.3979, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 12.12% (0.3516 => 0.3942, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.11% (0.3543 => 0.3972, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.05% (0.3561 => 0.3990, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.72% (0.3694 => 0.4127, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.44% (0.3828 => 0.4266, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.38% (1.1194 => 1.2468, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 11.23% (0.3927 => 0.4368, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.22% (0.3886 => 0.4322, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.98% (2.2022 => 2.3999, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.89% (1.7609 => 1.8999, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.67% (0.5925 => 0.6320, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.60% (0.6030 => 0.6428, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.3177 => 0.3361, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1892 => 0.1997, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.34% (0.7326 => 0.7717, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.18% (0.4615 => 0.4854, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 4.97% (0.3282 => 0.3445, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.4879 => 0.5120, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.93% (10.4361 => 10.9501, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.83% (7.0540 => 7.3948, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 4.08% (9.4845 => 9.8711, std. dev.: 0.0122) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.93% (0.8172 => 0.8493, std. dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 3.90% (0.7433 => 0.7723, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.85% (4.9449 => 5.1355, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (5.0018 => 5.1896, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.73% (0.5569 => 0.5777, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.2758 => 0.2859, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.29% (4.2646 => 4.4051, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.26% (0.5860 => 0.6051, std. dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.24% (0.3121 => 0.3222, std. dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 3.22% (0.3109 => 0.3209, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.21% (8.1363 => 8.3975, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 3.07% (0.3423 => 0.3528, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.99% (0.7835 => 0.8069, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 2.86% (5.7591 => 5.9237, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.83% (1.1861 => 1.2197, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 2.81% (1.5603 => 1.6042, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (14.3668 => 14.7615, std. dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.74% (1.3050 => 1.3408, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 2.54% (2.0273 => 2.0788, std. dev.: 0.0064) MultiSource/Applications/d/make_dparser: 2.52% (3.3354 => 3.4195, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.50% (1.1642 => 1.1933, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.48% (0.8067 => 0.8267, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 2.44% (0.4299 => 0.4404, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.28% (1.5415 => 1.5766, std. dev.: 0.0112) MultiSource/Applications/lua/lua: 2.12% (3.8723 => 3.9542, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.98% (0.5105 => 0.5206, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.96% (0.9765 => 0.9956, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.92% (2.2024 => 2.2447, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.88% (0.6450 => 0.6571, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.83% (2.0665 => 2.1044, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 1.81% (0.6456 => 0.6573, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.76% (0.5981 => 0.6086, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.75% (1.5859 => 1.6137, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.68% (1.4186 => 1.4425, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.60% (0.6675 => 0.6782, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 1.47% (0.8921 => 0.9052, std. dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 1.44% (17.1811 => 17.4281, std. dev.: 0.0194) MultiSource/Applications/hexxagon/hexxagon: 1.35% (1.2842 => 1.3015, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.18% (2.2969 => 2.3241, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 5.46% (2.2771 => 2.4014, std. dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.84% (4.2280 => 4.3905, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7466, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8320, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5086 => 1.5329, std. dev.: 0.0020) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2042, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2303, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.31% (5.2763 => 3.1492, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.11% (5.3855 => 3.7102, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.56% (5.3526 => 3.7171, std. dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -15.14% (54.1659 => 45.9631, std. dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.34% (2.9384 => 2.5464, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.26% (22.1758 => 19.9009, std. dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (3.8922 => 3.8496, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4241, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.82% (1.2373 => 1.1034, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/mandel-2: -7.90% (1.5373 => 1.4159, std. dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5952, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.43% (1.9577 => 1.8710, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4850, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (8.1563 => 7.9090, std. dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4238, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0000, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.33% (1.3677 => 1.3358, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -1.74% (12.5348 => 12.3161, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4199, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.24% (1.8329 => 1.8101, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -1.03% (3.2827 => 3.2489, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 12:11:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 14:11:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120731191129.1A5512A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2533?compare_to=2530&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2533, Order: 161053, Start Time: 2012-07-31 17:58:05, End Time: 2012-07-31 19:11:57 To: 2530, Order: 161049, Start Time: 2012-07-31 16:16:00, End Time: 2012-07-31 17:29:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (146 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.49% (2.0176 => 2.3099, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 10.42% (0.5818 => 0.6424, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.23% (0.5748 => 0.6336, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.07% (0.7061 => 0.7772, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 9.67% (0.3578 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.55% (0.3601 => 0.3945, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.48% (0.3650 => 0.3996, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 9.43% (0.3646 => 0.3990, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.36% (0.3663 => 0.4006, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.32% (0.3789 => 0.4142, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.30% (0.3623 => 0.3960, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.27% (0.3914 => 0.4277, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.09% (0.3940 => 0.4298, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.04% (0.4003 => 0.4365, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.40% (0.3130 => 0.3393, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.54% (1.3693 => 1.4726, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.87% (0.7710 => 0.8240, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 6.87% (0.4062 => 0.4341, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.82% (0.4328 => 0.4623, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.81% (3.9660 => 4.2361, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 6.80% (0.2781 => 0.2970, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.70% (0.5265 => 0.5618, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.66% (0.7038 => 0.7507, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2782 => 0.2966, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.2721 => 0.2898, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.29% (0.2607 => 0.2771, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.28% (0.2690 => 0.2859, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.18% (0.2765 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.16% (0.2726 => 0.2894, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.16% (0.2760 => 0.2930, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.14% (0.2655 => 0.2818, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2628 => 0.2789, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2761 => 0.2929, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.04% (0.2966 => 0.3145, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.00% (0.3899 => 0.4133, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.97% (1.9828 => 2.1012, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3485 => 0.3693, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wc: 5.92% (0.2937 => 0.3111, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.90% (0.3489 => 0.3695, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.87% (0.3580 => 0.3790, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.86% (0.2988 => 0.3163, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.83% (0.3107 => 0.3288, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.82% (0.2696 => 0.2853, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 5.72% (0.3149 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.60% (0.6959 => 0.7349, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary2: 5.58% (0.3192 => 0.3370, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.49% (1.2193 => 1.2863, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.47% (0.3453 => 0.3642, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.44% (0.2023 => 0.2133, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.29% (0.9199 => 0.9686, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.25% (13.8202 => 14.5464, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 5.22% (0.3293 => 0.3465, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.18% (0.5577 => 0.5866, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.14% (16.6129 => 17.4669, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.10% (0.4016 => 0.4221, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.09% (0.3534 => 0.3714, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 5.04% (0.2243 => 0.2356, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.01% (0.4390 => 0.4610, std. dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.95% (0.3756 => 0.3942, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 4.83% (0.3868 => 0.4055, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.76% (7.2180 => 7.5617, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.74% (0.7506 => 0.7862, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.71% (0.3246 => 0.3399, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.67% (1.4563 => 1.5243, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.67% (0.5637 => 0.5900, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.61% (1.1364 => 1.1888, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.52% (1.1061 => 1.1561, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.50% (13.2842 => 13.8816, std. dev.: 0.0152) MultiSource/Applications/treecc/treecc: 4.36% (1.9270 => 2.0110, std. dev.: 0.0108) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.29% (0.7460 => 0.7780, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 4.28% (0.8310 => 0.8666, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 4.24% (3.8646 => 4.0286, std. dev.: 0.0135) MultiSource/Applications/hexxagon/hexxagon: 4.21% (1.2292 => 1.2810, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.19% (1.3245 => 1.3800, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.18% (1.3819 => 1.4397, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.16% (1.0594 => 1.1035, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.13% (1.3813 => 1.4384, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (4.4433 => 4.6197, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.95% (4.3801 => 4.5532, std. dev.: 0.0111) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.83% (0.3755 => 0.3899, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.83% (3.6692 => 3.8098, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 3.60% (2.1791 => 2.2576, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.49% (1.1333 => 1.1728, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.46% (4.9865 => 5.1591, std. dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.42% (0.4791 => 0.4955, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.15% (0.6135 => 0.6328, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.13% (0.8698 => 0.8970, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.10% (3.1889 => 3.2878, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.09% (0.6283 => 0.6477, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.01% (0.4113 => 0.4237, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 2.88% (8.4961 => 8.7408, std. dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (6.5754 => 6.7592, std. dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: 2.66% (14.5298 => 14.9164, std. dev.: 0.0102) MultiSource/Applications/JM/lencod/lencod: 2.61% (14.8535 => 15.2416, std. dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 2.57% (16.2614 => 16.6801, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (2.1007 => 2.1526, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.28% (1.5188 => 1.5535, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.14% (3.2742 => 3.3444, std. dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 2.09% (4.6629 => 4.7602, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.52% (0.9108 => 0.9246, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.29% (3.7467 => 3.7949, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.25% (1.0313 => 1.0442, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.12% (33.2944 => 33.6667, std. dev.: 0.0142) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.09% (6.2785 => 6.3472, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5140, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/fbench: 25.01% (1.8175 => 2.2721, std. dev.: 0.0306) SingleSource/Benchmarks/Misc/mandel-2: 6.93% (1.2998 => 1.3899, std. dev.: 0.0207) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.12% (0.9996 => 1.0508, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 4.43% (7.4271 => 7.7558, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7039, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.19% (12.0921 => 12.4774, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8156, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0310 => 1.0565, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.23% (0.9692 => 0.9908, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5343, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 1.15% (4.5928 => 4.6458, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6469 => 3.6874, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.00% (3.1071 => 3.1383, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -9.32% (0.4657 => 0.4223, std. dev.: 0.0142) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.5627 => 21.1416, std. dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.75% (0.0997 => 0.0830, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -9.90% (1.2308 => 1.1089, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std. dev.: 0.0079) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.66% (3.0263 => 2.9457, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5926, std. dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2160, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5045, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2225 => 27.7101, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9821, std. dev.: 0.0298) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.71% (0.6589 => 0.6476, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8587, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2486, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2390, std. dev.: 0.0239) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2287, std. dev.: 0.0347) MultiSource/Applications/lua/lua: -1.11% (26.5159 => 26.2206, std. dev.: 0.0254) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 13:28:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 15:28:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120731202858.C14BF2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2534?compare_to=2532&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2534, Order: 161066, Start Time: 2012-07-31 19:10:48, End Time: 2012-07-31 20:29:26 To: 2532, Order: 161053, Start Time: 2012-07-31 17:24:25, End Time: 2012-07-31 18:42:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (89 on baseline) Performance Improvements: 4 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (748 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.06% (1.4159 => 1.4450, std. dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.40% (13.1987 => 13.0143, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -7.32% (19.9139 => 18.4553, std. dev.: 0.0536) MultiSource/Applications/hexxagon/hexxagon: -2.32% (12.4911 => 12.2015, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.18% (1.0572 => 1.0447, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.53% (10.3673 => 13.0143, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 11.89% (0.3473 => 0.3886, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.68% (1.1194 => 1.2501, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 11.67% (0.3497 => 0.3905, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3561 => 0.3976, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.54% (0.3543 => 0.3952, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 11.52% (0.3516 => 0.3921, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.48% (0.3694 => 0.4118, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 10.95% (0.3828 => 0.4247, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.62% (0.3927 => 0.4344, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.90% (2.2022 => 2.3983, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.34% (1.7609 => 1.9077, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.3177 => 0.3376, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.6030 => 0.6393, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.91% (0.5925 => 0.6275, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.49% (0.4879 => 0.5147, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.22% (0.4615 => 0.4856, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 4.88% (10.4361 => 10.9450, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 4.84% (0.3282 => 0.3441, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.83% (0.7326 => 0.7680, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.74% (7.0540 => 7.3885, std. dev.: 0.0103) MultiSource/Applications/lambda-0_1_3/lambda: 4.36% (0.7433 => 0.7757, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.27% (0.8172 => 0.8521, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.5569 => 0.5800, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 4.06% (9.4845 => 9.8700, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.95% (5.0018 => 5.1992, std. dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (4.9449 => 5.1386, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3121 => 0.3227, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.36% (0.3423 => 0.3538, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.33% (4.2646 => 4.4067, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.31% (8.1363 => 8.4057, std. dev.: 0.0096) MultiSource/Applications/hbd/hbd: 3.30% (1.5603 => 1.6118, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.25% (0.7835 => 0.8090, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.00% (14.3668 => 14.7973, std. dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.97% (1.1861 => 1.2213, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.93% (1.3050 => 1.3433, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.88% (0.4103 => 0.4221, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.85% (0.3650 => 0.3754, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.80% (5.7591 => 5.9205, std. dev.: 0.0110) MultiSource/Applications/Burg/burg: 2.71% (1.1642 => 1.1957, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3865 => 0.3969, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.67% (2.0665 => 2.1216, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.64% (0.3826 => 0.3927, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.63% (0.4289 => 0.4402, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.63% (2.0273 => 2.0807, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.4636 => 0.4758, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.59% (3.3354 => 3.4219, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.54% (0.3935 => 0.4035, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.50% (3.8723 => 3.9690, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.48% (0.8067 => 0.8267, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.43% (0.5020 => 0.5142, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.43% (1.5415 => 1.5789, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.6456 => 0.6609, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 2.33% (0.4299 => 0.4399, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.24% (0.9765 => 0.9984, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (0.4620 => 0.4722, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.04% (0.5105 => 0.5209, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.96% (0.5981 => 0.6098, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.94% (0.6450 => 0.6575, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.91% (1.2842 => 1.3087, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (2.2024 => 2.2433, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.81% (1.5859 => 1.6146, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.81% (17.1811 => 17.4913, std. dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.4186 => 1.4442, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.78% (0.6675 => 0.6794, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 1.67% (0.8921 => 0.9070, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.42% (0.7115 => 0.7216, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.33% (2.2969 => 2.3275, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.28% (1.1840 => 1.1992, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (4.2280 => 4.4139, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7502, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 1.72% (3.1578 => 3.2120, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8348, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5086 => 1.5330, std. dev.: 0.0088) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2341, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0005) MultiSource/Benchmarks/llubenchmark/llu: 1.02% (3.7781 => 3.8167, std. dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.04% (5.2763 => 3.1637, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.09% (5.3855 => 3.7111, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.51% (5.3526 => 3.7197, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1102, std. dev.: 0.0668) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.21% (2.9384 => 2.5502, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -10.15% (22.1758 => 19.9246, std. dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (3.8922 => 3.8501, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.98% (1.2373 => 1.1138, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.49% (19.9488 => 18.4553, std. dev.: 0.0536) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -6.00% (1.5373 => 1.4450, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.75% (1.9577 => 1.8648, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.48% (1.5835 => 1.5125, std. dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4872, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (8.1563 => 7.9165, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4288, std. dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3300, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9996, std. dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2015, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3194, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.54% (9.5636 => 9.4165, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.8329 => 1.8080, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 13:48:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 15:48:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120731204854.96F3D2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2535?compare_to=2531&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2535, Order: 161053, Start Time: 2012-07-31 18:06:03, End Time: 2012-07-31 20:49:23 To: 2531, Order: 161047, Start Time: 2012-07-31 14:54:55, End Time: 2012-07-31 17:38:12 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (105 on baseline) Performance Improvements: 1 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (777 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.02% (2.4016 => 2.4260, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.55% (54.0951 => 54.9344, std. dev.: 0.0659) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -2.32% (15.9795 => 15.6088, std. dev.: 0.0362) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.71% (0.3465 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.70% (0.3460 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.68% (0.3442 => 0.3913, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 13.67% (0.3496 => 0.3974, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3446 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.58% (0.3469 => 0.3940, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.56% (0.3488 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.26% (0.3643 => 0.4126, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 13.23% (0.3650 => 0.4133, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.70% (0.3724 => 0.4197, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.90% (0.5826 => 0.6286, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.73% (0.5889 => 0.6344, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.04% (0.1620 => 0.1734, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 6.38% (1.5932 => 1.6949, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 5.97% (0.7171 => 0.7599, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.58% (3.5627 => 3.7614, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.56% (0.5900 => 0.6228, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.50% (0.4361 => 0.4601, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.43% (1.6211 => 1.7092, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.14% (0.5000 => 0.5257, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.13% (0.4994 => 0.5250, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.97% (0.5026 => 0.5276, std. dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.97% (0.2014 => 0.2114, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.81% (0.3930 => 0.4119, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.80% (1.3152 => 1.3783, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.71% (0.2866 => 0.3001, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.62% (0.4029 => 0.4215, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 4.58% (1.0781 => 1.1275, std. dev.: 0.0092) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (2.7292 => 2.8485, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.31% (0.2875 => 0.2999, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.28% (4.2109 => 4.3910, std. dev.: 0.0093) SingleSource/Regression/C++/ofstream_ctor: 4.06% (0.3004 => 0.3126, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.2736 => 0.2845, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.96% (0.9909 => 1.0301, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.94% (0.2792 => 0.2902, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.91% (0.2738 => 0.2845, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 3.91% (0.2714 => 0.2820, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.88% (0.2729 => 0.2835, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.85% (0.2780 => 0.2887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.83% (0.2823 => 0.2931, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (0.3195 => 0.3317, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.82% (0.2750 => 0.2855, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 3.82% (0.2725 => 0.2829, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.81% (0.2811 => 0.2918, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.77% (0.2813 => 0.2919, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (2.0673 => 2.1449, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.73% (1.9694 => 2.0428, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.68% (1.9966 => 2.0701, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 3.67% (0.2803 => 0.2906, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.2911 => 0.3017, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.59% (0.3096 => 0.3207, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.55% (0.3267 => 0.3383, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.50% (0.3060 => 0.3167, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.49% (0.3124 => 0.3233, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.47% (0.3258 => 0.3371, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (2.1013 => 2.1741, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.45% (5.5417 => 5.7331, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.42% (0.3890 => 0.4023, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.35% (0.4658 => 0.4814, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.30% (0.9697 => 1.0017, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.29% (0.3282 => 0.3390, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.29% (0.3317 => 0.3426, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.21% (0.3362 => 0.3470, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 3.20% (0.3348 => 0.3455, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 3.19% (0.3726 => 0.3845, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.18% (0.3678 => 0.3795, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (0.3625 => 0.3740, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.3903 => 0.4026, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.13% (0.3477 => 0.3586, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.02% (0.3845 => 0.3961, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 3.01% (2.1653 => 2.2304, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.00% (4.4195 => 4.5521, std. dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 2.98% (1.8794 => 1.9355, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.96% (4.6177 => 4.7546, std. dev.: 0.0115) MultiSource/Benchmarks/Bullet/bullet: 2.87% (23.5202 => 24.1946, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.86% (0.3981 => 0.4095, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3690 => 0.3793, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.78% (0.4139 => 0.4254, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.77% (0.4146 => 0.4261, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.77% (0.7875 => 0.8093, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 2.73% (0.4251 => 0.4367, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.68% (1.4269 => 1.4651, std. dev.: 0.0043) MultiSource/Applications/Burg/burg: 2.42% (0.5546 => 0.5680, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.29% (0.6634 => 0.6786, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.5012 => 0.5123, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (0.6435 => 0.6564, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.20% (2.0346 => 2.0590, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 14.99% (2.5769 => 2.9632, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.2122 => 0.2234, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6678, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1682, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-2: 4.63% (1.8057 => 1.8893, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6806, std. dev.: 0.0293) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1956, std. dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4944, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5904, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.51% (3.1722 => 3.2202, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.04% (2.4764 => 2.4260, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -1.40% (11.9555 => 11.7883, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5217, std. dev.: 0.0167) SingleSource/Benchmarks/Dhrystone/fldry: -9.45% (17.2379 => 15.6088, std. dev.: 0.0362) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8111, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: -6.83% (0.2402 => 0.2238, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: -3.97% (0.4438 => 0.4262, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.84% (11.2080 => 10.7778, std. dev.: 0.0161) SingleSource/Benchmarks/Dhrystone/dry: -3.49% (14.0481 => 13.5573, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5798, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 13:53:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 15:53:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120731205309.D9E352A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2536?compare_to=2533&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2536, Order: 161070, Start Time: 2012-07-31 19:39:51, End Time: 2012-07-31 20:53:38 To: 2533, Order: 161053, Start Time: 2012-07-31 17:58:05, End Time: 2012-07-31 19:11:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (137 on baseline) Performance Improvements: 4 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 950 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -7.04% (19.9821 => 18.5748, std. dev.: 0.0330) MultiSource/Applications/hexxagon/hexxagon: -2.40% (12.4774 => 12.1781, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.22% (1.0565 => 1.0436, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -1.08% (7.6691 => 7.5860, std. dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.91% (2.0176 => 2.2983, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.04% (0.5818 => 0.6344, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.85% (0.7061 => 0.7686, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.80% (0.5748 => 0.6254, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.72% (0.3578 => 0.3890, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3601 => 0.3909, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.50% (0.3646 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.45% (0.3623 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.44% (0.3663 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3650 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.34% (0.3789 => 0.4105, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.07% (0.4003 => 0.4326, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.48% (0.3130 => 0.3364, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.17% (0.7710 => 0.8263, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.82% (1.3693 => 1.4627, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.44% (3.9660 => 4.2213, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.36% (0.2596 => 0.2761, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.34% (0.5265 => 0.5599, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.32% (0.2721 => 0.2893, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.12% (0.7038 => 0.7469, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 5.89% (0.4328 => 0.4583, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.64% (0.2782 => 0.2939, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.57% (0.2781 => 0.2936, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.44% (0.4379 => 0.4617, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2690 => 0.2835, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.26% (0.2607 => 0.2744, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.25% (0.6959 => 0.7324, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 5.24% (0.4062 => 0.4275, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.17% (1.2193 => 1.2823, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.15% (0.5577 => 0.5864, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (0.2628 => 0.2762, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2655 => 0.2790, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.96% (0.2760 => 0.2897, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.95% (0.2765 => 0.2902, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.93% (0.3022 => 0.3171, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.92% (0.3899 => 0.4091, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.91% (0.3485 => 0.3656, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.89% (0.2966 => 0.3111, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.87% (0.3489 => 0.3659, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.87% (0.2937 => 0.3080, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.84% (0.9199 => 0.9644, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.83% (0.3580 => 0.3753, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.80% (1.9828 => 2.0779, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.78% (0.2696 => 0.2825, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.78% (0.2761 => 0.2893, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.73% (0.2726 => 0.2855, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3107 => 0.3252, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.62% (0.2988 => 0.3126, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 4.58% (13.8202 => 14.4530, std. dev.: 0.0172) MultiSource/Applications/spiff/spiff: 4.54% (0.7506 => 0.7847, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.51% (0.3149 => 0.3291, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.48% (0.2925 => 0.3056, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.2914 => 0.3043, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.42% (1.4563 => 1.5207, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4390 => 0.4584, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.40% (7.2180 => 7.5355, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 4.40% (16.6129 => 17.3433, std. dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/ary2: 4.35% (0.3192 => 0.3331, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.33% (0.5637 => 0.5881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.25% (0.3293 => 0.3433, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.25% (1.1364 => 1.1847, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.24% (13.2842 => 13.8480, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.22% (0.3246 => 0.3383, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.18% (0.4016 => 0.4184, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.16% (1.3813 => 1.4388, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.11% (1.3819 => 1.4387, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 4.10% (0.3534 => 0.3679, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.10% (1.1061 => 1.1514, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 4.03% (0.8310 => 0.8645, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.01% (0.7460 => 0.7759, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.95% (1.9270 => 2.0032, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.90% (3.8646 => 4.0152, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.88% (4.3801 => 4.5502, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.83% (0.3756 => 0.3900, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.3868 => 0.4016, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.78% (1.3245 => 1.3746, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.74% (1.0594 => 1.0990, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.68% (4.4433 => 4.6067, std. dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 3.54% (0.2995 => 0.3101, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.50% (3.6692 => 3.7975, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.49% (1.2292 => 1.2721, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3220 => 0.3331, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 3.43% (0.2945 => 0.3046, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.13% (1.1333 => 1.1688, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.13% (0.4791 => 0.4941, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.13% (2.1791 => 2.2473, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.95% (4.9865 => 5.1336, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3755 => 0.3864, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 2.76% (3.1889 => 3.2770, std. dev.: 0.0105) MultiSource/Benchmarks/mafft/pairlocalalign: 2.67% (8.4961 => 8.7226, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.63% (0.6283 => 0.6448, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.62% (0.6135 => 0.6296, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.49% (16.2614 => 16.6664, std. dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.45% (0.8698 => 0.8911, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.42% (6.5754 => 6.7347, std. dev.: 0.0125) MultiSource/Applications/JM/lencod/lencod: 2.31% (14.8535 => 15.1972, std. dev.: 0.0134) MultiSource/Applications/ClamAV/clamscan: 2.26% (14.5298 => 14.8578, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.15% (2.1007 => 2.1459, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.11% (3.2742 => 3.3432, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.01% (1.5188 => 1.5493, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 1.70% (4.6629 => 4.7420, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.01% (1.0313 => 1.0417, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5213, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 24.76% (1.8175 => 2.2676, std. dev.: 0.0265) SingleSource/Benchmarks/Misc/mandel-2: 7.45% (1.2998 => 1.3966, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.33% (0.9996 => 1.0529, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7547, std. dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7064, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9887, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7743, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8156, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5336, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.56% (1.4298 => 1.4521, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.30% (4.5928 => 4.6523, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1401, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 1.00% (1.1560 => 1.1676, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.18% (0.4657 => 0.4183, std. dev.: 0.0132) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.62% (22.5627 => 21.0687, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.55% (0.6576 => 0.6474, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.55% (0.0997 => 0.0832, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -10.50% (1.2308 => 1.1016, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.68% (20.3410 => 18.5748, std. dev.: 0.0330) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std. dev.: 0.0026) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.63% (3.0263 => 2.9468, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5964, std. dev.: 0.0163) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.92% (6.3560 => 6.2339, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5071, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.60% (28.2225 => 27.7709, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8602, std. dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: -1.36% (7.3305 => 7.2308, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.5254 => 2.4919, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2257, std. dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2540, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 15:15:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 17:15:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120731221512.56BC42A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2537?compare_to=2534&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2537, Order: 161071, Start Time: 2012-07-31 20:57:19, End Time: 2012-07-31 22:15:40 To: 2534, Order: 161066, Start Time: 2012-07-31 19:10:48, End Time: 2012-07-31 20:29:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (87 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (749 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.19% (13.0143 => 13.2997, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.58% (78.6428 => 79.8833, std. dev.: 0.1551) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.29% (10.3673 => 13.2997, std. dev.: 0.0093) SingleSource/UnitTests/ObjC/trivial-interface: 12.15% (0.3473 => 0.3895, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3497 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.80% (0.3543 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.80% (0.3543 => 0.3961, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.79% (1.1194 => 1.2514, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.75% (0.3516 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.42% (0.3694 => 0.4116, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.18% (0.3828 => 0.4256, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.91% (0.3886 => 0.4310, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.87% (0.3927 => 0.4354, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.89% (2.2022 => 2.3980, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 8.03% (0.1432 => 0.1547, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.82% (1.7609 => 1.8986, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.78% (0.1622 => 0.1732, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.45% (0.3177 => 0.3382, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.09% (0.6030 => 0.6397, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.06% (0.5925 => 0.6284, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1892 => 0.1997, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.39% (0.4879 => 0.5142, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.06% (10.4361 => 10.9643, std. dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference: 4.97% (0.7326 => 0.7690, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.90% (0.4615 => 0.4841, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 4.88% (0.3282 => 0.3442, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.57% (7.0540 => 7.3766, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 4.27% (9.4845 => 9.8897, std. dev.: 0.0143) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.2554 => 0.2660, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.06% (0.5569 => 0.5795, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.96% (0.8172 => 0.8496, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.9449 => 5.1408, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.0018 => 5.1986, std. dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.84% (0.3121 => 0.3241, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.62% (0.5860 => 0.6072, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (4.2646 => 4.4154, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3423 => 0.3542, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.41% (0.3109 => 0.3215, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3180 => 0.3288, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.33% (0.3092 => 0.3195, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.30% (8.1363 => 8.4050, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: 3.24% (0.7835 => 0.8089, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 3.13% (1.5603 => 1.6091, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.10% (0.4103 => 0.4230, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.1861 => 1.2224, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.06% (1.3050 => 1.3449, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.03% (14.3668 => 14.8026, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.98% (0.4636 => 0.4774, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.92% (5.7591 => 5.9272, std. dev.: 0.0099) MultiSource/Applications/treecc/treecc: 2.83% (2.0273 => 2.0847, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.80% (1.1642 => 1.1968, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.79% (3.3354 => 3.4283, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.74% (0.3650 => 0.3750, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.62% (0.8067 => 0.8278, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 2.52% (3.8723 => 3.9699, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.52% (2.0665 => 2.1185, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (1.5415 => 1.5793, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 2.44% (0.4299 => 0.4404, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.42% (0.4289 => 0.4393, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.28% (0.6456 => 0.6603, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.27% (0.9765 => 0.9987, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.5105 => 0.5218, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.17% (2.2024 => 2.2501, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.08% (1.5859 => 1.6189, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.08% (0.6450 => 0.6584, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.98% (1.4186 => 1.4467, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.90% (17.1811 => 17.5069, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.89% (0.5981 => 0.6094, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6675 => 0.6799, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.82% (1.2842 => 1.3076, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 1.82% (0.8921 => 0.9083, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.48% (2.2969 => 2.3309, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.46% (0.7115 => 0.7219, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 1.44% (1.1840 => 1.2011, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.14% (1.0722 => 1.0844, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (4.2280 => 4.4142, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7521, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8334, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5086 => 1.5321, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 1.42% (2.2771 => 2.3094, std. dev.: 0.0025) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2042, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2278, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.94% (5.2763 => 3.1689, std. dev.: 0.0137) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.27% (5.3855 => 3.7012, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7091, std. dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1272, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.05% (2.9384 => 2.5549, std. dev.: 0.0091) MultiSource/Applications/ClamAV/clamscan: -10.19% (22.1758 => 19.9167, std. dev.: 0.0317) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.03% (0.0998 => 0.0838, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -10.13% (1.2373 => 1.1120, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -7.47% (1.5373 => 1.4224, std. dev.: 0.0120) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.70% (19.9488 => 18.6119, std. dev.: 0.0284) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -4.76% (1.9577 => 1.8646, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4937, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.06% (8.1563 => 7.9070, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.6802 => 8.4333, std. dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.78% (1.3677 => 1.3297, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 9.9999, std. dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.17% (12.4730 => 12.2023, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3299, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4174, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8088, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2496, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 15:36:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 17:36:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120731223636.90DFC2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2538?compare_to=2536&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2538, Order: 161075, Start Time: 2012-07-31 21:23:19, End Time: 2012-07-31 22:37:04 To: 2536, Order: 161070, Start Time: 2012-07-31 19:39:51, End Time: 2012-07-31 20:53:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (145 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.13% (77.5362 => 80.7410, std. dev.: 0.2327) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.75% (54.9696 => 56.4817, std. dev.: 0.0979) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.00% (1.3074 => 1.3205, std. dev.: 0.0050) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.35% (2.0176 => 2.3071, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.68% (0.3578 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.55% (0.3601 => 0.3981, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.27% (0.3650 => 0.4025, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 10.26% (0.3646 => 0.4020, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.16% (0.3623 => 0.3991, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.16% (0.3663 => 0.4035, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.11% (0.3789 => 0.4172, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.90% (0.5818 => 0.6394, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.86% (0.3914 => 0.4300, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.83% (0.5748 => 0.6313, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 9.80% (0.7061 => 0.7753, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 9.69% (0.4003 => 0.4391, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.64% (0.3940 => 0.4320, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.36% (0.1986 => 0.2152, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.7710 => 0.8250, std. dev.: 0.0050) MultiSource/Applications/hbd/hbd: 7.00% (1.3693 => 1.4651, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.99% (3.9660 => 4.2431, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.89% (0.5265 => 0.5628, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.80% (0.2781 => 0.2970, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (0.4328 => 0.4612, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.36% (0.2782 => 0.2959, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.35% (0.7038 => 0.7485, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.01% (0.4062 => 0.4306, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4379 => 0.4639, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 5.87% (0.2760 => 0.2922, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.87% (0.2607 => 0.2760, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.76% (0.2655 => 0.2808, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.71% (0.2628 => 0.2778, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3022 => 0.3194, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.66% (0.2966 => 0.3134, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.65% (0.2937 => 0.3103, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.62% (1.2193 => 1.2878, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.60% (0.3485 => 0.3680, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.59% (0.3899 => 0.4117, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.58% (0.2726 => 0.2878, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.50% (0.6959 => 0.7342, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.46% (1.9828 => 2.0910, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 5.46% (0.2988 => 0.3151, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.42% (0.3580 => 0.3774, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.3149 => 0.3318, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.36% (0.3489 => 0.3676, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.34% (0.3107 => 0.3273, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.20% (0.3192 => 0.3358, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.19% (0.9199 => 0.9676, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 5.18% (0.3453 => 0.3632, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.15% (0.5577 => 0.5864, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2243 => 0.2358, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.12% (0.2127 => 0.2236, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.11% (13.8202 => 14.5262, std. dev.: 0.0138) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.08% (0.2914 => 0.3062, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.03% (0.4390 => 0.4611, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 4.95% (0.3534 => 0.3709, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.86% (16.6129 => 17.4208, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.86% (0.4016 => 0.4211, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.85% (7.2180 => 7.5681, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/lists: 4.83% (0.3293 => 0.3452, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.62% (0.7506 => 0.7853, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3756 => 0.3929, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.60% (1.4563 => 1.5233, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.5637 => 0.5895, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.55% (1.1061 => 1.1564, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.49% (1.3819 => 1.4440, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.49% (1.1364 => 1.1874, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.43% (13.2842 => 13.8731, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 4.42% (0.3868 => 0.4039, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.41% (0.3246 => 0.3389, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.37% (3.8646 => 4.0334, std. dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 4.32% (1.0594 => 1.1052, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.31% (1.3813 => 1.4408, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.30% (1.3245 => 1.3814, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 4.28% (0.8310 => 0.8666, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.21% (0.7460 => 0.7774, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.21% (1.9270 => 2.0081, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (3.6692 => 3.8177, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.3801 => 4.5557, std. dev.: 0.0113) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (4.4433 => 4.6209, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.93% (1.2292 => 1.2775, std. dev.: 0.0147) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.50% (1.1333 => 1.1730, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 3.50% (0.4113 => 0.4257, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.49% (0.4791 => 0.4958, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3755 => 0.3884, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.42% (2.1791 => 2.2536, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.34% (4.9865 => 5.1528, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.11% (0.6135 => 0.6326, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.04% (0.8698 => 0.8962, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.99% (0.6283 => 0.6471, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.98% (3.1889 => 3.2840, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 2.97% (8.4961 => 8.7481, std. dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 2.82% (6.5754 => 6.7605, std. dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 2.72% (14.8535 => 15.2571, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.57% (3.2742 => 3.3585, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 2.53% (14.5298 => 14.8970, std. dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (2.1007 => 2.1530, std. dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: 2.43% (16.2614 => 16.6569, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.34% (1.5188 => 1.5544, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.86% (4.6629 => 4.7495, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.60% (0.9108 => 0.9254, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.28% (1.0313 => 1.0445, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (6.2785 => 6.3548, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 1.06% (3.7467 => 3.7866, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5137, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 24.34% (1.8175 => 2.2599, std. dev.: 0.0514) SingleSource/Benchmarks/Misc/mandel-2: 8.16% (1.2998 => 1.4058, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.20% (0.9996 => 1.0516, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 4.36% (7.4271 => 7.7506, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7025, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8156, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5333, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.31% (4.5928 => 4.6530, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.48% (22.5627 => 21.1008, std. dev.: 0.0170) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.13% (0.3511 => 0.3401, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.55% (0.6576 => 0.6474, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.75% (0.0997 => 0.0830, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -9.98% (1.2308 => 1.1080, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.58% (20.3410 => 18.5955, std. dev.: 0.0305) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.18% (0.3139 => 0.2945, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.17% (1.3780 => 1.3205, std. dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.67% (3.0263 => 2.9456, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6048, std. dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4995, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2293, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7677, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.34% (5.3167 => 5.2457, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4929, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.26% (7.3305 => 7.2380, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2231, std. dev.: 0.0163) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 17:00:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 19:00:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120801000012.8B7022A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2539?compare_to=2535&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2539, Order: 161073, Start Time: 2012-07-31 21:17:20, End Time: 2012-08-01 00:00:40 To: 2535, Order: 161053, Start Time: 2012-07-31 18:06:03, End Time: 2012-07-31 20:49:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (80 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (803 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.15% (2.0313 => 2.0953, std. dev.: 0.0141) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.70% (0.3446 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.65% (0.3465 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.61% (0.3460 => 0.3931, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.59% (0.3488 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.51% (0.3442 => 0.3907, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.50% (0.3496 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.49% (0.3469 => 0.3937, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 13.07% (0.3643 => 0.4119, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.01% (0.3650 => 0.4125, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.81% (0.3724 => 0.4201, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.35% (0.5826 => 0.6254, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.25% (0.3792 => 0.4067, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 7.25% (0.5889 => 0.6316, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.69% (3.5627 => 3.7653, std. dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.59% (1.6211 => 1.7117, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.55% (0.7171 => 0.7569, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.42% (1.5932 => 1.6795, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.08% (0.5000 => 0.5254, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (0.4994 => 0.5247, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.2014 => 0.2116, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.98% (0.5900 => 0.6194, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.98% (0.4361 => 0.4578, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.95% (1.3152 => 1.3803, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (0.3930 => 0.4121, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.77% (0.4029 => 0.4221, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.46% (0.5026 => 0.5250, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 4.43% (1.0781 => 1.1259, std. dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.38% (2.7292 => 2.8487, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.33% (0.2866 => 0.2990, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 4.27% (4.2109 => 4.3907, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.2736 => 0.2845, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.74% (1.9966 => 2.0713, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.70% (1.9694 => 2.0423, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.69% (0.2875 => 0.2981, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.64% (5.5417 => 5.7432, std. dev.: 0.0110) MultiSource/Benchmarks/mafft/pairlocalalign: 3.56% (2.1013 => 2.1762, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.47% (0.9909 => 1.0253, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.47% (0.3890 => 0.4025, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.44% (0.3195 => 0.3305, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.41% (2.0673 => 2.1377, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 3.40% (0.3004 => 0.3106, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3124 => 0.3226, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.25% (2.1653 => 2.2357, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.24% (0.4658 => 0.4809, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 3.21% (23.5202 => 24.2754, std. dev.: 0.0172) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.19% (4.4195 => 4.5607, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary3: 3.15% (0.3267 => 0.3370, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.13% (4.6177 => 4.7623, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.13% (0.3903 => 0.4025, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.94% (1.8794 => 1.9347, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/moments: 2.85% (0.3678 => 0.3783, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 2.79% (0.3726 => 0.3830, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.75% (0.4139 => 0.4253, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.3845 => 0.3949, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.70% (0.7875 => 0.8088, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.62% (0.9697 => 0.9951, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 2.56% (0.5546 => 0.5688, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.53% (1.4269 => 1.4630, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 2.50% (0.6634 => 0.6800, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 2.40% (0.4251 => 0.4353, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.6435 => 0.6553, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 14.90% (2.5769 => 2.9609, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6725, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 5.00% (0.2122 => 0.2228, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8953, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1703, std. dev.: 0.0425) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6430, std. dev.: 0.0422) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1969, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4586, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4962, std. dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5915, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2213, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.52% (11.9555 => 11.7736, std. dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5225, std. dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/ary2: -10.99% (0.2402 => 0.2138, std. dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/fldry: -8.43% (17.2379 => 15.7839, std. dev.: 0.2458) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9768, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7943, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/moments: -3.99% (0.4438 => 0.4261, std. dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7936, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: -3.60% (14.0481 => 13.5424, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5821, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 17:01:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 19:01:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801000159.069BE2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2540?compare_to=2537&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2540, Order: 161082, Start Time: 2012-07-31 22:43:38, End Time: 2012-08-01 00:02:23 To: 2537, Order: 161071, Start Time: 2012-07-31 20:57:19, End Time: 2012-07-31 22:15:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (78 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.88% (13.2997 => 13.6824, std. dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.92% (54.9854 => 56.5923, std. dev.: 0.0691) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.98% (10.3673 => 13.6824, std. dev.: 0.0140) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3473 => 0.3903, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.10% (0.3497 => 0.3920, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.00% (0.3543 => 0.3968, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.94% (0.3543 => 0.3966, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 11.93% (0.3561 => 0.3986, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-3: 11.89% (0.3516 => 0.3934, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.69% (0.3694 => 0.4126, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.57% (1.1194 => 1.2489, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3828 => 0.4258, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.04% (0.3886 => 0.4315, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.87% (0.3927 => 0.4354, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.18% (2.2022 => 2.4043, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.47% (1.7609 => 1.8925, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.6030 => 0.6395, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.01% (0.5925 => 0.6281, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.39% (0.1892 => 0.1994, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 5.30% (0.3282 => 0.3456, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4615 => 0.4848, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.04% (7.0540 => 7.4094, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.4879 => 0.5120, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 4.85% (0.7326 => 0.7681, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.84% (10.4361 => 10.9408, std. dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 4.31% (9.4845 => 9.8936, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 4.08% (0.7433 => 0.7736, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (4.9449 => 5.1398, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.90% (5.0018 => 5.1967, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.82% (0.5569 => 0.5782, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.77% (0.8172 => 0.8480, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (4.2646 => 4.4146, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.42% (8.1363 => 8.4148, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.40% (0.5860 => 0.6059, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.15% (0.7835 => 0.8082, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.04% (14.3668 => 14.8042, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1861 => 1.2221, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 2.98% (0.3387 => 0.3488, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.89% (1.3050 => 1.3427, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.84% (5.7591 => 5.9227, std. dev.: 0.0042) MultiSource/Applications/hbd/hbd: 2.69% (1.5603 => 1.6023, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 2.62% (1.1642 => 1.1947, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 2.61% (3.3354 => 3.4224, std. dev.: 0.0108) MultiSource/Applications/treecc/treecc: 2.57% (2.0273 => 2.0795, std. dev.: 0.0119) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.52% (0.4636 => 0.4753, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.43% (0.8067 => 0.8263, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.5415 => 1.5788, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.37% (0.5105 => 0.5226, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.36% (3.8723 => 3.9635, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.25% (0.9765 => 0.9985, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.2024 => 2.2461, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.98% (1.5859 => 1.6173, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6675 => 0.6797, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 1.82% (17.1811 => 17.4940, std. dev.: 0.0417) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.76% (2.0665 => 2.1029, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.76% (0.5981 => 0.6086, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.76% (1.4186 => 1.4435, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/football/football: 1.69% (0.8921 => 0.9072, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.45% (1.1840 => 1.2012, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 1.38% (2.2969 => 2.3285, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.37% (1.2842 => 1.3018, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.85% (4.2280 => 4.3908, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.32% (3.6395 => 3.7603, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 1.74% (3.1578 => 3.2129, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.65% (11.6436 => 11.8359, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2041, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 1.33% (2.2771 => 2.3073, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.28% (1.0313 => 1.0445, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2228, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3373, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9195, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.28% (5.2763 => 3.1509, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.18% (5.3855 => 3.7062, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.59% (5.3526 => 3.7155, std. dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -15.02% (54.1659 => 46.0306, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.41% (2.9384 => 2.5444, std. dev.: 0.0064) MultiSource/Applications/ClamAV/clamscan: -10.23% (22.1758 => 19.9082, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.63% (0.0998 => 0.0842, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.38% (1.2373 => 1.1089, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel-2: -7.64% (1.5373 => 1.4198, std. dev.: 0.0149) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.30% (19.9488 => 18.4921, std. dev.: 0.0549) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: -4.72% (1.9577 => 1.8653, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.22% (8.1563 => 7.8934, std. dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4764, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.6802 => 8.4211, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0006, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2014, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6784, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.66% (12.5348 => 12.3267, std. dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4178, std. dev.: 0.0075) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.25% (1.8329 => 1.8099, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.07% (1.7254 => 1.7069, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 5.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 17:18:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 19:18:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801001822.78E802A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2541?compare_to=2538&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2541, Order: 161085, Start Time: 2012-07-31 23:05:13, End Time: 2012-08-01 00:18:50 To: 2538, Order: 161075, Start Time: 2012-07-31 21:23:19, End Time: 2012-07-31 22:37:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (138 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.15% (1.3205 => 1.3053, std. dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.13% (2.0176 => 2.3026, std. dev.: 0.0157) SingleSource/UnitTests/ObjC++/property-reference-object: 9.40% (0.5818 => 0.6365, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 9.27% (0.5748 => 0.6281, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.11% (0.3578 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.11% (0.7061 => 0.7704, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions-2: 9.05% (0.3601 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.97% (0.3646 => 0.3973, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.90% (0.3650 => 0.3975, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.74% (0.3663 => 0.3983, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.72% (0.3623 => 0.3939, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 8.68% (0.3789 => 0.4118, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.56% (0.3914 => 0.4249, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.37% (0.4003 => 0.4338, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 8.22% (0.3940 => 0.4264, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.64% (0.3130 => 0.3369, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 7.03% (1.3693 => 1.4656, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.51% (0.7710 => 0.8212, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (3.9660 => 4.2235, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.47% (0.2596 => 0.2764, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.5265 => 0.5594, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 6.15% (0.2781 => 0.2952, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.00% (0.2782 => 0.2949, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.98% (0.4062 => 0.4305, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 5.97% (0.7038 => 0.7458, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2607 => 0.2754, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.2655 => 0.2804, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2765 => 0.2920, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.51% (0.3899 => 0.4114, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.4379 => 0.4618, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.43% (0.3022 => 0.3186, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.37% (0.2628 => 0.2769, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.36% (0.2966 => 0.3125, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.29% (1.2193 => 1.2838, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.29% (0.2761 => 0.2907, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.28% (0.3485 => 0.3669, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.28% (0.2937 => 0.3092, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.21% (0.3107 => 0.3269, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.20% (1.9828 => 2.0859, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.17% (0.3580 => 0.3765, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3489 => 0.3668, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.12% (0.2988 => 0.3141, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.12% (0.6959 => 0.7315, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.99% (0.9199 => 0.9658, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.89% (0.3192 => 0.3348, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.83% (13.8202 => 14.4882, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.81% (0.4390 => 0.4601, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.75% (0.5577 => 0.5842, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.72% (0.3453 => 0.3616, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.67% (0.3534 => 0.3699, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.55% (0.2243 => 0.2345, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.3756 => 0.3926, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.52% (0.3293 => 0.3442, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.49% (16.6129 => 17.3583, std. dev.: 0.0160) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.46% (0.2914 => 0.3044, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.43% (0.4016 => 0.4194, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.42% (0.5637 => 0.5886, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.38% (7.2180 => 7.5339, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 4.34% (0.2925 => 0.3052, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.29% (0.3868 => 0.4034, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.27% (13.2842 => 13.8514, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.22% (1.1364 => 1.1843, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.20% (0.7506 => 0.7821, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.20% (1.4563 => 1.5174, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.19% (0.3246 => 0.3382, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 4.14% (0.8310 => 0.8654, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.11% (1.3819 => 1.4387, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2945 => 0.3065, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.07% (1.0594 => 1.1025, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 4.01% (1.1061 => 1.1504, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.99% (1.3245 => 1.3774, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.94% (0.7460 => 0.7754, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.90% (1.3813 => 1.4352, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 3.90% (3.8646 => 4.0152, std. dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 3.77% (1.2292 => 1.2755, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.76% (1.9270 => 1.9995, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.71% (3.6692 => 3.8054, std. dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: 3.71% (0.2995 => 0.3106, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.65% (4.4433 => 4.6053, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.61% (4.3801 => 4.5381, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3220 => 0.3333, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.21% (0.4791 => 0.4945, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.20% (0.3755 => 0.3875, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.17% (4.9865 => 5.1448, std. dev.: 0.0127) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.12% (1.1333 => 1.1687, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4113 => 0.4239, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.97% (2.1791 => 2.2438, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 2.76% (8.4961 => 8.7310, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.66% (0.6283 => 0.6450, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.66% (0.8698 => 0.8929, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.65% (3.1889 => 3.2733, std. dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.59% (0.6135 => 0.6294, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.50% (6.5754 => 6.7395, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (3.2742 => 3.3556, std. dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 2.38% (14.8535 => 15.2071, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.32% (2.1007 => 2.1495, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.31% (16.2614 => 16.6375, std. dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: 2.25% (14.5298 => 14.8565, std. dev.: 0.0124) MultiSource/Applications/oggenc/oggenc: 2.04% (4.6629 => 4.7579, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.91% (1.5188 => 1.5478, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.46% (0.9108 => 0.9241, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5128, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 23.97% (1.8175 => 2.2531, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel-2: 7.46% (1.2998 => 1.3968, std. dev.: 0.0199) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.33% (0.9996 => 1.0529, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/salsa20: 4.39% (7.4271 => 7.7528, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7055, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9869, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9658, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8154, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (0.9692 => 0.9910, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5089 => 1.5335, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5943, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5078, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.38% (4.5928 => 4.6563, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.26% (10.7476 => 10.8832, std. dev.: 0.0427) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1396, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.63% (0.4657 => 0.4069, std. dev.: 0.0182) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.65% (22.5627 => 21.0624, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.99% (0.3511 => 0.3406, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.84% (0.6576 => 0.6455, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.05% (0.0997 => 0.0837, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1100, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.85% (20.3410 => 18.5414, std. dev.: 0.0206) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3053, std. dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5872, std. dev.: 0.0140) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9450, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2227, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5075, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7682, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std. dev.: 0.0162) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.3167 => 5.2463, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4928, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2370, std. dev.: 0.0200) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2215, std. dev.: 0.0319) MultiSource/Applications/lua/lua: -1.04% (26.5159 => 26.2409, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8497, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 18:48:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 20:48:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801014824.C5BCC2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2542?compare_to=2540&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2542, Order: 161093, Start Time: 2012-08-01 00:30:39, End Time: 2012-08-01 01:48:53 To: 2540, Order: 161082, Start Time: 2012-07-31 22:43:38, End Time: 2012-08-01 00:02:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (85 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.87% (13.6824 => 13.0167, std. dev.: 0.0076) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.56% (10.3673 => 13.0167, std. dev.: 0.0076) SingleSource/UnitTests/ObjC/trivial-interface: 12.04% (0.3473 => 0.3891, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.78% (1.1194 => 1.2513, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 11.75% (0.3497 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.71% (0.3543 => 0.3958, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.63% (0.3516 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.60% (0.3561 => 0.3974, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: 11.37% (0.3694 => 0.4114, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.08% (0.3828 => 0.4252, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 10.83% (0.3886 => 0.4307, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3927 => 0.4350, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.82% (2.2022 => 2.3965, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.16% (1.7609 => 1.9046, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.40% (0.1892 => 0.2013, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.04% (0.5925 => 0.6283, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference-object: 5.87% (0.6030 => 0.6384, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.21% (0.4879 => 0.5133, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.05% (7.0540 => 7.4099, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.98% (0.4615 => 0.4845, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.97% (10.4361 => 10.9548, std. dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 4.76% (0.7433 => 0.7787, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 4.75% (0.7326 => 0.7674, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 4.72% (0.3282 => 0.3437, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.22% (9.4845 => 9.8844, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.10% (0.5860 => 0.6100, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.08% (4.9449 => 5.1466, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (5.0018 => 5.2002, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.95% (0.5569 => 0.5789, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.92% (0.8172 => 0.8492, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.58% (0.3180 => 0.3294, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (4.2646 => 4.4171, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.48% (14.3668 => 14.8674, std. dev.: 0.0126) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3423 => 0.3542, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.3121 => 0.3228, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.38% (0.7835 => 0.8100, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.38% (8.1363 => 8.4112, std. dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.30% (5.7591 => 5.9492, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.20% (1.1861 => 1.2240, std. dev.: 0.0095) MultiSource/Applications/hbd/hbd: 3.13% (1.5603 => 1.6092, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.11% (1.3050 => 1.3456, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.09% (3.3354 => 3.4383, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.97% (0.4103 => 0.4225, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.92% (1.1642 => 1.1982, std. dev.: 0.0083) MultiSource/Applications/treecc/treecc: 2.89% (2.0273 => 2.0859, std. dev.: 0.0196) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.4636 => 0.4764, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3865 => 0.3970, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.65% (0.8067 => 0.8281, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 2.64% (3.8723 => 3.9746, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.60% (1.5415 => 1.5816, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.55% (0.5105 => 0.5235, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 2.42% (0.6456 => 0.6612, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.38% (2.2024 => 2.2549, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.33% (0.4289 => 0.4389, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5859 => 1.6226, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.27% (0.9765 => 0.9987, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.26% (2.0665 => 2.1133, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.20% (0.6675 => 0.6822, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.15% (17.1811 => 17.5503, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.11% (1.4186 => 1.4485, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5981 => 0.6099, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.89% (0.8921 => 0.9090, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 1.82% (1.2842 => 1.3076, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.74% (2.2969 => 2.3369, std. dev.: 0.0074) MultiSource/Applications/minisat/minisat: 1.70% (0.7115 => 0.7236, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.53% (1.1840 => 1.2021, std. dev.: 0.0059) MultiSource/Applications/lemon/lemon: 1.32% (1.0722 => 1.0863, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.08% (4.2280 => 4.4007, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.13% (3.6395 => 3.7535, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 1.65% (11.6436 => 11.8356, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.62% (3.1578 => 3.2090, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5086 => 1.5321, std. dev.: 0.0006) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2045, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.24% (9.1159 => 9.2285, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.06% (5.2763 => 3.1627, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.16% (5.3855 => 3.7074, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.50% (5.3526 => 3.7199, std. dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0762, std. dev.: 0.0264) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.14% (2.9384 => 2.5522, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -10.01% (22.1758 => 19.9564, std. dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4215, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.13% (0.0998 => 0.0847, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.66% (1.2373 => 1.1054, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.09% (19.9488 => 18.5343, std. dev.: 0.0611) SingleSource/Benchmarks/Misc/mandel-2: -6.66% (1.5373 => 1.4349, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.01% (1.9577 => 1.8596, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4850, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.12% (8.1563 => 7.9019, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4243, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0018, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.17% (12.4730 => 12.2019, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6786, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3228, std. dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4235, std. dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8085, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -1.02% (3.2827 => 3.2493, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 19:00:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 21:00:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801020005.26D8B2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2543?compare_to=2541&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2543, Order: 161093, Start Time: 2012-08-01 00:46:57, End Time: 2012-08-01 02:00:33 To: 2541, Order: 161085, Start Time: 2012-07-31 23:05:13, End Time: 2012-08-01 00:18:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (146 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.36% (2.0176 => 2.3074, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.08% (0.5818 => 0.6346, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.91% (0.5748 => 0.6260, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.78% (0.3578 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3646 => 0.3961, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.58% (0.3601 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.52% (0.3789 => 0.4112, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.44% (0.3663 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3623 => 0.3926, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.36% (0.3650 => 0.3955, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 8.23% (0.7061 => 0.7642, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3914 => 0.4236, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.16% (0.1986 => 0.2148, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: 8.09% (0.4003 => 0.4327, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.05% (0.3940 => 0.4257, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.13% (1.3693 => 1.4669, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.99% (3.9660 => 4.2432, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.86% (0.7710 => 0.8239, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.86% (0.2596 => 0.2774, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.86% (0.5265 => 0.5626, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.64% (0.7038 => 0.7505, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (0.4328 => 0.4613, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.26% (0.2781 => 0.2955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.18% (0.2782 => 0.2954, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.89% (0.6959 => 0.7369, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.83% (0.4062 => 0.4299, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.80% (0.4379 => 0.4633, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.71% (0.3485 => 0.3684, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.65% (0.2655 => 0.2805, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.64% (0.3899 => 0.4119, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.61% (1.2193 => 1.2877, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2966 => 0.3132, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.59% (0.3022 => 0.3191, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2765 => 0.2919, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.53% (0.3580 => 0.3778, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.48% (0.2628 => 0.2772, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.47% (0.2760 => 0.2911, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.47% (0.2726 => 0.2875, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.46% (1.9828 => 2.0911, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/wc: 5.45% (0.2937 => 0.3097, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.43% (0.2761 => 0.2911, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.40% (0.5577 => 0.5878, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.36% (0.3489 => 0.3676, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.35% (0.9199 => 0.9691, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.25% (13.8202 => 14.5464, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.21% (0.3149 => 0.3313, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.20% (16.6129 => 17.4767, std. dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 5.15% (0.3453 => 0.3631, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 5.04% (0.2243 => 0.2356, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.03% (0.2127 => 0.2234, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.92% (0.3534 => 0.3708, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.86% (0.5637 => 0.5911, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.86% (0.4016 => 0.4211, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.85% (0.4390 => 0.4603, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.80% (0.3293 => 0.3451, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 4.72% (0.7506 => 0.7860, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.69% (7.2180 => 7.5563, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.68% (0.3246 => 0.3398, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.4563 => 1.5244, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.64% (13.2842 => 13.9003, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.3868 => 0.4047, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3756 => 0.3929, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.58% (1.1061 => 1.1568, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.51% (3.8646 => 4.0390, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.48% (1.1364 => 1.1873, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 4.48% (0.8310 => 0.8682, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.45% (1.3245 => 1.3835, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.43% (1.0594 => 1.1063, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.38% (1.9270 => 2.0114, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.25% (0.7460 => 0.7777, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 4.17% (0.2995 => 0.3120, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.13% (1.3819 => 1.4390, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.08% (1.3813 => 1.4377, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2945 => 0.3065, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.97% (1.2292 => 1.2780, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.95% (4.3801 => 4.5533, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (4.4433 => 4.6180, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.90% (3.6692 => 3.8122, std. dev.: 0.0071) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.4791 => 0.4972, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.76% (2.1791 => 2.2610, std. dev.: 0.0162) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.72% (4.9865 => 5.1720, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.56% (1.1333 => 1.1737, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.38% (0.3755 => 0.3882, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.23% (0.4113 => 0.4246, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.23% (0.6135 => 0.6333, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.19% (0.3131 => 0.3231, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.18% (0.8698 => 0.8975, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.10% (0.6283 => 0.6478, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (8.4961 => 8.7540, std. dev.: 0.0046) MultiSource/Applications/d/make_dparser: 2.99% (3.1889 => 3.2842, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.89% (3.2742 => 3.3688, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.74% (2.1007 => 2.1583, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 2.67% (6.5754 => 6.7511, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.61% (1.5188 => 1.5585, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 2.54% (14.8535 => 15.2310, std. dev.: 0.0172) MultiSource/Applications/sqlite3/sqlite3: 2.48% (16.2614 => 16.6647, std. dev.: 0.0301) MultiSource/Applications/ClamAV/clamscan: 2.48% (14.5298 => 14.8897, std. dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 2.25% (4.6629 => 4.7678, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.86% (0.9108 => 0.9277, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 1.63% (0.6250 => 0.6352, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.57% (1.0313 => 1.0475, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.22% (3.7467 => 3.7924, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2705, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4045, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.21% (0.9996 => 1.0517, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 4.43% (7.4271 => 7.7560, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7075, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8158, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.55% (1.9290 => 1.9589, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5089 => 1.5315, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.45% (2.0200 => 2.0492, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.5928 => 4.6517, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0310 => 1.0438, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1396, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.98% (0.4657 => 0.4006, std. dev.: 0.0169) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.20% (22.5627 => 21.1634, std. dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -19.26% (0.0997 => 0.0805, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2308 => 1.1099, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.91% (20.3410 => 18.5281, std. dev.: 0.0374) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.11% (1.3780 => 1.3076, std. dev.: 0.0071) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5135, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.93% (1.9762 => 1.9182, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.67% (3.0263 => 2.9454, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6036, std. dev.: 0.0238) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5030, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: -1.92% (6.3560 => 6.2341, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7683, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4929, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2179, std. dev.: 0.0183) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2412, std. dev.: 0.0148) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2521, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 20:11:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 22:11:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120801031148.191382A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2544?compare_to=2539&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2544, Order: 161093, Start Time: 2012-08-01 00:28:52, End Time: 2012-08-01 03:12:17 To: 2539, Order: 161073, Start Time: 2012-07-31 21:17:20, End Time: 2012-08-01 00:00:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (70 on baseline) Performance Improvements: 1 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (812 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.79% (2.4923 => 2.4227, std. dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.77% (0.3446 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.73% (0.3465 => 0.3906, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.64% (0.3488 => 0.3929, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 12.64% (0.3442 => 0.3877, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.63% (0.3460 => 0.3897, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.63% (0.3469 => 0.3907, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.59% (0.3496 => 0.3936, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.22% (0.3643 => 0.4088, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.11% (0.3650 => 0.4092, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.76% (0.3724 => 0.4162, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.40% (0.5826 => 0.6199, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.21% (0.5889 => 0.6255, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.17% (0.3792 => 0.4026, std. dev.: 0.0072) MultiSource/Applications/oggenc/oggenc: 5.91% (1.5932 => 1.6874, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.21% (3.5627 => 3.7484, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.16% (1.6211 => 1.7047, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.01% (0.4994 => 0.5244, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.98% (0.5900 => 0.6194, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 4.81% (0.7171 => 0.7516, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.72% (0.4361 => 0.4567, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.58% (0.3930 => 0.4110, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.56% (0.5000 => 0.5228, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.48% (1.3152 => 1.3741, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.42% (0.4029 => 0.4207, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 4.26% (1.0781 => 1.1240, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.22% (0.5026 => 0.5238, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.16% (4.2109 => 4.3860, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.81% (2.7292 => 2.8331, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.77% (0.2866 => 0.2974, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.40% (5.5417 => 5.7301, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.32% (1.9694 => 2.0348, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.24% (0.3890 => 0.4016, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.20% (1.9966 => 2.0604, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.13% (0.3195 => 0.3295, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.13% (2.1013 => 2.1670, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.07% (0.4658 => 0.4801, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.05% (0.9909 => 1.0211, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (4.4195 => 4.5529, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.90% (2.0673 => 2.1272, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.89% (2.1653 => 2.2279, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (0.3625 => 0.3728, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.79% (0.3903 => 0.4012, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.76% (4.6177 => 4.7453, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.75% (0.4139 => 0.4253, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.72% (1.8794 => 1.9306, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 2.70% (0.7875 => 0.8088, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 2.53% (23.5202 => 24.1160, std. dev.: 0.0092) MultiSource/Applications/Burg/burg: 2.27% (0.5546 => 0.5672, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.26% (1.4269 => 1.4591, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 2.24% (0.9697 => 0.9914, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.13% (0.6634 => 0.6775, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.63% (0.6435 => 0.6540, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9638, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6721, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 4.44% (1.8057 => 1.8859, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6769, std. dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1912, std. dev.: 0.0617) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4966, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5907, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2220, std. dev.: 0.0080) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.17% (2.4764 => 2.4227, std. dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: -1.59% (11.9555 => 11.7650, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.94% (25.4195 => 16.5387, std. dev.: 0.0204) SingleSource/Benchmarks/Dhrystone/fldry: -9.15% (17.2379 => 15.6605, std. dev.: 0.1004) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7961, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary2: -6.91% (0.2402 => 0.2236, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: -3.94% (0.4438 => 0.4263, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7934, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: -3.59% (14.0481 => 13.5431, std. dev.: 0.0205) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5783, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 20:36:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 22:36:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801033654.9C7B72A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2545?compare_to=2542&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2545, Order: 161097, Start Time: 2012-08-01 02:18:52, End Time: 2012-08-01 03:37:23 To: 2542, Order: 161093, Start Time: 2012-08-01 00:30:39, End Time: 2012-08-01 01:48:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (86 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (750 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 206.05% (2.9746 => 9.1039, std. dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.55% (10.3673 => 13.0159, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/trivial-interface: 11.98% (0.3473 => 0.3889, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.89% (1.1194 => 1.2525, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-4: 11.74% (0.3543 => 0.3959, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.71% (0.3543 => 0.3958, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 11.67% (0.3497 => 0.3905, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.60% (0.3516 => 0.3924, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.57% (0.3561 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.37% (0.3694 => 0.4114, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.86% (0.3886 => 0.4308, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3927 => 0.4350, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.90% (2.2022 => 2.3983, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.15% (1.7609 => 1.9045, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.34% (0.1892 => 0.2012, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.17% (0.3177 => 0.3373, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 5.87% (0.5925 => 0.6273, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.84% (0.6030 => 0.6382, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.37% (0.4615 => 0.4863, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.25% (0.4879 => 0.5135, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.99% (10.4361 => 10.9573, std. dev.: 0.0148) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (7.0540 => 7.4009, std. dev.: 0.0131) SingleSource/UnitTests/ObjC++/property-reference: 4.83% (0.7326 => 0.7680, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 4.82% (0.7433 => 0.7791, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 4.75% (0.3282 => 0.3438, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.27% (0.2554 => 0.2663, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.24% (9.4845 => 9.8869, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.11% (0.8172 => 0.8508, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (4.9449 => 5.1450, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (5.0018 => 5.2027, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.5569 => 0.5787, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 3.77% (0.3423 => 0.3552, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.72% (0.5860 => 0.6078, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.3180 => 0.3295, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.59% (4.2646 => 4.4177, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.50% (14.3668 => 14.8699, std. dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 3.47% (0.3109 => 0.3217, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.3121 => 0.3228, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.40% (8.1363 => 8.4133, std. dev.: 0.0095) MultiSource/Applications/oggenc/oggenc: 3.37% (5.7591 => 5.9533, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 3.33% (0.7835 => 0.8096, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.29% (1.1861 => 1.2251, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: 3.27% (0.3092 => 0.3193, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 3.19% (1.5603 => 1.6100, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.16% (1.3050 => 1.3463, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 3.10% (3.3354 => 3.4387, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.10% (0.4103 => 0.4230, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.00% (2.0273 => 2.0881, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.97% (1.1642 => 1.1988, std. dev.: 0.0077) MultiSource/Benchmarks/sim/sim: 2.95% (0.3387 => 0.3487, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.79% (3.8723 => 3.9803, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.69% (1.5415 => 1.5829, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (0.5105 => 0.5242, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.60% (0.8067 => 0.8277, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.55% (0.4636 => 0.4754, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.46% (2.2024 => 2.2565, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.38% (1.5859 => 1.6237, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 2.35% (0.4299 => 0.4400, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.33% (0.9765 => 0.9993, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.22% (0.6450 => 0.6593, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 2.19% (17.1811 => 17.5573, std. dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.18% (1.4186 => 1.4495, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.17% (2.0665 => 2.1114, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (0.6675 => 0.6817, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5981 => 0.6099, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.95% (2.2969 => 2.3417, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 1.92% (0.8921 => 0.9092, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 1.92% (1.2842 => 1.3088, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: 1.74% (0.7115 => 0.7239, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.54% (1.1840 => 1.2022, std. dev.: 0.0055) MultiSource/Applications/lemon/lemon: 1.34% (1.0722 => 1.0866, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9734, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.10% (4.2280 => 4.4012, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.27% (3.6395 => 3.7584, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.94% (3.1578 => 3.2190, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (1.5086 => 1.5350, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.61% (11.6436 => 11.8312, std. dev.: 0.0019) MultiSource/Applications/aha/aha: 1.44% (3.1595 => 3.2049, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2343, std. dev.: 0.0314) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.02% (5.2763 => 3.1645, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.16% (5.3855 => 3.7073, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.53% (5.3526 => 3.7183, std. dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -15.00% (54.1659 => 46.0431, std. dev.: 0.0289) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.05% (2.9384 => 2.5550, std. dev.: 0.0066) MultiSource/Applications/ClamAV/clamscan: -9.90% (22.1758 => 19.9814, std. dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.33% (0.0998 => 0.0845, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.79% (1.2373 => 1.1162, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -9.21% (1.5373 => 1.3957, std. dev.: 0.0253) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.15% (19.9488 => 18.5225, std. dev.: 0.0605) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5539, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.78% (1.9577 => 1.8641, std. dev.: 0.0256) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.20% (8.1563 => 7.8957, std. dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4818, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.6802 => 8.4387, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0043, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4808 => 0.4690, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2007, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.67% (12.5348 => 12.3255, std. dev.: 0.0046) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5128, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4179, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8086, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2494, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 20:41:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 31 Jul 2012 22:41:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801034136.005202A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2546?compare_to=2543&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2546, Order: 161097, Start Time: 2012-08-01 02:28:28, End Time: 2012-08-01 03:42:02 To: 2543, Order: 161093, Start Time: 2012-08-01 00:46:57, End Time: 2012-08-01 02:00:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (144 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.39% (2.0176 => 2.3079, std. dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference-object: 9.08% (0.5818 => 0.6346, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5748 => 0.6259, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.78% (0.3578 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.53% (0.3646 => 0.3957, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-2: 8.53% (0.3601 => 0.3908, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.46% (0.3663 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.41% (0.3650 => 0.3957, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.37% (0.3789 => 0.4106, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3623 => 0.3926, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.25% (0.3914 => 0.4237, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.4003 => 0.4328, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.10% (0.3940 => 0.4259, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.07% (0.7061 => 0.7631, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.03% (1.3693 => 1.4655, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.94% (3.9660 => 4.2411, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.87% (0.7710 => 0.8240, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5265 => 0.5619, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.58% (0.7038 => 0.7501, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (0.4328 => 0.4611, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.22% (0.2781 => 0.2954, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.15% (0.2782 => 0.2953, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.08% (0.4062 => 0.4309, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.86% (0.2765 => 0.2927, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.72% (0.6959 => 0.7357, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.69% (1.2193 => 1.2887, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.68% (0.2607 => 0.2755, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.65% (0.2655 => 0.2805, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3899 => 0.4118, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.56% (0.3580 => 0.3779, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2760 => 0.2913, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.52% (0.2628 => 0.2773, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.49% (1.9828 => 2.0916, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/strcat: 5.47% (0.2726 => 0.2875, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.43% (0.3022 => 0.3186, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.42% (0.3485 => 0.3674, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.39% (0.9199 => 0.9695, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.39% (0.3489 => 0.3677, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.36% (0.2761 => 0.2909, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.35% (0.2937 => 0.3094, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.34% (0.5577 => 0.5875, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2696 => 0.2839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.3107 => 0.3271, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.27% (0.3149 => 0.3315, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.16% (13.8202 => 14.5330, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/matrix: 5.12% (0.2988 => 0.3141, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.08% (16.6129 => 17.4565, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 4.99% (0.2243 => 0.2355, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2127 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 4.98% (0.3534 => 0.3710, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.92% (0.3453 => 0.3623, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.83% (0.3293 => 0.3452, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.83% (0.5637 => 0.5909, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.81% (1.4563 => 1.5264, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.72% (0.4390 => 0.4597, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.4016 => 0.4205, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3756 => 0.3932, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.68% (0.3246 => 0.3398, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.68% (0.7506 => 0.7857, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 4.65% (0.3868 => 0.4048, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 4.65% (1.1061 => 1.1575, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.63% (7.2180 => 7.5520, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (13.2842 => 13.8944, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/football/football: 4.56% (0.8310 => 0.8689, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.46% (1.1364 => 1.1871, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.44% (1.0594 => 1.1064, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.35% (1.3245 => 1.3821, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.34% (3.8646 => 4.0324, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 4.29% (1.9270 => 2.0097, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.28% (0.7460 => 0.7779, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.12% (1.3819 => 1.4389, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.08% (1.2292 => 1.2793, std. dev.: 0.0100) MultiSource/Benchmarks/McCat/18-imp/imp: 4.07% (0.3220 => 0.3351, std. dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.3801 => 4.5535, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.94% (4.4433 => 4.6182, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.92% (1.3813 => 1.4354, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.90% (3.6692 => 3.8124, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (0.4791 => 0.4967, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 3.65% (2.1791 => 2.2587, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.63% (4.9865 => 5.1675, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.49% (1.1333 => 1.1728, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3755 => 0.3881, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.23% (0.3131 => 0.3232, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 3.19% (0.4113 => 0.4244, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.13% (0.6135 => 0.6327, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.09% (0.8698 => 0.8967, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 2.96% (8.4961 => 8.7480, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.93% (3.1889 => 3.2822, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.85% (2.1007 => 2.1605, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.74% (3.2742 => 3.3638, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (6.5754 => 6.7498, std. dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 2.57% (14.8535 => 15.2348, std. dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 2.49% (16.2614 => 16.6661, std. dev.: 0.0271) MultiSource/Applications/ClamAV/clamscan: 2.49% (14.5298 => 14.8909, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.44% (1.5188 => 1.5558, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 2.22% (4.6629 => 4.7665, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.70% (0.9108 => 0.9263, std. dev.: 0.0056) MultiSource/Applications/lemon/lemon: 1.57% (1.0313 => 1.0475, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.10% (3.7467 => 3.7879, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 24.44% (1.8175 => 2.2617, std. dev.: 0.0318) SingleSource/Benchmarks/Misc/mandel-2: 7.56% (1.2998 => 1.3980, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.52% (0.9996 => 1.0548, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 4.53% (7.4271 => 7.7633, std. dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7074, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.57% (1.7688 => 1.8143, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5089 => 1.5335, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9575, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1939, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.27% (4.5928 => 4.6513, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0310 => 1.0438, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.01% (3.1071 => 3.1386, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.55% (0.4657 => 0.4026, std. dev.: 0.0189) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.5627 => 21.1471, std. dev.: 0.0160) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.95% (0.0997 => 0.0818, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.38% (1.2308 => 1.1030, std. dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.99% (20.3410 => 18.5132, std. dev.: 0.0573) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.22% (1.3780 => 1.3061, std. dev.: 0.0090) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9478, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.34% (8.8259 => 8.6190, std. dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.28% (0.6589 => 0.6439, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.02% (6.6320 => 6.4979, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2383, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7679, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.43% (7.3305 => 7.2254, std. dev.: 0.0152) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4927, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2496, std. dev.: 0.0040) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2204, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 22:23:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 00:23:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801052325.7E3082A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2547?compare_to=2545&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2547, Order: 161099, Start Time: 2012-08-01 04:05:27, End Time: 2012-08-01 05:23:53 To: 2545, Order: 161097, Start Time: 2012-08-01 02:18:52, End Time: 2012-08-01 03:37:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (81 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.57% (13.0159 => 13.3504, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.68% (54.9857 => 56.4617, std. dev.: 0.1184) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.20% (78.4485 => 80.1717, std. dev.: 0.1567) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.77% (10.3673 => 13.3504, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.66% (1.1194 => 1.2499, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 11.63% (0.3473 => 0.3877, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.38% (0.3497 => 0.3895, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.32% (0.3543 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.26% (0.3543 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.23% (0.3516 => 0.3911, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.07% (0.3694 => 0.4103, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.47% (0.3886 => 0.4293, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.65% (2.2022 => 2.3927, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.79% (1.7609 => 1.8980, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.85% (0.3177 => 0.3363, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.67% (0.5925 => 0.6261, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.64% (0.6030 => 0.6370, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.15% (7.0540 => 7.4173, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.86% (0.4879 => 0.5116, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 4.84% (10.4361 => 10.9416, std. dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.72% (0.4615 => 0.4833, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 4.54% (0.3282 => 0.3431, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 4.53% (0.7326 => 0.7658, std. dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 4.48% (0.7433 => 0.7766, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (9.4845 => 9.8721, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (4.9449 => 5.1335, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.80% (5.0018 => 5.1921, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.66% (0.8172 => 0.8471, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.46% (0.5860 => 0.6063, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.34% (4.2646 => 4.4071, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 3.15% (0.7835 => 0.8082, std. dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 3.14% (5.7591 => 5.9400, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.13% (8.1363 => 8.3906, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.03% (14.3668 => 14.8024, std. dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.03% (1.1861 => 1.2220, std. dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.93% (0.4636 => 0.4772, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.92% (1.3050 => 1.3431, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.90% (0.4103 => 0.4222, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.88% (1.5603 => 1.6053, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: 2.76% (3.3354 => 3.4273, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.74% (2.0273 => 2.0828, std. dev.: 0.0123) MultiSource/Applications/Burg/burg: 2.66% (1.1642 => 1.1952, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.56% (1.5415 => 1.5809, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.47% (3.8723 => 3.9681, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.45% (0.5105 => 0.5230, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.44% (0.8067 => 0.8264, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 2.40% (0.4299 => 0.4402, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (1.5859 => 1.6231, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.28% (2.2024 => 2.2527, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.19% (0.9765 => 0.9979, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 2.14% (0.6456 => 0.6594, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.02% (0.6675 => 0.6810, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.96% (17.1811 => 17.5174, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.95% (2.0665 => 2.1068, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.82% (1.4186 => 1.4444, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/football/football: 1.73% (0.8921 => 0.9075, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.72% (0.5981 => 0.6084, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.62% (0.7115 => 0.7230, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.60% (1.2842 => 1.3048, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.53% (2.2969 => 2.3321, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 1.38% (1.1840 => 1.2003, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9734, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.60% (4.2280 => 4.4224, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7570, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 1.80% (3.1578 => 3.2146, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8336, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5086 => 1.5329, std. dev.: 0.0021) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2033, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2246, std. dev.: 0.0207) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.18% (5.2763 => 3.1564, std. dev.: 0.0141) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.07% (5.3855 => 3.7123, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.48% (5.3526 => 3.7210, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0949, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.12% (2.9384 => 2.5530, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -10.15% (22.1758 => 19.9242, std. dev.: 0.0157) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.65% (1.2373 => 1.1055, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: -7.44% (1.5373 => 1.4230, std. dev.: 0.0151) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.30% (19.9488 => 18.4925, std. dev.: 0.0559) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: -4.69% (1.9577 => 1.8658, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4806, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.11% (8.1563 => 7.9023, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.6802 => 8.4217, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0018, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.52% (0.4808 => 0.4687, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2013, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.76% (12.5348 => 12.3136, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4181, std. dev.: 0.0079) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.39% (1.8329 => 1.8074, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jul 31 22:23:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 00:23:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801052330.3C8EA2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2548?compare_to=2546&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2548, Order: 161099, Start Time: 2012-08-01 04:10:10, End Time: 2012-08-01 05:23:54 To: 2546, Order: 161097, Start Time: 2012-08-01 02:28:28, End Time: 2012-08-01 03:42:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (144 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.55% (78.3546 => 81.1344, std. dev.: 0.3990) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.28% (2.0176 => 2.3057, std. dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference-object: 9.13% (0.5818 => 0.6349, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.84% (0.5748 => 0.6256, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3578 => 0.3889, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.52% (0.3663 => 0.3975, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.44% (0.3601 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.42% (0.3646 => 0.3953, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3789 => 0.4104, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.27% (0.3650 => 0.3952, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 8.20% (0.3914 => 0.4235, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.09% (0.7061 => 0.7632, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.04% (0.4003 => 0.4325, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.08% (1.3693 => 1.4663, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.86% (0.7710 => 0.8239, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.77% (3.9660 => 4.2343, std. dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.67% (0.5265 => 0.5616, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 6.65% (0.7038 => 0.7506, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.47% (0.4328 => 0.4608, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.36% (0.2721 => 0.2894, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.22% (0.2782 => 0.2955, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.18% (0.2781 => 0.2953, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.79% (0.4062 => 0.4297, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.4379 => 0.4627, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.63% (1.2193 => 1.2879, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.59% (0.3022 => 0.3191, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.57% (0.3899 => 0.4116, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2607 => 0.2752, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.53% (0.6959 => 0.7344, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.51% (0.2760 => 0.2912, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.50% (0.2726 => 0.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.48% (0.2628 => 0.2772, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.46% (0.2655 => 0.2800, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2761 => 0.2910, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.39% (1.9828 => 2.0896, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.37% (0.3485 => 0.3672, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.34% (0.3580 => 0.3771, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.33% (0.5577 => 0.5874, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.29% (0.9199 => 0.9686, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.3107 => 0.3271, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.28% (0.2937 => 0.3092, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.21% (0.3149 => 0.3313, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.19% (0.2696 => 0.2836, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.19% (0.3489 => 0.3670, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.05% (0.2988 => 0.3139, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.03% (13.8202 => 14.5160, std. dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 5.01% (16.6129 => 17.4456, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.93% (0.4016 => 0.4214, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 4.87% (0.3534 => 0.3706, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3192 => 0.3346, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.81% (0.3453 => 0.3619, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.79% (0.2925 => 0.3065, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.77% (0.5637 => 0.5906, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.74% (0.4390 => 0.4598, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 4.74% (0.3293 => 0.3449, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.74% (0.2914 => 0.3052, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.65% (0.3246 => 0.3397, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.64% (0.7506 => 0.7854, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.3868 => 0.4047, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (13.2842 => 13.8921, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.55% (0.3756 => 0.3927, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.54% (7.2180 => 7.5455, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.53% (1.4563 => 1.5223, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.44% (1.1364 => 1.1869, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.40% (0.8310 => 0.8676, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 4.36% (1.1061 => 1.1543, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 4.32% (1.0594 => 1.1052, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.32% (1.3245 => 1.3817, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 4.28% (1.9270 => 2.0094, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.21% (3.8646 => 4.0273, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.12% (0.7460 => 0.7767, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.06% (1.3819 => 1.4380, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2945 => 0.3064, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.92% (1.2292 => 1.2774, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.85% (1.3813 => 1.4345, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (4.3801 => 4.5481, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.82% (3.6692 => 3.8095, std. dev.: 0.0076) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (4.4433 => 4.6099, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (0.4791 => 0.4967, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.59% (4.9865 => 5.1655, std. dev.: 0.0253) MultiSource/Applications/siod/siod: 3.54% (2.1791 => 2.2562, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.33% (0.3755 => 0.3880, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.32% (1.1333 => 1.1709, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.22% (0.6283 => 0.6485, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.19% (0.3131 => 0.3231, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.04% (0.4113 => 0.4238, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.00% (0.6135 => 0.6319, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.95% (0.8698 => 0.8955, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 2.91% (8.4961 => 8.7433, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 2.85% (3.1889 => 3.2798, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.71% (3.2742 => 3.3629, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.66% (2.1007 => 2.1566, std. dev.: 0.0216) MultiSource/Applications/JM/ldecod/ldecod: 2.59% (6.5754 => 6.7457, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (1.5188 => 1.5574, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.49% (14.8535 => 15.2240, std. dev.: 0.0123) MultiSource/Applications/sqlite3/sqlite3: 2.48% (16.2614 => 16.6642, std. dev.: 0.0121) MultiSource/Applications/ClamAV/clamscan: 2.43% (14.5298 => 14.8832, std. dev.: 0.0145) MultiSource/Applications/oggenc/oggenc: 2.14% (4.6629 => 4.7625, std. dev.: 0.0160) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.66% (0.9108 => 0.9259, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.43% (1.0313 => 1.0460, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.05% (3.7467 => 3.7859, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5180, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.57% (1.8175 => 2.2640, std. dev.: 0.0181) SingleSource/Benchmarks/Misc/mandel-2: 7.80% (1.2998 => 1.4012, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.09% (0.9996 => 1.0505, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7551, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7036, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8150, std. dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (1.9290 => 1.9570, std. dev.: 0.0093) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5071, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.29% (4.5928 => 4.6519, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.18% (1.0310 => 1.0432, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1397, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.57% (0.4657 => 0.4025, std. dev.: 0.0127) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.5627 => 21.1475, std. dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.15% (0.0997 => 0.0816, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.34% (1.2308 => 1.1035, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.52% (20.3410 => 18.6083, std. dev.: 0.0221) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.03% (1.3780 => 1.3087, std. dev.: 0.0181) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9185, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9447, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5886, std. dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.35% (0.6589 => 0.6434, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2241, std. dev.: 0.0091) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7682, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.35% (5.3167 => 5.2449, std. dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2349, std. dev.: 0.0181) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std. dev.: 0.0097) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2319, std. dev.: 0.0351) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: